[Dataset]: BNE Source Needs Refactored

[kkdavis14]

Priority Level

Medium

Dataset Name

BNE

Description

BNE is the national library of Spain. We already have it as a source, but it is set up from an old dump file. There are better files available here: https://datos.gob.es/en/catalogo?publisher_display_name=Biblioteca+Nacional+de+Espa%C3%B1a.

Data Access Method

Base URL: https://datos.gob.es/en/catalogo
Example URLs: https://www.bne.es/media/datosgob/catalogo-autoridades/entidad/entidad-JSON.zip
https://datos.gob.es/en/catalogo/ea0019768-catalogo-de-autoridades-geografico-JSON.zip

Data Format

Format: JSON-LD
JSON example:

{
    "idBNE": "XX492624",
    "otros_codigos_identificacion": "lcsh: http://id.loc.gov/authorities/subjects/sh2006001296 ** rameau: https://data.bnf.fr/ark:/12148/cb12446309b ** ",
    "cdu": "(1-04)  // ",
    "encabezamiento_materia": "Tierras fronterizas ",
    "termino_materia_no_aceptado": "Regiones fronterizas // Regiones limítrofes // Tierras limítrofes // Zonas fronterizas // Zonas limítrofes // ",
    "termino_relacionado": "Contaminación transfronteriza      // Cooperación transfronteriza      // Fronteras      // ",
    "fuente_informacion": "WWW LCSH, 14-2-2020 // WWW RAMEAU, 14-2-2020 // ",
    "informacion_encontrada": "(Borderlands) // (Régions frontalières) // ",
    "termino_aceptado_otro_vocabulario": "lcsh: Borderlands ** ",
    "obras_relacionadas_BNE": "http://catalogo.bne.es/uhtbin/cgisirsi/0/x/0/05?searchdata1=^A492624"
  },

Entity Matching

The data has fields like otros_identificadores and otros_codigos_identificacion to store sameAs URIs. They map to LC and BNF.

Technical Requirements

• Set up config file as per Add Configuration Files for Internal and External Data Sources #180
• Create loader for JSON files
• Refactor mapper to use new data structure

Known Limitations

No response

Example Integration

Add to the BNE config the URLs for the datasets from BNE that we would like to harvest, in the remote dump files block. Ensure these files can be downloaded via existing download code. Write a loader to load these files into the BNE datacache. Refactor the existing BNE mapper to use this new data structure.