Semantic Web: How SDMX and RDF can live together Raffaella Maria - - PowerPoint PPT Presentation

Official Statistics meets the Semantic Web: How SDMX and RDF can live together

Raffaella Maria Aracri, Stefano De Francisci, Andrea Pagano, Monica Scannapieco Istituto Nazionale di Statistica Istat, Italy

Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 2

Objective

• Designing and implementing

translation from SDMX data into RDF data

Format and Model translation Integration of SDMX dissemination architecture with Semantic Web technologies

[Part

• f

Eurostat: “Horizontal and vertical integration: implementing technical and statistical standards in ESS”]

Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 3

Agenda

• Background:

 RDF, RDF Schema, RDF QB  SDMX Reference Infrastructure (SDMX-RI) and SDMXSource.NET

• Methods and Results:

 Modeling: from SDMX to RDF Data Cube Vocabulary  Adding structure and data format to SdmxSource.NET  Testing

• Conclusions

BACKGROUND

Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 5

Semantic Web Standards: Data Models

• World Wide Web Consortium (W3C) data

models

• RDF (Resource Description Framework):

RDF 1.1 Suite, W3C Recommendation February 2014

• RDF-QB: RDF Data Cube Vocabulary,

W3C Recommendation January 2014, to represent multidimensional data structures

Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 6

SDMX-RI and NSI Web Services

Off-line mapping of NSI’s data Web Services to make data available as generic

• r structured format

according to client requirement

• .NET and Java implementation
• Open Source.

SDMX.Source.NET as the implementation of SDMX code source on which RI tools are built.

METHODS & RESULTS

Specializ ed RDF Writer METADA TA Speci alized RDF Write r DAT A

?

Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 8

The problem

returning an RDF Structure and Data

?

RDF data

NSI-DATA

.txt Gesmes file Excel

DB

Query REST

user through a client

SDMX data

Given a Client request to Web Services of the SDMX-RI…

Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 9

Mapping SDMX data model to RDF-QB data model

• The translation step from SDMX to RDF is not only a

“format” translation, but it involves a “model” translation.

RDF Data Cube Model

qb:componentnt qb:DataStructureDefinition qb:DataSet qb:Observation qb:structure qb:dataSet qb:ComponentSpecification qb:ComponentProperty qb:componentProperty qb:DimensionProperty qb:AttributeProperty qb:CodedProperty qb:MeasureProperty

Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 10

Example: RDF Data Cube Model - Data Structure Definition “Environment and energy – Air”

datiopen.istat.it/property/FREQ qb:componentProperty

qb:dimension

qb:codedProperty, qb:codList: datiopen.istat.it/code/1.0/CL_FREQ datiopen.istat.it/structure/1.0/CONS_ENERGIA_LOMB rdf:type

purl.org/linked-ata/sdmx#DataStructureDefinition

datiopen.istat.it/property/IND_TYPE qb:componentProperty

qb:dimension

qb:codedProperty, qb:codList: datiopen.istat.it /code/1.0/CL_AMBIENTE_INDICATOR qb:component qb:component qb:component datiopen.istat.it/property/REF_AREA qb:componentProperty

qb:dimension

qb:codedProperty, qb:codList: datiopen.istat.it/code/1.0/CL_PROV_LOMB qb:component datiopen.istat.it/property/USO_ENERGIA qb:componentProperty

qb:dimension

qb:codedProperty, qb:codList: datiopen.istat.it /code/1.0/CL_USO_ENERGIA qb:component datiopen.istat.it/property/TIME_PERIOD qb:componentProperty

qb:dimension

qb:component datiopen.istat.it/property/TIME_FORMAT qb:componentProperty

qb:attribute

qb:component datiopen.istat.it/property/OBS_VALUE qb:componentProperty

qb:measure

datiopen.istat.it/property/UNIT_MEAS qb:componentProperty

qb:attribute

qb:component

Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 11

Example: RDF Data Cube Model - Observation

• f DataSet “Environment and energy – Air”

rdf:type purl.org/linked-data/cube#Observation

dataset/DS_ENERGY_ITC41/ITC41/EE_DOM_XAB/1/A/2000

datiopen.istat.it /code/1.0/CL_PROV_LOMB/ITC41 property:REF_AREA datiopen.istat.it /code/1.0/code/1.0/CL_FREQ/A property:FREQ datiopen.istat.it /code/1.0/CL_AMBIENTE_INDICATOR/EE_DOM_XAB property:IND_TYPE datiopen.istat.it /code/1.0/CL_USO_ENERGIA/1 property:USO-ENERGIAENERGIA reference.data.gov.uk/id/year/2000

property:TIME_PERIOD

1194

qb:dataset datiopen.istat.it/dataset/DS_ENERGY_ITC41 qb:structure datiopen.istat.it/structure/1.0/CONS_ENERGIA_LOMB property:OBS_VALUE

Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 12

Implementation of the RDF «writer»

• Leverage SdmxSource.NET source code where possible
• Specific ‘add-on’ to be included in future

SDMXSource.Net releases

Request NSI Web Services

Specialized RDF Writer METADATA Specialized RDF Writer DATA

RDF V2.1 Structure & Data

Specializ ed RDF Writer METADA TA Speci alized RDF Write r DAT A

user through a client

Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 13

Testing

• To validate the results we leverage the

“Sdmx-RI Test Client”.

• The Test Client is a tool to test the

SDMX Reference Infrastructure building blocks and to expose/browse the dissemination environment of an NSI.

Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 14

Testing

CONCLUSIONS

!

Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 16

Conclusions

• Translating SDMX into RDF is possible!
• Working solution has been implemented
• Integration of the solution with Linked Open

Data dissemination channel based on a SPARQL Endpoint: datiopen.istat.it

!

Monica Scannapieco, NTTS, Brussels - 10-12 March 2015 17

Questions?