towards a dynamic linked data observatory
play

Towards a Dynamic Linked Data Observatory Tobias Kfer 1 , Jrgen - PowerPoint PPT Presentation

Jan 19, 2023 •18 likes •208 views

Towards a Dynamic Linked Data Observatory Tobias Kfer 1 , Jrgen Umbrich 2 , Aidan Hogan 2 , Axel Polleres 3 WWW2012 Workshop: Linked Data on the Web (LDOW2012) 1) KARLSRUHE INSTITUTE OF TECHNOLOGY, GERMANY 2) DERI, NUI GALWAY, IRELAND 3) SIEMENS

  1. Towards a Dynamic Linked Data Observatory Tobias Käfer 1 , Jürgen Umbrich 2 , Aidan Hogan 2 , Axel Polleres 3 WWW2012 Workshop: Linked Data on the Web (LDOW2012) 1) KARLSRUHE INSTITUTE OF TECHNOLOGY, GERMANY 2) DERI, NUI GALWAY, IRELAND 3) SIEMENS AG ÖSTERREICH, VIENNA, AUSTRIA KIT – University of the State of Baden-Wuerttemberg and www.kit.edu National Research Center of the Helmholtz Association

  2. What‘s this all about? The Web Dynamic Pages get created Pages get updated Pages get deleted Dynamicity causes problems Cache freshness etc. Studied and analysed Aren‘t we facing similar problems? April 16, 2012 Towards a Dynamic Linked Data Observatory // TOBIAS KÄFER, Jürgen Umbrich, 2 http://swse.deri.org/dyldo Aidan Hogan, Axel Polleres // LDOW 2012 @ WWW 2012

  3. What‘s this all about? ( Cont‘d ) The Web of Data Dynamic, too Data gets created, updated, deleted Vocabularies change, predicates are renamed Dynamicity influences … Synchronisation of indexes Smart caching of Linked Data content Hybrid search engine architectures … The Dynamic  Creation of a corpus to study the dynamics of Linked Data: Linked Data Observatory April 16, 2012 Towards a Dynamic Linked Data Observatory // TOBIAS KÄFER, Jürgen Umbrich, 3 http://swse.deri.org/dyldo Aidan Hogan, Axel Polleres // LDOW 2012 @ WWW 2012

  4. Building blocks of a Dynamic Linked Data Observatory + Idea of what to monitor Way of capturing the dimension of time + = + Means to create Bricks (for the snapshots : sake of the The Dynamic LDspider metaphor) Linked Data Observatory April 16, 2012 Towards a Dynamic Linked Data Observatory // TOBIAS KÄFER, Jürgen Umbrich, 4 http://swse.deri.org/dyldo Aidan Hogan, Axel Polleres // LDOW 2012 @ WWW 2012

  5. We need an idea of what to monitor, but: HOW TO GET A REPRESENTATION OF LINKED DATA? April 16, 2012 Towards a Dynamic Linked Data Observatory // TOBIAS KÄFER, Jürgen Umbrich, 5 http://swse.deri.org/dyldo Aidan Hogan, Axel Polleres // LDOW 2012 @ WWW 2012

  6. Requirements for a representation of Linked Data and two candidates Coverage Size Diverse data providers Balanced representation of data providers Representativeness Study something people consider as LOD Billion Triple Challenge Genesis: Register Dataset dataset, meet LOD cloud Genesis: A crawl requirements April 16, 2012 Towards a Dynamic Linked Data Observatory // TOBIAS KÄFER, Jürgen Umbrich, 6 http://swse.deri.org/dyldo Aidan Hogan, Axel Polleres // LDOW 2012 @ WWW 2012

  7. Pros and cons of both datasets LOD/CKAN BTC2011 PROS Domains pass “quality control” Covers more domains* (791) Community validated Empirically validated Includes vocabularies Includes decentralised datasets CONS Covers fewer domains* (133) Influence of high-volume domains  unbalanced Misses vocabularies Misses 47.4% of LOD/CKAN Misses decentralised datsets like domains * pay-level domains (PLDs) to be precise April 16, 2012 Towards a Dynamic Linked Data Observatory // TOBIAS KÄFER, Jürgen Umbrich, 7 http://swse.deri.org/dyldo Aidan Hogan, Axel Polleres // LDOW 2012 @ WWW 2012

  8. LOD/CKAN vs. BTC2011 WHAT WOULD WE MISS BY CHOOSING EITHER OF THEM? April 16, 2012 Towards a Dynamic Linked Data Observatory // TOBIAS KÄFER, Jürgen Umbrich, 8 http://swse.deri.org/dyldo Aidan Hogan, Axel Polleres // LDOW 2012 @ WWW 2012

  9. What sites* would we miss, which would we get? (Top 10 statements) # of stmts hi5.com  linkedgeodata.org  tfri.gov.tw livejournal.com  concordia.ca  ontologycentral.com scinets.org  rdfabout.com  legislation.gov.uk  unime.it rdfize.com  dbpedia.org  uriburner.com identi.ca  freebase.com  sudoc.fr bibsonomy.org  bio2rdf.org  viaf.org  data.gov.uk opera.com  europeana.eu  loc.gov archiplanet.org  moreways.net  vu.nl rambler.ru  uberblic.org  bbc.co.uk daml.org LOD-Cloud BTC2011 foaf scientific government linking publications * pay-level domains (PLDs) to be precise April 16, 2012 Towards a Dynamic Linked Data Observatory // TOBIAS KÄFER, Jürgen Umbrich, 9 http://swse.deri.org/dyldo Aidan Hogan, Axel Polleres // LDOW 2012 @ WWW 2012

  10. Our conclusion: a compromise Combination of CKAN/LOD-Cloud and BTC2011 Our sample: 220 example URIs from the LOD- Cloud‘s bubbles 220 highest-ranked (PageRank) URIs from BTC2011* Crawl from there to get a reasonably big seedlist Billion Triple Challenge Dataset * Cf. B. Glimm , A. Hogan , M. Krötzsch , A. Polleres: OWL: Yet to arrive on the Web of Data? CoRR abs/1202.0984: (2012) April 16, 2012 Towards a Dynamic Linked Data Observatory // TOBIAS KÄFER, Jürgen Umbrich, 10 http://swse.deri.org/dyldo Aidan Hogan, Axel Polleres // LDOW 2012 @ WWW 2012

  11. OUR MONITORING SETUP April 16, 2012 Towards a Dynamic Linked Data Observatory // TOBIAS KÄFER, Jürgen Umbrich, 11 http://swse.deri.org/dyldo Aidan Hogan, Axel Polleres // LDOW 2012 @ WWW 2012

  12. Our setup Published data: Seedlist The data itself access.log Frontier of the crawl after each hop Download seedlist Crawl =Taking into account RDF/XML, Turtle, RDFa, N-Triples, Nquads April 16, 2012 Towards a Dynamic Linked Data Observatory // TOBIAS KÄFER, Jürgen Umbrich, 12 http://swse.deri.org/dyldo Aidan Hogan, Axel Polleres // LDOW 2012 @ WWW 2012

  13. The Dimension of Time: Sketch of our adaptive revisiting scheme (only for seedlist URIs) URI changed between two visits ... bi-weekly quater-weekly weekly April 16, 2012 Towards a Dynamic Linked Data Observatory // TOBIAS KÄFER, Jürgen Umbrich, 13 http://swse.deri.org/dyldo Aidan Hogan, Axel Polleres // LDOW 2012 @ WWW 2012

  14. Summary / Q&A Summary: Motivated Dataset Dynamics Contrasted CKAN/LOD and BTC2011 Billion Described our setup vs. Triple Challenge Status quo: Dataset LOD cloud Close to launch (never been so close) Expected: May 1 Web page up http://swse.deri.org/dyldo Google Group up http://groups.google.com/group/dyldo Outlook Expected run-time: 1 year Elaborate on publishing issues Interpret data Q&A What would be your use-case? Does it need changes to our setup? How do you like our working definition of Linked Data? April 16, 2012 Towards a Dynamic Linked Data Observatory // TOBIAS KÄFER, Jürgen Umbrich, 14 http://swse.deri.org/dyldo Aidan Hogan, Axel Polleres // LDOW 2012 @ WWW 2012

  15. This presentation is CC BY-SA Picture on title slide based on a picture by A. Sparrow http://www.flickr.com/photos/49937157@N03/ CC BY 2.0 Linking Open Data cloud diagram, by Richard Cyganiak and Anja Jentzsch. http://lod-cloud.net/ CC BY-SA Treasure hunting map by kruxmux http://www.flickr.com/photos/76476049@N00/3946522483/in/photostream CC BY-NC 2.0 Clock picture by millynet http://www.flickr.com/photos/millynet/134071210/lightbox/ CC BY-NC-SA 2.0 Lens picture by Ben Cooper http://www.flickr.com/photos/cycleologist/1454436980/ CC BY-NC-SA 2.0 Picture on last slide by http://www.flickr.com/photos/stevendepolo/ CC BY 2.0 April 16, 2012 Towards a Dynamic Linked Data Observatory // TOBIAS KÄFER, Jürgen Umbrich, 15 http://swse.deri.org/dyldo Aidan Hogan, Axel Polleres // LDOW 2012 @ WWW 2012

  16. BACKUP April 16, 2012 Towards a Dynamic Linked Data Observatory // TOBIAS KÄFER, Jürgen Umbrich, 16 http://swse.deri.org/dyldo Aidan Hogan, Axel Polleres // LDOW 2012 @ WWW 2012

  17. Domination of large exporters in BTC: One provider shapes overall characteristics Number of documents Number of statements Number of statements RDF from http://www.hi5.com in the BTC2011 dataset BTC2011 dataset April 16, 2012 Towards a Dynamic Linked Data Observatory // TOBIAS KÄFER, Jürgen Umbrich, 17 http://swse.deri.org/dyldo Aidan Hogan, Axel Polleres // LDOW 2012 @ WWW 2012

  18. Reasons for largest 10 PLDs in CKAN/LOD not appearing in BTC 2011 April 16, 2012 Towards a Dynamic Linked Data Observatory // TOBIAS KÄFER, Jürgen Umbrich, 18 http://swse.deri.org/dyldo Aidan Hogan, Axel Polleres // LDOW 2012 @ WWW 2012

  19. Excursus: The PLD (pay-level domain) Pay money to a Top-level domain registrar  get a PLD Examples: http://urq.deri.ie/ http://www.bbc.co.uk/programmes/b006ml0g Same notion, different name: “Site” (Bray, WWW5, 1996) “Top Private Domain” (Google Guava Libraries) Cf.: Lee et al. Irlbot: Scaling to 6 billion pages and beyond. ACM Trans. Web , 3(3):1-34, 2009. April 16, 2012 Towards a Dynamic Linked Data Observatory // TOBIAS KÄFER, Jürgen Umbrich, 19 http://swse.deri.org/dyldo Aidan Hogan, Axel Polleres // LDOW 2012 @ WWW 2012

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Provenance in Dynamic Linked Data Marcin Wylot Linking Everything: Dynamic Graphs

Provenance in Dynamic Linked Data Marcin Wylot Linking Everything: Dynamic Graphs

Provenance in Dynamic Linked Data Marcin Wylot Linking Everything: Dynamic Graphs Integrated and summarized uncertain graph data Dynamic physical and logical network of things Necessity to established transparency 2 Data

850 views • 17 slides
CS261 Data Structures Linked Lists - Introduction Dynamic Arrays Revisited Dynamic array can

CS261 Data Structures Linked Lists - Introduction Dynamic Arrays Revisited Dynamic array can

CS261 Data Structures Linked Lists - Introduction Dynamic Arrays Revisited Dynamic array can sometimes be slow When? Why? Linked Lists to the Rescue Dynamic Array Linked List in memory in memory da LL Alan Newell data head a

420 views • 15 slides
16. Dynamic Data Structures so that it can be used efficiently Linked lists, Abstract data types

16. Dynamic Data Structures so that it can be used efficiently Linked lists, Abstract data types

Data Structures A data structure is a particular way of organizing data in a computer 16. Dynamic Data Structures so that it can be used efficiently Linked lists, Abstract data types stack, queue 446 447 Motivation: Stack Examples using a

258 views • 7 slides
Introduction to Object-Oriented Programming Linked Lists Christopher Simpkins

Introduction to Object-Oriented Programming Linked Lists Christopher Simpkins

Introduction to Object-Oriented Programming Linked Lists Christopher Simpkins chris.simpkins@gatech.edu CS 1331 (Georgia Tech) 1 / 13 Linked Lists Linked Lists Dynamic data structures Singly linked lists Generic linked lists Doubly linked

179 views • 13 slides
CS261 Data Structures Iterator ADT Dynamic Array and Linked List Goals Why do we need

CS261 Data Structures Iterator ADT Dynamic Array and Linked List Goals Why do we need

CS261 Data Structures Iterator ADT Dynamic Array and Linked List Goals Why do we need iterators? Iterator ADT Linked List and Dynamic Array Iterators The lecture will focus on link list iterators Interface of Bag ADT void

445 views • 26 slides
Rule-based Processing of Dynamic Linked Data Tutorial at the European Semantic Web Conference

Rule-based Processing of Dynamic Linked Data Tutorial at the European Semantic Web Conference

Rule-based Processing of Dynamic Linked Data Tutorial at the European Semantic Web Conference (ESWC) 2017 Andreas Harth and Tobias Kfer INSTITUTE AIFB, CHAIR FOR WEB SCIENCE KIT Die Forschungsuniversitt in der Helmholtz-Gemeinschaft

1.44k views • 110 slides
Topic #4 CS162 Topic #4 1 CS162 - Topic #4 Lecture: Dynamic Data Structures Review of

Topic #4 CS162 Topic #4 1 CS162 - Topic #4 Lecture: Dynamic Data Structures Review of

Introduction to C++ Linear Linked Lists Topic #4 CS162 Topic #4 1 CS162 - Topic #4 Lecture: Dynamic Data Structures Review of pointers and the new operator Introduction to Linked Lists Begin walking thru examples of linked lists

917 views • 55 slides
Linked Structures Songs, Games, Movies II Fall 2013 Carola Wenk Linked Lists x: y:

Linked Structures Songs, Games, Movies II Fall 2013 Carola Wenk Linked Lists x: y:

Linked Structures Songs, Games, Movies II Fall 2013 Carola Wenk Linked Lists x: y: hello world! The simplest dynamic structures is a linear ordering of data, called a linked list. We saw that is was easy to modify a

391 views • 17 slides
16. Dynamic Data Structures A data structure is a particular way of organizing data in a computer

16. Dynamic Data Structures A data structure is a particular way of organizing data in a computer

Data Structures 16. Dynamic Data Structures A data structure is a particular way of organizing data in a computer so that it can be used efficiently Linked lists, Abstract data types stack, queue 395 396 Examples using a Stack Motivation:

226 views • 7 slides
Querying multiple Linked Data sources on the Web Ruben Verborgh If you have a Linked

Querying multiple Linked Data sources on the Web Ruben Verborgh If you have a Linked

Querying multiple Linked Data sources on the Web Ruben Verborgh If you have a Linked Open Data set, you probably wonder: How can people query my Linked Data on the Web? A public SPARQL endpoint gives live

732 views • 57 slides
Linked Lists Kruse and Ryba Textbook 4.1 and Chapter 6 Linked Lists Linked list of items

Linked Lists Kruse and Ryba Textbook 4.1 and Chapter 6 Linked Lists Linked list of items

Linked Lists Kruse and Ryba Textbook 4.1 and Chapter 6 Linked Lists Linked list of items is arranged in order Size of linked list changes as items are inserted or removed Dynamic memory allocation is often used in linked list

484 views • 26 slides
Future NCHS-Linked Data Using Linked Data and Natural Language Processing to Support

Future NCHS-Linked Data Using Linked Data and Natural Language Processing to Support

1 Future NCHS-Linked Data Using Linked Data and Natural Language Processing to Support Patient-Centered Outcomes Research on Opioids Merianne Rose T. Spencer, M.P.H. National Center for Health Statistics Centers for Disease Control and

197 views • 18 slides
RDA linked data and the new RDA Toolkit Gordon Dunsire, Chair, RSC Presented at RDA Linked Data

RDA linked data and the new RDA Toolkit Gordon Dunsire, Chair, RSC Presented at RDA Linked Data

RDA linked data and the new RDA Toolkit Gordon Dunsire, Chair, RSC Presented at RDA Linked Data Forum June 25, 2018, New Orleans, USA 1 RDA Linked Data and the new RDA Toolkit July 6, 2018 3R Project RDA Toolkit Restructure and Redesign

150 views • 13 slides
CS 241 Data Organization Linked Lists March 27, 2018 Linked List A B C D E NULL A

CS 241 Data Organization Linked Lists March 27, 2018 Linked List A B C D E NULL A

CS 241 Data Organization Linked Lists March 27, 2018 Linked List A B C D E NULL A linked list is a data structure that consists of a sequence of data records such that in each record there is a field that contains a reference (a

474 views • 13 slides
Linked Lists Definition of Linked Lists A linked list is a sequence of items (objects) where

Linked Lists Definition of Linked Lists A linked list is a sequence of items (objects) where

Linked Lists Definition of Linked Lists A linked list is a sequence of items (objects) where every item is linked to the next. Graphically: data data data data None head_ptr Definition Details Each item has a data part , and

445 views • 22 slides
RDA linked data vocabularies data management and use workflow Gordon Dunsire Presented to RDA

RDA linked data vocabularies data management and use workflow Gordon Dunsire Presented to RDA

RDA linked data vocabularies data management and use workflow Gordon Dunsire Presented to RDA Linked Data Forum, ALA Annual, Chicago, USA, 26 June 2017 RDA Reference data flow Atomic audit trail Deprecation policy Entities, element sets,

447 views • 10 slides
CROWDFUNDING Promoting Innovative Growth: Venture Capital, Early Stage Funding and IPOS

CROWDFUNDING Promoting Innovative Growth: Venture Capital, Early Stage Funding and IPOS

CROWDFUNDING Promoting Innovative Growth: Venture Capital, Early Stage Funding and IPOS Brookings and Private Capital Research Institute The Brookings Institution Washington DC December 3, 2012 Ajay Agrawal, Christian Catalini, Avi

1.05k views • 56 slides
DCU-SAVASA Par,cipa,on and Reflec,ons Rami Albatal

DCU-SAVASA Par,cipa,on and Reflec,ons Rami Albatal

DCU-SAVASA Par,cipa,on and Reflec,ons Rami Albatal rami.albatal@dcu.ie FP7 project Started in December 2011 30 months 11 par,cipants 5

452 views • 16 slides
Online Video SEEDS Dr. Michael Van den Bergh Superpixels Extracted via SEEDS Energy- ECCV

Online Video SEEDS Dr. Michael Van den Bergh Superpixels Extracted via SEEDS Energy- ECCV

Online Video SEEDS Dr. Michael Van den Bergh Superpixels Extracted via SEEDS Energy- ECCV 2012 Driven Sampling What are superpixels? grouping pixels based on similarity (color) speeds up segmentation objects are made up of

537 views • 31 slides
Simon Waddington, Emma Tonkin Kings College London 11 February, IDCC 2015, London PERICLES

Simon Waddington, Emma Tonkin Kings College London 11 February, IDCC 2015, London PERICLES

GRANT AGREEMENT: 601138 | SCHEME FP7 ICT 2011.4.3 Promoting and Enhancing Reuse of Information throughout the Content Lifecycle taking account of Evolving Semantics [Digital Preservation] Simon Waddington, Emma Tonkin Kings College London 11

413 views • 17 slides
From Survival Analysis to Projecting Disability Payments Benjamin Abt & Simon Adamov January

From Survival Analysis to Projecting Disability Payments Benjamin Abt & Simon Adamov January

From Survival Analysis to Projecting Disability Payments Benjamin Abt & Simon Adamov January 30, 2020 Disclaimer The following presentation is for general information, education and discussion purposes only. It may not be reproduced or

925 views • 47 slides
(MSAAS) TOWARDS A GOVERNMENT SOLUTION LTC (OF4- ITA ARMY) Marco Biagini, PhD - NATO M&S CoE,

(MSAAS) TOWARDS A GOVERNMENT SOLUTION LTC (OF4- ITA ARMY) Marco Biagini, PhD - NATO M&S CoE,

MODELLING & SIMULATION CENTRE OF EXCELLENCE MODELLING AND SIMULATION AS A SERVICE (MSAAS) TOWARDS A GOVERNMENT SOLUTION LTC (OF4- ITA ARMY) Marco Biagini, PhD - NATO M&S CoE, CD&E Branch Chief Marco Picollo - Leonardo Electronics

334 views • 14 slides
Handling Real Life Dilemmas in APS Casework Summer Conference New York Public Welfare

Handling Real Life Dilemmas in APS Casework Summer Conference New York Public Welfare

7/9/2018 Handling Real Life Dilemmas in APS Casework Summer Conference New York Public Welfare Association Saratoga Springs, New York July 2018 Alan Lawitz, J.D . Director, Bureau of Adult Services, New York State Office of Children &

303 views • 9 slides
Tutorial: Methods for Reproducible Research Roger D. Peng Department Biostatistics Johns Hopkins

Tutorial: Methods for Reproducible Research Roger D. Peng Department Biostatistics Johns Hopkins

Tutorial: Methods for Reproducible Research Roger D. Peng Department Biostatistics Johns Hopkins Bloomberg School of Public Health ENAR 2009 Replication The ultimate standard for strengthening scientific evidence is replication of findings and

797 views • 50 slides

More recommend