Wikidata the free and open knowledge base Wikimedia DC - Sunlight - - PowerPoint PPT Presentation

▶
wikidata
SMART_READER_LITE
LIVE PREVIEW

Wikidata the free and open knowledge base Wikimedia DC - Sunlight - - PowerPoint PPT Presentation

Nov 22, 2022 137 likes •606 views

Wikidata the free and open knowledge base Wikimedia DC - Sunlight Foundation Hackathon - April 2014 Katie Filbert - @filbertkm https://github.com/filbertkm/slides CAN HAZ DATA? Credits: Sasan Geranmehr (CC-BY 3.0) What is Wikidata?

slide-1
SLIDE 1

Wikidata

the free and open knowledge base Wikimedia DC - Sunlight Foundation Hackathon - April 2014

Katie Filbert - @filbertkm https://github.com/filbertkm/slides

slide-2
SLIDE 2

CAN HAZ DATA?

Credits: Sasan Geranmehr (CC-BY 3.0)

slide-3
SLIDE 3
  • repository of the world's knowledge
  • database anyone can read and edit
  • multi-lingual
  • free and open source Software

What is Wikidata?

slide-4
SLIDE 4

supports Wikimedia projects (e.g. Wikipedia)

slide-5
SLIDE 5

14,500,000+ Items 31,000,000+ Statements

slide-6
SLIDE 6
  • Items are real things or concepts. eg. Berlin, Barack

Obama, Helium and are identified using a unique ID e.g. Q76 or Q13813879

  • Items have labels, descriptions, aliases, sitelinks and

claims/statements

  • Properties are used to label data e.g. Born in or Date of

Death or Location

Some points…

slide-7
SLIDE 7
  • Claims hold information, such as:

○ P47(shares border with) => Q64(Berlin) ○ P1128(employees) => 1,000+-100

  • Claims also have qualifiers, to expand on the

information

  • Statements what you see on Wikidata item pages.

They are a “subclass” of Claims. Statements also have references, telling you where the information was source from.

More points…

slide-8
SLIDE 8

Washington, D.C. Q61

www.wikidata.org/wiki/Q61

Example Item

slide-9
SLIDE 9
slide-10
SLIDE 10

LABEL

slide-11
SLIDE 11

DESCRIPTION

slide-12
SLIDE 12

ALIASES

slide-13
SLIDE 13

LABELS and DESCRIPTIONS in other languages

slide-14
SLIDE 14

STATEMENTS

slide-15
SLIDE 15

PROPERTY

slide-16
SLIDE 16

DATA VALUE (wikibase-item)

slide-17
SLIDE 17

SNAK

slide-18
SLIDE 18

QUALIFIER

slide-19
SLIDE 19

REFERENCE

slide-20
SLIDE 20

All available DataTypes

Datatypes are used in claims to represent data

  • Item
  • Commons media
  • String
  • Time
  • Globe coordinate
  • URL
  • Quantity

See wikidata.org/wiki/Special:ListDatatypes

slide-21
SLIDE 21

More about the data model

https://meta.wikimedia.org/wiki/Wikidata/Notes/Data_model_primer

slide-22
SLIDE 22

SITE LINKS

slide-23
SLIDE 23

Data used on Wikipedia

and Wikimedia sister projects (e.g. Wikivoyage)

  • Language links
  • Property parser function
  • Lua
slide-24
SLIDE 24

MAP IMAGE

slide-25
SLIDE 25
slide-26
SLIDE 26

Example Applications

All generated using the data stored in Wikidata https://www.wikidata.org/wiki/Wikidata:Tools

slide-27
SLIDE 27

GeneaWiki toolserver.org/~magnus/ts2/geneawiki

slide-28
SLIDE 28

The Wiki Atlas 4thmain.github.io/projects/hacks/wiki-atlas.html

slide-29
SLIDE 29

The Wiki Atlas 4thmain.github.io/projects/hacks/wiki-atlas.html

slide-30
SLIDE 30

Wikidata tempo-spatial display tools.wmflabs.org/wikidata-todo/tempo_spatial_display.html?q=Q12551

slide-31
SLIDE 31

The Map tools.wmflabs.org/wikidata-analysis/map/map.html

slide-32
SLIDE 32

The Map tools.wmflabs.org/wikidata-analysis/map/map.html

slide-33
SLIDE 33

Reasonator tools.wmflabs.org/reasonator/?q=Q76

slide-34
SLIDE 34

http://googleknowledge.github.io/qlabel/ qLabel

slide-35
SLIDE 35

Queries

https://wdq.wmflabs.org

slide-36
SLIDE 36

sandbox wikidata.org/wiki/Special:ApiSandbox docs

www.mediawiki.org/wiki/Extension:Wikibase/API

wikidata.org/w/api.php

The Api

slide-37
SLIDE 37

https://www.wikidata.org/w/api.php

?action=wbgetentities &ids=Q61 &format=jsonfm Washington, D.C. Q61 Example Item through Api

slide-38
SLIDE 38
  • wbgetentities
  • wbeditentity
  • wbsearchentities
  • wbformatvalue
  • wbparsevalue
  • wbsetlabel
  • wbsetdescription
  • wbsetaliases
  • wbsetsitelink
  • wbsetclaim

Wikibase Api Modules

  • wblinktitles
  • wbmergeitems
  • wbgetclaims
  • wbcreateclaim
  • wbremoveclaims
  • wbsetclaimvalue
  • wbsetreference
  • wbremovereferences
  • wbremovequalifiers
  • wbsetqualifier
slide-39
SLIDE 39

Database dumps

http://dumps.wikimedia.org/wikidatawiki/ current (as of latest dump) revisions for everything: pages-meta-current.xml Dumps are package everything in xml! Wikidata data “blobs” are json

(basic java tool for getting a wikidata dump into a db) https://github.com/filbertkm/wikidata-dump-parser (java toolkit) https://github.com/Wikidata/Wikidata-Toolkit (php library for working with dump serialization format) https://github.com/wmde/WikibaseInternalSerialization

slide-40
SLIDE 40

Bots

https://www.wikidata.org/wiki/Wikidata:Bots https://test.wikidata.org https://www.mediawiki.org/wiki/Manual:Pywikibot/Wikidata http://tools.wmflabs.org/ (place to run tools & bots, with access to database replication -- but not actual page or data content) Many Wikibase components are reusable and independent of MediaWiki

slide-41
SLIDE 41

Wikibase components

https://www.mediawiki.org/wiki/Wikibase/Components https://git.wikimedia.org/summary/mediawiki%2Fextensions% 2FWikibase https://github.com/wmde https://github.com/DataValues

slide-42
SLIDE 42

Other stuff

java toolkit developed by Markus Kroetzsch for working with dumps and queries: https://github.com/Wikidata/Wikidata-Toolkit student projects (property suggester & pubsubhubbub) https://github.com/Wikidata-lib

slide-43
SLIDE 43

Contributing to Wikibase

https://www.mediawiki.org/wiki/Wikibase/Contribution_workflow

slide-44
SLIDE 44

Q/A

slide-45
SLIDE 45

www.wikidata.org #wikidata on chat.freenode.net @wikidata on Twitter wikidata-l@lists.wikimedia.org https://www.wikidata.org/wiki/Wikidata:Status_updates Any questions, just ask! Katie Filbert - @filbertkm katie.filbert@wikimedia.de

aude in #wikidata on chat.freenode.net https://github.com/filbertkm/slides