P r a c t i c a l L i n k e d D a t a A c c e - PowerPoint PPT Presentation

P r a c t i c a l L i n k e d D a t a A c c e s s v i a S P A R Q L : T h e C a s e o f W i k i d a t a A d r i a n B i e l e f e l d t J u l i u s G o n s i o r Ma r k u s K r ö t z s c h K n o w l e d g e - B a s e d S y s t e m s T U D r e s d e n A l s o r e p o r t i n g o n j o i n t w o r k w i t h S t a s Ma l y s h e v ( Wi k i m e d i a ) L a r r y G o n z a l e z ( T U D r e s d e n ) a n d R e s e a r c h s u p p o r t e d b y t h e Wi k i m e d i a F o u n d a t i o n F o r t h e e p o n y m o u s L D O W 2 0 1 8 p a p e r , s e e h t t p s : / / i c c l . i n f . t u - d r e s d e n . d e / w e b / I n p r o c e e d i n g s 3 1 9 6 / e n Slideset published under CC-By-SA 3.0 – slides without the title slide also published as CC-By 3.0 Background image by Phillip Maiwald, CC-By-SA 3.0

+ = ? Wi k i d a t a , t h e k n o w l e d g e g r a p h o f Wi k i p e d i a , u s e s S P A R Q L a s i t s ma i n q u e r y A P I Wh o i s u s i n g t h i s ?  Wh a t a r e t h o s e S P A R Q L q u e r i e s l i k e ?  Wh a t c a n w e l e a r n f r o m t h e m?  2

W a i t ! – W i k i d a t a u s e s R D F ? ! 3

W a i t ! – W i k i d a t a u s e s R D F ? ! award received (P166) Nobel Prize Louis Néel in Physics (Q155781) (Q38104) point in time (P585): 1970 together with (P1706): H. Alfvén (Q54945) prize money (P2121): 200000 SEK (Q122922) H o w d o e s Wi k i d a t a ’ s r i c h g r a p h mo d e l r e l a t e t o R D F ? 4

W a i t ! – W i k i d a t a u s e s R D F ? ! O f fj c i a l R D F v e r s i o n f o l l o w s E r x l e b e n e t a l . [ I S WC 2 0 1 4 ] : Nobel Prize wdt:P166 Louis Néel in Physics (Q155781) (Q38104) 5

W a i t ! – W i k i d a t a u s e s R D F ? ! O f fj c i a l R D F v e r s i o n f o l l o w s E r x l e b e n e t a l . [ I S WC 2 0 1 4 ] : Nobel Prize wdt:P166 Louis Néel in Physics (Q155781) (Q38104) p:P166 ps:P166 wds:Q155781-... pq:P585 pq:P1706 pq:P2121 Q54945 “200000”^^xsd:decimal “1970”^^xsd:gYear 6

R D F f o r W i k i d a t a Wi k i d a t a o f f e r s a l l o f i t s c o n t e n t i n R D F  L i n k e d d a t a l i v e e x p o r t s  ( E x a mp l e : h t t p s : / / w w w . w i k i d a t a . o r g / w i k i / S p e c i a l : E n t i t y D a t a / Q 4 2 . n t ) We e k l y d u mp s  ( S e e h t t p s : / / d u mp s . w i k i me d i a . o r g / w i k i d a t a w i k i / e n t i t i e s / ) C u r r e n t l y 4 . 9 B t r i p l e s  ( a s o f A p r i l 2 0 1 8 ) > 4 1 5 M Wi k i d a t a S t a t e me n t s  → 4 . 5 K Wi k i d a t a p r o p e r t i e s > 4 8 K R D F p r o p e r t i e s  > 1 . 5 B l a b e l s / d e s c r i p t i o n s / a l i a s e s  > 6 3 M l i n k s t o Wi k i p e d i a a n d f r i e n d s  7

W i k i d a t a S P A R Q L Q u e r y S e r v i c e O f fj c i a l q u e r y s e r v i c e s i n c e mi d 2 0 1 5  U s e r i n t e r f a c e a t h t t p s : / / q u e r y . w i k i d a t a . o r g /  A l l t h e d a t a ( 4 . 9 B t r i p l e s ) , l i v e ( l a t e n c y < 6 0 s )  N o l i mi t s ( w e l l , a l mo s t ) :  6 0 s e c t i me o u t  N o l i mi t o n r e s u l t s i z e ( ! )  N o l i mi t o n q u e r y n u mb e r s p e r I P  C l i e n t s mi g h t b e p a u s e d a f t e r t o o ma n y p a r a l l e l r e q u e s t s  8

A s i m p l e S P A R Q L q u e r y 9

A s i m p l e S P A R Q L q u e r y 10

A n o t - s o - s i m p l e S P A R Q L q u e r y 11

A n o t - s o - s i m p l e S P A R Q L q u e r y 12

S o m e m e t r i c s  R u n n i n g o n B l a z e G r a p h d a t a b a s e e n g i n e 3 s e r v e r s ( + 3 a s b a c k u p )  I n t e l X e o n E 5 - 2 6 2 0 8 c o r e / 1 2 8 G me m/ 8 0 0 G S S D S t a n d a r d c a c h i n g ( V a r n i s h ) a n d l o a d b a l a n c i n g ( L V S )  S o me c u s t o m t o o l s , e x t e n s i o n a n d t u n i n g s  A l l a v a i l a b l e o n l i n e : h t t p s : / / g i t h u b . c o m/ w i k i me d i a / w i k i d a t a - q u e r y - r d f 13

S o m e m e t r i c s  R u n n i n g o n B l a z e G r a p h d a t a b a s e e n g i n e 3 s e r v e r s ( + 3 a s b a c k u p )  I n t e l X e o n E 5 - 2 6 2 0 8 c o r e / 1 2 8 G me m/ 8 0 0 G S S D S t a n d a r d c a c h i n g ( V a r n i s h ) a n d l o a d b a l a n c i n g ( L V S )  S o me c u s t o m t o o l s , e x t e n s i o n a n d t u n i n g s  A l l a v a i l a b l e o n l i n e : h t t p s : / / g i t h u b . c o m/ w i k i me d i a / w i k i d a t a - q u e r y - r d f  S e r v i n g > 1 0 0 M r e q u e s t s / mo n t h ( 3 . 8 M/ d a y ) 5 0 % o f q u e r i e s a n s w e r e d i n < 4 0 ms ( 9 5 % i n < 4 4 0 ms ; 9 9 % i n < 4 0 s )  L e s s t h a n 0 . 0 5 % o f q u e r i e s t i me o u t  S e r v i c e h a s n e v e r b e e n d o w n s o f a r  14

A n a l y s i n g S P A R Q L l o g s : T h e B o t P r o b l e m 15

A n a l y s i n g S P A R Q L l o g s : T h e B o t P r o b l e m  Q u e r y t r a f fj c i s r u l e d b y a f e w b o t s F i g . : Wi k i d a t a S P A R Q L t r a f fj c J u n - S e p 2 0 1 7 16

A n a l y s i n g S P A R Q L l o g s : T h e B o t P r o b l e m  Q u e r y t r a f fj c i s r u l e d b y a f e w b o t s F i g . : Wi k i d a t a S P A R Q L t r a f fj c J u n - S e p 2 0 1 7  4 1 % o f a l l Wi k i d a t a q u e r y t r a f fj c f r o m J u n e – S e p t e mb e r 2 0 1 7 c a u s e d b y o n e s u p e r - p o w e r u s e r ( Ma g n u s Ma n s k e ) 17

A n a l y s i n g S P A R Q L l o g s : T h e B o t P r o b l e m  Q u e r y t r a f fj c i s r u l e d b y a f e w b o t s F i g . : Wi k i d a t a S P A R Q L t r a f fj c J u n - S e p 2 0 1 7  4 1 % o f a l l Wi k i d a t a q u e r y t r a f fj c f r o m J u n e – S e p t e mb e r 2 0 1 7 c a u s e d b y o n e s u p e r - p o w e r u s e r ( Ma g n u s Ma n s k e )  T h e e f f e c t d o e s n o t 38.00% 40.00% a v e r a g e o u t , a n d i t 30.00% a f f e c t s o t h e r s i t e s t o o 18.00% 20.00% 11.00% 8.00% 8.00% 10.00% 0.00% F i g . : U s a g e o f D I S T I N C T o n D B p e d i a 2012 2013 2014 2015 2016 [ B o n i f a t i e t a l . 2 0 1 7 ] 18