[PPT] - f r o m h a n d t o mo u t h P a v l o B a r o PowerPoint Presentation

SLIDE 1

f r

m

h a n d t

mo

u t h

SLIDE 2

P a v l

B

a r

n

p a v l

.

b a r

n

@c

d

e c e n t r i c . d e @p a v l

b

a r

n

G e e k ‘ s G u i d e T

T

h e Wo r k i n g L i f e

SLIDE 3

F

r

g e t b a c k e n d

SLIDE 4

O r a t l e a s t w h a t y

u

c a l l a b a c k e n d

SLIDE 5

Y

u

r a p p l i c a t i

n

s e r v e r w i l l j u s t s l

w

d

w

n y

u

r ma c h i n e s t

k

e e p s t e p w i t h t h e m

SLIDE 6

O r y

u

w i l l s l

w

d

w

n y

u

r i n c

mi

n g t r a f f i c t

g

i v e y

u

r a p p l i c a t i

n

s e r v e r a c h a n c e t

b

r e a t h e

SLIDE 7

I t ' s l i k e :

r

d e r f

d

a t Mc D

n

a l d s , g e t q u e u e d a n d r e c e i v e t h e

r

d e r e d f

d

t h r

u

g h ma i l 3 d a y s l a t e r

SLIDE 8

T r y i n g t

s

p e e d i t u p i s l i k e :

r

d e r f

d

a t Mc D

n

a l d s , g e t q u e u e d , l e a v e t h e r e s t a u r a n t w i t h c

l
r

p i c t u r e s

f

y

u

r f

d

a n d w a i t 3 d a y s f

r

i t s d e l i v e r y

SLIDE 9

E v e r y s i n g l e d a t a a b s t r a c t i

n

l a y e r

n

l y h e l p s r u i n t h e a t mo s p h e r e t h r

u

g h h e a t i n g

SLIDE 10

H e y , ma n , y

u

c a r r y a r

u

n d a d a mn U S S E n t e r p r i s e i n y

u

r p

c

k e t A n d y

u

c a n r u n a d a mn B a b y l

n

5 i n a c l u s t e r

SLIDE 11

A n d i n t h e e n d , i t ' s a l w a y s s t

r

e / u p d a t e / d e l e t e / r e a d / s e a r c h / p r

c

e s s . I s n ' t i t ?

SLIDE 12

S

w

h y d r i v e a c l

w

n c a r w h e n y

u

c a n h a v e a F e r r a r i f u l l

f

t h e s e ?

SLIDE 13

Wh y n

t

j u s t l i v e f r

m

h a n d t

mo

u t h ?

SLIDE 14

Y

u

h a z t h i s ? Mo b i l e c l i e n t s w r i t e f r

m

e v e r y w h e r e , b u f f e r , r e a d

c

c a s i

n

a l l y , p

s

t

p

r

c

e s s i n g c

mp

l e t e l y b e h i n d t h e s c e n e s , l i k e s t a t i s t i c s e t c .

SLIDE 15

Z

m

i n ! I mme d i a t e , r e l i a b l e , ma s s i v e w r i t e s . A n a l y t i c s a n d p r

c

e s s i n g i n a b a t c h a f t e r w a r d s . N

n

e e d t

b

e e x a c t t

t

h e s e c

n

d a n d 1 % d a t a c

mp

l e t e

SLIDE 16

Z

m

i n !

SLIDE 17

Z

m

i n !

Buffer local ProtoBufs, REST Round Robin Web Apps, R, tools etc. REST, local Erlang

SLIDE 18

H T F d

e

s i t w

r

k ?

SLIDE 19

D a c

r

e

SLIDE 20

D a r i n g X b i t i n t e g e r s p a c e < = N < = 2 ^ X

r

: 2 x P i < = A < = 2 x P i x ( N ) = c

s

( A ) y ( N ) = s i n ( A )

SLIDE 21

D a c l u s t e r 1 2 p a r t i t i

n

s ( c

n

s t a n t ) 3 n

d

e s , 4 v n

d

e s e a c h a d d n

d

e 4 n

d

e s , 3 v n

d

e s e a c h A l t e r n a t i v e s : 3 n

d

e s , 2 x 5 + 1 x 2 v n

d

e s c

n

t a i n e r b a s e d

SLIDE 22

D a q u

r

u m V : v n

d

e s h

l

d i n g a k e y W: w r i t e q u

r

u m R : r e a d q u

r

u m D W, P W, P R W > . 5 * V R + W > V

SLIDE 23

Key = “foo” # = N, W = 2

N

I n s e r t k e y ( s l

p

p y q u

r

u m)

replicate

k

SLIDE 24

leave A d d n

d

e c

p

y copy leave leave c

p

y

SLIDE 25

Key = “foo” # = N, R = 2

N

L

k

u p k e y ( s l

p

p y q u

r

u m)

Value = “bar”

SLIDE 26

leave R e mo v e n

d

e copy

SLIDE 27

stable updates

D a G

s

s i p RM1 Clock table Replica clock Update log Value clock Value Executed operation table

write

RM2

SLIDE 28

Node 1 Node 2 Node 3 1,0,0 1,2,0 3,2,0 1,3,3 1,1,0 1,0,1 1,2,2 1,2,3 2,2,0 4,3,3 4,4,3 4,3,4

D a v e c t

r

c l

c

k s

SLIDE 29

D a Ma p R e d u c e

map reduce

Node X Node C N = "Alice"

map query = "Alice"

Node A N = „Alice" Node B N = "Alice"

map hit list

SLIDE 30

D a h i n t e d h a n d

f

f N : n

d

e , G : g r

u

p i n c l u d i n g N n

d

e ( N ) i s u n a v a i l a b l e r e p l i c a t e t

G
r

s t

r

e d a t a ( N ) l

c

a l l y h i n t h a n d

f

f f

r

l a t e r n

d

e ( N ) i s a l i v e h a n d

f

f d a t a t

n
d

e ( N )

SLIDE 31

Key = “foo”

N replicate

Key = “foo”, # = N -> handoff hint = true

R e p l i c a f a i l s

SLIDE 32

R e p l i c a r e c

v

e r s

handoff

SLIDE 33

A n d t h a t ' s b y f a r n

t

a l l : Y

u

c a n s e a r c h t h r

u

g h i n d e x w i t h d a t a l

c

a l i t y . Y

u

c a n t a g

b

j e c t s a n d q u e r y t h r

u

g h 2 i . Y

u

c a n a d d h

k

s

SLIDE 34

Y

u

d

n

' t e v e n n e e d t

s

t

r

e a n y t h i n g . J u s t d i s t r i b u t e y

u

r c a l c u l a t i

n

, s e a r c h , b a t c h

SLIDE 35

H a v e a l

k

a t t e n d i t a . c

m

SLIDE 36

S

i

t ' s e v e n c

mf

y t

l
a

d y

u

r c l

w

n c a r w i t h t h e s e

SLIDE 37

T h a n k y

u

SLIDE 38

Mo s t i ma g e s

r

i g i n a t e f r

m

i s t

c

k p h

t
.

c

m

e x c e p t f e w

n

e s t a k e n f r

m

Wi k i p e d i a

r

F l i c k r ( C C ) a n d p r

d

u c t p a g e s / p u b l i c l y a v a i l a b l e p r e s e n t a t i

n

s

r

g e n e r a t e d t h r

u

g h p u b l i c

n

l i n e g e n e r a t

r