dynamo five years later
play

Dynamo, Five Years Later Andy Gross Chief Architect, Basho - PowerPoint PPT Presentation

Aug 31, 2022 •144 likes •891 views

Dynamo, Five Years Later Andy Gross Chief Architect, Basho Technologies GOTO Chicago 2013 Tuesday, April 23, 13 Dynamo Published October 2007 @ SOSP Describes a collection of distributed systems techniques applied to low-latency key-value

  1. Dynamo, Five Years Later Andy Gross Chief Architect, Basho Technologies GOTO Chicago 2013 Tuesday, April 23, 13

  2. Dynamo Published October 2007 @ SOSP Describes a collection of distributed systems techniques applied to low-latency key-value storage Spawned (along with BigTable) many imitators, an industry (LinkedIn -> Voldemort, Facebook -> Cassandra) Authors nearly got fired from Amazon for publishing Tuesday, April 23, 13

  3. Riak - A Dynamo Clone First lines of first prototype written in Fall 2007 on a plane on the way to my Basho interview “Technical Debt” is another term we use at Basho for this code Mostly Erlang with some C/C++ Apache2 Licensed First release in 2009, 1.3 released 2/21/13 Tuesday, April 23, 13

  4. Basho Founded late 2007 by ex-Akamai people Currently ~120 employees, distributed, with offices in Cambridge, San Francisco, London, and Tokyo We sponsor of Riak Open Source We sell Riak Enterprise (Riak + Multi-DC replication) We just open sourced Riak CS (S3 clone backed by Riak Enterprise) Tuesday, April 23, 13

  5. Principles Always-writable Incrementally scalable Symmetrical Decentralized Heterogenous Focus on SLAs, tail latency Tuesday, April 23, 13

  6. Techniques Consistent Hashing Vector Clocks Read Repair Anti-Entropy Hinted Handoff Gossip Protocol Tuesday, April 23, 13

  7. Consistent Hashing Invented by Danny Lewin and others @ MIT/Akamai Minimizes remapping of keys when number of hash slots changes Originally applied to CDNs, used in Dynamo for replica placement Enables incremental scalability, even spread Minimizes hot spots Tuesday, April 23, 13

  8. Tuesday, April 23, 13

  9. Vector Clocks Introduced by Mattern et al, in 1988 Extends Lamport’s timestamps (1978) Each value in Dynamo tagged with vector clock Allows detection of stale values, logical siblings Tuesday, April 23, 13

  10. Read Repair Update stale versions opportunistically on reads (instead of writes) Pushes system toward consistency, after returning value to client Reflects focus on a cheap, always-available write path Tuesday, April 23, 13

  11. Hinted Handoff Any node can accept writes for other nodes if they’re down All messages include a destination Data accepted by node other than destination is handed off when node recovers As long as a single node is alive the cluster can accept a write Tuesday, April 23, 13

  12. Anti-Entropy Replicas maintain a Merkle Tree of keys and their versions/hashes Trees periodically exchanged with peer vnodes Merkle tree enables cheap comparison Only values with different hashes are exchanged Pushes system toward consistency Tuesday, April 23, 13

  13. Gossip Protocol Decentralized approach to managing global state Trades off atomicity of state changes for a decentralized approach Volume of gossip can overwhelm networks without care Tuesday, April 23, 13

  14. Hinted Handoff Tuesday, April 23, 13

  15. Hinted Handoff X • Node fails X X X X X X X Tuesday, April 23, 13

  16. Hinted Handoff X • Node fails X X • Requests go to fallback X X X X X hash(“ blocks/6307C89A-710A-42CD-9FFB-2A6B39F983EA ”) Tuesday, April 23, 13

  17. Hinted Handoff • Node fails • Requests go to fallback • Node comes back hash(“ blocks/6307C89A-710A-42CD-9FFB-2A6B39F983EA ”) Tuesday, April 23, 13

  18. Hinted Handoff • Node fails • Requests go to fallback • Node comes back • “Handoff” - data returns to recovered node hash(“ blocks/6307C89A-710A-42CD-9FFB-2A6B39F983EA ”) Tuesday, April 23, 13

  19. Hinted Handoff • Node fails • Requests go to fallback • Node comes back • “Handoff” - data returns to recovered node • Normal operations resume hash(“ blocks/6307C89A-710A-42CD-9FFB-2A6B39F983EA ”) Tuesday, April 23, 13

  20. Anatomy of a Request get(“ blocks/6307C89A-710A-42CD-9FFB-2A6B39F983EA” ) Tuesday, April 23, 13

  21. Anatomy of a Request get(“ blocks/6307C89A-710A-42CD-9FFB-2A6B39F983EA” ) client Riak Tuesday, April 23, 13

  22. Anatomy of a Request get(“ blocks/6307C89A-710A-42CD-9FFB-2A6B39F983EA” ) client Riak Get Handler (FSM) Tuesday, April 23, 13

  23. Anatomy of a Request get(“ blocks/6307C89A-710A-42CD-9FFB-2A6B39F983EA” ) client Riak hash(“blocks/ 6307C89A-710A-42CD-9FFB-2A6B39F983EA”) Get Handler (FSM) == 10, 11, 12 Tuesday, April 23, 13

  24. Anatomy of a Request get(“ blocks/6307C89A-710A-42CD-9FFB-2A6B39F983EA” ) client Riak hash(“blocks/ 6307C89A-710A-42CD-9FFB-2A6B39F983EA”) Get Handler (FSM) == 10, 11, 12 Coordinating node Cluster 6 7 8 9 10 11 12 13 14 15 16 The Ring Tuesday, April 23, 13

  25. Anatomy of a Request get(“ blocks/6307C89A-710A-42CD-9FFB-2A6B39F983EA” ) client Riak Get Handler (FSM) get(“ blocks/6307C89A-710A-42CD-9FFB-2A6B39F983EA ”) Coordinating node Cluster 6 7 8 9 10 11 12 13 14 15 16 The Ring Tuesday, April 23, 13

  26. Anatomy of a Request get(“ blocks/6307C89A-710A-42CD-9FFB-2A6B39F983EA” ) client Riak Get Handler (FSM) R=2 Coordinating node Cluster 6 7 8 9 10 11 12 13 14 15 16 The Ring Tuesday, April 23, 13

  27. Anatomy of a Request get(“ blocks/6307C89A-710A-42CD-9FFB-2A6B39F983EA” ) client Riak Get Handler (FSM) v1 R=2 Coordinating node Cluster 6 7 8 9 10 11 12 13 14 15 16 The Ring Tuesday, April 23, 13

  28. Anatomy of a Request get(“ blocks/6307C89A-710A-42CD-9FFB-2A6B39F983EA” ) client Riak Get Handler (FSM) v1 v2 R=2 Tuesday, April 23, 13

  29. Anatomy of a Request get(“ blocks/6307C89A-710A-42CD-9FFB-2A6B39F983EA” ) client v2 Riak Get Handler (FSM) v2 R=2 Tuesday, April 23, 13

  30. Anatomy of a Request get(“ blocks/6307C89A-710A-42CD-9FFB-2A6B39F983EA” ) v2 Tuesday, April 23, 13

  31. Read Repair get(“ blocks/6307C89A-710A-42CD-9FFB-2A6B39F983EA ”) client v2 Riak Get Handler (FSM) v1 v2 R=2 Coordinating node Cluster 6 7 8 9 10 11 12 13 14 15 16 v1 v2 Tuesday, April 23, 13

  32. Read Repair get(“ blocks/6307C89A-710A-42CD-9FFB-2A6B39F983EA ”) client v2 Riak Get Handler (FSM) v2 R=2 Coordinating node Cluster 6 7 8 9 10 11 12 13 14 15 16 v1 v2 Tuesday, April 23, 13

  33. Read Repair get(“ blocks/6307C89A-710A-42CD-9FFB-2A6B39F983EA ”) client v2 Riak Get Handler (FSM) v2 R=2 Coordinating node Cluster 6 7 8 9 10 11 12 13 14 15 16 v1 v1 v2 Tuesday, April 23, 13

  34. Read Repair get(“ blocks/6307C89A-710A-42CD-9FFB-2A6B39F983EA ”) client v2 Riak Get Handler (FSM) v2 R=2 Coordinating node Cluster v2 v2 6 7 8 9 10 11 12 13 14 15 16 v2 v2 v2 Tuesday, April 23, 13

  35. Riak Architecture Erlang/OTP Runtime Tuesday, April 23, 13

  36. Riak Architecture Erlang/OTP Runtime Riak KV Tuesday, April 23, 13

  37. Riak Architecture Erlang/OTP Runtime Client APIs Riak KV Tuesday, April 23, 13

  38. Riak Architecture Erlang/OTP Runtime Client APIs HTTP Riak KV Tuesday, April 23, 13

  39. Riak Architecture Erlang/OTP Runtime Client APIs HTTP Protocol Buffers Riak KV Tuesday, April 23, 13

  40. Riak Architecture Erlang/OTP Runtime Client APIs HTTP Protocol Buffers Erlang local client Riak KV Tuesday, April 23, 13

  41. Riak Architecture Erlang/OTP Runtime Client APIs HTTP Protocol Buffers Erlang local client Request Coordination Riak KV Tuesday, April 23, 13

  42. Riak Architecture Erlang/OTP Runtime Client APIs HTTP Protocol Buffers Erlang local client Request Coordination get put delete map-reduce Riak KV Tuesday, April 23, 13

  43. Riak Architecture Erlang/OTP Runtime Client APIs HTTP Protocol Buffers Erlang local client Request Coordination get put delete map-reduce Riak Core Riak KV Tuesday, April 23, 13

  44. Riak Architecture Erlang/OTP Runtime Client APIs HTTP Protocol Buffers Erlang local client Request Coordination get put delete map-reduce consistent hashing Riak Core Riak KV Tuesday, April 23, 13

  45. Riak Architecture Erlang/OTP Runtime Client APIs HTTP Protocol Buffers Erlang local client Request Coordination get put delete map-reduce consistent hashing Riak Core membership Riak KV Tuesday, April 23, 13

  46. Riak Architecture Erlang/OTP Runtime Client APIs HTTP Protocol Buffers Erlang local client Request Coordination get put delete map-reduce consistent hashing handoff Riak Core membership Riak KV Tuesday, April 23, 13

  47. Riak Architecture Erlang/OTP Runtime Client APIs HTTP Protocol Buffers Erlang local client Request Coordination get put delete map-reduce consistent hashing handoff Riak Core membership node-liveness Riak KV Tuesday, April 23, 13

  48. Riak Architecture Erlang/OTP Runtime Client APIs HTTP Protocol Buffers Erlang local client Request Coordination get put delete map-reduce consistent hashing handoff gossip Riak Core membership node-liveness Riak KV Tuesday, April 23, 13

  49. Riak Architecture Erlang/OTP Runtime Client APIs HTTP Protocol Buffers Erlang local client Request Coordination get put delete map-reduce consistent hashing handoff gossip Riak Core membership node-liveness buckets Riak KV Tuesday, April 23, 13

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Dynamo, Five Years Later Andy Gross Chief Architect, Basho Technologies QCon London 2013

Dynamo, Five Years Later Andy Gross Chief Architect, Basho Technologies QCon London 2013

Dynamo, Five Years Later Andy Gross Chief Architect, Basho Technologies QCon London 2013 Friday, March 8, 13 Dynamo Published October 2007 @ SOSP Describes a collection of distributed systems techniques applied to low-latency key-value

931 views • 75 slides
Dynamo, Five Years Later Andy Gross Chief Architect, Basho Technologies QCon SF 2012 Thursday,

Dynamo, Five Years Later Andy Gross Chief Architect, Basho Technologies QCon SF 2012 Thursday,

Dynamo, Five Years Later Andy Gross Chief Architect, Basho Technologies QCon SF 2012 Thursday, November 8, 12 Dynamo Published October 2007 @ SOSP Describes a collection of distributed systems techniques applied to low-latency key-value

461 views • 33 slides
Dynamo Saurabh Agarwal What have we looked at so far ? Assumptions CAP Theorem SQL and

Dynamo Saurabh Agarwal What have we looked at so far ? Assumptions CAP Theorem SQL and

Dynamo Saurabh Agarwal What have we looked at so far ? Assumptions CAP Theorem SQL and NoSQL Hashing Origins of Dynamo This is year 2004 One Amazon was growing and other shrinking What led to Dynamo ? What led to Dynamo ?

425 views • 40 slides
DynamO Workshop Introduction to Event-Driven Dynamics and DynamO Dr Marcus N. Bannerman & Dr

DynamO Workshop Introduction to Event-Driven Dynamics and DynamO Dr Marcus N. Bannerman & Dr

DynamO Workshop Introduction to Event-Driven Dynamics and DynamO Dr Marcus N. Bannerman & Dr Leo Lue m.campbellbannerman@abdn.ac.uk leo.lue@strath.ac.uk MNB & LL DynamO Workshop 23/01/2015 1 / 32 Agenda Section Outline Agenda What

616 views • 32 slides
Dynamo Dynamo motivation Fast, available writes - Shopping cart: always enable purchases FLP:

Dynamo Dynamo motivation Fast, available writes - Shopping cart: always enable purchases FLP:

Dynamo Dynamo motivation Fast, available writes - Shopping cart: always enable purchases FLP: consistency and progress at odds - Paxos: must communicate with a quorum Performance: strict consistency = single copy - Updates serialized to

1.45k views • 110 slides
Dynamo Dynamo motivation Fast, available writes - Shopping cart: always enable purchases FLP:

Dynamo Dynamo motivation Fast, available writes - Shopping cart: always enable purchases FLP:

Dynamo Dynamo motivation Fast, available writes - Shopping cart: always enable purchases FLP: consistency and progress at odds - Paxos: must communicate with a quorum Strict consistency = single copy - Updates serialized to single copy

809 views • 52 slides
www.hdtsoccer.com All teams will wear the dynamo uniform with logos and the club has all rights

www.hdtsoccer.com All teams will wear the dynamo uniform with logos and the club has all rights

The competitive programs will be combined under the Houston Dynamo name. Recreational Programs will not be affected. Both VSC and Revolution will retain their existing recreational programs. www.hdtsoccer.com All teams will wear the dynamo

506 views • 8 slides
Dynamo & Bigtable CSCI 2270, Spring 2011 Irina Calciu Zikai Wang Dynamo Amazon's highly

Dynamo & Bigtable CSCI 2270, Spring 2011 Irina Calciu Zikai Wang Dynamo Amazon's highly

Dynamo & Bigtable CSCI 2270, Spring 2011 Irina Calciu Zikai Wang Dynamo Amazon's highly available key-value store Amazon's E-commerce Platform Hundreds of services (recommendations, order fulfillment, fraud detection, etc.) Millions of

461 views • 44 slides
Amazon Dynamo A Highly Available Key-value Store Present by Jian Fang jianf@cmu.edu What is

Amazon Dynamo A Highly Available Key-value Store Present by Jian Fang jianf@cmu.edu What is

Amazon Dynamo A Highly Available Key-value Store Present by Jian Fang jianf@cmu.edu What is Dynamo Eventually consistent key-value store Support scalable highly available data access Optimized for availability to maximize customer

479 views • 26 slides
Reliability at Scale A tale of Amazon Dynamo Presented by Yunhe Liu @ CS6410 Fall19 Slides

Reliability at Scale A tale of Amazon Dynamo Presented by Yunhe Liu @ CS6410 Fall19 Slides

Reliability at Scale A tale of Amazon Dynamo Presented by Yunhe Liu @ CS6410 Fall19 Slides referenced and borrowed from Max & Zhen P2P Systems: Storage [2017], VanHattum [2018] Dynamo: Amazons Highly Available Key-value Store

602 views • 43 slides
A Global Model Investigation of MJO Initiation for DYNAMO Guang Zhang Scripps Institution of

A Global Model Investigation of MJO Initiation for DYNAMO Guang Zhang Scripps Institution of

A Global Model Investigation of MJO Initiation for DYNAMO Guang Zhang Scripps Institution of Oceanography Subramanian and Zhang (2014, JGR) Objectives To investigate the MJO initiation in the Indian Ocean using the NCAR CAM3 and the DYNAMO

653 views • 21 slides
DynamO Workshop Tutorial: Thermostats, transport properties, and compression Dr Marcus N.

DynamO Workshop Tutorial: Thermostats, transport properties, and compression Dr Marcus N.

DynamO Workshop Tutorial: Thermostats, transport properties, and compression Dr Marcus N. Bannerman & Dr Leo Lue m.campbellbannerman@abdn.ac.uk leo.lue@strath.ac.uk MNB & LL DynamO Workshop 23/01/2015 1 / 11 This tutorial session

533 views • 11 slides
DYNAMO: DYnamic Inputs of Natural Conditions for Air Quality MOdels AQAST Year 3 Tiger Team

DYNAMO: DYnamic Inputs of Natural Conditions for Air Quality MOdels AQAST Year 3 Tiger Team

DYNAMO: DYnamic Inputs of Natural Conditions for Air Quality MOdels AQAST Year 3 Tiger Team Daniel Cohan, Loretta Mickley, Richard McNider, Arastoo Pour Biazar, Bryan Duncan Key Additional Participants in DYNAMO Air Quality Management

353 views • 14 slides
D r o u g h 33.6 -45.5 33.6 -45.5 11 years 5.4 years 11 years 5.4 years years t

D r o u g h 33.6 -45.5 33.6 -45.5 11 years 5.4 years 11 years 5.4 years years t

D r o u g h 33.6 -45.5 33.6 -45.5 11 years 5.4 years 11 years 5.4 years years t years Figure 2. Precipitation anomalies during 11 years of the dust bowl (1930-1940) Station Set-up Montana Mesonet January 2018 4 36 ranchers

533 views • 36 slides
Building a Dynamo Bridge between revit and excel Vdc Tdindustries Craig technology chappell

Building a Dynamo Bridge between revit and excel Vdc Tdindustries Craig technology chappell

Building a Dynamo Bridge between revit and excel Vdc Tdindustries Craig technology chappell specialist Main objectives Class Description This class will focus on using Dynamo to develop a bridge of information between Excel

292 views • 25 slides
DynamO Workshop Tutorial: Hard sphere simulation Dr Marcus N. Bannerman & Dr Leo Lue

DynamO Workshop Tutorial: Hard sphere simulation Dr Marcus N. Bannerman & Dr Leo Lue

DynamO Workshop Tutorial: Hard sphere simulation Dr Marcus N. Bannerman & Dr Leo Lue m.campbellbannerman@abdn.ac.uk leo.lue@strath.ac.uk MNB & LL DynamO Workshop 23/01/2015 1 / 9 Hard-Sphere fluids Section Outline Hard-Sphere

930 views • 9 slides
T HE TRANSITION FROM 2D TO 3D AND TO IMRT - R ATIONALE AND C RITICAL E LEMENTS ICTP P S CHOOL ON

T HE TRANSITION FROM 2D TO 3D AND TO IMRT - R ATIONALE AND C RITICAL E LEMENTS ICTP P S CHOOL ON

T HE TRANSITION FROM 2D TO 3D AND TO IMRT - R ATIONALE AND C RITICAL E LEMENTS ICTP P S CHOOL ON ON M EDICAL AL P HYSI FOR R ADIAT ATION T HERAP SICS FOR APY D OSIMET METRY AND T REAT MENT P LANNING FOR FOR B ASIC AND A DVAN ANCED A PPLICAT

1.13k views • 81 slides
Nutri,on for Children and Adults With Special Needs Monica

Nutri,on for Children and Adults With Special Needs Monica

5/9/14 Nutri,on for Children and Adults With Special Needs Monica Andis, MS, RD, LD May , 2014 Contact Info Monica Andis, MS, RD, LD

786 views • 31 slides
Swarm Robotics Lecturer: Roderich Gross Companion slides for the book Bio-Inspired Artificial

Swarm Robotics Lecturer: Roderich Gross Companion slides for the book Bio-Inspired Artificial

Swarm Robotics Lecturer: Roderich Gross Companion slides for the book Bio-Inspired Artificial Intelligence: Theories, 1 Methods, and Technologies by Dario Floreano and Claudio Mattiussi, MIT Press Outline Why swarm robotics? Example domains:

1.08k views • 39 slides
Bio iologica logical l Anthropo ropolog logy Amy Non Margaret Schoeninger Shirley

Bio iologica logical l Anthropo ropolog logy Amy Non Margaret Schoeninger Shirley

Bio iologica logical l Anthropo ropolog logy Amy Non Margaret Schoeninger Shirley Strum Katerina Semendeferi Marni LaFleur Amy Non, PhD, MPH Assistant Professor of Anthropology Just arrived at UCSD (Fall 2015) Courses

658 views • 41 slides
How do small firms respond to tax schedule discontinuities? Evidence from South African tax data

How do small firms respond to tax schedule discontinuities? Evidence from South African tax data

How do small firms respond to tax schedule discontinuities? Evidence from South African tax data Wian Boonzaaier, Jarkko Harju, Tuomas Matikka and Jukka Pirttil National Treasury, VATT Institute for Economic Research, UNU-WIDER National

259 views • 5 slides
Writing and Understanding C++ Writing programs in any language requires understanding the

Writing and Understanding C++ Writing programs in any language requires understanding the

Writing and Understanding C++ Writing programs in any language requires understanding the syntax and semantics of the programming language as well as language-independent skills in programming. Syntax is similar to rules of spelling and

552 views • 18 slides
230B: Public Economics Tax Enforcement Emmanuel Saez Berkeley 1 Tax Enforcement Problem Most

230B: Public Economics Tax Enforcement Emmanuel Saez Berkeley 1 Tax Enforcement Problem Most

230B: Public Economics Tax Enforcement Emmanuel Saez Berkeley 1 Tax Enforcement Problem Most models of optimal taxation (income or commodity) as- sume away enforcement issues. In practice: 1) Enforcement is costly (eats up around 10% of

889 views • 55 slides
The essentials of a cryoEM lab What do you need and what can you borrow? How do you assess a new

The essentials of a cryoEM lab What do you need and what can you borrow? How do you assess a new

The essentials of a cryoEM lab What do you need and what can you borrow? How do you assess a new specimen? How do you service your equipment? How do you validate your equipment? Joaquin Ortega Department of Anatomy and Cell Biology NRAMM

474 views • 21 slides

More recommend