Chubby (OSDI 06) strong consistency, by Google Problem everyone - PowerPoint PPT Presentation

Sep 22, 2023 •309 likes •419 views

Chubby (OSDI 06) strong consistency, by Google Problem everyone needs consistency Paxos isnt the right abstraction (?) Solution distributed lock manager & filesystem Lock API Acquire, Release sequencer operations File API

Chubby (OSDI ‘06) strong consistency, by Google
Problem • everyone needs consistency • Paxos isn’t the right abstraction (?)
Solution distributed lock manager & filesystem
Lock API • Acquire, Release • sequencer operations
File API • Open, Close • Create, Delete • GetContentsAndStat • SetContents, SetACL • event notifications
Sessions • problem : clients can crash while holding locks • solution : locks get leases, too! • KeepAlive
Internal Architecture • quorum of five replicas • master elected with lease • database log replicated via consensus
Safety • crashes • communication delays • limited clock drift
Failover • master fails to be reelected, lease expires • new master gathers state from clients before servicing requests • grace period freezes clients
Handles Sequencers API Use Cases

Download Presentation

Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

BigTable Doug Woos Logistics notes Problem Set 3 due Chubby Discussion Most errors in failover

BigTable Doug Woos Logistics notes Problem Set 3 due Chubby Discussion Most errors in failover code - Netflix: Chaos Monkey Chubby metadata stored in Chubby itself Advisory vs. Mandatory locks Importance of programmer convenience -

935 views • 36 slides

Lecture: Google Chubby lock service ZooKeeper

Lecture: Google Chubby lock service ZooKeeper h#p://research.google.com/archive/chubby.html i am your father ! 10/15/2014 Romain Jaco7n romain.jaco9n@orange.fr Chub

776 views • 42 slides

Chubby Doug Woos Logistics notes Lab 3a due tonight Fridays class is in GWN 201! Next few

Chubby Doug Woos Logistics notes Lab 3a due tonight Fridays class is in GWN 201! Next few papers Three real-world systems from Google Chubby: coordination service BigTable: storage for structured data GFS: storage for bulk data All

1.22k views • 34 slides

The Google Storage Stack (Chubby, GFS, BigTable) Dan Ports, CSEP 552 Today Three

The Google Storage Stack (Chubby, GFS, BigTable) Dan Ports, CSEP 552 Today Three real-world systems from Google GFS: large-scale storage for bulk data BigTable: scalable storage of structured data Chubby: coordination to

821 views • 57 slides

Citrin Deficiency- The chubby baby story Fiona Carragher, Biochemical Sciences GSTS

Citrin Deficiency- The chubby baby story Fiona Carragher, Biochemical Sciences GSTS Pathology, St Thomas Hospital London Citrin Deficiency First described in Japan/East Asia Now increasingly recognised worldwide Mutations in

466 views • 17 slides

Procurement Process and OSDI Integration Commissioner Overview May 20, 2020 1 Agenda

Procurement Process and OSDI Integration Commissioner Overview May 20, 2020 1 Agenda Governance How do we buy? Exemptions from competition Types of solicitations and contracts and award process Approval thresholds Option

359 views • 20 slides

Automated Concurrency-Bug Fixing Guoliang Jin, Wei Zhang, Dongdong Deng, Den Libit, Shan Lu (OSDI

Automated Concurrency-Bug Fixing Guoliang Jin, Wei Zhang, Dongdong Deng, Den Libit, Shan Lu (OSDI 2012) Presented by: Kevin Burns October 2, 2013 Outline Paper Presentation Background/Motivation CFix Overview Bug Understanding Fix Strategy

347 views • 24 slides

Proving Confidentiality in a File System Using DiskSec (Poster #2) OSDI 18 Atalay Mert

Proving Confidentiality in a File System Using DiskSec (Poster #2) OSDI 18 Atalay Mert leri, Tej Chajed, Adam Chlipala, Frans Kaashoek, Nickolai Zeldovich MIT CSAIL Storage Systems Contain Confidential Data Users rely on the storage

796 views • 24 slides

Big Table A Distributed Storage System For Data OSDI 2006 Fay Chang, Jeffrey Dean, Sanjay

Big Table A Distributed Storage System For Data OSDI 2006 Fay Chang, Jeffrey Dean, Sanjay Ghemawat et.al. Presented by Rahul Malviya Why BigTable ? Lots of (semi-)structured data at Google - - URLs: Contents, crawl metadata(when,

611 views • 41 slides

GraphX : Graph Processing in a Distributed Dataflow Framework OSDI 2014 Bidyut Hota Agenda

GraphX : Graph Processing in a Distributed Dataflow Framework OSDI 2014 Bidyut Hota Agenda Analytics space background Motivation Goal Approach Optimizations Results Flaws/Limitations Questions Real life Analytics

555 views • 24 slides

project Chubby cats homemade cat food CRITERION A investigating a prequel to the madness Our

presenting community project Chubby cats homemade cat food CRITERION A investigating a prequel to the madness Our environment is filled Our environment is filled with stray cats, and we with stray cats, and we wanted to help them by

740 views • 33 slides

Making Byzantine Fault Tolerant Systems Tolerate Byzantine Failures Allen Clement, Mirco

Making Byzantine Fault Tolerant Systems Tolerate Byzantine Failures Allen Clement, Mirco Marchetti, Edmund Wong Lorenzo Alvisi, Mike Dahlin BFT Systems PBFT [OSDI 98] Attested Append Only Memory [SOSP 07] HQ [OSDI 06] Beyond 1/3 Faulty in

655 views • 64 slides

MapReduce: Simplified Data Processing on Large Clusters J. Dean, S. Ghemawat, OSDI, 2004. Review

MapReduce: Simplified Data Processing on Large Clusters J. Dean, S. Ghemawat, OSDI, 2004. Review by Mariana Marasoiu for R212 Motivation: Large scale data processing We want to: Extract data from large datasets Run on big clusters of

455 views • 22 slides

Thoughts and proposals for more components and flexibility in the VuFind 2/3 architecture based

Fourth VuFind user meeting in Constance, Germany, October 7th, 2015 Have we become a little chubby around the waist? The Potsdam potato http://www.spektrum.de/news/um-die-hueften-fuelliger/600896 Thoughts and proposals for more

404 views • 26 slides

1 Execution Implementation Overview Master notifies reducers about Focuses on large

MapReduce Jeffrey Dean and Sanjay Ghemawat. MapReduce: Simplified Data Processing on Large Clusters. MapReduce and SQL Injections OSDI'04: Sixth Symposium on Operating System Design and Implementation, San Francisco, CA, December, 2004 CS

383 views • 5 slides

GFS Doug Woos (based on slides from Tom Anderson and Dan Ports) Logistics notes Lab 3b due

GFS Doug Woos (based on slides from Tom Anderson and Dan Ports) Logistics notes Lab 3b due Wednesday Discussion grades trickling out Outline Last time: Chubby: coordination service BigTable: scalable storage of structured data

676 views • 25 slides

Beyond Peter Bailis and Ali Ghodsi, UC Berkeley - Nomchin Banga Outline Eventual

Eventual Consistency Today: Limitations, Extensions and Beyond Peter Bailis and Ali Ghodsi, UC Berkeley - Nomchin Banga Outline Eventual Consistency: History and Concepts How eventual is eventual consistency? Programming eventual

734 views • 21 slides

File Systems: All data structures are cached for better performance Create a new file

File Systems: Consistency Issues What about Multiple Updates? File systems maintain many data structures Several file system operations update multiple data structures Free list/bit vector Directories Examples: File headers and inode

257 views • 3 slides

S AFETY , L IVENESS , AND C ONSISTENCY How Do We Specify Distributed Systems? Execution: Sequence

S AFETY , L IVENESS , AND C ONSISTENCY How Do We Specify Distributed Systems? Execution: Sequence of events (i.e., steps taken by the system), potentially infinite. Property: A predicate on executions. Safety property: Specifies the "bad

860 views • 36 slides

Large-Scale Key-Value Stores Eventual Consistency Marco Serafini COMPSCI 532 Lecture 15/16

Large-Scale Key-Value Stores Eventual Consistency Marco Serafini COMPSCI 532 Lecture 15/16 Consistent Hashing 2 Consistent Hashing Each node has a membership set M When a node needs to access a key It hashes the IDs of the

307 views • 15 slides

THREE FLAVORS OF PREDICTIONS IN ONLINE ALGORITHMS Manish Purohit Joint work with Ravi Kumar,

THROUGH THE LENS OF SKI RENTAL THREE FLAVORS OF PREDICTIONS IN ONLINE ALGORITHMS Manish Purohit Joint work with Ravi Kumar, Zoya Svitkina, and Erik Vee OUTLINE Motivation Ski Rental Problem The Fortune Cookie The Weatherman

641 views • 32 slides

Dynamic Consistency Analysis for Convergent Operators Alva L. Couch and Marc Chiarini Tufts

Dynamic Consistency Analysis for Convergent Operators Alva L. Couch and Marc Chiarini Tufts University {couch,mchiar01}@cs.tufts.edu Overview Background Fixed-point operations Emergent consistency Practical considerations

488 views • 25 slides

Memory Consistency Exceptions 18742-Computer Architecture and Systems Nithin, Deepali Garg

Overview Conflict Exceptions DRFx Memory Consistency Exceptions 18742-Computer Architecture and Systems Nithin, Deepali Garg Electrical and Computer Engineering Carnegie Mellon University February 18, 2020 Nithin, Deepali Garg CMU Memory

1.04k views • 20 slides

JUST THE MATHS SLIDES NUMBER 7.2 DETERMINANTS 2 (Consistency and third order

JUST THE MATHS SLIDES NUMBER 7.2 DETERMINANTS 2 (Consistency and third order determinants) by A.J.Hobson 7.2.1 Consistency for three simultaneous linear equations in two unknowns 7.2.2 The definition of a third order determinant

584 views • 16 slides