Sudipto Das, Divy Agrawal, Amr El Abbadi Department of Computer - - PowerPoint PPT Presentation

sudipto das divy agrawal amr el abbadi
SMART_READER_LITE
LIVE PREVIEW

Sudipto Das, Divy Agrawal, Amr El Abbadi Department of Computer - - PowerPoint PPT Presentation

Sudipto Das, Divy Agrawal, Amr El Abbadi Department of Computer Science University of California at Santa Barbara ElasTraS: An Elastic Transactional Data Store in the Cloud Paradigm Shift in Computing 6/30/09 ElasTraS: An Elastic Transactional


slide-1
SLIDE 1

Sudipto Das, Divy Agrawal, Amr El Abbadi

Department of Computer Science University of California at Santa Barbara

slide-2
SLIDE 2

ElasTraS: An Elastic Transactional Data Store in the Cloud

Paradigm Shift in Computing

6/30/09

slide-3
SLIDE 3

ElasTraS: An Elastic Transactional Data Store in the Cloud

Cloud Computing

  • Software as a Service (SaaS)
  • Platform as a Service (PaaS)
  • Infrastructure as a Service (IaaS)
  • Utility Computing: pay‐as‐you‐go computing

 No up‐front cost  Elasticity and illusion of infinite resources  Transfer of risks

  • Scalable and Elastic infrastructure for hosting

applications and services

6/30/09

slide-4
SLIDE 4

ElasTraS: An Elastic Transactional Data Store in the Cloud

Typical Software Stack

6/30/09

Client Site Load Balancer Web Server/ Applica6on Server DB Server

slide-5
SLIDE 5

ElasTraS: An Elastic Transactional Data Store in the Cloud

Apache + App Server Apache + App Server Apache + App Server

Scaling in the Cloud

6/30/09

HAProxy (Load Balancer) Apache + App Server MySQL Master DB MySQL Slave DB

Replica(on Elas(c IP Client Site

Database becomes the Scalability Bottleneck Cannot leverage elasticity

Apache + App Server

Client Site Client Site

slide-6
SLIDE 6

ElasTraS: An Elastic Transactional Data Store in the Cloud

Apache + App Server Apache + App Server Apache + App Server

Scaling in the Cloud

6/30/09

HAProxy (Load Balancer) Apache + App Server MySQL Master DB MySQL Slave DB

Replica(on Elas(c IP Client Site

Apache + App Server

Client Site Client Site

slide-7
SLIDE 7

ElasTraS: An Elastic Transactional Data Store in the Cloud

Key Value Stores

Apache + App Server Apache + App Server Apache + App Server

Scaling in the Cloud

6/30/09

HAProxy (Load Balancer) Apache + App Server

Elas(c IP Client Site

Apache + App Server

Client Site Client Site

Scalable and Elastic But minimal consistency and

  • perational flexibility
slide-8
SLIDE 8

ElasTraS: An Elastic Transactional Data Store in the Cloud

Key Value Stores

Apache + App Server Apache + App Server Apache + App Server

Scaling in the Cloud

6/30/09

HAProxy (Load Balancer) Apache + App Server

Elas(c IP Client Site

Apache + App Server

Client Site Client Site

slide-9
SLIDE 9

ElasTraS: An Elastic Transactional Data Store in the Cloud

Apache + App Server Apache + App Server Apache + App Server

Scaling in the Cloud

6/30/09

HAProxy (Load Balancer) Apache + App Server

Elas(c IP Client Site

Apache + App Server

Client Site Client Site

ElasTraS

Better Scalability than Databases Higher Consistency than Key Value stores

slide-10
SLIDE 10

ElasTraS: An Elastic Transactional Data Store in the Cloud

ElasTraS

  • Is it yet another Distributed Database?
  • ……
  • It’s a Lightweight Distributed Data Store
  • Scalable design principles borrowed from

Bigtable

  • Transaction Management & Failure Recovery

borrowed from Databases

  • An Elastic and Scalable Transactional Store

6/30/09

slide-11
SLIDE 11

OTM1 Distributed Storage (S3) OTM2 OTMn Owning TM

Raw Storage

6/30/09

  • Exclusive access rights to database partitions
  • Executes client transactions for the partitions it
  • wns
  • Aggressive caching of partitions locally
  • No interaction across OTMs
  • Interacts with Metadata Manager for obtaining

leases

slide-12
SLIDE 12

OTM1

Metadata Manager and Master

Distributed Storage (S3) OTM2 OTMn Owning TM

Raw Storage

6/30/09

  • Heart and Brain of the system
  • Distributed lease management for the partitions
  • Maintaining persistent mapping of partitions to
  • wning transaction managers
  • Monitoring the health of the system
  • Synchronous replication of metadata for fault‐

tolerance

slide-13
SLIDE 13

HTM1 HTM2 HTMm OTM1

Metadata Manager and Master

Distributed Storage (S3) OTM2 OTMn Owning TM

Raw Storage

6/30/09

  • Absorb read only query workload

 Cache partial database contents  Answer queries from the database cache

  • Read‐only access to the entire database
  • No state associated with an HTM
  • Acts as coordinator for execution of

minitransactions

slide-14
SLIDE 14

Load Balancer for DB Server

Applica.on and Web Servers

HTM1 HTM2 HTMm OTM1

Metadata Manager and Master

Distributed Storage (S3) OTM2 OTMn Higher level TM Owning TM

Raw Storage

6/30/09

slide-15
SLIDE 15

ElasTraS: An Elastic Transactional Data Store in the Cloud

Digging into ElasTras

  • Partitioned database
  • Can be configured for static as well as dynamic

partitioning

  • Limited transactional semantics
  • Support for minitransactions [Sinfonia]

6/30/09

slide-16
SLIDE 16

ElasTraS: An Elastic Transactional Data Store in the Cloud

Design Principles

  • Segregate System metadata from Application

Specific data

 Different semantics – different requirements

  • Limit Application Interaction to Single physical

machine

 Restricted transactional semantics

  • Limited Distributed synchronization is practical

 Synchronous replication and Distributed consensus

for consistent and fault tolerant storage of meta data

6/30/09

slide-17
SLIDE 17

ElasTraS: An Elastic Transactional Data Store in the Cloud

Concluding Remarks

  • Easy transition of partitioned Enterprise

database systems into the cloud

  • Flexible schema for supporting a wide variety of

applications

  • Static Partitioning: Can support transactions

limited to partitions

  • Dynamic Partitioning: Can support only

minitransactions

  • Elasticity through partitioning

6/30/09

slide-18
SLIDE 18

6/30/09