Mesos: A Platform for Fine-Grained Resource Sharing in the Data - - PowerPoint PPT Presentation

mesos a platform for fine grained resource sharing in the
SMART_READER_LITE
LIVE PREVIEW

Mesos: A Platform for Fine-Grained Resource Sharing in the Data - - PowerPoint PPT Presentation

Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center Benjamin Hindman, Andy Konwinski, Matei Zaharia, Ali Ghodsi, Anthony D. Joseph, Randy Katz, Scott Shenker, Ion Stoica University of California, Berkeley Thomas Marshall


slide-1
SLIDE 1

Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center

Benjamin Hindman, Andy Konwinski, Matei Zaharia, Ali Ghodsi, Anthony D. Joseph, Randy Katz, Scott Shenker, Ion Stoica University of California, Berkeley Thomas Marshall

slide-2
SLIDE 2

Motivation

  • Lots of distributed frameworks

(Hadoop, Giraph, MPI, etc.)

  • Each manages its cluster
  • Hard to share resources
slide-3
SLIDE 3

Architecture

[1] B. Hindman, A. Konwinski, M. Zaharia, A. Ghodsi, A. D. Joseph, R. H. Katz, S. Shenker, and I. Stoica. Mesos: A platform for fine-grained resource sharing in the data center. Technical Report UCB/EECS-2010-87, EECS Department, University of California, Berkeley, May 2010.

slide-4
SLIDE 4

Scheduling

  • Scalability
  • Diverse resource requirements
slide-5
SLIDE 5

Scheduling

  • Scalability
  • Diverse resource requirements
  • Solution: 2 level scheduling via offers