Mesos: A Platform for Fine-Grained Resource Sharing in the Data - PowerPoint PPT Presentation

Jan 16, 2024 •329 likes •397 views

Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center Benjamin Hindman, Andy Konwinski, Matei Zaharia, Ali Ghodsi, Anthony D. Joseph, Randy Katz, Scott Shenker, Ion Stoica University of California, Berkeley Thomas Marshall

Mesos: A Platform for Fine-Grained Resource Sharing in the Data Center Benjamin Hindman, Andy Konwinski, Matei Zaharia, Ali Ghodsi, Anthony D. Joseph, Randy Katz, Scott Shenker, Ion Stoica University of California, Berkeley Thomas Marshall
Motivation ● Lots of distributed frameworks (Hadoop, Giraph, MPI, etc.) ● Each manages its cluster ● Hard to share resources
Architecture [1] B. Hindman, A. Konwinski, M. Zaharia, A. Ghodsi, A. D. Joseph, R. H. Katz, S. Shenker, and I. Stoica. Mesos: A platform for fine-grained resource sharing in the data center. Technical Report UCB/EECS-2010-87, EECS Department, University of California, Berkeley, May 2010.
Scheduling ● Scalability ● Diverse resource requirements
Scheduling ● Scalability ● Diverse resource requirements ● Solution: 2 level scheduling via offers

Download Presentation

Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Mesos A Platform for Fine-Grained Resource Sharing in the

Mesos A Platform for Fine-Grained Resource Sharing in the Data Center Benjamin Hindman, Andy Konwinski, Matei Zaharia , Ali Ghodsi, Anthony Joseph,

438 views • 32 slides

Resource Availability Prediction in Fine-Grained Cycle Sharing Systems Xiaojuan Ren, Seyong Lee,

Resource Availability Prediction in Fine-Grained Cycle Sharing Systems Xiaojuan Ren, Seyong Lee, Rudolf Eigenmann, Saurabh Bagchi School of ECE, Purdue University Presented by: Saurabh Bagchi Work supported by National Science Foundation

480 views • 17 slides

Mesos Problem Different applications need different frameworks How can we share a cluster

Mesos Problem Different applications need different frameworks How can we share a cluster among multiple frameworks? Statically partitioning the cluster Centralized task scheduler Key ideas Fine-grained sharing Key ideas

205 views • 18 slides

FIRM: An Intelligent Fine-grained Resource Management Framework for SLO-oriented Microservices

FIRM: An Intelligent Fine-grained Resource Management Framework for SLO-oriented Microservices Haoran Qiu* , Subho S. Banerjee, Saurabh Jha, Zbigniew T. Kalbarczyk, Ravishankar K. Iyer DEPEND Research Group University of Illinois at

477 views • 18 slides

Salus Fine-grained GPU Sharing Primitives for Deep Learning Applications Advisor: Mosharaf

Salus Fine-grained GPU Sharing Primitives for Deep Learning Applications Advisor: Mosharaf Chowdhury 2020-03-03 By Peifeng Yu Deep Learning Becomes Ubiquitous Computer vision Natural language processing Speech Robotics

1.11k views • 33 slides

Fine-Grained Geographic Communication (Geocast) Nexus Workshop Frank Drr 23.07.2003 1

Fine-Grained Geographic Communication (Geocast) Nexus Workshop Frank Drr 23.07.2003 1 Overview Motivation Requirements for Fine-Grained Geocast Location Model for Fine-Grained Geographic Addressing Summary Related Work

752 views • 18 slides

Mechanized Verification of Fine-grained Concurrent Programs Ilya Sergey Aleks Nanevski

Mechanized Verification of Fine-grained Concurrent Programs Ilya Sergey Aleks Nanevski Anindya Banerjee PLDI 2015 Terminology Coarse-grained Concurrency synchronisation between threads via locks ; Fine-grained

973 views • 72 slides

ConScript Specifying and Enforcing Fine-Grained Security Policies for JavaScript in the Browser

ConScript Specifying and Enforcing Fine-Grained Security Policies for JavaScript in the Browser Leo Meyerovich Benjamin Livshits UC Berkeley Microsoft Research Web Programmability Platform openid.net yelp.com adsense.com Google maps 2

727 views • 41 slides

Parts of Speech More Fine-Grained Classes More

Parts of Speech More Fine-Grained Classes More Fine-Grained Classes Actually , I ran home extremely quickly yesterday The closed classes Example of POS tagging The Penn Treebank Part-of-Speech

747 views • 54 slides

Fine Grained Access Control Fine-Grained Access Control Fine Grained Access Control

Fine Grained Access Control Fine-Grained Access Control Fine Grained Access Control Fine-grained access control examples: p g Students can see their own grades Students can see grades of all students in courses they registered for

548 views • 34 slides

Fine-grained Visual Analysis: From Classification to Retrieval Yi-Zhe Song SketchX Lab, CVSSP,

Fine-grained Visual Analysis: From Classification to Retrieval Yi-Zhe Song SketchX Lab, CVSSP, University of Surrey, UK http://sketchx.ai Why fine-grained? Dog Dog Dog I am not just a dog Why fine-grained? Husky

615 views • 24 slides

Timely Fine-Grained Scheduling Tatiana Jin, Zhenkun Cai, Boyang Li, Chenguang Zheng, Guanxian

Improving Resource Utilization by Timely Fine-Grained Scheduling Tatiana Jin, Zhenkun Cai, Boyang Li, Chenguang Zheng, Guanxian Jiang, James Cheng Department of Computer Science and Engineering The Chinese University of Hong Kong Core Problem

656 views • 30 slides

APACHE COTTON MySQL on Mesos Yan Xu xujyan 1 SHORT HISTORY Mesos: cornerstone of

APACHE COTTON MySQL on Mesos Yan Xu xujyan 1 SHORT HISTORY Mesos: cornerstone of Twitters compute platform. MySQL: backbone of Twitters data platform. Mysos: started as a hackweek project @twitter. Apache Cotton:

686 views • 35 slides

Fine-grained Image Recognition Lei Wang VILA group School of Computing and Information

Learning Kernel-matrix-based Representation for Fine-grained Image Recognition Lei Wang VILA group School of Computing and Information Technology University of Wollongong, Australia 11-Dec-2019 Introduction Fine-grained image recognition

1.56k views • 58 slides

TRILL Fine Grained Labeling Donald Eastlake 3 rd Huawei

TRILL Fine Grained Labeling Donald Eastlake 3 rd Huawei Technologies d3e3e3@gmail.com November 2011 TRILL WG 1 Fine Grained Labeling A way to

469 views • 8 slides

Addressing Inter-Class Similarity in Fine-Grained Visual Classification Abhimanyu Dubey

Addressing Inter-Class Similarity in Fine-Grained Visual Classification Abhimanyu Dubey Collaborators: Nikhil Naik, Ryan Farrell, Otkrist Gupta, Pei Guo, Ramesh Raskar Fine-Grained Visual Classification - Image classification with target

760 views • 35 slides

Board of Education Meeting April 22, 2013 The BIG Picture 21 st Century Teaching Safe, Secure

Board of Education Meeting April 22, 2013 The BIG Picture 21 st Century Teaching Safe, Secure and Inviting Schools and Learning Moving West Clermont Forward Communication Financial Stability $5.2 million deficit at the end of 2014

469 views • 15 slides

Citizens Advisory Committee October 15, 2020 Agenda I. Opening Remarks (5 minutes) II.

Cupertino Union School District Citizens Advisory Committee October 15, 2020 Agenda I. Opening Remarks (5 minutes) II. Affirmations and Charge (5 minutes) III. Groups Present Updated Scenarios (15 min per group) Highlight Modifications A.

406 views • 13 slides

Readings in Digital Financial Services Richard Anderson Ruth Anderson Topic Overview Improved

CSE 490D, Winter 2016 Readings in Digital Financial Services Richard Anderson Ruth Anderson Topic Overview Improved access to financial services is recognized as an important mechanism for raising people out of poverty Financial Services

387 views • 10 slides

TDDB68/TDDE47 Lesson 1 Felipe Boeira Based on previous slides from the course Contents

TDDB68/TDDE47 Lesson 1 Felipe Boeira Based on previous slides from the course Contents Overview of the labs General information about Pintos System calls Lab 0/Lab 1 details Debugging Administration Webreg: If you still

1.16k views • 30 slides

Reversing an ArrayList readIntArrayList() /* Reads the data into the list */ import

Student Responsibilities Mat 2170 Week 14 Reading: Textbook, Chapter 11 ArrayList Lab: ArrayList, input files, bar chart Attendance Spring 2008 1 2 The ArrayList Class ArrayList Methods The java.util package includes a class

203 views • 3 slides

Linked Lists first: 3 first: 4 first: 5 first: 3 first: 4 first: 5 rest: rest: rest:

Linked List Structure Linked List Structure A linked list is either empty or a first value and the rest of the linked list A linked list is either empty or a first value and the rest of the linked list A linked list A class attribute represents

61 views • 4 slides

Introduction to Unification Theory Matching Temur Kutsia RISC, Johannes Kepler University of

Introduction to Unification Theory Matching Temur Kutsia RISC, Johannes Kepler University of Linz, Austria kutsia@risc.jku.at Overview Syntactic Matching Advanced Topics Overview Syntactic Matching Advanced Topics Matching Problem

1.85k views • 141 slides

DIGITAL TELEVISION: DIGITAL TELEVISION: FIRST GENERATION FIRST GENERATION Fernando Pereira

DIGITAL TELEVISION: DIGITAL TELEVISION: FIRST GENERATION FIRST GENERATION Fernando Pereira Instituto Superior Tcnico Audio and Video Communication, Fernando Pereira, 2014/2015 The Analogue TV World The Analogue TV World The Analogue TV

1.67k views • 165 slides