Mero: Co-Designing an Object Store for Extreme Scale Presented at - PowerPoint PPT Presentation

Aug 29, 2023 •314 likes •391 views

Mero: Co-Designing an Object Store for Extreme Scale Presented at PDSW2016(SC16) Presented by Sai Narasimhamurthy Co-authors: Nikita Danilov, Nathan Rutman [All Seagate] John Bent[Seagate Government Solutions] Storage Software for BDEC

Mero: Co-Designing an Object Store for Extreme Scale Presented at PDSW’2016(SC’16) Presented by Sai Narasimhamurthy Co-authors: Nikita Danilov, Nathan Rutman [All Seagate] John Bent[Seagate Government Solutions]
Storage Software for BDEC Big (Massive!) Exascale Data Analysis Computing Exascale Data Centric Computing ( B ig D ata E xtreme C omputing, or BDEC ) Mero: Object Storage Software  Build from the ground up to cater to BDEC  Involved co-design with the community 23/6/2015 2
Mero Simplicity
Mero Co-Design Timeline
Mero Resulting Architecture
Everything you’d expect in an Exascale Object Store ..PLUS Complex Layouts PGAS and MPI One sided Comms Expect More! Peer-Peer Caching Analytics In-Storage Compute Event Log Subscription & Diagnostics
Ongoing Work & Next Steps http://www.seagate.com/files/www-content/product-content/xyratex-branded/clustered-file- systems/_shared/datasheets/seagate-clusterstor-a200-datasheet.pdf http://sagestorage.eu/ http://www.sagestorage.eu/content/public-deliverables 7

Download Presentation

Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

The Samuel realcompactification Ana S. Mero no Universidad Complutense de Madrid Joint work

The Samuel realcompactification Ana S. Mero no Universidad Complutense de Madrid Joint work with Prof. M. Isabel Garrido Ana S. Mero no The Samuel realcompactification Introduction. In this talk we will introduce a realcompactification

456 views • 30 slides

CREST Research in Dynamic Adaptive Methods for Extreme Scale Computation Thomas Sterling

SOIC/ISE Colloquium Series: Big Data and Big Simulation CREST Research in Dynamic Adaptive Methods for Extreme Scale Computation Thomas Sterling Professor of Electrical Engineering Director, Center for Research in Extreme Scale Technologies

605 views • 35 slides

Vectors Vectors are homogeneous collections with random access Store the same type/class of

Vectors Vectors are homogeneous collections with random access Store the same type/class of object, e.g., int, string, The 1000 th object in a vector can be accessed just as quickly as the 2 nd object Weve used files to store

902 views • 28 slides

Scale Confusion What is Scale? Scale is the size of an object in relation to other objects. What

Scale Confusion What is Scale? Scale is the size of an object in relation to other objects. What Proportion Proportion refers to the relative size of parts of a whole (elements within an object).

313 views • 9 slides

Hierarchical Locality and Parallel Programming in the Extreme Scale Era Tarek El-Ghazawi The

Hierarchical Locality and Parallel Programming in the Extreme Scale Era Tarek El-Ghazawi The George Washington University University of Southern California September 29, 2016 Overview Fundamental Challenges for Extreme Computing

899 views • 52 slides

Designing and building a distributed data store in Go 3 February 2018 Matt Bostock Who am I?

Designing and building a distributed data store in Go 3 February 2018 Matt Bostock Who am I? Platform Engineer working for Cloudare in London. Interested in distributed systems and performance. Bulding and designing a distributed data

841 views • 68 slides

Ceph: An Open Source Object Store Evan Harvey Gustavo Rayos Nick Schuchhardt Mentors: David

Ceph: An Open Source Object Store Evan Harvey Gustavo Rayos Nick Schuchhardt Mentors: David Bonnie, Chris Hoffman, Dominic Manno LA-UR-15-25907 1 What is an Object Store? Manages data as objects Offers

511 views • 28 slides

Use of a New I/O Stack for Extreme-scale Systems in

The HDF Group Use of a New I/O Stack for Extreme-scale Systems in Scientific Applications Michael Breitenfeld, Neil Fortner, Jerome Soumagne The HDF Group

414 views • 13 slides

Accessibility is extreme usability. Designing accessible apps is the most extreme form of

Outline Administration Accessibility App distribution Preview Outline Administration Accessibility App distribution Preview Accessibility is extreme usability. Designing accessible apps is the most extreme form of Enterprise Computing:

452 views • 6 slides

JST-CREST Extreme Big Data Project (2013-2018) Future Non-Silo Extreme Big Data Scientific

JST-CREST Extreme Big Data Project (2013-2018) Future Non-Silo Extreme Big Data Scientific Apps Ultra Large Scale Massive Sensors and Graphs and Social Large Scale Data Assimilation in Issues

548 views • 17 slides

Designing Object Designing Object- -Oriented Oriented Prerequisites: Prerequisites:

Course Syllabus Course Syllabus Credits: 5 cp (3 cu) Credits: 5 cp (3 cu) Designing Object Designing Object- -Oriented Oriented Prerequisites: Prerequisites: Software Software Ohjelmointi II [Programming II]

235 views • 5 slides

Synergistic Challenges in Data-Intensive Science and Extreme Scale Computing Vivek Sarkar

Synergistic Challenges in Data-Intensive Science and Extreme Scale Computing Vivek Sarkar Department of Computer Science Rice University vsarkar@rice.edu NSF workshop on Big Data and Extreme-scale Computing (BDEC) April 30 - May 1, 2013

289 views • 28 slides

Extreme-scale Computing Global Knowledge without Global Communication Dr. Giuse seppe pe Di Fa

Invited Talk: Epidemic Protocols for Extreme-scale Computing Global Knowledge without Global Communication Dr. Giuse seppe pe Di Fa Fatta ta G.DiFatta@reading.ac.uk Wednesday, September 24, 2014 Outline e X tre reme-sca scale le

918 views • 67 slides

Extreme Weather at the Watershed Scale: How to Protect Water Quality Shreeram Inamdar, University

Extreme Weather at the Watershed Scale: How to Protect Water Quality Shreeram Inamdar, University of Delaware Key Premise LARGE EXPORTS OF Extreme Human Landuse NUTRIENTS & weather events, Change current & POLLUTANTS particularly

1.26k views • 38 slides

Designing data types Fundamentals of Computer Science I 2 Overview Object Oriented

Designing data types Fundamentals of Computer Science I 2 Overview Object Oriented Programming (OOP) Data encapsulation Important consideration when designing a class Access modifiers Getters and setters Immutability,

399 views • 23 slides

Analytics for Object Storage Simplified - Unified File and Object for Hadoop Sandeep R Patil

Analytics for Object Storage Simplified - Unified File and Object for Hadoop Sandeep R Patil STSM, Master Inventor, IBM Spectrum Scale Smita Raut Object Development Lead, IBM Spectrum Scale Acknowledgement : Bill Owen, Tomer Perry, Dean

630 views • 25 slides

Hi good morning! Welcome to Building Community. I'm Ross or as some people online refer to me as

Hi good morning! Welcome to Building Community. I'm Ross or as some people online refer to me as the Pony. About me, I Started at Ping Identity in 2012, and was thrown into the deep end with this new tool my boss had bought called Casper, now

429 views • 21 slides

EPORTFOLIO CHAMPION & VIDEO CV COMPETITION - Towards UTM Life -Ready Graduate -

PEJABAT PENGAJIAN PRASISWAZAH Office of Undergraduate Studies 19 NOVEMBER 2019 (TUESDAY) EPORTFOLIO CHAMPION & VIDEO CV COMPETITION - Towards UTM Life -Ready Graduate - BRIEFING & WORKSHOP - MR. MOHD RASHID BIN ABD RAHUP

544 views • 22 slides

Clinical champion for digital change reflection on 30 years HIC 2017 Dr Richard Ashby Chief

Clinical champion for digital change reflection on 30 years HIC 2017 Dr Richard Ashby Chief Executive / Chief Information Officer eHealth Queensland Follow us on Twitter @eHealthQLD 1 First there was the green screen 1980s Queensland

512 views • 25 slides

Safety Craig Parker, President, Silver Star Construction Co Moore, OK Past Chairman, NAPA

Safety Craig Parker, President, Silver Star Construction Co Moore, OK Past Chairman, NAPA Safety is a Culture We have to Create and Sustain a Culture of Safety within our Company Why me Why you It takes everyone in the company to

169 views • 13 slides

IN4080 2020 FALL NATURAL LANGUAGE PROCESSING Jan Tore Lnning 2 IE: Relation extraction,

1 IN4080 2020 FALL NATURAL LANGUAGE PROCESSING Jan Tore Lnning 2 IE: Relation extraction, encoder-decoders Lecture 14, 16 Nov. Today 3 Information extraction: Relation extractions 5 ways Two words on syntax

876 views • 54 slides

The new battleground The secret to customer engagement and prospect engagement. Findings of a

The new battleground The secret to customer engagement and prospect engagement. Findings of a marketing study revealed James Skellington Strategic Automation Consultant Formerly with hair and of: Google Agencies Force24

371 views • 35 slides

Fundmentals 1 Our world is made of: Stories and gossip make up 65% of our daily conversations.

Help is at the door: Brand New Public Awareness tools for Home Visiting Programs Marketing is WO WORDS VI VISUAL SUALS STRATE STRATEGY GY Fundmentals 1 Our world is made of: Stories and gossip make up 65% of our daily

351 views • 14 slides

Research and Teaching Marketing Hanoi 30.05.2019 Overview 1. Introduction 2. Marking 2019

Research and Teaching Marketing Hanoi 30.05.2019 Overview 1. Introduction 2. Marking 2019 and beyond 3. Marketing education 4. Marketing research & publication 1. Introduction Leeds Beckett University Leeds Business

471 views • 33 slides