o ur s olution bstore o ur s olution bstore
play

O UR S OLUTION BSTORE O UR S OLUTION BSTORE Key ideas: Data - PowerPoint PPT Presentation

Feb 21, 2024 •429 likes •1.6k views

S EPARATING W EB A PPLICATIONS FROM U SER D ATA S TORAGE WITH BSTORE Ramesh Chandra Priya Gupta Nickolai Zeldovich MIT CSAIL M OTIVATING E XAMPLE Alice manages her photos online. M OTIVATING E XAMPLE Alice manages her photos online. Snaps

  1. T ALK O UTLINE  Motivation  Current solutions  BSTORE overview  Design details:  Filesystem API  FS organization with tags  Tag-based access control  Filesystem setup  Implementation  Evaluation  Related work

  2. F ILESYSTEM API  Each FS has a flat file structure  BSTORE FS API:  create(fs, init_tags) -> handle  set (handle, data) ->  get (handle) -> data  delete(handle) ->  Fits data model for most web apps

  3. V ERSIONING  All files are versioned  Most API calls return current version

  4. V ERSIONING  All files are versioned  Most API calls return current version  create(fs, init_tags) -> ver, handle  set (handle, data) -> ver  get (handle) -> ver, data  delete(handle) ->

  5. V ERSIONING  All files are versioned  Most API calls return current version  create(fs, init_tags) -> ver, handle  set (handle, data) -> ver  get (handle) -> ver, data  delete(handle) ->  set increments version number

  6. V ERSIONING  All files are versioned  Most API calls return current version  create(fs, init_tags) -> ver, handle  set (handle, data, [match_ver]) -> ver  get (handle) -> ver, data  delete(handle, [match_ver]) ->  set increments version number  Compare and swap-like functionality to detect concurrent modifications  set and delete fail if current ver != match_ver

  7. P RINCIPALS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS Shutterfly BACKEND SERVERS

  8. P RINCIPALS BROWSER redeye.com viewer.com sfly.com editor.com flickr.com fsmgr.com flickr.com Shutterfly BACKEND SERVERS

  9. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS Shutterfly

  10. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS Shutterfly

  11. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS Shutterfly paris newyork

  12. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS Shutterfly paris newyork print

  13. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS Shutterfly paris newyork print

  14. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS Shutterfly paris newyork print

  15. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS Shutterfly paris newyork print print

  16. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS flickr.com flickr.com Shutterfly #paris #newyork flickr.com viewer.com #print #print

  17. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor File Manager FS Manager flickr FS flickr.com flickr.com Shutterfly #paris #newyork flickr.com viewer.com #print #print

  18. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor File Manager FS Manager flickr FS flickr.com flickr.com Shutterfly #paris #newyork flickr.com viewer.com #print #print

  19. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor File Manager FS Manager flickr FS flickr.com flickr.com Shutterfly #paris #newyork flickr.com viewer.com #print #print fsmgr.com fsmgr.com #christmas #christmas

  20. FS O RGANIZATION WITH T AGS BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor Tags API File Manager FS Manager settag(handle, tag) -> ver rmtag (handle, tag) -> ver gettag(handle) -> ver, tag_list search(fs, tag_expr) -> handle_list flickr FS flickr.com flickr.com Shutterfly #paris #newyork flickr.com viewer.com #print #print fsmgr.com fsmgr.com #christmas #christmas

  21. A CCESS C ONTROL BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor File Manager FS Manager flickr FS Shutterfly viewer.com #print fsmgr.com fsmgr.com fsmgr.com #christmas #christmas #private

  22. A CCESS C ONTROL BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor File Manager FS Manager from to tags rights flickr FS Shutterfly viewer.com #print fsmgr.com fsmgr.com fsmgr.com #christmas #christmas #private

  23. A CCESS C ONTROL BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor File Manager FS Manager from to tags rights flickr FS Shutterfly viewer.com #print fsmgr.com fsmgr.com fsmgr.com #christmas #christmas #private

  24. A CCESS C ONTROL BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor File Manager FS Manager from to tags rights fsmgr.com viewer.com fsmgr.com read #christmas flickr FS Shutterfly viewer.com #print fsmgr.com fsmgr.com fsmgr.com #christmas #christmas #private

  25. A CCESS C ONTROL BROWSER SuperRedEye Photo Photo Photo Shutterfly Remover Viewer Viewer Editor File Manager FS Manager from to tags rights fsmgr.com viewer.com fsmgr.com read #christmas flickr FS Shutterfly viewer.com #print fsmgr.com fsmgr.com fsmgr.com #christmas #christmas #private

  26. A CCESS C ONTROL BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor File Manager FS Manager from to tags rights fsmgr.com viewer.com fsmgr.com read #christmas flickr FS Shutterfly viewer.com #print fsmgr.com fsmgr.com fsmgr.com #christmas #christmas #private

  27. A CCESS C ONTROL BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor File Manager FS Manager from to tags rights fsmgr.com viewer.com fsmgr.com read #christmas viewer.com sfly.com viewer.com read #print flickr FS Shutterfly viewer.com #print fsmgr.com fsmgr.com fsmgr.com #christmas #christmas #private

  28. A CCESS C ONTROL BROWSER SuperRedEye Photo Photo Shutterfly Shutterfly Remover Viewer Editor File Manager FS Manager from to tags rights fsmgr.com viewer.com fsmgr.com read #christmas viewer.com sfly.com viewer.com read #print flickr FS Shutterfly viewer.com #print fsmgr.com fsmgr.com fsmgr.com #christmas #christmas #private

  29. A CCESS C ONTROL BROWSER SuperRedEye Photo Photo Shutterfly Shutterfly Remover Viewer Editor File Manager FS Manager from to tags rights fsmgr.com viewer.com fsmgr.com read #christmas viewer.com sfly.com viewer.com read #print flickr FS Shutterfly viewer.com #print fsmgr.com fsmgr.com fsmgr.com #christmas #christmas #private

  30. A CCESS C ONTROL BROWSER SuperRedEye Photo Photo Shutterfly Shutterfly Remover Viewer Editor File Manager FS Manager from to tags rights fsmgr.com viewer.com fsmgr.com read #christmas viewer.com sfly.com viewer.com read #print flickr FS viewer.com sfly.com fsmgr.com read #private Shutterfly viewer.com #print fsmgr.com fsmgr.com fsmgr.com #christmas #christmas #private

  31. A CCESS C ONTROL BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor Access Control API File Manager FS Manager add_dlg(to, tags, rights) -> from to tags rights rm_dlg (to, tags, rights) -> fsmgr.com viewer.com fsmgr.com read get_dlg(to) -> <tags,rights> #christmas viewer.com sfly.com viewer.com read #print flickr FS viewer.com sfly.com fsmgr.com read #private Shutterfly viewer.com #print fsmgr.com fsmgr.com fsmgr.com #christmas #christmas #private

  32. F ILESYSTEM S ETUP  FS manager needs FS info to mount the FS  FS info stored in a mountpoint file  Example: <mountpoint> <url src="http://flickr.com/fs.html"/> <params username="ramesh" password="pass"/> </mountpoint>  Any principal can add a mountpoint as long as it can create the mountpoint file  Mountpoint file contents encrypted by FS manager  encrypt(mntpoint_plaintext) -> mntpoint_ciphertext

  33. F ILESYSTEM E XAMPLES BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS Shutterfly BACKEND SERVERS

  34. F ILESYSTEM E XAMPLES BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS amazon FS Shutterfly BACKEND SERVERS

  35. F ILESYSTEM E XAMPLES BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS amazon FS Storage FS Shutterfly BACKEND SERVERS

  36. F ILESYSTEM E XAMPLES BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS amazon FS encrypt FS Storage FS Shutterfly BACKEND SERVERS

  37. F ILESYSTEM E XAMPLES BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS amazon FS encrypt FS Layered FS Storage FS Shutterfly BACKEND SERVERS

  38. F ILESYSTEM E XAMPLES BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS amazon FS encrypt FS Layered FS Storage FS Shutterfly BACKEND SERVERS

  39. F ILESYSTEM E XAMPLES BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS amazon FS encrypt FS Layered FS Storage FS Shutterfly BACKEND SERVERS

  40. F ILESYSTEM E XAMPLES BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS amazon FS encrypt FS Layered FS Storage FS Shutterfly BACKEND SERVERS

  41. F ILESYSTEM E XAMPLES BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS amazon FS encrypt FS Layered FS Storage FS Shutterfly BACKEND SERVERS

  42. F ILESYSTEM E XAMPLES BROWSER SuperRedEye Photo Photo Shutterfly Remover Viewer Editor FS Manager flickr FS amazon FS encrypt FS Layered FS Storage FS Shutterfly BACKEND SERVERS

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

CSA CSA Ev Evolut olution: ion:

CSA CSA Ev Evolut olution: ion:

CSA CSA Ev Evolut olution: ion: The e Farm rms: s: Juni niper per Hi Hill Far arm Fledgin dging g Crow w

338 views • 17 slides
REV REVOL OLUTION UTIONAR ARY Y P&amp;A P&amp;A Melti Melting ng r roc ock us k using T

REV REVOL OLUTION UTIONAR ARY Y P&amp;A P&amp;A Melti Melting ng r roc ock us k using T

REV REVOL OLUTION UTIONAR ARY Y P&amp;A P&amp;A Melti Melting ng r roc ock us k using T ing The hermit mite MIKE RICHARDSON Spirit Energy With input from Interwell CO CONTENTS NTENTS Traditional P&amp;A is a Pain

555 views • 32 slides
10 B EST P RACTICES F OR S OLUTION A RCHITECTURES THAT WOULD TAME BIG DATA !!! B IG D ATA B EST P

10 B EST P RACTICES F OR S OLUTION A RCHITECTURES THAT WOULD TAME BIG DATA !!! B IG D ATA B EST P

10 B EST P RACTICES F OR S OLUTION A RCHITECTURES THAT WOULD TAME BIG DATA !!! B IG D ATA B EST P RACTICE -1 U SE CASE ! U SE C ASE ! U SE C ASE ( F RAME IT TIGHT ) T HE IDEA IN B RIEF What are the questions at the heart of the problem ?

590 views • 46 slides
C OMPUTING ? [Mark Weiser 1991] PART 1 : R EQUIREMENTS , TRENDS , Silicon based

C OMPUTING ? [Mark Weiser 1991] PART 1 : R EQUIREMENTS , TRENDS , Silicon based

R AINBOW RESEARCH GROUP T RENDS IN M IDDLEWARE FOR T RENDS IN M IDDLEWARE FOR U BIQUITUOUS C OMPUTING : WC OMP S OLUTION S OLUTION HMI Ubiquitous User Interaction Computing DAAD Summer CTDS 09, 24th 26th September Tunis Reactive and HMI

486 views • 16 slides
L ECTURE 24: T ASK A LLOCATION 3 I NSTRUCTOR : G IANNI A. D I C ARO S OLUTION APPROACHES Use

L ECTURE 24: T ASK A LLOCATION 3 I NSTRUCTOR : G IANNI A. D I C ARO S OLUTION APPROACHES Use

15-382 C OLLECTIVE I NTELLIGENCE S18 L ECTURE 24: T ASK A LLOCATION 3 I NSTRUCTOR : G IANNI A. D I C ARO S OLUTION APPROACHES Use the reference optimization models in a centralized scheme, solving the problems to optimality (e.g.,

323 views • 28 slides
From Th Theory to Practice: Exploring Sustainable Sol olution ons t to A o Africas D

From Th Theory to Practice: Exploring Sustainable Sol olution ons t to A o Africas D

From Th Theory to Practice: Exploring Sustainable Sol olution ons t to A o Africas D Develop opmental C Challenges !!!!!!!!!!!! F. Kwame Yeboah, Assistant Professor Thomas S. Jayne, University Foundation Professor Michigan State

410 views • 24 slides
MOS OSAIC: : Mas ask k Opt ptimiz imizing ing Solut olution ion Wit With h Proces

MOS OSAIC: : Mas ask k Opt ptimiz imizing ing Solut olution ion Wit With h Proces

MOS OSAIC: : Mas ask k Opt ptimiz imizing ing Solut olution ion Wit With h Proces ocess Window Window Awar are e Inv nver erse e Cor orrect ection ion Jhih-Rong Gao, Xiaoqing Xu, Bei Yu, and David Z. Pan Dept. of Electrical

383 views • 23 slides
Dynamics i in the Short-Term rm E Evol olution on of of HIV D Drug g Res esistance e

Dynamics i in the Short-Term rm E Evol olution on of of HIV D Drug g Res esistance e

Dynamics i in the Short-Term rm E Evol olution on of of HIV D Drug g Res esistance e Prelim limin inary Data ta Arevir 2019 Jennifer Brown Molecular Virology, Department of Biomedicine, University of Basel Rationale Higher

244 views • 8 slides
C RITIQUE OF C OST -R ISK A NALYSIS AND F RANKENSTEIN S PACECRAFT D ESIGNS : A P ROPOSED S OLUTION

C RITIQUE OF C OST -R ISK A NALYSIS AND F RANKENSTEIN S PACECRAFT D ESIGNS : A P ROPOSED S OLUTION

C RITIQUE OF C OST -R ISK A NALYSIS AND F RANKENSTEIN S PACECRAFT D ESIGNS : A P ROPOSED S OLUTION 2014 ICEAA Workshop Denver, CO June 10-13 , 2014 Eric Plumer, NASA CAD HQ Mohamed Elghefari, Pasadena Applied Physics Cost- Risk Analysis Best

458 views • 31 slides
Us Using a g agen ent-bas ased ed model els t to exam amine e e eco-evol olution onar

Us Using a g agen ent-bas ased ed model els t to exam amine e e eco-evol olution onar

Us Using a g agen ent-bas ased ed model els t to exam amine e e eco-evol olution onar ary f y feedbac acks Monique de Jager m.dejager@uu.nl PhD at NIOZ Yerseke Im an evolutionary ecologist With Johan van de Koppel Postdoc

661 views • 38 slides
Tw Two-St Stream C Con onvol olution onal Networ orks fo for Action Recognition in Vi

Tw Two-St Stream C Con onvol olution onal Networ orks fo for Action Recognition in Vi

Tw Two-St Stream C Con onvol olution onal Networ orks fo for Action Recognition in Vi Videos Karen Simonyan Andrew Zisserman Cemil Zalluholu Introduction Aim Extend deep ConvolutionNetworks to action recognitionin video.

809 views • 23 slides
SOL OLUTION TION! ! Observation Theory OUR LEARNING EXPERIENCE Solution Results Evolution

SOL OLUTION TION! ! Observation Theory OUR LEARNING EXPERIENCE Solution Results Evolution

INT NTERP ERPRETERS'S RETERS'S PROFES OFESSIONAL IONAL LE LEAR ARNING NING IN N SCIC IC THE HE BLE LENDED NDED SOL OLUTION TION! ! Observation Theory OUR LEARNING EXPERIENCE Solution Results Evolution Synthesis OBSE SERVA

248 views • 9 slides
S afety &amp; ecurity olution Utmost Safety with Exceptional Technology Integrat egrated ed

S afety &amp; ecurity olution Utmost Safety with Exceptional Technology Integrat egrated ed

Unique S afety &amp; ecurity olution Utmost Safety with Exceptional Technology Integrat egrated ed Solut ution ion by y Skool olSm Smar art-No No Swiping ng of Cards s (Aut Automat omatic ic De Detect ection) ion) Bus Solution

347 views • 12 slides
E W OLUTION - Efficacy and safety of LAAO in patients with prior ischemic and hemorrhagic stroke

E W OLUTION - Efficacy and safety of LAAO in patients with prior ischemic and hemorrhagic stroke

E W OLUTION - Efficacy and safety of LAAO in patients with prior ischemic and hemorrhagic stroke Prof. Dr. Lucas Boersma, MD/PhD/FESC St. Antonius Hospital, Nieuwegein, The Netherlands AMC/University of Amsterdam, The Netherlands H. Ince

436 views • 17 slides
DATA VISUALS P OWER BI AS A S OLUTION 44 ZETTABYTES BY 2020 IDC E XECUTIVE S UMMARY D ATA G ROWTH ,

DATA VISUALS P OWER BI AS A S OLUTION 44 ZETTABYTES BY 2020 IDC E XECUTIVE S UMMARY D ATA G ROWTH ,

DATA VISUALS P OWER BI AS A S OLUTION 44 ZETTABYTES BY 2020 IDC E XECUTIVE S UMMARY D ATA G ROWTH , B USINESS O PPORTUNITIES , AND THE IT I MPERATIVES DATA IS HARD TO UNDERSTAND WE NEED TO SEE IT, MOVE IT D ATA MUST INFORM DECISIONS D ATA

427 views • 9 slides
Or Oregon egon Records Manage gemen ent Sol olution Public / Private Partnership: Oregon

Or Oregon egon Records Manage gemen ent Sol olution Public / Private Partnership: Oregon

Or Oregon egon Records Manage gemen ent Sol olution Public / Private Partnership: Oregon Secretary of State, Archives Division Chaves Consulting, Inc. / Arikkan, Inc. The Problem Too much stuff to manage manually Too many silos

676 views • 12 slides
Renewal Application Training for Part II FY2019 Continuum of Care Competition August 6, 2019 1

Renewal Application Training for Part II FY2019 Continuum of Care Competition August 6, 2019 1

Renewal Application Training for Part II FY2019 Continuum of Care Competition August 6, 2019 1 Agenda 1. NOFA Overview 2. Process Overview 3. E-snaps Application 4. Timeline 5. Resources 6. Questions 2 2019 CoC Program NOFA NOFA

871 views • 48 slides
FY19 HUD CoC Competition New Project Application Webinar Presented by: Karen Kowal, Director of

FY19 HUD CoC Competition New Project Application Webinar Presented by: Karen Kowal, Director of

FY19 HUD CoC Competition New Project Application Webinar Presented by: Karen Kowal, Director of CoC Programs Max Burns, Program Coordinator August 14, 2019 Welcome Our staff: Dave Thomas, Vice President of Community Partnerships

1.17k views • 67 slides
Agenda Introduction The players And? Summary GUUG FFG FEB 2016 Me :-) Teacher

Agenda Introduction The players And? Summary GUUG FFG FEB 2016 Me :-) Teacher

Quo vadis Linux?!? The rise of new cloud O/S Dr. Udo Seidel Agenda Introduction The players And? Summary GUUG FFG FEB 2016 Me :-) Teacher of mathematics and physics PhD in experimental physics Started with Linux in

1.17k views • 53 slides
DEVICES Geoffrey Zweig Outline What is Mobile Voice search? An example: Live Search for

DEVICES Geoffrey Zweig Outline What is Mobile Voice search? An example: Live Search for

Microsoft Research ---- Lang Tech 2008 VOICE SEARCH ON MOBILE DEVICES Geoffrey Zweig Outline What is Mobile Voice search? An example: Live Search for Windows Mobile Why is it important? The Competitive Landscape Basic

913 views • 48 slides
An inside look at HPs Snapchat journey Global Social Marketing, Content Director, HP Softway

An inside look at HPs Snapchat journey Global Social Marketing, Content Director, HP Softway

An inside look at HPs Snapchat journey Global Social Marketing, Content Director, HP Softway Global Social Marketing, HP Fortun tune e 100 company $48.2B 2B revenu nue e in FY 2016 250,000 0,000+ + channel partners

868 views • 32 slides
Q2 2018 Earnings Slides August 7, 2018 Forward-Looking Statements &amp; Non-GAAP Financial

Q2 2018 Earnings Slides August 7, 2018 Forward-Looking Statements &amp; Non-GAAP Financial

Q2 2018 Earnings Slides August 7, 2018 Forward-Looking Statements &amp; Non-GAAP Financial Measures This presentation contains forward-looking statements about us and our industry that involve substantial risks and uncertainties. All statements

372 views • 19 slides
Social Media and Digital Footprints: Our Responsibilities commonsense.org/education Shareable

Social Media and Digital Footprints: Our Responsibilities commonsense.org/education Shareable

DIGITAL CITIZENSHIP | GRADE 8 Social Media and Digital Footprints: Our Responsibilities commonsense.org/education Shareable with attribution for noncommercial use. Remixing is permitted. Essential Question How does using social media affect

465 views • 8 slides
Full Stack Kotlin on Google Cloud Brent Shaffer, Google Cloud DPE bshaffe r Brent Shaffer No

Full Stack Kotlin on Google Cloud Brent Shaffer, Google Cloud DPE bshaffe r Brent Shaffer No

KotlinConf, Amsterdam Oct 4, 2018 Full Stack Kotlin on Google Cloud Brent Shaffer, Google Cloud DPE bshaffe r Brent Shaffer No language makes you feel more like a cog in a machine than Java Google Employee who will remain anonymous 3

818 views • 55 slides

More recommend