cloud and peer to peer storage
play

Cloud- and Peer-to-Peer Storage End-user considerations and product - PowerPoint PPT Presentation

Jan 23, 2024 •142 likes •300 views

Cloud- and Peer-to-Peer Storage End-user considerations and product overview 4/3/2010 Arjan Peddemors Objectives Get overview of existing cloud storage and P2P storage concepts and products* outline of basic principles underlying cloud-

  1. Cloud- and Peer-to-Peer Storage End-user considerations and product overview 4/3/2010 Arjan Peddemors

  2. Objectives • Get overview of existing cloud storage and P2P storage concepts and products* • outline of basic principles underlying cloud- and P2P storage technologies • product scan • scenario description • Focus on end-users (researchers, staff, students) * Report available soon on SURFnet website 2

  3. Overview Cloud Storage cloud storage service cloud storage process local data storage 3

  4. Overview Peer-to-Peer (P2P) Storage p2p storage process local data peer data storage storage 4

  5. Overview Application Domain • Cloud storage / P2P storage domain is currently highly dynamic • many new products • quickly increasing number of (end-)users • new technologies being applied • Future developments driven by • fast internet connections for (end-)users • cheap storage hardware • uptake of cloud computing in general 5

  6. Basic principles • Redundancy • Erasure coding • Security • Asymmetric read / write • Peer selection • Fairness and quota • Versioning • Efficient transmission 6

  7. Erasure Coding Original file Split Fragments ( k = 3) Encode Redundant fragments ( n = 6) Upload to peers Fragments stored at peers Loss of fragments due to peer churn or temporal unavailability Remaining fragments stored at peers Download from peers Retrieved fragments ( ≥ k ) Decode and join Original file 7

  8. Erasure Coding • Compared to replication, erasure codes deliver a higher probability of successful data restore • Example calculation • peer network consisting of 10000 peers • 10% of peers is offline on average • replication factor of 2 (file consumes twice the original size at peers) • 2 replicas: probability of availability of at least one replica is 0.99 (2 nines) • 16 fragments at peers: probability of availability of at least 8 fragments is 0.99994 (four nines) 8

  9. Product scan • Research projects / products • Simple Tools • Cloud Storage products • P2P Storage products • Amazon S3 • Wuala • Dropbox • Tahoe • Microsoft Live Mesh / • CrashPlan Live Skydrive • Cucku • Adrive • PowerFolder • Mozy 9

  10. Amazon S3 / Dropbox (cloud) 10

  11. Amazon S3 / Dropbox (cloud) 11

  12. Wuala (P2P) 12

  13. Scenario • Doctoral student working on research data / thesis at multiple locations cloud storage / P2P storage home university laptop fixed PC fixed PC 13

  14. Scenario • Comparing • Simple tool (Unison) • Cloud storage service (Dropbox) • P2P storage service (Wuala) • Aspects • Preparation / installation • Regular activities and maintenance • Recovery 14

  15. Conclusions • Cloud / P2P storage products interesting for SURFnet end users • Domain is new and developing quickly • Many product variants (targeting different usage) • Subscription versus bringing in own resources • Two types of P2P storage products • ‘full’ P2P system scaling to many peers • ‘social’ P2P systems • Cloud storage services more mature than P2P • Many products have both Cloud and P2P features 15

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Peer-to-Peer Computing Peer-to-Peer (P2P) employ distributed resources to perform function in a

Peer-to-Peer Computing Peer-to-Peer (P2P) employ distributed resources to perform function in a

Introduction Peer-to-Peer Computing Peer-to-Peer (P2P) employ distributed resources to perform function in a decentralized manner Resource can be: computing, storage, bandwidth Function can be: computing, data sharing, D.

625 views • 6 slides
Peer-to-Peer Networks 09 Random Graphs for Peer-to-Peer-Networks Christian Ortolf Technical

Peer-to-Peer Networks 09 Random Graphs for Peer-to-Peer-Networks Christian Ortolf Technical

Peer-to-Peer Networks 09 Random Graphs for Peer-to-Peer-Networks Christian Ortolf Technical Faculty Computer-Networks and Telematics University of Freiburg Peer-to-Peer Networking Facts Hostile environment - Legal situation - Egoistic

882 views • 57 slides
Storage Management and Caching in PAST, a Large-scale, Persistent Peer-to-peer Storage Utility

Storage Management and Caching in PAST, a Large-scale, Persistent Peer-to-peer Storage Utility

Storage Management and Caching in PAST, a Large-scale, Persistent Peer-to-peer Storage Utility Presented by Haiming Jin 2013-03-07 Background P2P applications emerges as mainstream applications 53.3% of upstream internet traffic (2010)

848 views • 41 slides
Comparing Hybrid Peer-to-Peer Hybrid peer-to-peer systems Systems Beverly Yang and Hector

Comparing Hybrid Peer-to-Peer Hybrid peer-to-peer systems Systems Beverly Yang and Hector

Comparing Hybrid Peer-to-Peer Hybrid peer-to-peer systems Systems Beverly Yang and Hector Garcia-Molina Pure peer-to-peer systems are hard to scale Gnutella Look at hybrids between p2p and server-client Presented by Marco Barreno Servers

282 views • 6 slides
THE PEER-TO-PEER NETWORK JOHN NEWBERY @jfnewbery github.com/jnewbery THE PEER-TO-PEER NETWORK

THE PEER-TO-PEER NETWORK JOHN NEWBERY @jfnewbery github.com/jnewbery THE PEER-TO-PEER NETWORK

THE PEER-TO-PEER NETWORK JOHN NEWBERY @jfnewbery github.com/jnewbery THE PEER-TO-PEER NETWORK Introduction Types of nodes Message format Control messages Transaction propagation Block propagation THE PEER TO PEER

767 views • 38 slides
Serverless networking (peer-to-peer computing) Peer-to-peer models Client-server computing

Serverless networking (peer-to-peer computing) Peer-to-peer models Client-server computing

5/7/08 Serverless networking (peer-to-peer computing) Peer-to-peer models Client-server computing servers provide special services to clients clients request service from a server Pure peer-peer computing all systems have equivalent

586 views • 20 slides
Hierarchical Codes: How to Make Erasure Codes Attractive for Peer-to-Peer Storage Systems

Hierarchical Codes: How to Make Erasure Codes Attractive for Peer-to-Peer Storage Systems

Hierarchical Codes: How to Make Erasure Codes Attractive for Peer-to-Peer Storage Systems Alessandro Duminuco and Ernst Biersack EURECOM Sophia Antipolis, France (Best paper award in P2P'08) Presented by: Amir H. Payberah amir@sics.se

456 views • 45 slides
Peer-to-Peer Networks 11 Past Christian Ortolf Technical Faculty Computer-Networks and

Peer-to-Peer Networks 11 Past Christian Ortolf Technical Faculty Computer-Networks and

Peer-to-Peer Networks 11 Past Christian Ortolf Technical Faculty Computer-Networks and Telematics University of Freiburg PAST PAST: A large-scale, persistent peer-to-peer storage utility - by Peter Druschel (Rice University, Houston

372 views • 26 slides
Peer-to-Peer Networking and Discovery Technologies Week 6 Whats Peer-to-Peer? A different

Peer-to-Peer Networking and Discovery Technologies Week 6 Whats Peer-to-Peer? A different

Peer-to-Peer Networking and Discovery Technologies Week 6 Whats Peer-to-Peer? A different network architecture than client/server Each peer is both a client and a server Appropriate for applications that dont require a

353 views • 11 slides
NSYNC Network Synchronization for Low-latency Peer-to-Peer Streaming Overlay Construction

NSYNC Network Synchronization for Low-latency Peer-to-Peer Streaming Overlay Construction

NSYNC Network Synchronization for Low-latency Peer-to-Peer Streaming Overlay Construction Shudong Jin Case Western Reserve University NEONet Workshop, March 1, 2006 Peer-to-Peer Streaming Peer-to-peer systems versus client/server systems

292 views • 15 slides
THE POLITICS OF BLOCKCHAIN From Primus Inter Pares to Peer-to-Peer HOW BLOCKCHAIN WORKS In

THE POLITICS OF BLOCKCHAIN From Primus Inter Pares to Peer-to-Peer HOW BLOCKCHAIN WORKS In

THE POLITICS OF BLOCKCHAIN From Primus Inter Pares to Peer-to-Peer HOW BLOCKCHAIN WORKS In peer-to-peer networks, all the operations Peer-to-peer networks Proof-of-work equally rely on each node in the system. Digital signature Registry

328 views • 18 slides
Economics of Peer-to-Peer Markets Jonathan Levin Stanford

Economics of Peer-to-Peer Markets Jonathan Levin Stanford

Economics of Peer-to-Peer Markets Jonathan Levin Stanford University Lear Conference July 25, 2015 1 Internet Marketplaces 2 On-Demand Services 3 Introduction Peer-to-peer

1.02k views • 25 slides
5th Grade Peer Ambassadors Parkway Elementary What is a Peer Ambassador? A Peer Ambassador is a

5th Grade Peer Ambassadors Parkway Elementary What is a Peer Ambassador? A Peer Ambassador is a

5th Grade Peer Ambassadors Parkway Elementary What is a Peer Ambassador? A Peer Ambassador is a good role model! She or he proudly represents the 6 pillars of character: Trustworthiness, Respect, Responsibility, Fairness, Caring, Citizenship A

258 views • 7 slides
P2P: Distributed Hash Tables Chord + Routing Geometries Nirvan Tyagi CS 6410 Fall16

P2P: Distributed Hash Tables Chord + Routing Geometries Nirvan Tyagi CS 6410 Fall16

P2P: Distributed Hash Tables Chord + Routing Geometries Nirvan Tyagi CS 6410 Fall16 Peer-to-peer (P2P) Peer-to-peer (P2P) Decentralized! Hard to coordinate with peers joining and leaving Peer-to-peer (P2P) Napster (1999) Peer-to-peer

869 views • 68 slides
Lets Put a Peer Worker on Campus! Keely Phillips, Self Help & Peer Support OPDI

Lets Put a Peer Worker on Campus! Keely Phillips, Self Help & Peer Support OPDI

Lets Put a Peer Worker on Campus! Keely Phillips, Self Help & Peer Support OPDI Conference, October 2018 About Self Help & Peer Support Peer Navigator Services at Conestoga College A full-time Peer Navigator will provide:

579 views • 16 slides
Peer-to-Peer Networks 14 Game Theory Christian Schindelhauer Technical Faculty

Peer-to-Peer Networks 14 Game Theory Christian Schindelhauer Technical Faculty

Peer-to-Peer Networks 14 Game Theory Christian Schindelhauer Technical Faculty Computer-Networks and Telematics University of Freiburg Literature Feldman, Chuang Overcoming Free-Riding Behavior in Peer-to-Peer Systems, 2005

449 views • 24 slides
iLab P2P Networks Dirk Haage Chair for Network Architectures and Services Department of

iLab P2P Networks Dirk Haage Chair for Network Architectures and Services Department of

Network Architectures and Services, Georg Carle Faculty of Informatics Technische Universitt Mnchen, Germany iLab P2P Networks Dirk Haage Chair for Network Architectures and Services Department of Computer Science Technische

943 views • 30 slides
Lightweight Emulation to Study Peer-to-Peer Systems Lucas Nussbaum and Olivier Richard

Lightweight Emulation to Study Peer-to-Peer Systems Lucas Nussbaum and Olivier Richard

Introduction P2PLab Conclusion Lightweight Emulation to Study Peer-to-Peer Systems Lucas Nussbaum and Olivier Richard Laboratoire I nformatique et D istribution Laboratoire ID-IMAG MESCAL INRIA Project Grenoble, France Lucas Nussbaum and

617 views • 27 slides
s Prtr

s Prtr

tt ts s trrtt t s tr r

275 views • 24 slides
A Stealthier Partitioning Attack against Bitcoin Peer-to-Peer Network Muoi Tran , Inho Choi, Gi

A Stealthier Partitioning Attack against Bitcoin Peer-to-Peer Network Muoi Tran , Inho Choi, Gi

IEEE Symposium on Security and Privacy ( IEEE S&P ) 2020 https://erebus-attack.comp.nus.edu.sg/ A Stealthier Partitioning Attack against Bitcoin Peer-to-Peer Network Muoi Tran , Inho Choi, Gi Jun Moon, Anh V. Vu, Min Suk Kang May 2020

814 views • 18 slides
Client-side Web Mining for Community Formation in Peer-to-Peer Environments Kun Liu, Kanishka

Client-side Web Mining for Community Formation in Peer-to-Peer Environments Kun Liu, Kanishka

Client-side Web Mining for Community Formation in Peer-to-Peer Environments Kun Liu, Kanishka Bhaduri, Kamalika Das, Phuong Nguyen and Hillol Kargupta University of Maryland, Baltimore County WebKDD06, August 20, 2006, Philadelphia, PA, USA

547 views • 21 slides
A Security & Privacy Perspective through Hyperledger/fabric Elli Androulaki Staff member,

A Security & Privacy Perspective through Hyperledger/fabric Elli Androulaki Staff member,

Blockchain for Enterprise: A Security & Privacy Perspective through Hyperledger/fabric Elli Androulaki Staff member, IBM Research, Zurich Workshop on cryptocurrencies Athens, 06.03.2016 Blockchain systems Introduced in 2008

707 views • 23 slides
CAMHPRO Peer Certification SB 614 Update & Input Meeting August 11, 2016 870 Market St., Suite

CAMHPRO Peer Certification SB 614 Update & Input Meeting August 11, 2016 870 Market St., Suite

CAMHPRO Peer Certification SB 614 Update & Input Meeting August 11, 2016 870 Market St., Suite 922; San Francisco, Karin Lettau, MS, Director of California CA 94102 (415) 341-9460 Please follow us and like us on Face Book Training

1.06k views • 37 slides
Writing Datomic in Clojure Rich Hickey Datomic, Clojure Overview What is Datomic?

Writing Datomic in Clojure Rich Hickey Datomic, Clojure Overview What is Datomic?

Writing Datomic in Clojure Rich Hickey Datomic, Clojure Overview What is Datomic? Architecture Implementation - Clojure Applied Summary What is Datomic? A new kind of database Bringing data power into the application

1.31k views • 52 slides

More recommend