Exploring Heterogeneity of Unreliable Machines for P2P Backup Piotr Skowron 1 , Krzysztof Rzadca 2 1 p.skowron@mimuw.edu.pl 2 krzadca@mimuw.edu.pl University of Warsaw May 31, 2013 Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
Backup solutions are expensive. The market for backup is vast. Why p2p backup system? The other alternatives for backup are expensive: Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
Backup solutions are expensive. The market for backup is vast. Why p2p backup system? The other alternatives for backup are expensive: approx. $1000 for renting 1TB of cloud storage per year (Amazon, Google, Rackspace or Dropbox), Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
Backup solutions are expensive. The market for backup is vast. Why p2p backup system? The other alternatives for backup are expensive: approx. $1000 for renting 1TB of cloud storage per year (Amazon, Google, Rackspace or Dropbox), more than $12,000 for a single backup server with raw capacity of 14TB, Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
Backup solutions are expensive. The market for backup is vast. Why p2p backup system? The other alternatives for backup are expensive: approx. $1000 for renting 1TB of cloud storage per year (Amazon, Google, Rackspace or Dropbox), more than $12,000 for a single backup server with raw capacity of 14TB, more than $7,000 for a tape-based backup system for 14TB, Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
Backup solutions are expensive. The market for backup is vast. Why p2p backup system? The other alternatives for backup are expensive: approx. $1000 for renting 1TB of cloud storage per year (Amazon, Google, Rackspace or Dropbox), more than $12,000 for a single backup server with raw capacity of 14TB, more than $7,000 for a tape-based backup system for 14TB, + cost of maintenence, Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
Backup solutions are expensive. The market for backup is vast. Why p2p backup system? The other alternatives for backup are expensive: approx. $1000 for renting 1TB of cloud storage per year (Amazon, Google, Rackspace or Dropbox), more than $12,000 for a single backup server with raw capacity of 14TB, more than $7,000 for a tape-based backup system for 14TB, + cost of maintenence, the scalable solutions are even more expensive. The market for the backup solutions is vast. E.g. DataDomain in 2009: Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
Backup solutions are expensive. The market for backup is vast. Why p2p backup system? The other alternatives for backup are expensive: approx. $1000 for renting 1TB of cloud storage per year (Amazon, Google, Rackspace or Dropbox), more than $12,000 for a single backup server with raw capacity of 14TB, more than $7,000 for a tape-based backup system for 14TB, + cost of maintenence, the scalable solutions are even more expensive. The market for the backup solutions is vast. E.g. DataDomain in 2009: over 3,000 customers, Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
Backup solutions are expensive. The market for backup is vast. Why p2p backup system? The other alternatives for backup are expensive: approx. $1000 for renting 1TB of cloud storage per year (Amazon, Google, Rackspace or Dropbox), more than $12,000 for a single backup server with raw capacity of 14TB, more than $7,000 for a tape-based backup system for 14TB, + cost of maintenence, the scalable solutions are even more expensive. The market for the backup solutions is vast. E.g. DataDomain in 2009: over 3,000 customers, over 8,000 systems deployed, Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
Backup solutions are expensive. The market for backup is vast. Why p2p backup system? The other alternatives for backup are expensive: approx. $1000 for renting 1TB of cloud storage per year (Amazon, Google, Rackspace or Dropbox), more than $12,000 for a single backup server with raw capacity of 14TB, more than $7,000 for a tape-based backup system for 14TB, + cost of maintenence, the scalable solutions are even more expensive. The market for the backup solutions is vast. E.g. DataDomain in 2009: over 3,000 customers, over 8,000 systems deployed, was bought by EMC for $2,4 billion. Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
P2P architecture gives additional possibilities for backup Why p2p backup system? The p2p backup is cheaper: Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
P2P architecture gives additional possibilities for backup Why p2p backup system? The p2p backup is cheaper: common PCs are cheaper than reliable servers, Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
P2P architecture gives additional possibilities for backup Why p2p backup system? The p2p backup is cheaper: common PCs are cheaper than reliable servers, the unused disk space on the desktop workstations. The p2p architecture can be explored: Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
P2P architecture gives additional possibilities for backup Why p2p backup system? The p2p backup is cheaper: common PCs are cheaper than reliable servers, the unused disk space on the desktop workstations. The p2p architecture can be explored: the bandwidth of many nodes scales better than of a single server, Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
P2P architecture gives additional possibilities for backup Why p2p backup system? The p2p backup is cheaper: common PCs are cheaper than reliable servers, the unused disk space on the desktop workstations. The p2p architecture can be explored: the bandwidth of many nodes scales better than of a single server, the load on the network is more evenly distributed causing less bottlenecks, Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
P2P architecture gives additional possibilities for backup Why p2p backup system? The p2p backup is cheaper: common PCs are cheaper than reliable servers, the unused disk space on the desktop workstations. The p2p architecture can be explored: the bandwidth of many nodes scales better than of a single server, the load on the network is more evenly distributed causing less bottlenecks, better protection in case of natural disasters (geographical dispersion). Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
P2P architecture gives additional possibilities for backup Why p2p backup system? The p2p backup is cheaper: common PCs are cheaper than reliable servers, the unused disk space on the desktop workstations. The p2p architecture can be explored: the bandwidth of many nodes scales better than of a single server, the load on the network is more evenly distributed causing less bottlenecks, better protection in case of natural disasters (geographical dispersion). How to take advantage from the p2p architecture? Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
We can take advantage from p2p architecture by smart replica placement Flexibility in replica placement is important If system design allows that any replica can be placed anywhere, we can choose the best replica placement. Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
We can take advantage from p2p architecture by smart replica placement Flexibility in replica placement is important If system design allows that any replica can be placed anywhere, we can choose the best replica placement. Flexibility in replica placement is important The current p2p storage systems do not give this flexibility (rather they use the structured overlays, e.g. DHT). Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
We design a contract-based system We build a prototype implementation that is based on mutual contracts. Contract A contract for storing a data chunk of the owner i on the replicator j is a promise made by j to keep i s data chunk for a certain amount of time. Contracts can be exploited in two ways: Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
We design a contract-based system We build a prototype implementation that is based on mutual contracts. Contract A contract for storing a data chunk of the owner i on the replicator j is a promise made by j to keep i s data chunk for a certain amount of time. Contracts can be exploited in two ways: contracts form an unstructured, decentralized architecture that enables to optimize replica placement, Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
We design a contract-based system We build a prototype implementation that is based on mutual contracts. Contract A contract for storing a data chunk of the owner i on the replicator j is a promise made by j to keep i s data chunk for a certain amount of time. Contracts can be exploited in two ways: contracts form an unstructured, decentralized architecture that enables to optimize replica placement, contracts allow strategies for replica placement that are incentive-compatible. Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
The architecture of a contract-based system The system uses 3 storage overlays: Piotr Skowron, Krzysztof Rzadca Exploring Heterogeneity for P2P Backup
Recommend
More recommend
