C OMMUNITY -L AB T ESTBED A ND C LOUDY D ISTRIBUTION Mennan Selimi - - PowerPoint PPT Presentation

Mennan Selimi

Universitat Politècnica de Catalunya - BarcelonaTECH

CLOMMUNITY

COMMUNITY-LAB TESTBED AND CLOUDY DISTRIBUTION

Outline

• Community networks
• Community-Lab
• Community-Lab Demo
• Motivation
• Community Clouds
• Services in Community Networks
• Cloudy Demo

CLOMMUNITY

• PROJECT.EU Decentralized Systems 2015 1

Community Networks

• What’s this ? A cooperative development of a network
• Where ? Local, community (city, region, area)
• Who? You and your neighbors

Don’t buy the network, be the network ! Scalable, self-organized and decentralized IP networks and services built and operated by citizens for citizens

CLOMMUNITY

• PROJECT.EU Decentralized Systems 2015 2

26.600+ nodes 50.000+ km of links

CLOMMUNITY

• PROJECT.EU Decentralized Systems 2015 3

Community-Lab

• An open, distributed infrastructure for experimentation

with Community Networks

• An outdoor testbed with nodes and links embedded in

community networks, with many people too

• A realistic environment for experimentation with the

best and worst of real community networks

• Research Devices connected to Community Devices

CLOMMUNITY

• PROJECT.EU Decentralized Systems 2015 4

Community-Lab DEMO

206 Nodes Slice creation Adding slivers Sliver properties Sliver templates

COMMUNITY

• PROJECT.EU Decentralized Systems 2015 5

http://community-lab.net

26.600+ nodes 50.000+ km of links

What other services can community members provide to each other ?

CLOMMUNITY

• PROJECT.EU Decentralized Systems 2015 6

Motivation

• Wireless networks successful as communication infrastructure in

underserved areas

• Opportunity to build community network clouds in wireless

mesh networks

• Cooperative deployment and maintenance of clouds
• Saving of uplink bandwidth - no need to consume services from

the Internet. They are available within the wireless network

• Storage, Video streaming and service discovery in community

clouds

CLOMMUNITY

• PROJECT.EU Decentralized Systems 2015 7

Community Clouds

➡ The vision of cloud-based services in community networks ➡ We are talking about specific community cloud:

✦ built in community network ✦ hosted in community-owned

computing resources

✦ providing services of local interest ✦ A P2P cloud made of individual

computers and home gateways

Pros:

• no single entity that owns or controls
• to join/leave no need for permission or consent
• small components, energy-efficient, well distributed

Cons:

• can’t provide the QoS
• f Google, Amazon

CLOMMUNITY

• PROJECT.EU Decentralized Systems 2015 8

Services in community clouds

• Technological barrier when deploying

services

• Community network cloud distribution

✦ Service Discovery platform ✦ Decentralization ✦ User-friendliness and experience ✦ Free, Open Source Software (FOSS)

• Cloudy
• Debian GNU/Linux distribution aimed to foster the

transition and adoption of the CN cloud environment

• can be installed in VMs or “bare metal”
• running on low-resource devices

CLOUDY

http://cloudy.community/

CLOMMUNITY

• PROJECT.EU Decentralized Systems 2015 9

Cloudy Architecture

• Internal architecture
• overlay to interconnect all nodes in a community

cloud

• service announcement and discovery: publish local

information to the cloud and receive remote data from neighbor peers

• Services included:
• Database: CouchDB
• Storage: Tahoe-LAFS, XtreemFS, etcd, Syncthing
• VoIP: Asterisk DUNDi
• Video streaming: PeerStreamer
• Video on demand: Gvod
• Container: OpenVZ
• Discovery: and Announcement: Avahi
• Network overlay: TincVPN
• Proxy, SNP Services, DNS Services

Cloudy architecture

CLOMMUNITY

• PROJECT.EU Decentralized Systems 2015 10

Tahoe-LAFS

• Open source, secure distributed data storage system
• Provider-independent security (security at the client side)
• Erasure coding generalized to K-of-N nodes (3-of-10)
• Tahoe-LAFS grid consists of:
• Client node: user interface into the grid
• Introducer node: publish/subscribe hub
• Storage node: stores the shares

Tahoe-LAFS architecture

Introducer

Storage

Client Client Client

Storage Storage Storage

CLOMMUNITY

• PROJECT.EU Decentralized Systems 2015 11

Experimental Environment

43 nodes in total VMs in most of the machines Community Lab testbed nodes (LXC) IoT - Internet of Things boards

Number of nodes Type Location

10 - UPC VMs in a single machine Barcelona, Spain 10 - TAR VMs in a single machine Barcelona North, Spain 10 - UPC VMs in a single machine Barcelona South, Spain 4 - KTH VMs in two machines Stockholm, Sweden 2 - ICTP VMs in a single machine Trieste, Italy 4 - CAT Community-Lab nodes Catalonia 3 - CAT Intel Galileo IoT boards Catalonia

OpenWRT LXC

CLOUDY

Our topology

CLOMMUNITY

• PROJECT.EU Decentralized Systems 2015 12

Tahoe-LAFS vs. XtreemFS

No replication 5 replicas Sequential read and write of Tahoe-LAFS and XtreemFS with different replication factors

CLOMMUNITY

• PROJECT.EU Decentralized Systems 2015 13

Tahoe-LAFS

CLOMMUNITY

• PROJECT.EU Decentralized Systems 2015 14

Lessons learned

demonstration to the end users that cloud services are supported by the community wireless network

provision of platform and application services rather than on infrastructure service time-sensitive services as video live streaming, VoIP , VoD

focus on community cloud services sustainability of the community cloud

incentives for the users to contribute Tahoe-LAFS promising secure storage service for community network clouds

CLOMMUNITY

• PROJECT.EU Decentralized Systems 2015 15

Conclusion

• Cloud infrastructures are deployed in a real

production wireless community network

• A easy to use community distribution might help for

massive uptake and provision of stable key services

• Tahoe-LAFS showed to be promising application for

privacy-preserving, secure cloud storage

CLOMMUNITY

• PROJECT.EU Decentralized Systems 2015 16

DEMO

CLOMMUNITY

http://cloudy.community/

http://clommunity-project.eu/

A community networking Cloud in a box

CLOMMUNITY

Demo http://84.88.85.42/ user/pass: guest/guest

Service Discovery

• Avahi - system which facilitates the service discovery on a local network via

the mDNS/DNS-SD protocol suite

• In community networks nodes are spread over different broadcast domains,

Avahi packets can not reach !

• One solution: TincVPN

✦ Virtual Private Network daemon that uses tunneling and encryption to

create a secure private network between hosts

✦ Installed and configured on every Cloudy

Domain A Domain B

CLOMMUNITY

• PROJECT.EU Decentralized Systems 2015 1