TERENA Trusted Cloud Drive pilot STATUS UPDATE Motivations Since - - PowerPoint PPT Presentation

TERENA Trusted Cloud Drive pilot STATUS UPDATE

TF-Storage meeting 26-27 September 2012 Dubrovnik, Croatia Peter Szegedi Project Development Officer szegedi@terena.org www.terena.org

Motivations

Since 2 0 1 0 , TERENA has been actively looking into how NRENs can offer cloud services. › Task Force on the Management of Service Portfolios (TF-MSP) has investigated business aspects of NRENs offering clouds or cloud brokerage services. › Task Force on Storage (TF-Storage) covers more technical aspects, providing a forum for exchanging and promoting ideas. › At the pan-European level, TERENA is also leading the ASPIRE foresight study, which includes the adoption of cloud services within the research and education community.

› develop a pilot activity for NRENs to experiment and gain experience with clouds and applications;

Aim of the pilot

› to explore possible deployment scenarios for a trusted storage service for NRENs:

› longer term sustainability for a potential service; › legal aspects and perceived trust issues related to the storage and management of the encryption keys and metadata; › software scalability and performance.

I dea and Concept

› Federated › Encrypted › Metadata and storage data separated › Trusted › Brokered › Flexible › Open-sourced

Unique Selling Points

Trusted party Cloud Storage Provider

Metadata

Storage data

encryption

I dea...

Windows7 Android Mac OS iOS Linux

TERENA Trusted Cloud Drive pilot Phase I - DONE

Trusted party Public Cloud Storage Providers Windows7 Android Mac OS iOS Linux

Can run on local premisses

Web page WebDAV

Local Storage

Metadata store

encrypted blob federated access Cloud broker facility Local file system I n- built Am azon S3 interface Federated access W EB DI SK Native support

• f platform s

METADATA

Features I

› Federated access › Web interface

› Create, delete, modify folders › Upload, download files › Tagging › Search by tags (only) › Public folder › Shared folder (in progress)

› Disk activation

Features I I

› Virtual disk drive

› Create, delete, modify folders › Upload, download files › Creating folders makes search in tags › Full filename search

› Platforms and clients

› Windows7 (BitKinex, native WE in progress) › Android 2.3 (WebDAV File Manager, WebDAV Navigator Lite) › MacOS (Native, Transmit, Cyberduck) › iOS (WebDAVNav+ , Keynote, Pages, Goodreader)

Actual lim itations of the TERENA pilot installation

› Federated access is whitelisted for the pilot › Metadata store is inside the VM (20GB) › Local storage is 100GB

› Bulit-in Amazon S3 interface

› Filesize limit of 5GB › Only 2 VMs

› VM1 (tc1.terena.org) is the WebDAV daemon › VM2 (tc2.terena.org) is the Website and Metadata store

› Daily backup of VMs › No limit on the # concurrent users, daemons scale horizontally (stateless against metadata store Voldemort from LinkedIn)

› Upload, compression, and encryption at application level › CPU > I O

Developm ent roadm ap

› Code is opensource

› Available at

https: / / github.com/ VirtualCloudDrive/ CloudDrive

› Apache License, Version 2.0 › Documented › Downloadable images.... (what?)

› Maarten’s roadmap

› Sharing is in progress › Billing, quota, metering is in the code › Back-end API support...

› What is our roadmap?

Three w ays to participate Phase I I - OPEN

Pilot runs until March 2013:

1. Bring your federated test users

Must be whitelisted...

2. Attach your storage back-end

a) Develop the interface to your storage (contribution to the project) b) Generic S3 API c) Jclouds API

3. Get familiar with the code

a) Wiki documentation! b) Take the code and DI Y

Actual status

› Interested participants (18)

› (13) ACOnet, ARNES, BELNET, CARNet, CESNET, CSC/ FUNET, FCCN, GRNET, NIIF, PSNC, RedIRIS, SURFnet, SWITCH › (3) ERNET India, AARnet Australia, RNP Brazil › (4) CESCA, EPFL, Uni. Malta, Scre

› Test accounts

› 17 BETA testers - initial feedback... › Amazon grant – application...

› First installation (other than TERENA)

› PSNC – Installation Guide... › Support contract with Maarten...

› Next steps

› Build a development community around the code › Validate service delivery scenarios Slide 12

Open issues

› Who else is interested in installing the cloud platform at their location for experimental purposes?

› Co-owners, develppers’ community

› Amazon or VMware image?

› Own software development roadmap!

› Which API development option would you prefer, purely from your storage back-end and service development point of view?

› Who is interested in introducing this cloud platform as a service and what would be the main characteristics of such a service?

› Service development › Scenarios...

› Integration with Unhosted, FileSender, others...

Slide 13

Service delivery scenarios

• 1. Hosted service scenarios

a) Fully centralised model b) Distributed storage model

• 2. Brokered service scenarions

a) Centralised storage model b) Fully distributed model

Hosted Service Scenario A

Fully Centralised Model

Slide 15

Public Storag e

NREN NREN NREN

Cloud Broker

Web page WebDAV Metadata store

USERS USERS USERS User DATA Storage DATA CONTRACT

Hosted Service Scenario B

Distributed Storage Model

Slide 16

Public Storag e

NREN NREN NREN

NREN Storage NREN Storage

Cloud Broker

Web page WebDAV Metadata store

USERS USERS User DATA Storage DATA CONTRACT

Brokered Service Scenario A

Centralised Storage Model

Slide 17

Public Storag e

NREN NREN NREN

Cloud Broker

Web page WebDAV Metadata store

Cloud Broker

Web page WebDAV Metadata store

Cloud Broker

Web page WebDAV Metadata store

USERS USERS USERS User DATA Storage DATA CONTRACT

Brokered Service Scenario B

Fully Distributed Model

Slide 18

Public Storag e

NREN NREN NREN

NREN Storage NREN Storage

Cloud Broker

Web page WebDAV Metadata store

Cloud Broker

Web page WebDAV Metadata store

USERS USERS User DATA Storage DATA CONTRACT

I DEA: TERENA Cloud Storage Store

Slide 19 Organisation I tem Pricing AUP/ SLA TERENA

Cloud Broker

Web page WebDAV Metadata store

Free* Open

NREN Storage API

[ NREN x] TBD National use only

Public Storage API

[ Commercial x] TBD EU use only

• Federated web portal
• Download options
• AUP / SLA

Adm inistrativa

› May 2 0 1 2 – Pre-installation: System installation and technical documentation concerning the installation process (phase i). › Jan 2 0 1 3 – Describe possible service m odels: This document will describe what service(s) can be deployed and how and will detail the service scenario recommended to phase ii and the related metrics to asses the pilot. The scenario of TERENA offering this as a (sharing) service will be considered. › March 2 0 1 3 – Final report: Provide an evaluation of the pilot and recommendations for the next steps, based on the success of the pilot. Technical recommendations for NRENs that wish to run a local instance of the software will also be provided.

Slide 20

Sum m ary

1. Code co-owners + support (News Item PHOTO)

› Downloadable image? › Documentation... › Amazon grant....

2. TERENA software development roadmap

› Generic S3 › Jclouds API › Direct bridge - contribution

3. Practical examples – Use Cases

› Who else wants to take it at this stage?

4. Potential service scenarios – BC

› Recommendation to service scenarios...

5. Privacy issues – recommendations 6. Service roll out - plan

Slide 21