TERENA Trusted Cloud Drive pilot STATUS UPDATE Motivations Since - PowerPoint PPT Presentation

TF-Storage meeting 26-27 September 2012 Dubrovnik, Croatia Peter Szegedi Project Development Officer szegedi@terena.org www.terena.org TERENA Trusted Cloud Drive pilot STATUS UPDATE

Motivations Since 2 0 1 0 , TERENA has been actively looking into how NRENs can offer cloud services. › Task Force on the Management of Service Portfolios (TF-MSP) has investigated business aspects of NRENs offering clouds or cloud brokerage services. › Task Force on Storage (TF-Storage) covers more technical aspects, providing a forum for exchanging and promoting ideas. › At the pan-European level, TERENA is also leading the ASPIRE foresight study, which includes the adoption of cloud services within the research and education community. › develop a pilot activity for NRENs to experiment and gain experience with clouds and applications;

Aim of the pilot › to explore possible deployment scenarios for a trusted storage service for NRENs: › longer term sustainability for a potential service; › legal aspects and perceived trust issues related to the storage and management of the encryption keys and metadata; › software scalability and performance.

I dea and Concept › Federated › Encrypted › Metadata and storage data separated › Trusted › Brokered › Flexible › Open-sourced Unique Selling Points

I dea... encryption Metadata Storage Cloud Storage Provider data Windows7 Android Mac OS iOS Linux Trusted party

TERENA Trusted Cloud Drive pilot Phase I - DONE Native support of platform s Public Cloud Storage Windows7 Cloud broker facility Providers Android Mac OS METADATA iOS W EB Linux I n- built Am azon S3 interface Trusted party Web encrypted blob page Metadata store federated access Local file system WebDAV Can run on local premisses DI SK Federated access Local Storage

Features I › Federated access › Web interface › Create, delete, modify folders › Upload, download files › Tagging › Search by tags (only) › Public folder › Shared folder (in progress) › Disk activation

Features I I › Virtual disk drive › Create, delete, modify folders › Upload, download files › Creating folders makes search in tags › Full filename search › Platforms and clients › Windows7 (BitKinex, native WE in progress) › Android 2.3 (WebDAV File Manager, WebDAV Navigator Lite) › MacOS (Native, Transmit, Cyberduck) › iOS (WebDAVNav+ , Keynote, Pages, Goodreader)

Actual lim itations of the TERENA pilot installation › Federated access is whitelisted for the pilot › Metadata store is inside the VM (20GB) › Local storage is 100GB › Bulit-in Amazon S3 interface › Filesize limit of 5GB › Only 2 VMs › VM1 (tc1.terena.org) is the WebDAV daemon › VM2 (tc2.terena.org) is the Website and Metadata store › Daily backup of VMs › No limit on the # concurrent users, daemons scale horizontally (stateless against metadata store Voldemort from LinkedIn) › Upload, compression, and encryption at application level › CPU > I O

Developm ent roadm ap › Code is opensource › Available at https: / / github.com/ VirtualCloudDrive/ CloudDrive › Apache License, Version 2.0 › Documented › Downloadable images.... (what?) › Maarten’s roadmap › Sharing is in progress › Billing, quota, metering is in the code › Back-end API support... › What is our roadmap?

Three w ays to participate Phase I I - OPEN Pilot runs until March 2013: 1. Bring your federated test users Must be whitelisted... 2. Attach your storage back-end a) Develop the interface to your storage (contribution to the project) b) Generic S3 API c) Jclouds API 3. Get familiar with the code a) Wiki documentation! b) Take the code and DI Y

Actual status › Interested participants (18) › (13) ACOnet, ARNES, BELNET, CARNet, CESNET, CSC/ FUNET, FCCN, GRNET, NIIF, PSNC, RedIRIS, SURFnet, SWITCH › (3) ERNET India, AARnet Australia, RNP Brazil › (4) CESCA, EPFL, Uni. Malta, Scre › Test accounts › 17 BETA testers - initial feedback... › Amazon grant – application... › First installation (other than TERENA) › PSNC – Installation Guide... › Support contract with Maarten... › Next steps › Build a development community around the code › Validate service delivery scenarios Slide 12

Open issues › Who else is interested in installing the cloud platform at their location for experimental purposes? › Co-owners, develppers’ community › Amazon or VMware image? › Own software development roadmap! › Which API development option would you prefer, purely from your storage back-end and service development point of view? › Who is interested in introducing this cloud platform as a service and what would be the main characteristics of such a service? › Service development › Scenarios... › Integration with Unhosted, FileSender, others... Slide 13

Service delivery scenarios 1. Hosted service scenarios a) Fully centralised model b) Distributed storage model 2. Brokered service scenarions a) Centralised storage model b) Fully distributed model

Hosted Service Scenario A Fully Centralised Model User DATA Storage DATA CONTRACT Public Storag e Cloud Broker Web page Metadata store WebDAV NREN NREN NREN USERS USERS USERS Slide 15

Hosted Service Scenario B Distributed Storage Model NREN NREN Public Storage Storag e Cloud Broker Web page Metadata store NREN WebDAV USERS NREN Storage NREN USERS User DATA Storage DATA CONTRACT Slide 16

Brokered Service Scenario A Centralised Storage Model User DATA Storage DATA CONTRACT Public Storag e Cloud Broker Cloud Broker Cloud Broker Web page Web page Web page Metadata Metadata Metadata store store store WebDAV WebDAV WebDAV NREN NREN NREN USERS USERS USERS Slide 17

Brokered Service Scenario B Fully Distributed Model Public NREN Storag e NREN Storage Cloud Broker NREN Cloud Broker Web page Metadata store Web page WebDAV Metadata USERS NREN store WebDAV Storage NREN USERS User DATA Storage DATA CONTRACT Slide 18

I DEA: TERENA Cloud Storage Store • Federated web portal • Download options • AUP / SLA Organisation I tem Pricing AUP/ SLA Cloud Broker Web page Free* Open TERENA Metadata store WebDAV [ NREN x] TBD National use only NREN Storage API [ Commercial x] Storage API EU use only Public TBD Slide 19

Adm inistrativa › May 2 0 1 2 – Pre-installation : System installation and technical documentation concerning the installation process (phase i). › Jan 2 0 1 3 – Describe possible service m odels : This document will describe what service(s) can be deployed and how and will detail the service scenario recommended to phase ii and the related metrics to asses the pilot. The scenario of TERENA offering this as a (sharing) service will be considered. › March 2 0 1 3 – Final report : Provide an evaluation of the pilot and recommendations for the next steps, based on the success of the pilot. Technical recommendations for NRENs that wish to run a local instance of the software will also be provided. Slide 20

Sum m ary 1. Code co-owners + support (News Item PHOTO) › Downloadable image? › Documentation... › Amazon grant.... 2. TERENA software development roadmap › Generic S3 › Jclouds API › Direct bridge - contribution 3. Practical examples – Use Cases › Who else wants to take it at this stage? 4. Potential service scenarios – BC › Recommendation to service scenarios... 5. Privacy issues – recommendations 6. Service roll out - plan Slide 21