Update on NIIFI's storage and cloud related activities TF-Storage - PowerPoint PPT Presentation

Update on NIIFI's storage and cloud related activities TF-Storage Meeting September 27, 2012 Dubrovnik, Croatia Szabolcs Székelyi <szekelyi@niif.hu>

Agenda Storage infrastructure update ● Archiving service ● Cloud GUI ● Cloud without OpenNebula ● A lesson learned ●

Storage infrastructure 2 new Eternus DX90s ● Deployed in Debrecen ● 4 x 10 GE fiber ● Redundant connection to HPC ● network and HBONE Total 1 PB storage, nearly fully ● booked

Archiving service – infrastructure Based on Oracle StorageTek SL3000 ● in Sopron 4 x LTO-5 drives ● 696 tapes, 1.5 TB each ● Fujitsu PRIMERGY TX300 S6 ● 8 TB local disk storage ● SSD? ● Planned services ● Archival ● HSM (local – iSCSI – tape) ●

Archiving service User's server Archive... ● ... a file set ● ... from a URL (recursively) ● ... to a specific tape ● No delete (for individual files) ● No overwrite ● Frontend Backend but versioning is supported ● Deduplication (on the file level) ● Supported protocols: HTTP, ● HTTPS, FTP, FTPS, SFTP

Archiving service – file sets

Archiving service – file set view

Archiving service – merged view

Archiver – backend workflow Pending ExpanderWorker JobLCM NetworkWorker TapeWorker Done

Archiving service – screenshot 1

Archiving service – screenshot 2

Archiving service – screenshot 3

Cloud GUI All VM and VNet functions available (except ACL management) ● Uses REST API ● Federated authentication ● EPPN & token based access ● Full-featured HTML5 console access (based on Guacamole) ● On-screen keyboard (mobile device friendly) ● Well tested, few small bugs possible ● Demo... ●

NC without OpenNebula

NC without OpenNebula Replace ONE calls with libvirt calls ● Take over... ● host provisioning & monitoring ● lifecycle management ● resource authority (IP and MAC addresses, etc.) ● Successful PoC ● Started first VM ● 80% ready ● Accelerate implementation of future features ● Changing VM config, IPv6, foreign APIs, etc. ●

Roll your own? vs.

A lesson learned THINK TWICE BEFORE YOU DISTRIBUTE YOUR SERVICES More latency → lower performance ● More network equipment → more network outages ● More power sources → more power outages ● More people → more human errors ● (“Sorry, we pulled the plug, don't you mind?”)

Thank you. Question time! Szabolcs Székelyi <szekelyi@niif.hu>