Update on NIIFI's storage and cloud related activities TF-Storage - - PowerPoint PPT Presentation

▶

May 29, 2023 687 likes •878 views

Update on NIIFI's storage and cloud related activities TF-Storage Meeting September 27, 2012 Dubrovnik, Croatia Szabolcs Szkelyi <szekelyi@niif.hu> Agenda Storage infrastructure update Archiving service Cloud GUI

SLIDE 1

Update on NIIFI's storage and cloud related activities

TF-Storage Meeting September 27, 2012 Dubrovnik, Croatia Szabolcs Székelyi <szekelyi@niif.hu>

SLIDE 2

Agenda

Storage infrastructure update
Archiving service
Cloud GUI
Cloud without OpenNebula
A lesson learned

SLIDE 3

Storage infrastructure

2 new Eternus DX90s
Deployed in Debrecen
4 x 10 GE fiber
Redundant connection to HPC

network and HBONE

Total 1 PB storage, nearly fully

booked

SLIDE 4

Archiving service – infrastructure

Based on Oracle StorageTek SL3000

in Sopron

4 x LTO-5 drives
696 tapes, 1.5 TB each
Fujitsu PRIMERGY TX300 S6
8 TB local disk storage
SSD?
Planned services
Archival
HSM (local – iSCSI – tape)

SLIDE 5

Archiving service

Archive...
... a file set
... from a URL (recursively)
... to a specific tape
No delete (for individual files)
No overwrite
but versioning is supported
Deduplication (on the file level)
Supported protocols: HTTP,

HTTPS, FTP, FTPS, SFTP

Backend User's server Frontend

SLIDE 6

Archiving service – file sets

SLIDE 7

Archiving service – file set view

SLIDE 8

Archiving service – merged view

SLIDE 9

Archiver – backend workflow

ExpanderWorker NetworkWorker TapeWorker JobLCM Done Pending

SLIDE 10

Archiving service – screenshot 1

SLIDE 11

Archiving service – screenshot 2

SLIDE 12

Archiving service – screenshot 3

SLIDE 13

Cloud GUI

All VM and VNet functions available (except ACL management)
Uses REST API
Federated authentication
EPPN & token based access
Full-featured HTML5 console access (based on Guacamole)
On-screen keyboard (mobile device friendly)
Well tested, few small bugs possible
Demo...

SLIDE 14

NC without OpenNebula

SLIDE 15

NC without OpenNebula

Replace ONE calls with libvirt calls
Take over...
host provisioning & monitoring
lifecycle management
resource authority (IP and MAC addresses, etc.)
Successful PoC
Started first VM
80% ready
Accelerate implementation of future features
Changing VM config, IPv6, foreign APIs, etc.

SLIDE 16

Roll your own?

vs.

SLIDE 17

A lesson learned

More latency → lower performance
More network equipment → more network outages
More power sources → more power outages
More people → more human errors

(“Sorry, we pulled the plug, don't you mind?”)

THINK TWICE BEFORE YOU DISTRIBUTE YOUR SERVICES

SLIDE 18

Thank you. Question time!

Szabolcs Székelyi <szekelyi@niif.hu>