SLIDE 1
Ivan Andrian – 2018.05.24 JRA Face to Face Meeting – ESRF
JRA2 Task 24.7 Testing
2
JRA2 Task 24.7 Testing JRA Face to Face Meeting ESRF Ivan Andrian - - PowerPoint PPT Presentation
JRA2 Task 24.7 Testing JRA Face to Face Meeting ESRF Ivan Andrian - - PowerPoint PPT Presentation
JRA2 Task 24.7 Testing JRA Face to Face Meeting ESRF Ivan Andrian 2018.05.24 2 Data Storage for DaaS VM/Docker KVM Access Data Expose it i 2.5 600GB 15kRPM A 800GB HGST NVMe (1 SSD serves 5 OSDs) 6TB 7200RPM B SSD for
SLIDE 2
SLIDE 3
Ivan Andrian – 2018.05.24 JRA Face to Face Meeting – ESRF
Data Storage for DaaS
3
i A B
KVM
6TB 7200RPM SSD for journaling
(1 SSD serves 5 OSDs)
2.5” 600GB 15kRPM 800GB HGST NVMe
(1 SSD serves 5 OSDs)
VM/Docker Access Data Expose it
Life (of big storage) in the fast lane Ivan Andrian, Roberto Passuello, Iztok Gregori, Massimo Del Bianco DOI: 10.26314/GARR-Conf17-proceedings-22
SLIDE 4
Ivan Andrian – 2018.05.24 JRA Face to Face Meeting – ESRF
Easy and direct access to data
4
From filesystem to objects NFS/SMB/DAV treated as legacy Direct RADOS access to data Local infrastructure for DaaS ✗ KVM + Docker spreading no orchestrator yet ✗ Guacamole for Remote Access
SLIDE 5
Ivan Andrian – 2018.05.24 JRA Face to Face Meeting – ESRF
5
Browse and download dataset
SLIDE 6
Ivan Andrian – 2018.05.24 JRA Face to Face Meeting – ESRF
6
JRA2 Tasks
SLIDE 7
Ivan Andrian – 2018.05.24 JRA Face to Face Meeting – ESRF
7
T24.7 – Testing
Deploy packages (containers?) of 24.5 on local infrastructure Test them with real data The same test should be replicated in other facilities
SLIDE 8
Ivan Andrian – 2018.05.24 JRA Face to Face Meeting – ESRF
8
Use cases at Elettra
- T 24.3 selected 5 applications
- ELETTRA focuses on PyMca and Ptycho
Shelves
- Two good BL candidates have been selected
at Elettra: TwinMic and XRF
SLIDE 9
Ivan Andrian – 2018.05.24 JRA Face to Face Meeting – ESRF
9
Use cases at Elettra
PyMca in TwinMic beamline and XRF beamline
SLIDE 10
Ivan Andrian – 2018.05.24 JRA Face to Face Meeting – ESRF
10
Use cases at Elettra
Ptycho Shelves in SciComp and TwinMic PtyPy under evaluation so far
Kourousias et al. Nano Research, Vol. 9 - 7, (2016)
SLIDE 11
Ivan Andrian – 2018.05.24 JRA Face to Face Meeting – ESRF
11
How, who and when
- Will hire two persons for 6M (from September?)
- Support of Elettra ICTSS activity for infrastructure
- Real data are ready
– When tested, we can also engage real users
- Deployment technology?
- Containers?
- Orchestrator?
- Resulting data retrieval?
SLIDE 12