Handling time-critical service applications with EGI e-Infrastructure Joao Pina, EGI Foundation Portuguese NGI representative INCD / LIP www.egi.eu This work by EGI.eu is licensed under a Creative Commons Attribution 4.0 International License.
EGI: advanced computing for research EGI… …delivers advanced computing services to support scientists, multinational projects, research infrastructures and industry www.egi.eu 2016/11/29 2
EGI Federation, 2016 QR3 The largest distributed compute e-Infra worldwide 2016/11/29 3
Service Catalogue 2016/11/29 4
The list of services that EGI as a federation EGI service offers for research & innovation portfolio IT4RIs workshop @RTSS 2016, 29 Nov - 02 Dec, Porto 2016/11/29 5
● EGI Federated Cloud 2016/11/29 6
EGI Federated Cloud • • • • • → → 2016/11/29 7
EGI Federated Cloud • • • • • 2016/11/29 8
Architecture of EGI FedCloud 23/11/29 9
Access to the Federated Cloud: Virtual Organisations Generic VOs → Incubator for new users Sector-specific VOs → Dedicated environments 23/11/29 10
23/11/29 11
Who Use EGI? 23/11/29 12
SLA negotiation ● EGI Foundation is acting as negotiator for communities ○ Finds and arranges resources that ‘fit for purpose’ ● Process is facilitated by ○ E-GRANT, Council surveys, broadcasting tool for sites ● SLA agreed with ○ BILS, MoBrain, DRIHM, EXTraS, DARIAH-CC, Terradue (ESA TEPs), LSGC and Peachnote, Bioisi, EMSO_DEV ● Finalising requests of D4Science … 23/11/29 13
FedCloud Typical usage models ● ○ ○ ● ○ ● ○ ● ○ 23/11/29 14
Support of RealTime Applications ● ○ ○ ■ ■ ● ○ ○ ● ○ ■ 2016/11/29 15
● 2016/11/29 16
Near-real time earthquake simulations 23/11/16 17
● Building the EMSODEV Data Management Platform (DMP) using EGI Federated Cloud ○ Push Transfer Flow : data is sent to a DMP service which “listens” to near-real time updates on XML files describing sensors data and measurements ○ Pull Transfer Flow : data is retrieved via API exposed by an OGC SOS server available at the OBSEA observatory located in Vilanova and managed by Universitat Politecnica De Catalunya. 2016/11/29 18
DATA MANAGEMENT PLATFORM Production VO: vo.emsodev.eu Cloud Compute: ~10 VMs (8 CPUs + 16GB RAM + 40GB HD) File Storage: 5 TB 2016/11/29 19
● 2016/11/29 20
● ● ● ● ● 2016/11/29 21
● ● ● ● ● 2016/11/29 22
But: Cloud Challenges ● It’s new ! ● Security / your intellectual property ● Traditional software licensing ● Data transfer ● Cloud expertise is needed ● Losing control over your jobs and data ● First access to clouds is often cumbersome 2016/11/29 23
● 2016/11/29 24
Software Containers remove or reduce cloud challenges ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ ✓ Beta phase ✓ 2016/11/29 25
Thank you for your attention Questions? 2016/11/29 26
Recommend
More recommend
