An Integrating Fresh Water An Integrating Fresh Water VRE for - - PowerPoint PPT Presentation

▶
an integrating fresh water an integrating fresh water vre
SMART_READER_LITE
LIVE PREVIEW

An Integrating Fresh Water An Integrating Fresh Water VRE for - - PowerPoint PPT Presentation

Jan 07, 2024 374 likes •607 views

An Integrating Fresh Water An Integrating Fresh Water VRE for LifeWatch (ongoing work) Showcasing tools and services from Research Showcasing tools and services from Research Infrastructures at EGI CF 2015 in Bari Jesus MARCO DE LUCAS .

slide-1
SLIDE 1

An Integrating Fresh Water An Integrating Fresh Water VRE for LifeWatch (ongoing work)

Showcasing tools and services from Research Showcasing tools and services from Research Infrastructures at EGI CF 2015 in Bari

Jesus MARCO DE LUCAS . Fernando AGUILAR , Daniel GARCÍA, Guadalupe CAÑAS (IFCA) Agustin MONTEOLIVA, Tamara SANTIAGO , Jose Augusto MONTEOLIVA (ECOHYDROS SL) Jose Augusto MONTEOLIVA (ECOHYDROS SL) Ana Yaiza RODRIGUEZ (AEONIUM) Juan Miguel GONZALEZ ARANDA (MINECO) AJ SAENZ (CITIC-CENTA)

JRU LW ES www.egi.eu

EGI-Engage is co-funded by the Horizon 2020 Framework Programme

  • f the European Union under grant number 654142

JRU LW ES

slide-2
SLIDE 2

SCOPE

An Integrating Fresh Water VRE for LifeWatch

  • IFCA Experience on Fresh Water systems
  • The current framework in LW: VRE, Cloud, existing examples
  • An Integrating VRE following the Data Life-Cycle:

Building an Open Science Framework

  • The “project” orientation
  • The hard question: integrating Digital Knowledge

2 11/10/2015

An Innovative Fresh Water VRE for LifeWatch

slide-3
SLIDE 3

EVOLUTION

Our interest on Fresh Water systems

  • 2005: Start of IFCA ECOHYDROS (SME) collaboration
  • 2005: Start of IFCA-ECOHYDROS (SME) collaboration

– Modeling for Itoiz water reservoir, CWM models (ELCOM, DYRESM+ CAEDYM) Modelling of A Watershed: A Distributed Parallel Application in a Grid Framework

  • 2008: DORII FP7 project
  • 2008: DORII FP7 project

– Monitoring platform @CdP , Instrumentation, Labview, Web Services, Grid Instrument Element

  • 2012: ROEM+ (LIFE+ project)

Extension of monitoring system – Extension of monitoring system – Start of use of Delft3D for hydrological and water quality (algae bloom)

  • 2013: Connecting with LifeWatch

Presentation to EGI – Presentation to EGI – SCARCE Int.Conference, NETLAKE

  • 2014: Extension of monitoring network

– Cogotas water reservoir: new monitoring station connected via 3G – Cogotas water reservoir: new monitoring station connected via 3G

  • 2015: Integration in the LW framework

– Observatory in EGI-Engage LW CC – CdP & SWIRL presented at Ecology at Interface (Rome)

3 11/10/2015

CdP & SWIRL presented at Ecology at Interface (Rome) – Case Study for Structural Funds project

  • An Innovative Fresh Water VRE for LifeWatch
slide-4
SLIDE 4

FRAMEWORK

  • LifeWatch (lifewatch.eu) is an ESFRI (EU Research Infrastructure)

– Addressing Biodiversity & Ecosystems Addressing Biodiversity & Ecosystems – An e-Infrastructure to build Virtual Research Environments (VRE) – Integrating OPEN DATA information

GBIF LTER GENBANK SATELLITE IMAGES TERRESTRIAL MAPS

  • GBIF, LTER, GENBANK, SATELLITE IMAGES, TERRESTRIAL MAPS...
  • EGI-LifeWatch Competence Center

– Framework: EGI FedCloud – Dedicated Resources (~5000 cores + PB, new node in Seville, Andalusia, SPAIN )

  • Support LW VRE

Marine VRE (marine lifewatch eu ) – Marine VRE (marine.lifewatch.eu ) – Terrestrial + FreshWater VRE

  • Pilot projects

– Ecological Observatories Data Flow and “Big Data” analysis – Workflows: Galaxy and TRUFA; Network of Life Citizen Science: Assisted Pattern Recognition

4 11/10/2015

– Citizen Science: Assisted Pattern Recognition

An Innovative Fresh Water VRE for LifeWatch

slide-5
SLIDE 5

Exploration of VREs in LW

  • LifeWatch Marine VRE

See LW EGI CC session @ Lisbon

  • Terrestrial-Fresh Water VRE

– Both SWIRL and CdP are included

S See LW EGI CC session @ BARI (TOMORROW!)

5 11/10/2015

  • Invasive Species VRE
slide-6
SLIDE 6

Global Scheme

USER APPLICATIONS Portals Visualization Liferay COMPOSITION Software as a Service (SaaS) Workflows Kepler, Taverna Platform for Collaborative Framework e INFRASTRUCTURE Platform as a Service (PaaS) Orchestration (ESB/BPL) O h Open Data & Preservation Platform Distributed Control Platform e‐INFRASTRUCTURE Infrastructure as a Service (IaaS) (Integration in EGI FedCloud) Orchestra SOA/ Cloud Computing RESOURCES “Internal” “External” ( g ) SITE SITE

6 11/10/2015

Internal Data External Data Network Servers Storage …

slide-7
SLIDE 7

Definition and

Human impact in Spanish basins

  • Dams, reservoirs, etc.

Changes in the environment due to new implementation of a new integrated model for management of

Changes in the environment due to new uses of the ground and built of infrastructures

Need of ensuring certain water quality information from hydrological networks

Need of ensuring certain water quality and flow levels.

Swirl combines 2000 different data sources (flow, purity, pluviometry rate,

Open(*) Resources and Products

LifeWatch Standard Architecture sources (flow, purity, pluviometry rate, etc.)

LifeWatch Standard Architecture

1700 Web Services in Catalogue

Focused on Science-based Exploitable Scenarios

Iterative-Agile Integrations, Deployments and Results

Iterative Agile Integrations, Deployments and Results

Integrating Researchers, Environmental Managers, Enterprises and Citizens.

7 LifeWatch ESFRI España

slide-8
SLIDE 8

EGI-LIFEWATCH / INDIGO-WP2 Case Study Monitoring & Modeling ALGAE BLOOM in a Water Reservoir

LIFE+ Project lead by a SME, collecting monitoring data (environmental station+ water quality and chloro-cyano profiler), and modeling hydro+bio – INTEGRATE EXISTING OPEN RESEARCH DATA

  • USE METEO, TERRAIN, BATHIMETRY, LAND USE

STORAGE+COMPUTING NEED HPC FOR DELFT 3D

  • HYDROLOGICAL INPUT

– PRESERVE NEW OPEN RESEARCH DATA & ANALYSIS

NEED HPC FOR DELFT‐3D

  • REMOTELY COLLECTED DATA INTO REPLICATED DB
  • COMPLEX MODEL OUTPUTS
  • MULTIPARAMETRIC ANALYSIS

Model already running in FedCloud Adapt Multiparametric scan

8 11/10/2015

An Innovative Fresh Water VRE for LifeWatch

Preserve Thermoclines analysis (in R)

slide-9
SLIDE 9

SOLUTIONS EXPLORED

  • Support external resources (data, tools): VRE

E bl “/lif t h/h ” f h h / h See OPEN DATA Commons session @ RDA

  • Enable a “/lifewatch/home” for each researcher/each

community, accessible with ID via a preservation portal

  • Users will define the “openness” of their
  • Users will define the openness of their
  • DATA (private/embargo/open/published-DOI)
  • ANALYSIS (R/python, via github)

ANALYSIS (R/python, via github)

  • WORKFLOWS at SaaS level (R,python)
  • Support it with a global (federated) distributed storage

pp g ( ) g

  • OneData (Data Commons basic component)
  • Integrated also with FedCloud computing resources
  • We will rely on INDIGO project developments to optimize!
  • Enforce DMP (Data Management Plan)

9 11/10/2015

An Innovative Fresh Water VRE for LifeWatch

If it needs to be preserved => DMP & OPEN (after embargo)

slide-10
SLIDE 10

AN INTEGRATING VRE FRAMEWORK

  • Based on the idea of a Digital Knowledge Platform as a

Framework for Open Science

See DKP talk tomorrow in

Framework for Open Science

– Start from Data Life-Cycle – Dual View: Data & Software

See DKP talk tomorrow in “Data without boundaries” session (16h20)

– Incorporate Digital Knowledge from start – Integration of external resources – Include Acquisition q – Incorporate Analysis – &… Simplify Workflows – Enable Publication of Datasets – Enable Publication of Datasets

  • Developed initially as a Open Data Preservation Portal

– Using Structural Funds Project for LW in Spain – In collaboration with

  • Aeonium
  • Viavansis

Ad i

See “Setting up a new FedCloud site in collaboration with the industry” talk Thursday in

10 11/10/2015

  • Adevice
  • Telefonica

y y “Community Cloud” session (15h35)

slide-11
SLIDE 11

APPLIED TO CdP WATER RESERVOIR

  • Start from Data Life-Cycle
  • DMP for CdP (already in INDIGO), DMP Online Tool
  • Incorporate Digital Knowledge from start
  • Understand the use of “ontologies”
  • Dual View: Data & Software
  • Dual View: Data & Software
  • Integration of external resources

– Other measurements, maps & GIS… – Models Output (example: Delft3D, ABM based)

  • Include Acquisition

– Ex: replace LabView web services using pyVISA from Jupyter Ex: replace LabView web services using pyVISA from Jupyter – Directly store into cloud enabled workspace (OneData)

  • Incorporate Analysis

& Si lif W kfl

  • &… Simplify Workflows

– Jupyter/Python notebook Thermoclinae example

  • Enable Publication of Datasets

11 11/10/2015

– Mint DoI

slide-12
SLIDE 12

Projects follow the Data Life-Cycle: Plan

12 11/10/2015

slide-13
SLIDE 13

Projects follow the Data Life-Cycle: Describe

13 11/10/2015

slide-14
SLIDE 14

Projects follow the Data Life-Cycle: Analyze

14 11/10/2015

slide-15
SLIDE 15

Projects follow the Data Life-Cycle: Analyze

15 11/10/2015

slide-16
SLIDE 16

Projects follow the Data Life-Cycle: Preserve

16 11/10/2015

slide-17
SLIDE 17

Projects follow the Data Life-Cycle: Publish

17 11/10/2015

slide-18
SLIDE 18

An integrating VRE oriented to Projects

Technical question: connect with OpenProject?

18 11/10/2015

Technical question: connect with OpenProject? ‐code: github ‐resources: VO policies, groups , VM…

slide-19
SLIDE 19

Key question: Incorporate Digital Knowledge

  • Software (VM) + Data preservation is not enough

– Ideas explored under CMS preservation Ideas explored under CMS preservation

  • Validation
  • Analysis Description

– CHEP 2014 discussion Knowledge Preservation

Incorporate Digital Knowledge from start

  • Incorporate Digital Knowledge from start

– Understand the use of “ontologies” / “semantics”

  • Ontologies are not taxonomies
  • Ontologies are not metadata
  • Ontologies are not (restricted) vocabularies
  • Under analysis for Fresh Water VRE:

– Ontological Framework explored: SWEET O t l i EML d W t EML – Ontologies: EML and WaterEML – Consider report at RDA 2015 (Paris) devoted session – What about INSPIRE directive?

  • First try:
  • First try:

– Build on SWEET – Start from vocabularies used in CdP

  • Yet how to integrate into DMP? Ideal (unify) is obvious

19 11/10/2015

Yet, how to integrate into DMP? Ideal (unify) is obvious…

slide-20
SLIDE 20

Incorporating Digital Knowledge…

OWL via PORTEGE OWL via PORTEGE (to be integrated !!!) BUT… BUT… We NEED key questions to understand what we can/want to do /

20 11/10/2015

slide-21
SLIDE 21

Incorporating Digital Knowledge…

SPARQL via PORTEGE SPARQL via PORTEGE (to be integrated !!!) BUT… BUT… We NEED key questions to understand what we can/want to do /

21 11/10/2015

slide-22
SLIDE 22

Thank you for your attention.

Tourists in the ARTIC seeing how glaciers melt

Questions?

Tourists in the ARTIC seeing how glaciers melt

You are invited to the LW CC meeting at 17h on Monday Join EGI‐LW CC meeting in EGI Conference in BARI meeting at 17h on Monday 18th and on Thursday 21st EGI Conference in BARI Tomorrow 11/11 @ 9h

It takes a while! How boring!

www.egi.eu

This work by Parties of the EGI-Engage Consortium is licensed under a Creative Commons Attribution 4.0 International License.