GEO-Software R. Prez, G. Gonzlez, J. Becedas, F. Pedrera, M. J. - - PowerPoint PPT Presentation

geo software
SMART_READER_LITE
LIVE PREVIEW

GEO-Software R. Prez, G. Gonzlez, J. Becedas, F. Pedrera, M. J. - - PowerPoint PPT Presentation

Testing Cloud Computing for Massive Space Data Processing Storage and Distribution with Open Source GEO-Software R. Prez, G. Gonzlez, J. Becedas, F. Pedrera, M. J. Latorre Jonathan Becedas, PhD R&D Manager This project has received


slide-1
SLIDE 1

This project has received funding from the European Union’s Seventh Framework Programme for research, technological development and demonstration under grant agreement no 318389

Testing Cloud Computing for Massive Space Data Processing Storage and Distribution with Open Source GEO-Software

  • R. Pérez, G. González, J. Becedas, F. Pedrera, M. J. Latorre

Jonathan Becedas, PhD R&D Manager FOSS4G-E 2014 July 16

slide-2
SLIDE 2

2

Outline

— Introduction — The GEO-Cloud Experiment — Preliminary Results — Conclusions — Acknowledgements

slide-3
SLIDE 3

3 1

Introduction

slide-4
SLIDE 4

4

Introduction

— The Organization

— Technology branch of Elecnor Group — >500 employees — Markets: Aeronautics, Aerospace, Defense, Transport, Energy and

Environment, ICT and Security. (www.deimos-space.com)

slide-5
SLIDE 5

5

Introduction

— The Fed4FIRE Project

— Integrated Project under European Union’s FP7, Future Internet Research and

Experimentation (FIRE)

— Coordinator: iMinds — 29 partners — Scope and objective: Federation of Future Internet European Facilities for

innovative experiments (http://www.fed4fire.eu/)

slide-6
SLIDE 6

6

Introduction

— The GEO-Cloud Experiment

— Uses several federated testbeds: PlanetLab, BonFIRE and Virtual Wall. — Main Objective: Implementation of a realistic and complete Earth Observation

system to validate if cloud computing offers viable solutions to manage big data.

Virtual Wall

slide-7
SLIDE 7

7 2

The GEO-Cloud Experiment

slide-8
SLIDE 8

8

The GEO-Cloud Experiment

Traditional Data Centers

  • n Premises

Complete EO System in Cloud

Earth Observation Big Data ü Flexible ü Scalable ü On Demand ü Globally Accesible ü Data Fusion ü New Applications ü High Added Value Earth Observation Big Data ü Difficult to Process ü Difficult to Store ü Difficult to Distribute ü Not Flexible ü Applications Limited ü Expensive ü Completely Controlable Viable Solution?

slide-9
SLIDE 9

9

The GEO-Cloud Experiment

— Space Mission

  • Daily coverage of the World surface with satellite images.
  • Resolution 6.7m
  • Swath 160km
  • Generation of 20TB daily
  • Transfer of data into the cloud

12 Ground Stations Constellation of 17 Satellites

slide-10
SLIDE 10

10

The GEO-Cloud Experiment

Virtual Wall

Space System Simulation Emulation of the network between Ground Stations and Data Center Real Data Center in Cloud

Off Line Experiment Real Time Experiment

— GEO-Cloud in Fed4FIRE

slide-11
SLIDE 11

11

The GEO-Cloud Experiment

Virtual Wall

Space System Simulation Emulation of the network between Ground Stations and Data Center Real Data Center in Cloud

Off Line Experiment Real Time Experiment

— GEO-Cloud in Fed4FIRE

slide-12
SLIDE 12

12

The GEO-Cloud Experiment

— Virtual Wall

  • Infrastructure to deploy virtual machines.
  • Any topology network can be created.
  • Controllability and monitoring (Bandwidth, Loss Rate, Latency).
  • Simulation of the Space System (Satellites and Ground Stations).

Sat1 Sat2 Sat20 GS1 GS2 GS12

To BONFIRE

slide-13
SLIDE 13

13

The GEO-Cloud Experiment

Virtual Wall

Space System Simulation Emulation of the network between Ground Stations and Data Center Real Data Center in Cloud

Off Line Experiment Real Time Experiment

— GEO-Cloud in Fed4FIRE

slide-14
SLIDE 14

14

The GEO-Cloud Experiment

Virtual Wall

Space System Simulation Emulation of the network between Ground Stations and Data Center Real Data Center in Cloud

Off Line Experiment Real Time Experiment

— GEO-Cloud in Fed4FIRE

slide-15
SLIDE 15

15

The GEO-Cloud Experiment

— BonFIRE

  • Multi-cloud testbed
  • Monitoring and controllability
  • Implementation of a real data centre in cloud

From Virtual Wall From Other Sources

slide-16
SLIDE 16

16

The GEO-Cloud Experiment

— BonFIRE

  • Implementation with an Orchestrator which ingests the raw data into

the cloud and automatically manages the transfer of data between modules

slide-17
SLIDE 17

17

The GEO-Cloud Experiment

Virtual Wall

Space System Simulation Emulation of the network between Ground Stations and Data Center Real Data Center in Cloud

Off Line Experiment Real Time Experiment

— GEO-Cloud in Fed4FIRE

slide-18
SLIDE 18

18

The GEO-Cloud Experiment

Virtual Wall

Space System Simulation Emulation of the network between Ground Stations and Data Center Real Data Center in Cloud

Off Line Experiment Real Time Experiment

— GEO-Cloud in Fed4FIRE

slide-19
SLIDE 19

19

The GEO-Cloud Experiment

— PlanetLab

  • It offers the possibility of testing real networks.
  • Emulation in real environment
  • Measurement of impairments of the networks tested: Bandwidth,

Latency and Loss Rate.

Network impairments

slide-20
SLIDE 20

20

The GEO-Cloud Experiment

— Experiment

Basic services High added value services Hosting services

Crisis management, infrastructure monitoring, precission agriculture, etc.

Processing Time? Workload?

slide-21
SLIDE 21

21 3

Preliminary Results

slide-22
SLIDE 22

22

Preliminary Results

— Graphical User Interface to control and monitor the experiment — Scenario: Infrastructure monitoring – Railway Medina-Mecca — Time from ingestion of data in the cloud until a user accesses a

geolocated image with radiometric calibration: 8 minutes.

slide-23
SLIDE 23

23

Preliminary Results

— Automatic archive and catalogue of satellite imagery.

slide-24
SLIDE 24

24

Preliminary Results

— Instantaneous access to satellite imagery through the Internet.

slide-25
SLIDE 25

25 4

Conclusions

slide-26
SLIDE 26

26

Conclusions

— Experiment conclusions

  • Complete design and implementation of a

complete EO system in Fed4FIRE

  • Reduction in the time from acquisition of data until

its distribution to end users.

  • Automatic archive and catalogue
  • Internet access
  • First round of experiments in progress
slide-27
SLIDE 27

27

Conclusions

— Benefits of using Fed4FIRE

  • Multi-testbed connectivity
  • Simulation environment accessibility
  • Emulation environment accessibility
  • Real infrastructures to test real developments
  • Controllability at all levels
  • Monitoring at all levels
  • Access to control and monitoring tools: NEPI, Jfed,

BonFIRE web.

slide-28
SLIDE 28

28

Acknowledgement

— This work was carried out with the support of the

Fed4FIRE-project (“Federation for FIRE"), an Integrated project receiving funding from the European Union’s Seventh Framework Programme for research, technological development and demonstration under grant agreement no 318389

— It does not necessarily reflect the views of the European

  • Commission. The European Commission is not liable for

any use that may be made of the information contained herein.

slide-29
SLIDE 29

29

Thanks for your attention

Contacts: jonathan.becedas@elecnor-deimos.es felix.pedrera@deimos-space.com ruben.perez@elecnor-deimos.es manuel-jose.latorre@deimos-space.com