Data Management at Ocean Networks Canada Benot Pirenne, Reyna - - PowerPoint PPT Presentation

data management at ocean networks canada
SMART_READER_LITE
LIVE PREVIEW

Data Management at Ocean Networks Canada Benot Pirenne, Reyna - - PowerPoint PPT Presentation

Data Management at Ocean Networks Canada Benot Pirenne, Reyna Jenkyns, September 11, 2016 What is Ocean Networks Canada? Support broad science themes (climate, biology, geology, oceanography, ) Provides societal benefits: marine and


slide-1
SLIDE 1

Data Management at Ocean Networks Canada

Benoît Pirenne, Reyna Jenkyns, September 11, 2016

slide-2
SLIDE 2

What is Ocean Networks Canada?

  • Support broad science themes (climate, biology, geology, oceanography, …)
  • Provides societal benefits: marine and public safety data products, and data services to gov’t
slide-3
SLIDE 3

What is Ocean Networks Canada?

  • Science and science-based services provider
  • research infrastructure
  • manufacture and delivery of data products aimed at government

and industry

  • Operator of sensor networks, land-based or

underwater

  • real-time data acquisition where possible, thanks to high-

bandwidth communications

  • high time resolution thanks to ample power
  • sophisticated Data Management (Oceans 2.0)
slide-4
SLIDE 4

ONC’s data Management

Oceans 2.0

  • ONC’s Oceans 2.0 is unique in the world for

its ocean (meta)data management capabilities

(realtime/offline/QAQC/event detection/product generation/complete metadata management)

  • Oceans 2.0 is a >$25M investment from

Canada, British Columbia over the past 12 years

  • Improves continuously (2016 new funding: $5M from

BC to build operational Early Earthquake Warning, $0.6M from CANARIE for data processing sandbox)

slide-5
SLIDE 5

Oceans 2.0 capabilities

Data Acquisition

slide-6
SLIDE 6

Oceans 2.0 capabilities

Data Archival

  • Currently hosting data from:
  • 7 different sensor networks
  • 4 x 102 instruments
  • 5 x 103 sensors
  • 3 x 106 files
  • x 1010 measurements
  • >300TB in the archive, with full copy

1600km away

  • Many data types supported (scalar,

complex, stream)

slide-7
SLIDE 7

Oceans 2.0 capabilities

Hosting of non-ONC data

  • 3rd party data hosting capabilities
  • Data ownership acknowledged
  • Specific data access policy accommodated
  • Leveraging of data preview, search and download

capabilities

  • Access through web services for 3rd party data

portals, direct software access

slide-8
SLIDE 8

Oceans 2.0 capabilities

Hosting of non-ONC data: examples

  • Citizen Scientist collected data (ONC App)
  • Previously published, hard to access datasets
  • Data from buoys, coastal radars, gliders, ferries
  • Automatic capture of data from vessels, …
  • Added ability to provide QA/QC and specialized

data products

slide-9
SLIDE 9