Data Management at Ocean Networks Canada Benoît Pirenne, Reyna Jenkyns, September 11, 2016
What is Ocean Networks Canada? Support broad science themes (climate, biology, geology, oceanography, …) • Provides societal benefits: marine and public safety data products, and data services to gov’t •
What is Ocean Networks Canada? • Science and science-based services provider • research infrastructure • manufacture and delivery of data products aimed at government and industry • Operator of sensor networks, land-based or underwater • real-time data acquisition where possible, thanks to high- bandwidth communications • high time resolution thanks to ample power • sophisticated Data Management (Oceans 2.0)
ONC’s data Management Oceans 2.0 • ONC’s Oceans 2.0 is unique in the world for its ocean (meta)data management capabilities (realtime/offline/QAQC/event detection/product generation/complete metadata management) • Oceans 2.0 is a >$25M investment from Canada, British Columbia over the past 12 years • Improves continuously (2016 new funding: $5M from BC to build operational Early Earthquake Warning, $0.6M from CANARIE for data processing sandbox)
Oceans 2.0 capabilities Data Acquisition
Oceans 2.0 capabilities Data Archival • Currently hosting data from: • 7 different sensor networks • 4 x 10 2 instruments • 5 x 10 3 sensors • 3 x 10 6 files • x 10 10 measurements • >300TB in the archive, with full copy 1600km away • Many data types supported (scalar, complex, stream)
Oceans 2.0 capabilities Hosting of non-ONC data • 3rd party data hosting capabilities • Data ownership acknowledged • Specific data access policy accommodated • Leveraging of data preview, search and download capabilities • Access through web services for 3rd party data portals, direct software access
Oceans 2.0 capabilities Hosting of non-ONC data: examples • Citizen Scientist collected data (ONC App) • Previously published, hard to access datasets • Data from buoys, coastal radars, gliders, ferries • Automatic capture of data from vessels, … • Added ability to provide QA/QC and specialized data products
Recommend
More recommend
