VRE for Northern Eurasia climatic studies Evgeny GORDOV SCERT/IMCES SB RAS and Tomsk State University gordov@scert.ru 1
OUTLINES The state of the art: • Big data • Virtual research environment • Integrated regional studies: SIRS/NEESPI/PEEX Platform CLIMATE • Functionality • Some results of climatic extremes analysis • Education Plans/Perspectives 2
Data, information and knowledge (Richard Kenway) virtual data – from a database somewhere – computed (on request) – measured (on request) – data : un-interpreted bits and bytes – i nformation : data equipped with meaning – knowledge : information applied to solve a problem 3
AGU FM 2013 B. Lawrence and M. Juckes From petascale to exascale, the future of simulated climate data Coleridge ought to have said: data, data, everywhere, and all the data centres groan, data data everywhere, nor any I should clone. Except of course, he didn't say it, and we do clone data! 4
While we've been dealing with terabytes of simulated datasets, downloading ("cloning") and analysing, has been a plausible way forward. In the not too distant future we can imagine exabytes of data being produced, and all these problems will get worse. Arguably we have no plausible methods of effectively exploiting such data - particularly if the analysis requires intercomparison. Yet of course, we know full well that intercomparison is at the heart of climate science. 5
In the past 10 years, NCDC’s digital archive experienced a six-fold increase from 1 petabyte to 6 petabytes. With increasing sophistication of data collection equipment, such as new satellites and radars, data is expected to exceed 15 petabytes by 6 2020.
7
8
9
10
11
12
13
14
15
16
17
Problems/Challanges Data volumes are growing: Observations – up to 1 Tb/day CFSR NCEP – more then 66 Tb; ECMWF current status: 18
Experience with managing a multi-petabyte meteorological archive Manuel Fuentes and Baudouin Raoult Meteorological Data Section ECMWF 19
20 20
21 21
Virtual research environment Increasingly global, multipolar and networked science is calling for research supporting environments where scattered scientists can seamlessly access data, software, and processing resources managed by diverse systems in separate administration domains through their web browser. Virtual Research Environments / Science Gateways (Portals) / Collaboratories / Digital Libraries / Inhabited Information Spaces 22 22
Web-based services should be loosely combined into portals to provide a comprehensive infrastructure for the support of research across all academic disciplines. “VRE” portals should also leverage Web 2.0 technologies and social networking solutions to support collaboration and resource discovery. 23 23
24
RIMS Rapid Integrated Mapping System Гидрология метеорология : данные , модели , анализ http://rims.unh.edu/ 25
26
Integrated Regional Studies in Northern Eurasia NEESPI Siberia Integrated Regional Studies http://sirs.scert.ru/, http://iopscience.iop.org/1748-9326/5/1/015007/ PEEX MAIRS Major drivers and domain of applications 27
Climate http://climate.scert.ru/ Software and hardware Web GIS platform for monitoring and analysis of regional climatic and ecological changes
Climate| Solid knowledge Ongoing climate changes have a significant impact on regional environment and socio-economic conditions. In some regions these changes go on much faster than at the global scale affecting the vegetation and permafrost, threatening northern infrastructure. They change the living conditions of the population, influence the spatial distribution of plant ecosystems and can cause serious socio-economic consequences. Under these conditions, the analysis of spatial data obtained from modeling and observations is paramount for timely decision-making at the municipal and federal levels. Software and hardware platform Climate is based on advanced technologies for development of modern web GIS applications. It allows to process and analyze significant amounts of spatial data to extract and present solid knowledge about ongoing regional climate changes and their socio-economical consequences using only a modern graphical web browser.
Architecture
One approach to all data kinds Easy to handle large data sets Handling different data file formats Volumes of modern data sets of climatic and Platform Climate has built-in procedures to search and meteorological data are tens and hundreds gigabytes. In retrieve information from data sets, as well as providing order to effectively operate them powerful computational the user with results in such popular formats as netCDF, resources are required. Platform Climate includes high HDF, ESRI Shapefile and GeoTIFF. Also access to the performance cloud storage and data processing systems, processing results using geo services is available according to the OGC standards. which power is available to users with ordinary personal computers. Heterogeneous data integration GIS in a web browser window Platform Climate integrates in one graphical environment Thanks to joint usage of Web and GIS technologies, the scientific tools for processing and visualization of platform Climate includes tools for representation and heterogeneous data obtained from various sources, manipulation of vector and raster data through a web including data modeling, satellite imagery, observations at interface typical for a desktop GIS, including adding, meteorological stations, boundaries of administrative deleting, and overlapping of geolocated layers, zoom and areas and more in raster and vector formats. pan.
Methods of processing and analysis of climatic and meteorological data Statistical characteristics of Derivative climatic indices meteorological data Length of the growing season, sum of Sample mean, variance, kurtosis, median, effective temperatures, Selyaninov’s maximum and minimum value, the asymmetry Hydrothermal Coefficient Periodic variations Non-periodic variations Mean square deviation, norms, deviation from Duration and frequency of occurrences of norms, amplitude of diurnal and annual cycle atmospheric phenomena with parameters above or below specified limits at different time scales
Spatial data with processing and rendering tools are accessible via a standard web browser from anywhere in the world
Графический интерфейс пользователя
Функциональность системы
Функциональность ЭО Платформы Mean temperature (Merra,850mb, June 1990 – raster and NCEP2 – contour)
Integrated models Функциональность ЭО Платформы
Results presentations Surface temperature, January means 38 38
Results presentations Wind velocity, January 39 39
Google Maps and Landsat layers 40 40
Data archives Название набора Организация Временной период Разрешение данных данных NCEP/NCAR NCEP/NCAR 1951 – 2001 2.5° × 2.5° Reanalysis 17 в . ур . давления NCEP/DOE AMIP II NCEP/DOE 1979 – 2003 2.5° × 2.5° Reanalysis 17 в . ур . давления ERA-40 Reanalysis ECMWF 1957 – 2004 2.5° × 2.5° 23 в . ур . давления JRA-25 Reanalysis JMA/CRIEPI 1979 – 2009 2.5° × 2.5°; 23 в . ур . давления NOAA-CIRES 20th NOAA/OAR/ESRL 1908 – 1958 2.0° × 2.0°; Century Global PSD 24 в . ур . давления Reanalysis APHRODITE RIHN-MRI/JMA 1951 - 2007 0.25° × 0.25°; Reanalysis поверхность Merra Reanalysis ECMWF 1979 - 2000 0.67° × 0.5°; 42 ур . давл . GPCC Reanalysis GPCC 1901 - 2009 0.5° × 0.5°; INM CM4 dataset INM RAS 1950 - 2005 2.0° × 1.5°; 8 ур . PlaSim dataset IMCES SB RAS 2000 - 2100 2.5° × 2.5° 9092 с Synoptic RIHMI-WDC/ NOAA ~ 1900 – 2000 83 метеостанций 41 Network CNDC Сибири
Recommend
More recommend
