Keyword-Based Search over Environmental Datasets Jos R.R. Viqueira - - PowerPoint PPT Presentation

keyword based search over environmental datasets
SMART_READER_LITE
LIVE PREVIEW

Keyword-Based Search over Environmental Datasets Jos R.R. Viqueira - - PowerPoint PPT Presentation

1st International KEYSTONE Conference IKC 2015 Coimbra Portugal, 8-9 September, 2015 Keyword-Based Search over Environmental Datasets Jos R.R. Viqueira Alberto Bugarn Joaqun Trianes Jaime Martnez-Urtaza Outline MOTIVATIONAL


slide-1
SLIDE 1

Keyword-Based Search over Environmental Datasets

José R.R. Viqueira Alberto Bugarín Joaquín Triñanes Jaime Martínez-Urtaza 1st International KEYSTONE Conference IKC 2015 Coimbra Portugal, 8-9 September, 2015

slide-2
SLIDE 2

Keyword-Based Search over Environmental Datasets

Outline

 MOTIVATIONAL EXAMPLES  ENVIRONMENTAL DATASETS  KEYWORD-BASED SEARCH  PROPOSED METHODOLOGY

slide-3
SLIDE 3

Keyword-Based Search over Environmental Datasets Motivational Examples Environmental Datasets

MOTIVATIONAL EXAMPLES

 Public health and water microbiology (Cholera risk)

  • High water temperatures and rainfall close to sea level during

monsoon season

KeyWord- Based Search Proposed Methodology

slide-4
SLIDE 4

Keyword-Based Search over Environmental Datasets Motivational Examples Environmental Datasets

MOTIVATIONAL EXAMPLES

 Public health and water microbiology (Cholera risk)

  • High water temperatures and rainfall close to sea level during

monsoon season

KeyWord- Based Search Proposed Methodology

  • Environmental properties
  • Sea Surface Temperature (SST) [NOAA]
  • Rainfall (TRMM) [NASA]
  • Geographic Coverages (fields, grids, etc.)
  • Very large scientific data multidimensional arrays
  • Dims: Lat., Lon., Time, Depth, etc.

Many datasets even for the same property

slide-5
SLIDE 5

Keyword-Based Search over Environmental Datasets Motivational Examples Environmental Datasets

MOTIVATIONAL EXAMPLES

 Public health and water microbiology (Cholera risk)

  • High water temperatures and rainfall close to sea level during

monsoon season

KeyWord- Based Search Proposed Methodology

  • Fuzzy linguistic value
  • Relative to the mean of the same month during

the last 7 years for the specific location

  • World Ocean Atlas (WOA). Statistical

mean of temperature

  • NOAA. cwblendednightSST. 22/07/2015
  • WOA. Stat. mean temperature. July

Meaning depends

  • n the context of

application, geo location, time period, …

slide-6
SLIDE 6

Keyword-Based Search over Environmental Datasets Motivational Examples Environmental Datasets

MOTIVATIONAL EXAMPLES

 Public health and water microbiology (Cholera risk)

  • High water temperatures and rainfall close to sea level during

monsoon season

KeyWord- Based Search Proposed Methodology Coast line. NOAA GSSHG

  • Fuzzy geographic restriction
  • Close to the coast line
  • Geographic Entity (E/R data)
  • Elevation of about 0 meters above sea level
  • Geographic Coverage

Elevation. NOAA ETOPO1

slide-7
SLIDE 7

Keyword-Based Search over Environmental Datasets Motivational Examples Environmental Datasets

MOTIVATIONAL EXAMPLES

 Public health and water microbiology (Cholera risk)

  • High water temperatures and rainfall close to sea level during

monsoon season

KeyWord- Based Search Proposed Methodology

  • Fuzzy temporal restriction
  • Monsoon season (Malaysia)
  • Northeast Monsoon from November to March (more rainfall)
  • Southwest Monsoon from May to September (less rainfall)

NOAA Blended Sea Winds. January NOAA Blended Sea Winds. July

slide-8
SLIDE 8

Keyword-Based Search over Environmental Datasets Motivational Examples Environmental Datasets

MOTIVATIONAL EXAMPLES

 Severe weather reporting

  • Hurricane of high category close to highly populated areas
  • Strong winds and heavy swell on marine traffic routes
  • Hailstorm on the highway

 Tourism

  • Beach protected from wind, with warm water and air temperature,

and few waves

KeyWord- Based Search Proposed Methodology

slide-9
SLIDE 9

Keyword-Based Search over Environmental Datasets Motivational Examples Environmental Datasets

ENVIRONMENTAL DATASETS

 Do no always fit E/R model

  • Geographic Entities
  • Entities with geometric

properties

  • Relational data
  • Rivers, Meteostations,

Municipalities, etc.

  • Geographic Coverages
  • Mappings with geographic

domain

  • Multidimensional array

data

  • Temperature, rainfall,

elevation, salinity, etc.

KeyWord- Based Search Proposed Methodology

slide-10
SLIDE 10

Keyword-Based Search over Environmental Datasets Motivational Examples Environmental Datasets

ENVIRONMENTAL DATASETS

 Many large or very large datasets

  • Stations, buoys, satellites, radars, etc.
  • Blended Sea Winds
  • Over 300 gigabytes
  • Prediction, reanalysis, etc.
  • Climate Forecast System

Version 2 (CFSv2)

  • Over 500 terabytes

KeyWord- Based Search Proposed Methodology

slide-11
SLIDE 11

Keyword-Based Search over Environmental Datasets Motivational Examples Environmental Datasets

ENVIRONMENTAL DATASETS

 Many large or very large datasets

  • Stations, buoys, satellites, radars, etc.
  • Blended Sea Winds
  • Over 300 gigabytes
  • Prediction, reanalysis, etc.
  • Climate Forecast System

Version 2 (CFSv2)

  • Over 500 terabytes

 Highly heterogeneous

  • Formats and encodings
  • Shape Files, GML, GeoJSON, etc.
  • GeoTiff, ASC, NetCDF, HDF, GRIB, etc.
  • Semantics
  • Temperature, Sea Temperature, Sea Surface Temperature, air

temperature, etc.

KeyWord- Based Search Proposed Methodology

slide-12
SLIDE 12

Keyword-Based Search over Environmental Datasets Motivational Examples Environmental Datasets

ENVIRONMENTAL DATASETS

 Open Data

  • Spatial Data Infrastructures (SDIs)
  • Global Spatial Data Infrastructure (GSDI)
  • INSPIRE
  • NSDI
  • Unidata
  • OpenDAP

KeyWord- Based Search Proposed Methodology

slide-13
SLIDE 13

Keyword-Based Search over Environmental Datasets Motivational Examples Environmental Datasets

ENVIRONMENTAL DATASETS

 Open Data

  • Spatial Data Infrastructures (SDIs)
  • Global Spatial Data Infrastructure (GSDI)
  • INSPIRE
  • NSDI
  • Unidata
  • OpenDAP

 Data models, Vocabularies, Ontologies

  • Observations and Measurements (O&M)
  • Sensor Model Language (SensorML)
  • Semantic Web for Earth and Environmental Terminology (SWEET)
  • CF Conventions and Metadata
  • World Meteorological Organization Manual on Codes
  • SeaDataNet Sensor Vocabularies
  • ETC.

KeyWord- Based Search Proposed Methodology

slide-14
SLIDE 14

Keyword-Based Search over Environmental Datasets Motivational Examples Environmental Datasets

KEYWORD-BASED SEARCH

 Non structured data sources

  • Information Retrieval (IR)
  • Text data
  • Multimedia Information Retrieval (MIR)
  • Audio, images, video.

KeyWord- Based Search Proposed Methodology

slide-15
SLIDE 15

Keyword-Based Search over Environmental Datasets Motivational Examples Environmental Datasets

KEYWORD-BASED SEARCH

 Non structured data sources

  • Information Retrieval (IR)
  • Text data
  • Multimedia Information Retrieval (MIR)
  • Audio, images, video.

 Structured data sources

  • Relational DBMSs
  • Linked Data
  • E/R based data!

KeyWord- Based Search Proposed Methodology

slide-16
SLIDE 16

Keyword-Based Search over Environmental Datasets Motivational Examples Environmental Datasets

PROPOSED METHODOLOGY

KeyWord- Based Search Proposed Methodology

Search Engine Spatio-temporal Keyword-Based Index Crawling, Annotation, Indexing, ETL? Metadata Repositories Coverage-Based Datasets Vocabulary

Fuzzy Spatio-temporal extension of each keyword in each dataset Machine Learning Data to Text Systems Fuzzy-based approaches Computing with Words

Entity-Based Datasets

Keyword-based Search Fuzzy Spatio- temporal extension in each dataset Language/grammar

slide-17
SLIDE 17

Keyword-Based Search over Environmental Datasets

José R.R. Viqueira (jrr.viqueira@usc.es) Alberto Bugarín (alberto.bugarin@usc.es) Joaquín Triñanes (joaquin.trinanes@usc.es) Jaime Martínez-Urtaza (j.l.martinez-urtaza@bath.ac.uk) 1st International KEYSTONE Conference IKC 2015 Coimbra Portugal, 8-9 September, 2015