Towards data reference catalog With MDweb tool Program ROSELT/ OSS - - PowerPoint PPT Presentation

towards data reference catalog with mdweb tool program
SMART_READER_LITE
LIVE PREVIEW

Towards data reference catalog With MDweb tool Program ROSELT/ OSS - - PowerPoint PPT Presentation

Technical support mission Egypt, 2 12 J uly 2004 Towards data reference catalog With MDweb tool Program ROSELT/ OSS ROSELT/OSS Regional Coordination Towards data reference catalog Content et objectives : : data valorisation and


slide-1
SLIDE 1

Towards data reference catalog With MDweb tool Program ROSELT/ OSS

Technical support mission – Egypt, 2 – 12 J uly 2004

ROSELT/OSS Regional Coordination

slide-2
SLIDE 2

Towards data reference catalog

Content

1.

  • 1. Principles

Principles et objectives et objectives :

: data valorisation and sharing

2.

  • 2. Conceptual

Conceptual choices choices : : Generic tool 4.Installation 4.Installation of

  • f Mdweb

Mdweb : : local and regional installation

  • 5. Data
  • 5. Data catalog

catalog management : management : Roles definition 3.

  • 3. Implementation

Implementation : : MDweb, metadata management tool

  • 6. On
  • 6. On line

line tool tool presentation presentation

2/ 35

slide-3
SLIDE 3

Facts

Beyond the diagnosis : Evaluate of

enviromental changes to understand and predict the desertification process

Heterogeneous data collection years

after years, program after program, difficult to use (lack of data informations & structuration)

3/ 35

slide-4
SLIDE 4

Main objectives Main objectives

Set- up an observatory environmental data (past,

present and future) reference catalog consultable via intranet and Internet

Provide access to data via its metadata

Principles Principles

Local data management by the observatories (cf.

charter)

Data consolidation: regroup the local observatory DBs

to give a uniform view of all data

Principles et Objectives

4/ 35

slide-5
SLIDE 5

Three Three main main features features

  • Reference

Reference : manually or semi- automatically input and update the observatory metadata

  • Publish

Publish : make the referenced datasets available so that they are accessible according to defined restrictions

  • Navigate

Navigate, , consult consult and and download download the data with the help of a query interface (keywords, geographic)

Required Features

5/ 35

slide-6
SLIDE 6

Towards data reference catalog

Content

1.

  • 1. Principles

Principles et objectives et objectives :

: data valorisation and sharing

2.

  • 2. Conceptual

Conceptual choices choices : : Generic tool 4.Installation 4.Installation of

  • f Mdweb

Mdweb : : local and regional installation

  • 5. Data
  • 5. Data catalog

catalog management : management : Roles definition 3.

  • 3. Implementation

Implementation : : MDweb, metadata management tool

  • 6. On
  • 6. On line

line tool tool presentation presentation

6/ 35

slide-7
SLIDE 7

7/ 35

Generic tool

Multi- standards & multi- languages Use and customisation for a scientific

community through metadata « profile » (an ISO standard « view » or extraction)

slide-8
SLIDE 8

Role and use of metadata

  • Know the data and its properties

Know the data and its properties

the first role is to provide a better understanding of the existing data in all the network observatories (Inventory, description and cataloguing role)

  • Data

Data search search

Main issue : propose a reference catalogue of information accumulated in the process of monitoring work lead by the observatory network

  • Access to

Access to the the data data

8/ 35

slide-9
SLIDE 9

Choice of a metadata standard

Today : apparition of ISO 19115 Today : apparition of ISO 19115 –

– geographic

geographic metadata metadata ISO TC/ 211

International Standard (2003)

Standardisation Standardisation organisations

  • rganisations, software

, software distributors and countries adopting the standard distributors and countries adopting the standard

OpenGIS

FGDC CEN AFNOR

ISO 19115 ISO 19115

9/ 35

slide-10
SLIDE 10

ISO 19115 : metadata for geographical Information

Main packages or sections of metadata standard 19115

10/ 35

<<Leaf>> Identification information <<Leaf>> Spatial representation information <<Leaf>> Units of Measure (from derived) <<Leaf>> Extent information <<Leaf>> Reference System information <<Leaf>> Metadata extension information <<Leaf>> Distribution information <<Leaf>> Citation and responsible party information <<Leaf>> Content information <<Leaf>> Constraint information <<Leaf>> Portrayal catalogue information <<Leaf>> Maintenance information <<Leaf>> Application schema information <<Leaf>> Data quality information <<Leaf>> Metadata entity set information

slide-11
SLIDE 11

Notion of metadata profile

Standard Standard «

« View

View »

» or

  • r «

« profile

profile »

» Extraction of elements

from the standard (and its extension, if necessary) according to the needs of a community, project, or application

I SO Core Profile standard

11/ 35

slide-12
SLIDE 12

Typology of resources in ROSELT

12/ 35

Ground Ground measures measures Georeferenced Georeferenced info info Non Non-

  • geo

geo info info ??Vegetation inventory ??Inventory of habitats, flora and its diversity ??Inventory of habitats, fauna and its diversity ??Socio-economic survey ??Pedological survey ??Bioclimatic survey ??Paper map ??Digital map ??Vector information layer ??Raster information layer ??Raw or pre-processed satellite image ??Paper aerial image ??Digital aerial image ??Geographical database ??Non-geographical database ??Paper document ??Digital document ??Paper table ??Digital table

slide-13
SLIDE 13

Available profiles

13/ 35

? Vegetation inventory ? Inventory of habitats, flora and its diversity ? Inventory of habitats, fauna and its diversity ? Socio-economic survey ? Pedological survey ? Bioclimatic survey ? Paper map ? Digital map ? Vector information layer ? Raster information layer ? Raw or pre-processed satellite image ? Paper aerial image ? Digital aerial image ? Geographical database ? Non-geographical database ? Paper document ? Digital document ? Paper table ? Digital table Ground Ground measures measures Georeferenced Georeferenced info info Non Non-

  • geo

geo info info

slide-14
SLIDE 14

Detail level of metadata

3 levels of details defined :

  • cataloguing

cataloguing level level =

= ‘cataloguing’ function

(localisation, general knowledge)

  • sharing

sharing level level =

= ‘sharing’ or ‘data access’ function

(distribution format, access protocol,…)

  • integration

integration level level =

= ‘data integration’ function

(data schema, geographical, temporal system of reference)

14/ 35

slide-15
SLIDE 15

Towards data reference catalog

Content

1.

  • 1. Principles

Principles et objectives et objectives :

: data valorisation and sharing

2.

  • 2. Conceptual

Conceptual choices choices : : Generic tool 4.Installation 4.Installation of

  • f Mdweb

Mdweb : : local and regional installation

  • 5. Data
  • 5. Data catalog

catalog management : management : Roles definition 3.

  • 3. Implementation

Implementation : : MDweb, metadata management tool

  • 6. On
  • 6. On line

line tool tool presentation presentation

15/ 35

slide-16
SLIDE 16

Technical specifications : MDweb

Based Based on Open Source softwares :

  • n Open Source softwares : Apache

server, PHP scripts, Open DBMS

  • Multi

Multi-

  • OS

OS : : Unix, Linux or Windows

  • Multi

Multi-

  • DBMS

DBMS : : Postgresql, MySQL, (ORACLE?

)

  • Multi

Multi-

  • language

language : : english, french, other

customisable languages

  • Multi

Multi-

  • standards :

standards : ISO by default, possibilities

to add other metadata standard

16/ 35

slide-17
SLIDE 17

17/ 35

Data caloguing

DBMS

Web browser

DBMS : Database Management System (Postgres, MySQL, Oracle)

PHP scripts

Tool administration MDweb Search

Apache web server

Import/Export

Tool architecture

slide-18
SLIDE 18

Catalog structuration

  • Choice of a metadata standard :

Choice of a metadata standard : ISO 19115

  • Customisation

Customisation via the creation of ROSELT

profiles

  • Input of the metadata sheets

Input of the metadata sheets according to

the structure described by the defined profiles

18/ 35

slide-19
SLIDE 19

MDweb database structuration

Standard description Form (profile) description Metadata sheets

19/ 35

slide-20
SLIDE 20
  • Secure

Secure access access by by password password

  • Customisation :

Customisation : choice of interface colour and

language for each user

  • Input and update

Input and update of metadata sheets

  • Publication

Publication of input sheets

  • Consultation

Consultation of metadata sheets and data

download

  • Administration

Administration of the tool

General MDweb Features

20/ 35

slide-21
SLIDE 21

21/ 35

MDweb Features – input & Update

  • Controlled form fields :

Controlled form fields : calendar to input dates, counting

the number of characters remaining, digital format

  • Input help :

Input help : use of values from a sheet already input for

the input of a new sheet

  • Relationship links between sheets

Relationship links between sheets :

: possibility to input

the metadata sheet from a map and to join the sheets of its layers

  • Choice of a input level of detail :

Choice of a input level of detail : cataloguing, sharing,

integration levels

  • Choice of sheet and data access level

Choice of sheet and data access level : visible or not

during free consultation.

slide-22
SLIDE 22

22/ 35

MDweb Features – publication

Publication status : Publication status : so long as a sheet is not

published it is not visible for any type of consultation. Direct publication if the publication rule is ‘automatic’, otherwise published by a validator or an administrator.

slide-23
SLIDE 23

23/ 35

MDweb Features – consultation

Two types of consultation

  • Free consultation :

Free consultation : access to unrestricted sheets and

data

  • Private

Private Consultation Consultation : access to restricted sheets and

data

Two kind of search

  • Simple search

Simple search : by keywords, by resource thematic or

by observatory index

  • Advanced search

Advanced search : combined research criteria

slide-24
SLIDE 24

24/ 35

MDweb Features – administration

  • Administer the tool :

Administer the tool : management of users,

languages input forms, sheet publication rules (automatic or manual)

  • Import/ export :

Import/ export : interaction with the metadata from

  • ther sources (LEIS), send to the regional metadata

management tool

slide-25
SLIDE 25

Towards data reference catalog

Content

1.

  • 1. Principles

Principles et objectives et objectives :

: data valorisation and sharing

2.

  • 2. Conceptual

Conceptual choices choices : : Generic tool 4.Installation 4.Installation of

  • f Mdweb

Mdweb : : local and regional installation

  • 5. Data
  • 5. Data catalog

catalog management : management : Roles definition 3.

  • 3. Implementation

Implementation : : MDweb, metadata management tool

  • 6. On
  • 6. On line

line tool tool presentation presentation

25/ 35

slide-26
SLIDE 26
  • local

local tool tool : : for the inventory and

consultation of observatory metadata Each observatory manages its local tool itself (users, languages, …)

Local tool installation

26/ 35

slide-27
SLIDE 27

27/ 35

Data catalog

(Metadata DB) ROSELT national web server

MDweb MDweb

que r y r e s pons e

Search Search via local via local MDweb MDweb

Connection to a local data catalog

slide-28
SLIDE 28
  • Regional

Regional tool tool : : for the consultation of all the

  • bservatories data catalog and the management of

standards The metadata input in the local tools are regrouped at the regional operator level.

Regional installation tool

28/ 34

slide-29
SLIDE 29

29/ 35

Data catalog

(metadata DB) Exchange protocol

Data catalog

(metadata DB) Exchange protocol

Data catalog

(metadata DB) Exchange protocol ROSELT national web server

MDweb MDweb MDweb MDweb MDweb MDweb

ROSELT regional web server

Multiple queries

que r i e s r e s pons e

Multiple results

Search Search via via regional regional MDweb MDweb

Connection to regional data catalog

slide-30
SLIDE 30

30/ 35

Catalogue de données

(BD Métadonnées) ROSELT national web server

MDweb MDweb

I m por t m

  • dul e

XML Workstation

National National databases databases

LEIS

Vegat.

etc.

pr oduc t i on–e xpor t M

  • dul e

Relation MDweb – LEIS and GIS applications

slide-31
SLIDE 31

Towards data reference catalog

Content

1.

  • 1. Principles

Principles et objectives et objectives :

: data valorisation and sharing

2.

  • 2. Conceptual

Conceptual choices choices : : Generic tool 4.Installation 4.Installation of

  • f Mdweb

Mdweb : : local and regional installation

  • 5. Data
  • 5. Data catalog

catalog management : management : Roles definition 3.

  • 3. Implementation

Implementation : : MDweb, metadata management tool

  • 6. On
  • 6. On line

line tool tool presentation presentation

31/ 35

slide-32
SLIDE 32

Features / Roles

32/ 35 Scientific specialist Cataloguing role IS officer Administrator role Final user Consultation role manage labels* profiles mgmt. manage users manage sheets (creation, update) manage values standards validate sheets import sheets export sheets standards mgmt. National coord. Validation role manage his preferences consult the sheets manage languages choose publication rule manage his preferences If publication rule = manual Regional coord. Standardisation role

slide-33
SLIDE 33

Towards data reference catalog

Content

1.

  • 1. Principles

Principles et objectives et objectives :

: data valorisation and sharing

2.

  • 2. Conceptual

Conceptual choices choices : : Generic tool 4.Installation 4.Installation of

  • f Mdweb

Mdweb : : local and regional installation

  • 5. Data
  • 5. Data catalog

catalog management : management : Roles definition 3.

  • 3. Implementation

Implementation : : MDweb, metadata management tool

  • 6. On
  • 6. On line

line tool tool presentation presentation

33/ 35

slide-34
SLIDE 34

On line tool presentation

ROSELT/ OSS coordination Data Catalog :

http:/ / mdweb.roselt- oss.org/

34/ 35

slide-35
SLIDE 35

Thank you for your attention

35/ 35

Towards data reference catalog