Towards data reference catalog With MDweb tool Program ROSELT/ OSS - - PowerPoint PPT Presentation
Towards data reference catalog With MDweb tool Program ROSELT/ OSS - - PowerPoint PPT Presentation
Technical support mission Egypt, 2 12 J uly 2004 Towards data reference catalog With MDweb tool Program ROSELT/ OSS ROSELT/OSS Regional Coordination Towards data reference catalog Content et objectives : : data valorisation and
Towards data reference catalog
Content
1.
- 1. Principles
Principles et objectives et objectives :
: data valorisation and sharing
2.
- 2. Conceptual
Conceptual choices choices : : Generic tool 4.Installation 4.Installation of
- f Mdweb
Mdweb : : local and regional installation
- 5. Data
- 5. Data catalog
catalog management : management : Roles definition 3.
- 3. Implementation
Implementation : : MDweb, metadata management tool
- 6. On
- 6. On line
line tool tool presentation presentation
2/ 35
Facts
Beyond the diagnosis : Evaluate of
enviromental changes to understand and predict the desertification process
Heterogeneous data collection years
after years, program after program, difficult to use (lack of data informations & structuration)
3/ 35
Main objectives Main objectives
Set- up an observatory environmental data (past,
present and future) reference catalog consultable via intranet and Internet
Provide access to data via its metadata
Principles Principles
Local data management by the observatories (cf.
charter)
Data consolidation: regroup the local observatory DBs
to give a uniform view of all data
Principles et Objectives
4/ 35
Three Three main main features features
- Reference
Reference : manually or semi- automatically input and update the observatory metadata
- Publish
Publish : make the referenced datasets available so that they are accessible according to defined restrictions
- Navigate
Navigate, , consult consult and and download download the data with the help of a query interface (keywords, geographic)
Required Features
5/ 35
Towards data reference catalog
Content
1.
- 1. Principles
Principles et objectives et objectives :
: data valorisation and sharing
2.
- 2. Conceptual
Conceptual choices choices : : Generic tool 4.Installation 4.Installation of
- f Mdweb
Mdweb : : local and regional installation
- 5. Data
- 5. Data catalog
catalog management : management : Roles definition 3.
- 3. Implementation
Implementation : : MDweb, metadata management tool
- 6. On
- 6. On line
line tool tool presentation presentation
6/ 35
7/ 35
Generic tool
Multi- standards & multi- languages Use and customisation for a scientific
community through metadata « profile » (an ISO standard « view » or extraction)
Role and use of metadata
- Know the data and its properties
Know the data and its properties
the first role is to provide a better understanding of the existing data in all the network observatories (Inventory, description and cataloguing role)
- Data
Data search search
Main issue : propose a reference catalogue of information accumulated in the process of monitoring work lead by the observatory network
- Access to
Access to the the data data
8/ 35
Choice of a metadata standard
Today : apparition of ISO 19115 Today : apparition of ISO 19115 –
– geographic
geographic metadata metadata ISO TC/ 211
International Standard (2003)
Standardisation Standardisation organisations
- rganisations, software
, software distributors and countries adopting the standard distributors and countries adopting the standard
OpenGIS
FGDC CEN AFNOR
ISO 19115 ISO 19115
9/ 35
ISO 19115 : metadata for geographical Information
Main packages or sections of metadata standard 19115
10/ 35
<<Leaf>> Identification information <<Leaf>> Spatial representation information <<Leaf>> Units of Measure (from derived) <<Leaf>> Extent information <<Leaf>> Reference System information <<Leaf>> Metadata extension information <<Leaf>> Distribution information <<Leaf>> Citation and responsible party information <<Leaf>> Content information <<Leaf>> Constraint information <<Leaf>> Portrayal catalogue information <<Leaf>> Maintenance information <<Leaf>> Application schema information <<Leaf>> Data quality information <<Leaf>> Metadata entity set information
Notion of metadata profile
Standard Standard «
« View
View »
» or
- r «
« profile
profile »
» Extraction of elements
from the standard (and its extension, if necessary) according to the needs of a community, project, or application
I SO Core Profile standard
11/ 35
Typology of resources in ROSELT
12/ 35
Ground Ground measures measures Georeferenced Georeferenced info info Non Non-
- geo
geo info info ??Vegetation inventory ??Inventory of habitats, flora and its diversity ??Inventory of habitats, fauna and its diversity ??Socio-economic survey ??Pedological survey ??Bioclimatic survey ??Paper map ??Digital map ??Vector information layer ??Raster information layer ??Raw or pre-processed satellite image ??Paper aerial image ??Digital aerial image ??Geographical database ??Non-geographical database ??Paper document ??Digital document ??Paper table ??Digital table
Available profiles
13/ 35
? Vegetation inventory ? Inventory of habitats, flora and its diversity ? Inventory of habitats, fauna and its diversity ? Socio-economic survey ? Pedological survey ? Bioclimatic survey ? Paper map ? Digital map ? Vector information layer ? Raster information layer ? Raw or pre-processed satellite image ? Paper aerial image ? Digital aerial image ? Geographical database ? Non-geographical database ? Paper document ? Digital document ? Paper table ? Digital table Ground Ground measures measures Georeferenced Georeferenced info info Non Non-
- geo
geo info info
Detail level of metadata
3 levels of details defined :
- cataloguing
cataloguing level level =
= ‘cataloguing’ function
(localisation, general knowledge)
- sharing
sharing level level =
= ‘sharing’ or ‘data access’ function
(distribution format, access protocol,…)
- integration
integration level level =
= ‘data integration’ function
(data schema, geographical, temporal system of reference)
14/ 35
Towards data reference catalog
Content
1.
- 1. Principles
Principles et objectives et objectives :
: data valorisation and sharing
2.
- 2. Conceptual
Conceptual choices choices : : Generic tool 4.Installation 4.Installation of
- f Mdweb
Mdweb : : local and regional installation
- 5. Data
- 5. Data catalog
catalog management : management : Roles definition 3.
- 3. Implementation
Implementation : : MDweb, metadata management tool
- 6. On
- 6. On line
line tool tool presentation presentation
15/ 35
Technical specifications : MDweb
Based Based on Open Source softwares :
- n Open Source softwares : Apache
server, PHP scripts, Open DBMS
- Multi
Multi-
- OS
OS : : Unix, Linux or Windows
- Multi
Multi-
- DBMS
DBMS : : Postgresql, MySQL, (ORACLE?
)
- Multi
Multi-
- language
language : : english, french, other
customisable languages
- Multi
Multi-
- standards :
standards : ISO by default, possibilities
to add other metadata standard
16/ 35
17/ 35
Data caloguing
DBMS
Web browser
DBMS : Database Management System (Postgres, MySQL, Oracle)
PHP scripts
Tool administration MDweb Search
Apache web server
Import/Export
Tool architecture
Catalog structuration
- Choice of a metadata standard :
Choice of a metadata standard : ISO 19115
- Customisation
Customisation via the creation of ROSELT
profiles
- Input of the metadata sheets
Input of the metadata sheets according to
the structure described by the defined profiles
18/ 35
MDweb database structuration
Standard description Form (profile) description Metadata sheets
19/ 35
- Secure
Secure access access by by password password
- Customisation :
Customisation : choice of interface colour and
language for each user
- Input and update
Input and update of metadata sheets
- Publication
Publication of input sheets
- Consultation
Consultation of metadata sheets and data
download
- Administration
Administration of the tool
General MDweb Features
20/ 35
21/ 35
MDweb Features – input & Update
- Controlled form fields :
Controlled form fields : calendar to input dates, counting
the number of characters remaining, digital format
- Input help :
Input help : use of values from a sheet already input for
the input of a new sheet
- Relationship links between sheets
Relationship links between sheets :
: possibility to input
the metadata sheet from a map and to join the sheets of its layers
- Choice of a input level of detail :
Choice of a input level of detail : cataloguing, sharing,
integration levels
- Choice of sheet and data access level
Choice of sheet and data access level : visible or not
during free consultation.
22/ 35
MDweb Features – publication
Publication status : Publication status : so long as a sheet is not
published it is not visible for any type of consultation. Direct publication if the publication rule is ‘automatic’, otherwise published by a validator or an administrator.
23/ 35
MDweb Features – consultation
Two types of consultation
- Free consultation :
Free consultation : access to unrestricted sheets and
data
- Private
Private Consultation Consultation : access to restricted sheets and
data
Two kind of search
- Simple search
Simple search : by keywords, by resource thematic or
by observatory index
- Advanced search
Advanced search : combined research criteria
24/ 35
MDweb Features – administration
- Administer the tool :
Administer the tool : management of users,
languages input forms, sheet publication rules (automatic or manual)
- Import/ export :
Import/ export : interaction with the metadata from
- ther sources (LEIS), send to the regional metadata
management tool
Towards data reference catalog
Content
1.
- 1. Principles
Principles et objectives et objectives :
: data valorisation and sharing
2.
- 2. Conceptual
Conceptual choices choices : : Generic tool 4.Installation 4.Installation of
- f Mdweb
Mdweb : : local and regional installation
- 5. Data
- 5. Data catalog
catalog management : management : Roles definition 3.
- 3. Implementation
Implementation : : MDweb, metadata management tool
- 6. On
- 6. On line
line tool tool presentation presentation
25/ 35
- local
local tool tool : : for the inventory and
consultation of observatory metadata Each observatory manages its local tool itself (users, languages, …)
Local tool installation
26/ 35
27/ 35
Data catalog
(Metadata DB) ROSELT national web server
MDweb MDweb
que r y r e s pons e
Search Search via local via local MDweb MDweb
Connection to a local data catalog
- Regional
Regional tool tool : : for the consultation of all the
- bservatories data catalog and the management of
standards The metadata input in the local tools are regrouped at the regional operator level.
Regional installation tool
28/ 34
29/ 35
Data catalog
(metadata DB) Exchange protocol
Data catalog
(metadata DB) Exchange protocol
Data catalog
(metadata DB) Exchange protocol ROSELT national web server
MDweb MDweb MDweb MDweb MDweb MDweb
ROSELT regional web server
Multiple queries
que r i e s r e s pons e
Multiple results
Search Search via via regional regional MDweb MDweb
Connection to regional data catalog
30/ 35
Catalogue de données
(BD Métadonnées) ROSELT national web server
MDweb MDweb
I m por t m
- dul e
XML Workstation
National National databases databases
LEIS
Vegat.
etc.
pr oduc t i on–e xpor t M
- dul e
Relation MDweb – LEIS and GIS applications
Towards data reference catalog
Content
1.
- 1. Principles
Principles et objectives et objectives :
: data valorisation and sharing
2.
- 2. Conceptual
Conceptual choices choices : : Generic tool 4.Installation 4.Installation of
- f Mdweb
Mdweb : : local and regional installation
- 5. Data
- 5. Data catalog
catalog management : management : Roles definition 3.
- 3. Implementation
Implementation : : MDweb, metadata management tool
- 6. On
- 6. On line
line tool tool presentation presentation
31/ 35
Features / Roles
32/ 35 Scientific specialist Cataloguing role IS officer Administrator role Final user Consultation role manage labels* profiles mgmt. manage users manage sheets (creation, update) manage values standards validate sheets import sheets export sheets standards mgmt. National coord. Validation role manage his preferences consult the sheets manage languages choose publication rule manage his preferences If publication rule = manual Regional coord. Standardisation role
Towards data reference catalog
Content
1.
- 1. Principles
Principles et objectives et objectives :
: data valorisation and sharing
2.
- 2. Conceptual
Conceptual choices choices : : Generic tool 4.Installation 4.Installation of
- f Mdweb
Mdweb : : local and regional installation
- 5. Data
- 5. Data catalog
catalog management : management : Roles definition 3.
- 3. Implementation
Implementation : : MDweb, metadata management tool
- 6. On
- 6. On line
line tool tool presentation presentation
33/ 35
On line tool presentation
ROSELT/ OSS coordination Data Catalog :
http:/ / mdweb.roselt- oss.org/
34/ 35
Thank you for your attention
35/ 35