SLIDE 1 I NSPI RE W orkshop - How to Leverage Available I NSPI RE data
Dean Hintz & Ken Bragg Safe Softw are
INSPIRE 2016, Barcelona
SLIDE 2 Challenges
- How can anyone who wants to access INSPIRE
data?
- What are typical barriers to ease of access and
use?
- What are some key workflows based on INSPIRE
data?
- What INSPIRE data do you have most trouble with?
SLIDE 3 Agenda
- 1. Introduction to FME & INSPIRE
- 2. Reading INSPIRE GML, Raster
- 3. Reading from Web Services
- 4. Accessing INSPIRE Data from ArcGIS
- 5. Making INSPIRE transparent: web friendly
(INSPIRE for everyone else)
SLIDE 4 #fmewebinar
Convert data Transform data Share data Integrate data Validate data And more
FME transforms data to use and share.
W hat is FME?
SLIDE 5 #fmewebinar
FME transforms data to use and share.
W hat is FME?
SLIDE 6
FME Bridges the Gap
Proprietary Open Standards
SLIDE 7
FME and I NSPI RE Overview Full Life Cycle Support
SLIDE 8 FME and I NSPI RE Overview
- Consum e I NSPI RE – Leverage existing INSPIRE content
and services
- Transform ation – the hard problem that FME makes
easier and automates
- Validation of I NSPI RE Data
- Powerful set of validation tools
- Publishing I NSPI RE
- INSPIRE OGC Services with FME Server
- Other client friendly services: image, JSON
SLIDE 9 Reading I NSPI RE: GML / XML
- Evaluation and Inspection
- Data Inspector
- Metadata
- INSPIRE GML
- Transformation
- Transform schema and geometry
- Adding value to your INSPIRE workflows with
Workspaces
SLIDE 10 Consum ing I NSPI RE data and Services
- INSPIRE services should be results oriented
and driven by user requirements
- FME takes the pain out of reading and
leveraging com plex GML, XML and web services
- Data I nspector makes it easy
- Visualize all data types: 2D / 3D, vector /
raster, non-spatial / complex geometries
- Consume directly from URLs or web services
- Inspect complex data models and geometries
SLIDE 11
Your I NSPI RE View er: Data I nspector
Read any GML
SLIDE 12 XML Reading
- Metadata
- GML embedded in XML
- Leveraging web services and content: RSS, XML
streams, HTML
- Use metadata to drive workflow automation
- Parse GetCapabilities to compose GetFeature
requests
SLIDE 13
XML Reading: Tree Navigation
No need for editors!
SLIDE 14
XML Reading: Tree Navigation
SLIDE 15
- Schema – know which ones you need
- Validity
- make sure it’s actually GML
- check against the INSPIRE schemas
- verify those namespaces
Consum ing I NSPI RE GML
SLIDE 16 Reader Configuration
- Axis order & SRS
- Index lists to map relationally
- Properties to ignore – boundedBy (for ArcGIS)
SLIDE 17
I NSPI RE Reader Configuration
Parameters reordered with collapsible sections improve usability
SLIDE 18 I NSPI RE GML Reader: Exam ple settings
- Prefix attributes to keep
track of namespaces
boundedBy
- Flatten element names
- List braces to empty_string
- Axis order: look-out!
SLIDE 19 Reading: Troubleshooting
Common challenges with reading INSPIRE data
- Missing schemas
- Custom schemas
- Namespace differences: data vs schema
- Axis order
- File fragments: XML syntax
SLIDE 20 Reading: W orkarounds
- Use GML reader (not INSPIRE) with ‘Ignore
schema mode’ to read using data only (no schema required)
- Try using the XML reader (using new tree view),
and then extract GML with GeometryReplacer
- Filter out what you don’t need: elements,
geometries, lists
- WFS: use your browser to test - click on log links
SLIDE 21
GML / W FS Reading: I gnore Schem a
smoothly skip parser errors
SLIDE 22
Adm in Units: I gnore Properties
SLIDE 23
Adm in Units: I gnore Properties
SLIDE 24
Flood Risk Areas w ith Open Street Map
SLIDE 25
I NSPI RE – 3 D Buildings
SLIDE 26 I NSPI RE W orkflow s
- Inspection & evaluation
- Validation
- Loading to GIS, database
- Integrating with other data
- Common ids
- Spatial relationship
- Georeferencing / reprojection
SLIDE 27
XMLValidator transformer (syntax and schema) Many other FME validation transformers to check attribute values, geometry... Don’t forget to inspect! Logical validation – business rules
Validation
SLIDE 28 To / From GI S
Nested (XML) Relational (FME Workbench)
<Contact> <name>John</name> <city>Vancouver</city> <activeDate> <from>11-22-99</from> <to>12-11-09</to> </activeDate> name = John city = Vancouver activeDate.from = 11-22-99 activeDate.to = 12-11-09
▪ Nested object structure vs. Relational ▪ Schema mapping
SLIDE 29
Database Loader
SLIDE 30
Protected Sites to Geodatabase
SLIDE 31
Protected Sites Geodatabase Result
SLIDE 32 To / From GI S - Secret to Success
Schema Mapping
- Feature types
- Attributes
- Lists
Data model knowledge > XML knowledge Schema mapping is what FME is all about! FME can also manage all your validation needs
SLIDE 33 Reading I NSPI RE W eb Services
- 1. WMS Reader
- 2. WFS Reader
- 3. Atom/RSS Reader
SLIDE 34 Reading I NSPI RE: W eb Services
1 . W MS Reader
- 2. WFS Reader
- 3. Atom/RSS Reader
SLIDE 35 Reading I NSPI RE: W eb Services
FME W MS Reader
- Supports WMS 1.1, 1.3
- Supports time
Dem o
http:/ / m ap.salford.gov.uk/ geoserver/ I NSPI RE/ ow s?service= w m s&version= 1 .3 .0 &request= GetCapabilities
SLIDE 36 Reading I NSPI RE: W eb Services
2 . W FS Reader
SLIDE 37 Reading I NSPI RE: W eb Services
FME W FS Reader
- Read WFS Features and Translate to Any format
- Supports 1.1, 2.0
- Supports paging
Dem o
https://data.gov.uk/dataset/nymnpa-inspire-download-wfs-service
SLIDE 38 Reading I NSPI RE: W eb Services
- 1. WMS Reader
- 2. WFS Reader
3 . Atom / RSS Reader
SLIDE 39 Reading I NSPI RE: W eb Services
FME RSS/ ATOM Reader
- Download Zip file
- Extract Contents
- Translate to another format
ALL in one FME W orkspace
SLIDE 40
Saxony, Germ any Data Dow nload Site
SLIDE 41 Accessing Saxony ATOM Feed Data
http://geodownload.sachsen.de/inspire/ad_atom/Dataset_gmd_ad_gml_4258.xml
SLIDE 42 FME W orkspace Detail - Dem o
- 1. Parameter for Municipality(Gemeinde)
- 2. Read Download Link from ATOM XML
- 3. Download Zip file
- 4. Unzip and Read and Translate to Shape
SLIDE 43 Accessing I NSPI RE Data from ArcGI S
- Data Interoperability Extension includes WFS
Reader
- Interoperability Connection
- Spatial ETL Tool
- FME Extension
SLIDE 44 Accessing I NSPI RE Data from ArcGI S
- Using Data Interoperability Extension &
Spatial ETL Tool (FME Workspace)
Dem o
SLIDE 45 Making I NSPI RE transparent: client friendly
- Client friendly formats: KML, PDF
- Web Services: Image service, JSON feeds
- A deeper level of integration, leveraging:
- 3D
- Real time
SLIDE 46
SE Protected Sites KML
SLIDE 47
KML / COLLADA: Georeferenced Result
SLIDE 48 Client Friendly Services
- INSPIRE WFS -> FME -> Image service
- INSPIRE WFS -> FME -> JSON data stream
- INSPIRE GML 3D Buildings -> Adobe 3D PDF
SLIDE 49
W FS to KML Stream ing via W rapper
GE request -> FME Server -> Airports WFS
SLIDE 50
W FS to KML Stream ing
SLIDE 51
I NSPI RE Buildings to 3 D PDF
SLIDE 52
I NSPI RE Buildings to 3 D PDF
SLIDE 53 W riting and Publishing I NSPI RE Data
- Schema based
- Generate required attribute and geometry schema
just like other formats
- Complex attributes & geometries
- All annexes supported (I,II,III)
- 2, 2.5 & 3D
- Coverages
- Raster
SLIDE 54
GML Geom etry
SLIDE 55
UKHO Flood Data to I NSPI RE Natural Hazards
SLIDE 56
3 . The Solution: Result
SLIDE 57
FME WxS Workspace
GetCapabilities Request
Response XML
GetFeature Request
Response GML FME Server
FME Workspace as WFS Service Broker
SLIDE 58
WFS Workspace
SLIDE 59 New in FME 2 0 1 6
- GML: ignore schema mode
- GML: Parameter refresh – reordering
- XML: tree view
- WFS: feature collections
- WFS: paging
- INSPIRE: Schema updates
- All: Improved schema caching
SLIDE 60 Exam ple I NSPI RE Solutions by FME Partners
- con terra (> 50 implementations across Europe)
- Metria, Sweden (Protected Areas; Transportation)
- 1 -Spatial; Dotted Eyes, UK
- AED Sicad (NAS to INSPIRE conversions)
- Spatialw orld, Finland (National Land Survey)
- Verem es, France (INSPIRE writer testing)
- Vicrea, NL
- GI M, BE
- SW ECO, Denmark, GST
SLIDE 61
FME com pletes the I NSPI RE Life Cycle
SLIDE 62 FME and I NSPI RE
FME simplifies the process of achieving EU INSPIRE* compliance - without any coding - through its abilities to:
- Read I NSPI RE data and services, using a number of
readers, including the INSPIRE GML Reader
- Prepare data for contribution to INSPIRE through data
transformation and schema mapping
- W rite I NSPI RE GML using the INSPIRE GML Writer,
with built-in application schemas
- Validate I NSPI RE GML to ensure compliance with EU
standards
- Share I NSPI RE data using FME Server’s web services
SLIDE 63 Keys to Success w ith I NSPI RE
- Don’t just publish without trying:
eat your own dogfood
- Balance flexibility, complexity and
usability
- Integrate with existing workflows
- Get stakeholder and vendor
feedback: know your audience
- Look for easy wins early
- Automate and future-proof
SLIDE 64 Conclusion
INSPIRE Data and Services can seem complex BUT:
- You can easily transform it to use
- Share it an way that is accessible to anyone
SLIDE 65
Resources:
Safe.com : safe.com/inspire safe.com/webinars I NSPI RE Tutorial:
https://knowledge.safe.com Other tutorials: XML, GML, 3D Google: INSPIRE FME
SLIDE 66
Thank You!
Dean Hintz Senior Analyst
dean@safe.com
@DeanAtSafe
Ken Bragg European Services Manager Safe Softw are
Ken.Bragg@safe.com
@KenAtsafe
SLIDE 67
Tutorial Setup
FME INSPIRE Tutorial:
https://knowledge.safe.com/articles/How_To/INSPIRE Download source data and work spaces
SLIDE 68 FME and I NSPI RE
- Consum e I NSPI RE – Leverage existing INSPIRE content
and services
- Schem a Transform ation* – the hard problem that FME
makes easier and automates. (e.g. conterra’s ISP for FME)
- Publishing I NSPI RE – INSPIRE writer and web service
support – easily meet INSPIRE requirements - no code!
- Com plex Geom etries – FME’s powerful data modeling
supports raster coverages, surfaces, 3D, point clouds, needed for Annex II, III
- W eb Services - workspace as web service broker
via FMEServer**
SLIDE 69
I NSPI RE Data Harm onization Supported by FME
Consum ption
Data assessment
Assem bly Formats, Joins Transform ation schema, geometry Validation QA, XSD, values Publication Web Services, GML I NSPI RE SDI Data Sharing
SLIDE 70 FME and I NSPI RE
- Consum e I NSPI RE – Leverage existing INSPIRE content
and services
- Schem a Transform ation* – the hard problem that FME
makes easier and automates. (e.g. conterra’s ISP for FME)
- Publishing I NSPI RE – INSPIRE writer and web service
support – easily meet INSPIRE requirements - no code!
- Com plex Geom etries – FME’s powerful data modeling
supports raster coverages, surfaces, 3D, point clouds, needed for Annex II, III
- W eb Services - workspace as web service broker
via FMEServer**
SLIDE 71 Tutorial Exercises / Dem os
- 1. Reading: Protected Sites, Parcels, Hydrography
- 2. Writing: Natural Hazards
- 3. Validation: HazardAreas, Parcels
- 4. Writing: 3D Buildings
5 . Conterra: INSPIRE Solution Pack
- 6. Atom Feeds
- 7. Web Services
- 8. New Stuff
SLIDE 72
Parcels w ith XML Filter Query
SLIDE 73 FME can even read new GML formats like GeoS ciML
(data from British Geological S urvey)
GML / W FS Reading: I gnore Schem a