I NSPI RE W orkshop - How to Leverage Available I NSPI RE data - - PowerPoint PPT Presentation

i nspi re w orkshop how to leverage available i nspi re
SMART_READER_LITE
LIVE PREVIEW

I NSPI RE W orkshop - How to Leverage Available I NSPI RE data - - PowerPoint PPT Presentation

I NSPI RE W orkshop - How to Leverage Available I NSPI RE data Dean Hintz & Ken Bragg Safe Softw are INSPIRE 2016, Barcelona Challenges How can anyone who wants to access INSPIRE data? What are typical barriers to ease of access


slide-1
SLIDE 1

I NSPI RE W orkshop - How to Leverage Available I NSPI RE data

Dean Hintz & Ken Bragg Safe Softw are

INSPIRE 2016, Barcelona

slide-2
SLIDE 2

Challenges

  • How can anyone who wants to access INSPIRE

data?

  • What are typical barriers to ease of access and

use?

  • What are some key workflows based on INSPIRE

data?

  • What INSPIRE data do you have most trouble with?
slide-3
SLIDE 3

Agenda

  • 1. Introduction to FME & INSPIRE
  • 2. Reading INSPIRE GML, Raster
  • 3. Reading from Web Services
  • 4. Accessing INSPIRE Data from ArcGIS
  • 5. Making INSPIRE transparent: web friendly

(INSPIRE for everyone else)

  • 6. Conclusion
slide-4
SLIDE 4

#fmewebinar

Convert data Transform data Share data Integrate data Validate data And more

FME transforms data to use and share.

W hat is FME?

slide-5
SLIDE 5

#fmewebinar

FME transforms data to use and share.

W hat is FME?

slide-6
SLIDE 6

FME Bridges the Gap

Proprietary Open Standards

slide-7
SLIDE 7

FME and I NSPI RE Overview Full Life Cycle Support

slide-8
SLIDE 8

FME and I NSPI RE Overview

  • Consum e I NSPI RE – Leverage existing INSPIRE content

and services

  • Transform ation – the hard problem that FME makes

easier and automates

  • Validation of I NSPI RE Data
  • Powerful set of validation tools
  • Publishing I NSPI RE
  • INSPIRE OGC Services with FME Server
  • Other client friendly services: image, JSON
slide-9
SLIDE 9

Reading I NSPI RE: GML / XML

  • Evaluation and Inspection
  • Data Inspector
  • Metadata
  • INSPIRE GML
  • Transformation
  • Transform schema and geometry
  • Adding value to your INSPIRE workflows with

Workspaces

slide-10
SLIDE 10

Consum ing I NSPI RE data and Services

  • INSPIRE services should be results oriented

and driven by user requirements

  • FME takes the pain out of reading and

leveraging com plex GML, XML and web services

  • Data I nspector makes it easy
  • Visualize all data types: 2D / 3D, vector /

raster, non-spatial / complex geometries

  • Consume directly from URLs or web services
  • Inspect complex data models and geometries
slide-11
SLIDE 11

Your I NSPI RE View er: Data I nspector

Read any GML

slide-12
SLIDE 12

XML Reading

  • Metadata
  • GML embedded in XML
  • Leveraging web services and content: RSS, XML

streams, HTML

  • Use metadata to drive workflow automation
  • Parse GetCapabilities to compose GetFeature

requests

slide-13
SLIDE 13

XML Reading: Tree Navigation

No need for editors!

slide-14
SLIDE 14

XML Reading: Tree Navigation

slide-15
SLIDE 15
  • Schema – know which ones you need
  • Validity
  • make sure it’s actually GML
  • check against the INSPIRE schemas
  • verify those namespaces

Consum ing I NSPI RE GML

slide-16
SLIDE 16

Reader Configuration

  • Axis order & SRS
  • Index lists to map relationally
  • Properties to ignore – boundedBy (for ArcGIS)
slide-17
SLIDE 17

I NSPI RE Reader Configuration

Parameters reordered with collapsible sections improve usability

slide-18
SLIDE 18

I NSPI RE GML Reader: Exam ple settings

  • Prefix attributes to keep

track of namespaces

  • Ignore properties:

boundedBy

  • Flatten element names
  • List braces to empty_string
  • Axis order: look-out!
slide-19
SLIDE 19

Reading: Troubleshooting

Common challenges with reading INSPIRE data

  • Missing schemas
  • Custom schemas
  • Namespace differences: data vs schema
  • Axis order
  • File fragments: XML syntax
slide-20
SLIDE 20

Reading: W orkarounds

  • Use GML reader (not INSPIRE) with ‘Ignore

schema mode’ to read using data only (no schema required)

  • Try using the XML reader (using new tree view),

and then extract GML with GeometryReplacer

  • Filter out what you don’t need: elements,

geometries, lists

  • WFS: use your browser to test - click on log links
slide-21
SLIDE 21

GML / W FS Reading: I gnore Schem a

smoothly skip parser errors

slide-22
SLIDE 22

Adm in Units: I gnore Properties

slide-23
SLIDE 23

Adm in Units: I gnore Properties

slide-24
SLIDE 24

Flood Risk Areas w ith Open Street Map

slide-25
SLIDE 25

I NSPI RE – 3 D Buildings

slide-26
SLIDE 26

I NSPI RE W orkflow s

  • Inspection & evaluation
  • Validation
  • Loading to GIS, database
  • Integrating with other data
  • Common ids
  • Spatial relationship
  • Georeferencing / reprojection
slide-27
SLIDE 27

XMLValidator transformer (syntax and schema) Many other FME validation transformers to check attribute values, geometry... Don’t forget to inspect! Logical validation – business rules

Validation

slide-28
SLIDE 28

To / From GI S

Nested (XML) Relational (FME Workbench)

<Contact> <name>John</name> <city>Vancouver</city> <activeDate> <from>11-22-99</from> <to>12-11-09</to> </activeDate> name = John city = Vancouver activeDate.from = 11-22-99 activeDate.to = 12-11-09

▪ Nested object structure vs. Relational ▪ Schema mapping

slide-29
SLIDE 29

Database Loader

slide-30
SLIDE 30

Protected Sites to Geodatabase

slide-31
SLIDE 31

Protected Sites Geodatabase Result

slide-32
SLIDE 32

To / From GI S - Secret to Success

Schema Mapping

  • Feature types
  • Attributes
  • Lists

Data model knowledge > XML knowledge Schema mapping is what FME is all about! FME can also manage all your validation needs

slide-33
SLIDE 33

Reading I NSPI RE W eb Services

  • 1. WMS Reader
  • 2. WFS Reader
  • 3. Atom/RSS Reader
slide-34
SLIDE 34

Reading I NSPI RE: W eb Services

1 . W MS Reader

  • 2. WFS Reader
  • 3. Atom/RSS Reader
slide-35
SLIDE 35

Reading I NSPI RE: W eb Services

FME W MS Reader

  • Supports WMS 1.1, 1.3
  • Supports time

Dem o

http:/ / m ap.salford.gov.uk/ geoserver/ I NSPI RE/ ow s?service= w m s&version= 1 .3 .0 &request= GetCapabilities

slide-36
SLIDE 36

Reading I NSPI RE: W eb Services

  • 1. WMS Reader

2 . W FS Reader

  • 3. Atom/RSS Reader
slide-37
SLIDE 37

Reading I NSPI RE: W eb Services

FME W FS Reader

  • Read WFS Features and Translate to Any format
  • Supports 1.1, 2.0
  • Supports paging

Dem o

https://data.gov.uk/dataset/nymnpa-inspire-download-wfs-service

slide-38
SLIDE 38

Reading I NSPI RE: W eb Services

  • 1. WMS Reader
  • 2. WFS Reader

3 . Atom / RSS Reader

slide-39
SLIDE 39

Reading I NSPI RE: W eb Services

FME RSS/ ATOM Reader

  • Download Zip file
  • Extract Contents
  • Translate to another format

ALL in one FME W orkspace

slide-40
SLIDE 40

Saxony, Germ any Data Dow nload Site

slide-41
SLIDE 41

Accessing Saxony ATOM Feed Data

http://geodownload.sachsen.de/inspire/ad_atom/Dataset_gmd_ad_gml_4258.xml

slide-42
SLIDE 42

FME W orkspace Detail - Dem o

  • 1. Parameter for Municipality(Gemeinde)
  • 2. Read Download Link from ATOM XML
  • 3. Download Zip file
  • 4. Unzip and Read and Translate to Shape
slide-43
SLIDE 43

Accessing I NSPI RE Data from ArcGI S

  • Data Interoperability Extension includes WFS

Reader

  • Interoperability Connection
  • Spatial ETL Tool
  • FME Extension
slide-44
SLIDE 44

Accessing I NSPI RE Data from ArcGI S

  • Using Data Interoperability Extension &

Spatial ETL Tool (FME Workspace)

Dem o

slide-45
SLIDE 45

Making I NSPI RE transparent: client friendly

  • Client friendly formats: KML, PDF
  • Web Services: Image service, JSON feeds
  • A deeper level of integration, leveraging:
  • 3D
  • Real time
slide-46
SLIDE 46

SE Protected Sites KML

slide-47
SLIDE 47

KML / COLLADA: Georeferenced Result

slide-48
SLIDE 48

Client Friendly Services

  • INSPIRE WFS -> FME -> Image service
  • INSPIRE WFS -> FME -> JSON data stream
  • INSPIRE GML 3D Buildings -> Adobe 3D PDF
slide-49
SLIDE 49

W FS to KML Stream ing via W rapper

GE request -> FME Server -> Airports WFS

slide-50
SLIDE 50

W FS to KML Stream ing

slide-51
SLIDE 51

I NSPI RE Buildings to 3 D PDF

slide-52
SLIDE 52

I NSPI RE Buildings to 3 D PDF

slide-53
SLIDE 53

W riting and Publishing I NSPI RE Data

  • Schema based
  • Generate required attribute and geometry schema

just like other formats

  • Complex attributes & geometries
  • All annexes supported (I,II,III)
  • 2, 2.5 & 3D
  • Coverages
  • Raster
slide-54
SLIDE 54

GML Geom etry

slide-55
SLIDE 55

UKHO Flood Data to I NSPI RE Natural Hazards

slide-56
SLIDE 56

3 . The Solution: Result

slide-57
SLIDE 57

FME WxS Workspace

GetCapabilities Request

Response XML

GetFeature Request

Response GML FME Server

FME Workspace as WFS Service Broker

slide-58
SLIDE 58

WFS Workspace

slide-59
SLIDE 59

New in FME 2 0 1 6

  • GML: ignore schema mode
  • GML: Parameter refresh – reordering
  • XML: tree view
  • WFS: feature collections
  • WFS: paging
  • INSPIRE: Schema updates
  • All: Improved schema caching
slide-60
SLIDE 60

Exam ple I NSPI RE Solutions by FME Partners

  • con terra (> 50 implementations across Europe)
  • Metria, Sweden (Protected Areas; Transportation)
  • 1 -Spatial; Dotted Eyes, UK
  • AED Sicad (NAS to INSPIRE conversions)
  • Spatialw orld, Finland (National Land Survey)
  • Verem es, France (INSPIRE writer testing)
  • Vicrea, NL
  • GI M, BE
  • SW ECO, Denmark, GST
slide-61
SLIDE 61

FME com pletes the I NSPI RE Life Cycle

slide-62
SLIDE 62

FME and I NSPI RE

FME simplifies the process of achieving EU INSPIRE* compliance - without any coding - through its abilities to:

  • Read I NSPI RE data and services, using a number of

readers, including the INSPIRE GML Reader

  • Prepare data for contribution to INSPIRE through data

transformation and schema mapping

  • W rite I NSPI RE GML using the INSPIRE GML Writer,

with built-in application schemas

  • Validate I NSPI RE GML to ensure compliance with EU

standards

  • Share I NSPI RE data using FME Server’s web services
slide-63
SLIDE 63

Keys to Success w ith I NSPI RE

  • Don’t just publish without trying:

eat your own dogfood

  • Balance flexibility, complexity and

usability

  • Integrate with existing workflows
  • Get stakeholder and vendor

feedback: know your audience

  • Look for easy wins early
  • Automate and future-proof
slide-64
SLIDE 64

Conclusion

INSPIRE Data and Services can seem complex BUT:

  • You can easily transform it to use
  • Share it an way that is accessible to anyone
slide-65
SLIDE 65

Resources:

Safe.com : safe.com/inspire safe.com/webinars I NSPI RE Tutorial:

https://knowledge.safe.com Other tutorials: XML, GML, 3D Google: INSPIRE FME

slide-66
SLIDE 66

Thank You!

Dean Hintz Senior Analyst

dean@safe.com

@DeanAtSafe

Ken Bragg European Services Manager Safe Softw are

Ken.Bragg@safe.com

@KenAtsafe

slide-67
SLIDE 67

Tutorial Setup

FME INSPIRE Tutorial:

https://knowledge.safe.com/articles/How_To/INSPIRE Download source data and work spaces

slide-68
SLIDE 68

FME and I NSPI RE

  • Consum e I NSPI RE – Leverage existing INSPIRE content

and services

  • Schem a Transform ation* – the hard problem that FME

makes easier and automates. (e.g. conterra’s ISP for FME)

  • Publishing I NSPI RE – INSPIRE writer and web service

support – easily meet INSPIRE requirements - no code!

  • Com plex Geom etries – FME’s powerful data modeling

supports raster coverages, surfaces, 3D, point clouds, needed for Annex II, III

  • W eb Services - workspace as web service broker

via FMEServer**

slide-69
SLIDE 69

I NSPI RE Data Harm onization Supported by FME

Consum ption

Data assessment

Assem bly Formats, Joins Transform ation schema, geometry Validation QA, XSD, values Publication Web Services, GML I NSPI RE SDI Data Sharing

slide-70
SLIDE 70

FME and I NSPI RE

  • Consum e I NSPI RE – Leverage existing INSPIRE content

and services

  • Schem a Transform ation* – the hard problem that FME

makes easier and automates. (e.g. conterra’s ISP for FME)

  • Publishing I NSPI RE – INSPIRE writer and web service

support – easily meet INSPIRE requirements - no code!

  • Com plex Geom etries – FME’s powerful data modeling

supports raster coverages, surfaces, 3D, point clouds, needed for Annex II, III

  • W eb Services - workspace as web service broker

via FMEServer**

slide-71
SLIDE 71

Tutorial Exercises / Dem os

  • 1. Reading: Protected Sites, Parcels, Hydrography
  • 2. Writing: Natural Hazards
  • 3. Validation: HazardAreas, Parcels
  • 4. Writing: 3D Buildings

5 . Conterra: INSPIRE Solution Pack

  • 6. Atom Feeds
  • 7. Web Services
  • 8. New Stuff
slide-72
SLIDE 72

Parcels w ith XML Filter Query

slide-73
SLIDE 73

FME can even read new GML formats like GeoS ciML

(data from British Geological S urvey)

GML / W FS Reading: I gnore Schem a