Enabling Information Sharing thru Common Services Distribution of - - PowerPoint PPT Presentation

▶
enabling information sharing thru common services
SMART_READER_LITE
LIVE PREVIEW

Enabling Information Sharing thru Common Services Distribution of - - PowerPoint PPT Presentation

Feb 07, 2023 235 likes •473 views

Enabling Information Sharing thru Common Services Distribution of WXXM data in the NAS using OGC data access services Presented To: Services Session Presented By: Oliver Newell Date: August 31, 2011 This work was sponsored by the Federal

slide-1
SLIDE 1

Distribution of WXXM data in the NAS using OGC data access services

Presented To: Services Session Presented By: Oliver Newell Date: August 31, 2011

Enabling Information Sharing thru Common Services

This work was sponsored by the Federal Aviation Administration under Air Force Contract No. FA8721-05-C-0002. Opinions, interpretations, conclusions, and recommendations are those of the authors and are not necessarily endorsed by the United States Government.

slide-2
SLIDE 2

Introduction

  • This talk covers
  • High-level architecture concepts for distribution of

weather data in the NAS, based on R&D conducted by the NNEW and SWIM programs

  • Exercising the architecture concepts using an OGC

Web Feature Service (WFS) to disseminate WXXM data

slide-3
SLIDE 3

Agenda

  • Architectural Background
  • Distribution of WXXM data using the NNEW

Web Feature Service Reference Implementation (WFSRI)

  • Summary
slide-4
SLIDE 4

Shared Surveillance Sources DoD C2 Facility (DoD-specific fns.) DOT C2 Facility (DOT-specific fns.) NOAA and Other Facilities

Internet

Public Access Portal

  • Filter
  • Delay

Shared Services

  • SSA Data Management
  • SSA Correlator/Tracker
  • Weather Data Reduction
  • Other

Net Centric Data Distribution NOAA and Other Facilities DOT C2 Facility (DOT-specific fns.) DOT C2 Facility (DOT-specific fns.) DoD C2 Facility (DoD-specific fns.) DoD C2 Facility (DoD-specific fns.) DHS C2 Facility (DHS-specific fns.) Interagency shared situation awareness (SSA) enabled by network access to shared services and collaborative capabilities built into C2 systems

JPDO Integrated Surveillance Concept of Operations

slide-5
SLIDE 5

WXXM 1.1 Data Model (Collaborative effort among Eurocontrol, FAA, NWS, DoD, NOAA)

XML ISO 19139

Observations & Measurements General-purpose WXXM Components

GML Observations & Measurements / ISO 19123 General-purpose Weather Components (WXXM 1.1) Aviation-Specific Weather Components (WXXM 1.1) Eurocontrol-Specific Extensions FAA-Specific Extensions

  • Composable, extensible data model balances standardization with the need for individual

communities to innovate over time

  • What is the vision for distributing this data within the NAS?
  • Composable, extensible data model balances standardization with the need for individual

communities to innovate over time

  • What is the vision for distributing this data within the NAS?

NWS-Specific Extensions

W3C ISO / OGC World Meteorological Organization (WMO) * International Civil Aviation Organization (ICAO) * Individual Organizations Standards Governance Body (* = Notional)

Agility

High (months) Low (years)

DOD-Specific Extensions

Interoperability via WXXM

slide-6
SLIDE 6

SOA Core Services Interface Management Messaging Support Services Content Management Data Access Technical Infrastructure Services Mission Services Interaction Services Weather Data Access Aeronautical Data Access Surveillance Data Access Content Discovery Request/ Response Message Routing Publish/ Subscribe Service Discovery Short-term Capacity Management Long-term Capacity Management Navigation Support Trajectory Management Safety Management Thick Clients Web Clients Network Air/Ground Comm Terrestrial Comm Hardware Data Storage Hosting Platforms Computing Platforms

NextGen Enterprise Architecture System View 4 (SV-4)

FTI SWIM Weather (NNEW)

NextGen Standards and Programs 'Stack'

Weather Data Dissemination Supporting Infrastructure Programs

slide-7
SLIDE 7
  • Segment

FTI POP OC-N ‘s

  • ZSE
  • !
  • "

" #

  • $

ZDV ZAB ZMP ZKC ZHU ZMA ZJX ZID ZOB OEX ZME DCC VNT ZNY ZA U AC Y

ZD C

ZBW ZTL

ZF W

ZL A ZOA ZLC

2010 Core Rings Expansion Rings (2010- 2015)

FTI Optical Backbone Segment

  • Weather data can be large in size when compared with typical surveillance data
  • 1000's of users – many getting the same or similar data
  • FTI not (currently) encouraging use of multicast protocols at network layer due to

management complexity

  • Weather data can be large in size when compared with typical surveillance data
  • 1000's of users – many getting the same or similar data
  • FTI not (currently) encouraging use of multicast protocols at network layer due to

management complexity

Key Challenge – Efficient use

  • f Network Bandwidth
slide-8
SLIDE 8

It's Not a Brand-New Problem...

Scalable Web Caching Architecture

  • To this concept, we would like to add:
  • Spatial filtering operations relevant to aviation weather
  • Support for publish/subscribe message exchanges
  • Common interface semantics for real-time and archived data
  • To this concept, we would like to add:
  • Spatial filtering operations relevant to aviation weather
  • Support for publish/subscribe message exchanges
  • Common interface semantics for real-time and archived data
slide-9
SLIDE 9

International standards for access to data of all types using spatial/temporal queries

  • Web Coverage Service – Gridded data access
  • Web Feature Service – Non-gridded data access

2 spatial dimensions + time 3 spatial dimensions + time (4-D Cube)

  • OGC data access services not historically focused on continuous real-time data delivery
  • NNEW is extending WCS/WFS to include publish/subscribe capability
  • Goal is to standardize the extensions within OGC (Pub/Sub Working Group)
  • OGC data access services not historically focused on continuous real-time data delivery
  • NNEW is extending WCS/WFS to include publish/subscribe capability
  • Goal is to standardize the extensions within OGC (Pub/Sub Working Group)

OGC Data Access Services

slide-10
SLIDE 10

Internal NAS Weather Data Origin Server FAA

Large Site: Many Weather Data Clients

Top-Tier Distribution Servers External Weather Data Origin Servers (NWS, …) NAS Enterprise Gateway NAS Enterprise Gateway Edge Distribution Server

Small Site: Few Weather Data Clients

  • Content Delivery Network (CDN) for

Weather Data − Origin Servers − Distribution Servers − Common Interfaces at all Server Tiers (OGC WFS, WCS, WMS) − Leverages and extends SWIM- compliant Pub/Sub Messaging

  • Content Delivery Network (CDN) for

Weather Data − Origin Servers − Distribution Servers − Common Interfaces at all Server Tiers (OGC WFS, WCS, WMS) − Leverages and extends SWIM- compliant Pub/Sub Messaging

  • Top-Tier distribution servers isolate
  • rigin servers from demands of

multiple distributed clients

  • Actual deployed distribution server

topology can grow or shrink over time based on changing user demand and underlying network capability

  • Edge distribution servers isolate

network and top-tier servers from demands of many clients at a single location (e.g., large TRACON facility)

Service-Oriented Weather Content Delivery Network

slide-11
SLIDE 11

Agenda

  • Architectural Background
  • Distribution of WXXM data using the NNEW

Web Feature Service Reference Implementation (WFSRI)

  • Summary
slide-12
SLIDE 12

Roles of the NNEW Service Reference Implementations

  • Proof-of-concept platform used to exercise

the core OGC specifications and extensions against NNEW requirements

  • Build on top of the SWIM software stack -

provide lesson’s learned

  • Technology transfer from R&D to NNEW

implementation phase (Government Furnished Information)

slide-13
SLIDE 13

Service Container (e.g., Tomcat, Jetty, ServiceMix) Service Container (e.g., Tomcat, Jetty, ServiceMix)

Subscription Spatial Filter

Java Topology Suite

Data Store

Message Broker Apache ActiveMQ

Transaction- Insert (SOAP/HTTP)

Request/ Response Transaction Interface (Insert)

Jetty/ Apache Camel

Subscription XML Feature Parsing Feature Cache

SQL Database Apache Derby, Postgres,…

OGC Query Processor Insert New Data Trigger Triggered Subscription Query Requests Subscription Manager Single-Shot Query Requests Single-Shot Query Responses Request/ Response Query Interface

Jetty/ Apache Camel

Subscription Data

JMX Mbean Server

Monitoring ‘Beans’ Monitoring ‘Beans’ Monitoring ‘Beans’ Insert

Pub/Sub Transaction- Insert (JMS) Subscription Data Subscription Setup Requests/Responses

Repeater

Remote Dataset Subscription Data (JMS)

Insert

Single-Shot Requests/Responses

WFSRI Block Diagram

slide-14
SLIDE 14

Web Feature Service Reference Implementation Web Feature Service Reference Implementation WFSRI Core SamplePublisher SamplePublisher Simulator Sample Core (Cmd- Line Interface & I/O) Test Files Message Broker Transaction- Insert (SOAP) SampleReqReply SampleReqReply Sample Core GetFeature (SOAP) SampleSubscribe r SampleSubscribe r Sample Core Transaction- Insert (JMS) Subscription Control/Setup (SOAP) Subscribe (JMS)

WFSRI Installation Verification/ Performance Measurement

Sample program capable of simulating a variety of products at a number of different spatial densities Sample program capable of simulating a variety of products at a number of different spatial densities

  • Data flow instrumented to enabled

creation of timing trace at end receiver

  • HTTP, JMS headers used (similar to

HTTP 'Via' header in principle)

  • Data flow instrumented to enabled

creation of timing trace at end receiver

  • HTTP, JMS headers used (similar to

HTTP 'Via' header in principle)

Hostname AppName After Timestamp(ms) DeltaTime

  • sampson.local WFS Recv 1314164845047

localhost WFS Proc 1314164845455 ( 408 ms ) localhost WFS Zip 1314164845469 ( 14 ms ) sampson.local WFSClientApp Recv 1314164845471 ( 2 ms ) sampson.local WFSClientApp Unzip 1314164845481 ( 10 ms ) Hostname AppName After Timestamp(ms) DeltaTime

  • sampson.local WFS Recv 1314164845047

localhost WFS Proc 1314164845455 ( 408 ms ) localhost WFS Zip 1314164845469 ( 14 ms ) sampson.local WFSClientApp Recv 1314164845471 ( 2 ms ) sampson.local WFSClientApp Unzip 1314164845481 ( 10 ms )

slide-15
SLIDE 15

Simulated Storm Contours (Dense Scenario – NW Filter)

slide-16
SLIDE 16

WFSRI Installation Verification/ Performance Measurement

  • ‘Dense’ simulation exceeds feature count of CIWS worst-case weather

day

  • ~ 2 seconds per distribution node ‘hop’ for this loading is not considered

problematic (forecast data latency requirements are relaxed when compared to their wind-shear alert counterparts)

  • Room for improvement remains via a number of optimizations
  • ‘Dense’ simulation exceeds feature count of CIWS worst-case weather

day

  • ~ 2 seconds per distribution node ‘hop’ for this loading is not considered

problematic (forecast data latency requirements are relaxed when compared to their wind-shear alert counterparts)

  • Room for improvement remains via a number of optimizations
slide-17
SLIDE 17

WFS, WXXM, and AIXM

<AirspaceVolume> <upperLimit uom="m">5000</upperLimit> <upperLimitReference>STD</upperLimitReference> <lowerLimit uom="m">0</lowerLimit> <lowerLimitReference>MSL</lowerLimitReference <horizontalProjection> <Surface gml:id="SURF"> <gml:patches> <gml:PolygonPatch> <gml:exterior> <gml:LinearRing> <gml:posList dimension="2"> 40.450001 -93.900002 40.525002 -93.491669 (additional points....) 40.450001 -93.900002 </gml:posList> </gml:LinearRing> </gml:exterior> </gml:PolygonPatch> </gml:patches> </Surface> </horizontalProjection> </AirspaceVolume> <AirspaceVolume> <upperLimit uom="m">5000</upperLimit> <upperLimitReference>STD</upperLimitReference> <lowerLimit uom="m">0</lowerLimit> <lowerLimitReference>MSL</lowerLimitReference <horizontalProjection> <Surface gml:id="SURF"> <gml:patches> <gml:PolygonPatch> <gml:exterior> <gml:LinearRing> <gml:posList dimension="2"> 40.450001 -93.900002 40.525002 -93.491669 (additional points....) 40.450001 -93.900002 </gml:posList> </gml:LinearRing> </gml:exterior> </gml:PolygonPatch> </gml:patches> </Surface> </horizontalProjection> </AirspaceVolume>

Querying for weather in an Airspace Volume

  • WFS issue: no generic GML ‘2.5-D’ data types

(2-D shapes plus vertical extent)

  • AIXM provides the needed types

WFS AIXM Support Example

<wfs:WFS_Capabilities> … <fes:Spatial_Capabilities> <fes:GeometryOperands> <fes:GeometryOperand name="gml:Point"/> <fes:GeometryOperand name="gml:Curve"/> <fes:GeometryOperand name="gml:Polygon"/> <fes:GeometryOperand name="gml:Envelope"/> <fes:GeometryOperand name=“aixm:AirspaceVolume"/> </fes:GeometryOperands> <fes:SpatialOperators> … </wfs:WFS_Capabilities> <wfs:WFS_Capabilities> … <fes:Spatial_Capabilities> <fes:GeometryOperands> <fes:GeometryOperand name="gml:Point"/> <fes:GeometryOperand name="gml:Curve"/> <fes:GeometryOperand name="gml:Polygon"/> <fes:GeometryOperand name="gml:Envelope"/> <fes:GeometryOperand name=“aixm:AirspaceVolume"/> </fes:GeometryOperands> <fes:SpatialOperators> … </wfs:WFS_Capabilities> <wfs:GetFeature> <wfs:Query typeNames="avwx:PIREP"> <fes:Filter> <fes:Within> <fes:ValueReference>GEOMETRY</fes:ValueReference> <aixm:AirspaceVolume> <aixm:upperLimit uom="m">5000</aixm:upperLimit> <aixm:upperLimitReference>STD</aixm:upperLimitReference> <aixm:lowerLimit uom="m">0</aixm:lowerLimit> <aixm:lowerLimitReference>MSL</aixm:lowerLimitReference> <horizontalProjection> <Surface gml:id="SURF"> …. (details omitted)</Surface> <aixm:AirspaceVolume> </fes:Within> </fes:Filter> </wfs:Query> </wfs:GetFeature> <wfs:GetFeature> <wfs:Query typeNames="avwx:PIREP"> <fes:Filter> <fes:Within> <fes:ValueReference>GEOMETRY</fes:ValueReference> <aixm:AirspaceVolume> <aixm:upperLimit uom="m">5000</aixm:upperLimit> <aixm:upperLimitReference>STD</aixm:upperLimitReference> <aixm:lowerLimit uom="m">0</aixm:lowerLimit> <aixm:lowerLimitReference>MSL</aixm:lowerLimitReference> <horizontalProjection> <Surface gml:id="SURF"> …. (details omitted)</Surface> <aixm:AirspaceVolume> </fes:Within> </fes:Filter> </wfs:Query> </wfs:GetFeature>

slide-18
SLIDE 18

WFS Weather Contour Query Filtered by AIXM <AirspaceVolume>

slide-19
SLIDE 19
  • Data providers pass variety of weather

data products via R&D NAS Enterprise Gateway (NESG)

  • Flexible environment - ability to

simulate multiple data distribution tiers

  • Quality-of-Service (QoS) capable

routers between tiers

  • WFS/WCS reference implementations

currently being deployed and instrumented

  • Focus on performance,

documentation of lessons learned

  • Data providers pass variety of weather

data products via R&D NAS Enterprise Gateway (NESG)

  • Flexible environment - ability to

simulate multiple data distribution tiers

  • Quality-of-Service (QoS) capable

routers between tiers

  • WFS/WCS reference implementations

currently being deployed and instrumented

  • Focus on performance,

documentation of lessons learned

FAA Tech Center R&D Enclave (Weather Domain Portion)

slide-20
SLIDE 20
  • FAA has a need to efficiently distribute WXXM

data in the operational NAS environment

  • The OGC WFS interface, augmented with

pub/sub extensions and configured in a hub & spoke topology, can be used to help implement this vision

  • NNEW WFS Reference Implementation being

used to demonstrate feasibility of approach Summary

slide-21
SLIDE 21

Questions & Answers / Feedback

slide-22
SLIDE 22

More Information / Contacts

  • WFS/WCS Reference Implementations
  • https://wiki.ucar.edu/display/NNEWD/Reference+Implementations
  • olivern@LL.mit.edu