Logistics Update Session 3.0a Greenbelt Marriott Hotel Greenbelt, - - PowerPoint PPT Presentation

Natalia Donoho Conference Co-Chair NESDIS Office of Satellite and Product Operations (OSPO) Satellite Products and Services Division College Park, MD

#NSatCon15

Logistics Update

Session 3.0a

Greenbelt Marriott Hotel Greenbelt, MD April 27 – May 1, 2015

WMO

Regional Association III Perspective related to satellites

JULIAN BAEZ BENITEZ President of Regional Association III

WMO; OBS

2015 NOAA SATELLITE CONFERENCE

• B. Calpini

CIMO

Regional Association III (RA-III) of WMO

• It is composed by 13 countries
• f South America
• All countries are represented by

a Meteorological Service and in some cases with hydrological services.

• To contribute with the security and welfare of the

population and to the economic prosperity of the countries.

Mission of Meteorological Services

Produce and release reliable Forecast for EWS

Establishment of Coordination Group on Satellite Data Requirements for RA-III and RA-IV

• The Association recalled the vital role of satellite
• bservations from various orbits for permanent weather

monitoring, and forecasting. It also recognized that in addition to

• perational

meteorology, space-based

• bservations cut across all component observing systems
• f the WIGOS, with satellite capabilities contributing to
• bserving and monitoring climate and climate change,
• cean surface, atmospheric composition, hydrological and

cryosphere variables, space weather, etc.

Establishment of Coordination Group on Satellite Data Requirements for RA-III and RA-IV

• This group currently includes experts from seven RA III and RA IV

Members (Argentina, Brazil, Canada, Colombia, Chile, Trinidad and Tobago, and the Bolivarian Republic of Venezuela) and three satellite

• perators (CONAE, EUMETSAT, NOAA).
• It has documented initial user requirements which led to improved data

services via the GEONETCast-Americas and EUMETCast dissemination systems;

• It contributed to a better understanding of the value of satellite data for

regional applications; furthermore, it has facilitated a coordinated input from satellite data users in South America, allowing NOAA to refine the specification of geostationary image coverage of the South American continent by GOES-East as indicated above.

test footer 5

Current Situation of Weather Monitoring

• Satellite data use is greatly distributed in a variety
• f areas, contexts and satellites, and is most used

for research and development means, education and training, weather forecasts and warnings and climate predictions and assessments.

• Both near-real time and historical data are

important for the community.

• Part of the community doesn’t know the

GEONETCast broadcast system.

In the current satellite generation, the Region is mostly using data from the following satellites

• Aqua /Terra (54.35%), GOES- E (43.48%), TRMM (39.13

%), Meteosat - 10 (34.78%) and Landsat (32.61%).

• Other satellites like GOES-W (26.09%), METOP (19.57%),

SPOT (19.57%), SAR.

• Missions (19.57%), POES (17.39%), Aquarius / SAC-D

(15.22%), CBERS (15.22%), DMSP (13.04%),

• NPP (8.70%), Jason (6.52%), Cloudsat/Calipso (4.35%),

COSMIC (2.17%), Oceansat (2.17%), SMOS (2.17%), and

• ther (26,09%).

Results of Survey in RA-III and RA-IV

Results of Survey in RA-III and RA-IV

Results of Survey in RA-III and RA-IV

Resolutions of RA-III Meeting. Asuncion, Paraguay, September 2014

• The Association re-emphasized the continued need to count with

higher frequency satellite imagery relating to South America, at times

• f severe phenomena occurrences in the Region. It also wished to
• btain information, from satellite providers, about cost and technical

requirements to allow regional satellite stations to receive data from the planned new generation satellites.

• The Association recalled the vital role of satellite observations from

various orbits for permanent weather monitoring, and forecasting. It also recognized that in addition to operational meteorology, space- based observations cut across all component observing systems of the WIGOS, with satellite capabilities contributing to observing and monitoring climate and climate change, ocean surface, atmospheric composition, hydrological and cryosphere variables, space weather, etc.

• In particular, the Association underlined the importance of frequent

geostationary satellite observations to support nowcasting and very short-range forecasting and recalled the valuable service provided by the United States of America through the operation of a relocated GOES satellite delivering 15-minute imagery over South America from December 2006 to August 2013. Following the termination of this GOES-South America mission, the Association welcomed the measures taken by NOAA to optimize GOES-East operations, in close consultation with experts from RA III and RA IV Members, with a view to ensure at least hourly coverage of most of the Region during rapid- scan operation over North America

Resolutions of RA-III Meeting. Asuncion, Paraguay, September 2014

• The Association recommended a special training

effort to prepare for the new generation satellite and encouraged all Members to set up internal user preparation projects at the national level, in accordance with the CBS-15 Guidelines. Resolutions of RA-III Meeting. Asuncion, Paraguay, September 2014

www.wmo.int

Thank you for your attention

High-level Conference Overview:

Monday – Opening Session, Special Guest speakers, Highlights since 2013 (and Icebreaker) Tuesday – What data is out there now and in the future (and Workshop on Consideration of Commercial Data) Wednesday – How to access data, PDA Breakout and No-Host Dinner. Thursday – Education & Training, Other NOAA Space Programs: 2015 to 2020+ and Frequency Matters Friday – Conference Summary and a Panel on "Meeting our Nation's Challenges: Socio-Economic Benefits of Environmental Satellites“.

2

There is an No-Host Dinner tonight at 6 pm!

Delicious buffet meal for $27.00 USD Guest Speaker: Mr. Jon Malay

We are GLAD you are here!

3

This program is physically accessible to people with disabilities. Sign language interpretation will be provided. Interpretation Services (English to Spanish): Multilingual Experts Sponsors: World Meteorological Organization

Conference Functions /Floor Plan

Emergency Information

6

Poster Sessions

(Annapolis Room) Currently expect 175 posters We will have 3 different poster sessions, of ~60 posters each.

• Session 2 posters viewable during No Host Dinner;

Finalized poster list and one-page summaries are on the website.

Poster Session Poster Placement Formal Session Time Poster Removal 1 Monday – Tuesday Morning Tuesday 10:30 - 11:30 am, & 3:00 – 4:15 pm End of day Tuesday 2 Wednesday Morning Wednesday 10:30 - 11:30 am, & 3:00 - 4:00 pm End of day Wednesday 3 Thursday Morning Thursday 10:30 - 11:30 am, & 3:15 - 4:15 pm Noon on Friday

7

Exhibits & Demos

(Chesapeake, Potomac, Patuxent & Montpelier Rooms) We have 37 exhibitors and vendors!

• 8 from NOAA in Grand Ballroom Foyer
• 3 confirmed Demos (sign-up sheet in Patuxent Room)

– GRB Simulator, CLASS, DRO Registration Database

See the final list and floor plan on the website

Date Time Monday 3:00 - 8:00 pm Tuesday 8:00 am - 5:30 pm Wednesday 8:00 am - 6:00 pm Thursday 8:00 am - 5:30 pm Friday 8:00 am - noon

8

Presenters

• Speakers
• Be up front before your session begins; introduce yourself to

Session Co-Chairs

• Use microphones as directed by A/V team
• Be careful not to turn away from microphone
• Stay on stage at the podium and utilize the hard wired

microphone that is attached to the podium throughout their presentation.

• Use clicker to advance slides
• Presenter's monitor on the floor
• Remember - all the presentations will be

made public. Please, no sensitive or ITAR/EAR information.

• Keep us on schedule: Heed time indications

9

Where Can I Eat Lunch?

• Lunch and snacks/beverages are available for

purchase at the on-site restaurant, Silver Moon Café, M Blue Bar and Lounge and Food Kiosks.

• The local Greenbelt area has a wide variety of

restaurants and shops within driving distance of the hotel. Transportation is available for registered hotel guests to the local area restaurants and shopping centers.

• No Complimentary Refreshments or Meals

10

We need your feedback

• Post-Conference Survey will be available on

NSC-2015 Website today; PLEASE take the time to provide your feedback!

• Index Cards – available at the Registration Desk
• Remote attendees: write in the “question” box in

the webinar

11

3

3.1 JPSS Products and Dissemination: How to Access

4

3.1a JPSS Products and Capabilities

Lihang Zhou Physical Scientist, NOAA/NESDIS/STAR/Satellite Meteorology and Climate Division

PowerPoint Presentation

Sustain • Enable • Create – OSGS

Tom Schott Satellite Product Manager NOAA/NESDIS/OSGS

JPSS Stored Mission Data and Environmental Satellite Processing Center Products

Sustain • Enable • Create – OSGS

• S-NPP Stored Mission Data (SMD) Flow
• S-NPP Data Access
• S-NPP Environmental Satellite Processing

Center (ESPC) Data Products

• Data Product Tailoring

Outline

2

Sustain • Enable • Create – OSGS

ESPC

S-NPP Stored Mission Data (SMD) Flow

Svalbard

Department of Defense NDE S-NPP Data Exploitation IDPS Interface Data Processing Segment C3S Command, Control, and Communications Segment GRAVITE Calibration/Validation CLASS Long-Term Archive User Community NOAA and Other Users EUMETSAT Numerical Weather Prediction Community NASA Science/Climate Studies

3

Sustain • Enable • Create – OSGS

• ESPC Data Processing
• S-NPP Application Packets (APs) are downlinked at Svalbard and relayed to the ESPC within

the NOAA Satellite Operations Facility (NSOF) in Suitland, MD

• IDPS processes APs into Raw Data Records (RDRs), Sensor Data Records (SDRs),

Environmental Data Records (EDRs), and Intermediate Products (IPs) [collectively known as xDRs]

• NDE process the SDRs and EDRs from IDPS and generates additional data records
• ESPC Data Distribution
• IDPS distributes xDRs to the Comprehensive Large Array-data Steward System (CLASS) for

archive, Government Resource for Algorithm Verification, Independent Test, and Evaluation (GRAVITE) for calibration and validation, Department of Defense (DoD), and NASA Science Data Segment (SDS)

• NDE distributes xDRs to real time users: National Weather Service (NWS), Authorized NOAA

and NASA users, DoD, and European Organisation for the Exploitation of Meteorological Satellites (EUMETSAT), other international partners

S-NPP SMD Data Flow

4

Sustain • Enable • Create – OSGS

• CLASS – Electronic library of NOAA environmental data

– xDRs, ancillary data, auxiliary data, and software release packages are archived – IPDS data delayed by 6 hours or more and normally made available to users within 24 hours – NDE generated data made available for archive when data is generated – Access: via Internet (http://www.class.noaa.gov/)

• NOAA’s S-NPP Data Exploitation Project

– Serves data to near real-time user community via ftp-s – Access: Submit NPP Data Access Request (DAR) form to NESDIS.Data.Access@noaa.gov

• Global Telecommunications Service (GTS) via EUMETSAT

– GTS is used for operational international exchange of meteorological data between NWP users

• EUMETCast via EUMETSAT

– EUMETCast is a satellite multicast system using Digital Video Broadcasting-Satellite (DVB-S) technology – Access: Register for access via EUMETSAT

• Direct Readout (X-band)

– The Community Satellite Processing Package (CSPP) allows for access to S-NPP data in regional areas – Access: Register and download software: https://cimss.ssec.wisc.edu/cspp/download/

• Product Distribution and Access (PDA)

– PDA is a future capability that will be discussed in Session 3.3, “Product Distribution System” this afternoon

S-NPP Data Access

5

Sustain • Enable • Create – OSGS

Critical

VIIRS Green Vegetation Fraction Polar Winds Sea Surface Temperature (ACSPO) Ocean Color/Chlorophyll ATMS Land Surface Emissivity (MIRS) AMSR-2 SDR Blended SST (with VIIRS) SST (with AMSR-2)

Supplemental High

CrIS Outgoing Longwave Radiation (NUCAPS) Infrared Ozone Profile (NUCAPS) CrIS/ATMS Atm Moisture Profile (NUCAPS) Atm Temperature Profile (NUCAPS) ATMS Cloud Liquid Water (MIRS) Rainfall Rate (MIRS) Sea Ice Concentration (MIRS) Snow Cover (MIRS) Snow Water Equivalent (MIRS) Total Precipitable Water (MIRS) Blended Snow Cover (with VIIRS) Snow Cover (with AMSR-2) Rainfall Rate (with ATMS) Rainfall Rate (with AMSR-2) Total Precipitable Water (with ATMS) Total Precipitable Water (with AMSR-2) Ozone (with OMPS Nadir Profile) Ozone (with CrIS Ozone) Soil Moisture (with AMSR-2)

Supplemental Low

ATMS Land Surface Temperature (MIRS) Moisture Profile (MIRS) Temperature Profile (MIRS) CrIS Trace Gases (CO, CO2, CH4) (NUCAPS) VIIRS Vegetation Health Product Suite AMSR-2 Surface Type Blended Land Surf Temp (with VIIRS) AMSR-2 Cloud Liquid Water Imagery Precipitation (Type/Rate) Precipitable Water Sea Ice Characterization Sea Surface Temperature Sea Surface Wind Speed Snow Cover/Depth Snow Water Equivalent Soil Moisture

S-NPP ESPC Data Products

Blue text indicates product is operational

ACSPO: Advanced Clear-Sky Processor for Oceans AMSR-2: Advanced Microwave Scanning Radiometer-2 ATMS: Atmospheric Temperature Moisture Sounder CrIS: Cross-track Infrared Sounder MIRS: Microwave Integrated Retrieval System NUCAPS: NOAA Unique CrIS/ATMS Processing System OMPS: Ozone Mapping and Profiler Suite VIIRS: Visible Infrared Imaging Radiometer Suite

6

Sustain • Enable • Create – OSGS

S-NPP ESPC Product Examples

Microwave Integrated Retrieval System (MiRS)

• MiRS provides temperature and moisture profiles, land surface

temperature, land surface emissivity, snow water equivalent, snow cover, sea ice concentration, cloud liquid water, total precipitable water, ice water path, instantaneous rain water path, and rain rate products from microwave instruments in all weather and all surface conditions.

• Formats: NetCDF4
• Coverage: Global

Vegetation Health Suite (VHS)

• VHS provides vegetation health index (VHI), vegetation condition index

(VCI), and temperature condition index (TCI) products which are used for drought monitoring, in global climate impact assessments, and to determine global crop production, fire risk, disaster mitigation, and food security.

• Format: NetCDF4
• Coverage: Global

VIIRS Polar Winds (VPW)

• VPW provides wind speed, direction, and height at high latitudes to be

assimilated in numerical weather prediction models to improve model forecasts and improve hurricane track forecasts.

• Formats: NetCDF4, BUFR
• Coverage: Poleward of 65 degrees

7

Sustain • Enable • Create – OSGS

ESPC Blended Products

• Snow Cover (with VIIRS and AMSR-2)
• Rainfall Rate (with ATMS and AMSR-2)
• Total Precipitable Water (with ATMS and AMSR-2)
• Ozone (with OMPS Nadir Profile and CrIS)
• Soil Moisture (with AMSR-2)

S-NPP ESPC Product Examples

Blended Snow and Ice Products Blended Soil Moisture

8

Sustain • Enable • Create – OSGS

Data Product Tailoring

• S-NPP data products can be tailored by NDE to meet user needs
• Tailoring options include the following:

– Aggregating – Reformatting

• NetCDF4 , GRIB2, BUFR, GeoTIFF

– Resampling – Subsetting (i.e., thinning data files) – Subsampling – Remapping – Filtering – Compressing

• GZIP, ZIP, ZLIB, and JPEG compression of files
• Internal HDF5/netCDF-4 compression of data arrays

– Applying World Meteorological Organization (WMO) Headers

Filtered ACSPO SST Remapped VIIRS RGB Aggregated VIIRS Imagery 9

Sustain • Enable • Create – OSGS

• S-NPP SMD flows from Svalbard to the ESPC and is

distributed to NOAA’s long term archive and to various users/consumers

• S-NPP SMD data can be accessed from archive and in

near real time

• S-NPP ESPC satellite data products include

atmospheric, oceanic, land, and blended products

• S-NPP ESPC satellite data products can be tailored to

suit user-applications/needs

Summary

10

JPSS: SBN (AWIPS Products)

Brian Gockel

Acting NWS Ground Readiness Project Manager NOAA/NWS Office of Observations

April 29, 2015

JPSS: SBN (AWIPS Products) - Topics

• S-NPP/JPSS Product Flow to AWIPS
• NOAAPort SBN
• S-NPP/JPSS Products Planned for AWIPS
• AWIPS Screen Shots of S-NPP/JPSS Products

2

3

S-NPP and JPSS Space Segment S-NPP/JPSS Ground Stations

(Space/Ground Comms Node)

NSOF CBU

JPSS Ground Segment NOAA/NWS

AWIPS NCF

PDA JPSS IDPS NDE/ PDA JPSS IDPS

Flow of S-NPP and JPSS Products to AWIPS

Alternative, local or secondary data paths not shown.

4

Satellite Broadcast Network ~ “NOAAPort”

S-NPP/JPSS Product Distribution

GOES S-NPP/JPSS NOAA/NESDIS NOAA/NWS

VIIRS Imagery Soundings etc.

NCEP

Hydromet Sensor Products (e.g., radar, ASOS, Profiler, River Gages) TOC NWSTG

Satellite Product Generation

AWIPS NCF Guidance & Model Products

Satellite imagery

Other Environmental Satellite Products

SES-1 Satellite

SBN Uplink Facility (NY) WFO/RFC/NC Forecasts, Watches Warnings SBN Users – includes NWS-internal (AWIPS) and externals

• The SBN disseminates satellite, model, radar and
• ther products to AWIPS and other users
• SBN Bandwidth is 60+ Mbps
• Only SBN-related product flows shown

SBN

NWS

Networks

SBN Rec. Antennas

5 5

SBN Channels Carrying S-NPP/JPSS Products

Channel Name S-NPP/JPSS Products Example Products

NMC/NWSTG S-NPP Point Data (e.g., NUCAPS soundings) GOES/GINI

Legacy GOES Imagery (Mostly CONUS)

GOES-R West

GOES-R ABI Imagery (West)

GOES-R East

GOES-R ABI Imagery (East)

NMC2/NWSTG2

GRIB2 model/analysis/forecast grids

OCONUS

GRIB1 OCONUS Grids, Legacy OCONUS GOES Imagery, DCS

POLARSAT S-NPP/JPSS VIIRS Imagery EXP Test or Experimental Products

6

• 1. VIIRS Imagery Channels for AK Region - added in 2012

a. Channel I1 (0.64 um) b. Channel I4 (3.74 um) c. Channel I5 (11.45 um)

• 2. Western Hemisphere NUCAPS (NOAA-Unique

CrIS/ATMS Processing System Soundings) – added April 2014

• 3. VIIRS Near-Constant Contrast Imagery – Regional,

planned for addition in July 2015

• 4. Blended Products (e.g., Total Precip Water)

S-NPP/JPSS Products Planned for AWIPS SBN Addition

7

Other candidate products, in addition to products on preceding slide, include: VIIRS Channel I3 (1.61um) imagery, S-NPP/JPSS Active Fires Product, Cloud Liquid Water (ATMS – NUP), Snow Products, Sea Ice Characterization and/or Concentration. Notes:

• 1. NWS field sites with a polar-satellite direct readout feed and

ingest/processing systems receive more expansive product set than that which is available via the SBN.

• 2. All NWS field sites have secondary/local methods for acquiring

products that are not on the SBN/NOAAPort.

S-NPP/JPSS Products Planned for AWIPS SBN Addition

8

VIIRS Imagery (Channel I4 – 3.74 um)

AWIPS II Screenshots of S-NPP Products

9

AWIPS II Screenshot NUCAPS Soundings

Geographical Sectors for NUCAPS Soundings on SBN

10

Blending of TPW Product from Multiple Satellites done by NESDIS

AWIPS Screenshot of Blended Total Precipitable Water

11

AWIPS II Screenshot of VIIRS NCC Granule

Geographical Sectors for VIIRS NCC Products on SBN (to be added July 2015)

1

JPSS Science Data Services for the Direct Readout Community

• Dr. Bob Lutz

FTS Manager NASA GSFC Code 581

NOAA Satellite Conference for Direct Readout, GOES/POES, and GOES-R/JPSS Users. April 27 – May 1 2015

2

• FTS Overview
• FTS Requirements and Functions
• FTS System Architecture
• FTS Software Design
• Progress to Date
• FTS Schedule
• Summary

Agenda

TDRS

ANC Data

Launch Service Space/Ground

• Comm. Node

MD Frames SMD TT&C JPSS Ground System High-level Architecture OV-2 (Jul 14, 2014) SMD MSD TT&C TT&C TT&C TT&C TT&C MD – Mission Data SMD – Stored Mission Data MSD – Mission Support data DMSP DP AFWA, EUMETSAT PPF, WindSat NRL/FNMOC SCaN POP GSFC Findings Alg. Support MD Frames HRD Performance HRD Performance MSD SvalSat JPSS Ground System

JPSS Ground System Provider of SMD, TT&C, LRD/HRD/MSD No Internal Support, Pass-thru Only FVTS Flight Development Organizations Common Ground System (CGS) Provider of SMD Only Direct Readout & Field Terminals GRAVITE External

SMD GCOM-n MD Frames Coriolis/ WindSat MetOp-n DMSP-Fn (NASA) HRD TT&C Management & Operations Node Supporting Ops CLASS NASA SDS xDR, IPs ESPC xDRs, IPs Security Ops Sim & Test Systems

• Integrate

Element level simulators

• Maintain

Simulators Alg, ASF, DRs, Findings Correlative Data Sources Data Data Alg & Val LCFs STAR Data SMD APs Simulation Node Data Processing Node TT&C/ MSD

JPSS Ground Network Node

• Alg. Support

xDRs, IPs Data Network supports routing of NASA SCaN-supported missions, & McMurdo NSF data SMD (J-1+) SMD (J-1+) CGS Support Node (L3) FNMOC NAVOCEANO SMD APs MSD Fairbanks CDA TrollSat McMurdo NSOF MMC Fairmont CBU Alt MMC NSOF IDPS Fairmont Alt IDPS FVS FVTS Flt Dynamics System Support Nodes Field Terminal Users & S-NPP JPSS-n WSC LEGEND: Black/White Text – Block 1.2 + Red Text – Block 2.0 Purple Text – Block 3+ MSD AGS AGS NASA CARA Cal/Val Node GRAVITE

• Alg. Support

AFWA xDRs, IPs (Blk 1.2 only) Field Terminal Support Node HRD Monitor

4

Satellite Communication Links

TDRSS Ground Link

TDRSS White Sands Station Ground Station

Svalbard, McMurdo, Fairbanks, Troll

Direct Readout User Terminal

S-Band Antenna DB Antenna SMD Antenna

7.812 GHz 15 Mbps 8.2125 GHz 300 Mbps

TDRS Direct Broadcast High Rate Data (HRD) Downlink Direct Broadcast components indicated in green

5

• JPSS Level 1 Requirements Document (JPSS L1RD) provides the

fundamental requirements and scope of JPSS FTS

– JPSS-1 will provide HRD broadcast – JPSS-2 will provide HRD broadcast – JPSS shall provide the Direct Readout community with software, documentation, and periodic updates to enable them to produce data products from JPSS, using their own hardware to receive the JPSS HRD broadcasts

• The JPSS Program is not responsible for developing, testing, or

deploying any JPSS capable field terminal

• JPSS will not perform encryption of the direct broadcast

FTS Level 1 Requirements

6

• Provide the following functionality:

– Hardware Specifications

• Suggested field terminal configurations

– DFCB and RF-ICD

• Containing specifics on direct broadcast data format

– Software to produce RDRs from packets

• Provide and maintain RT-STPS

– Algorithms & Software

• Used to create data products from direct broadcast

– Updated algorithms & software

• Notification when updates are available

– Mission Support Data

• Ancillary/auxiliary data

Key Functions of FTS (1 of 2)

7

• Provide the following functionality (cont’d):

– Maintain list of registered users

• Condition for NTIA Frequency allocation approval

– Mission status

• Users are provided status of the JPSS direct broadcast

– HRD Link status

• Users are provided post-pass performance information

– On-orbit checkout and special tests – Promote the use of the JPSS data products from HRD link

Key Functions of FTS (2 of 2)

8

GRAVITE JPSS Science Team / STAR CGS IDPS Svalbard

HRD Link Status

FTS Distribution Server DRL/IPOPP UWISC/CSPP

Customer Community

JPSS Ground Project Requirements

ADL

ADL

ADL

Algorithm Development Library (ADL) Centerpiece of FTS Implementation

• JPSS Science Team members heavily rely

upon ADL as part of the Algorithm Change Package (ACP)

• ADL provide a means for processing RDRs

into SDRs and EDRs

• Most of the direct broadcast users are not

familiar with using ADL

• JPSS Program will provide support for the

development and maintenance of user- friendly software packages (derived from ADL): GSFC DRL (IPOPP) and University of Wisconsin (CSPP)

Community Satellite Processing Package (CSPP) International Polar Orbiter Processing Package (IPOPP)

Customer Community

9

FTS Logical Architecture

FTS Distribution Server

FTS Customers

FTS Acquisition Server

JPSS Field Terminal Support CGS Support Node CGS JPSS Ground System

4 1. Mission Support Data(MSD) 2. Software (ADL) and Documentation 3. Intermediate Products 4. Software, MSD, Field Terminal Documentation 5. Documentation 6. HRD 6 1 2

JPSS CM

5

GRAVITE

3

10

FTS Data Acquisition and Organization

• FTS acquires and organizes data and documentation relevant to HRD processing

from JPSS-managed satellites

• Data is obtained from the CGS, the CGS support node, GRAVITE and JPSS CM, and

stored in the Data Acquisition server

• This data includes processing source code (e.g., ADL, algorithm update packages,

RT-STPS), documentation, ancillary data, intermediate products and auxiliary data (PCTs, LUTs, Mission Notices, Schedules)

11

FTS Data Distribution

• The FTS mechanism for data distribution is a web portal. Selected

data stored on the FTS server is made available for distribution by the FTS Distribution Server

• Customers desiring the system building blocks (e.g., ADL, algorithms
• r RT-STPS) interact with the FTS Distribution Server to download

source code distribution packages for these components

• Mission Support Data, updated regularly from the CGS, is similarly

made available to FTS customers

12

FTS Customer Registration and Reporting

• Customer registration for FTS access is a self-service capability enabled

through interaction with the Distribution Server main page

• Customer-provided contact information is available to the FTS
• perator for reporting purposes (e.g., to support requests for

frequency usage documentation) and notification purposes (to make FTS customers aware of changes to in system status)

13

FTS System Status and Health

• The FTS internally monitors FTS component health and status, and logs relevant

information on the FTS server to support FTS troubleshooting and recovery

• The monitoring approach planned for the FTS leverages existing capabilities used

for monitoring DPES infrastructure. Expected items to monitor may include:

– Hardware Status, – Disk, CPU and Network Utilization – Server Availability – Process Status

14

System Architecture

15

Software Design

16

Software Design

Top Level Design Overview

• Data Acquisition: components on the private, secured system that

is not reachable by customers

– Data Manger: schedules tasks that transfer, organize, and prepare data for distribution – Private Repository: contains an internal copy of downloaded data

• Data Distribution: components on the public facing system that

are provide access to customers

– Web Portal: provides an interface for customers to register and access data – Public Repository: contains the data to be made available to customers through the web portal

17

Data Acquisition

18

Data Acquisition

Overview of Data Acquisition Components

• Data Manager: Schedules the following tasks

– Transfer Module: establishes a connection and pulls data from a particular external data source – Organizer: organizes incoming data for distribution – Replicator: pushes data from the private repository to the public repository.

• Private Repository

– Incoming data: data from external sources that has not been organized – Organized Data: incoming data organized to make data more meaningful

19

Data Acquisition – Data Manager: Transfer Modules

• One transfer module for each external source of data that is
• btained automatically.
• Each transfer module shall:

– Connect to the external source – Download data automatically – Log activity and generate notifications via email – Report a problem when an external source is unreachable – Report a problem when data integrity is questionable (failed checksum, etc.)

20

Data Acquisition – Data Manager: Organizer

├── data │ ├── ancillary │ │ ├── gmasi │ │ ├── naaps │ │ ├── navgem │ │ ├── ncep_gfs │ │ ├── polar_wander │ │ └── static │ ├── auxiliary │ │ ├── hlm_reports │ │ ├── luts │ │ ├── mission_notices │ │ ├── mission_schedules │ │ ├── pcts │ │ ├── rev_number_files │ │ └── tles │ └── gridded_IPs │ ├── lsa │ ├── mli │ ├── ndvi │ ├── qst │ ├── qst-lwm │ └── snow_ice_cover ├── documentation │ └── public-released_specs └── software ├── adl ├── adl_data ├── algorithm_update_packages └── RT_STPS

• The Organizer shall:

– Maintain an organized directory structure informed by the FT community. – Expire data based on required retention times. – Log activity and generate notifications for problems via email.

• The top level of organization has been

peer reviewed.

• Structure is flexible at lower levels to

support changes based on feedback from the FT community.

• Data expiration is determined by

checking timestamps of incoming data files.

21

Data Acquisition – Data Manager: Replicator

• The Replicator shall:

– Push an exact copy (mirror) to distribution using rsync. – Log activity and generate notifications for problems via email.

• Replicator pushes only data from the organized directory

structure.

• Replicator relies on organizer to maintain the correct set of data

that should be available for distribution.

22

Data Distribution

23

Data Distribution

Overview of Data Distribution Components

• Web Portal

– Provides access over HTTPS. – Utilizes Redmine: an open source web application. – Repository Viewer: allows customers to browse and acquire data. – Registration Manager: allows customers self-service registration.

• Public Repository

– Public Data: distribution directory structure containing data, documentation, and software.

24

Data Distribution: Web Portal

Capabilities for immediate use

• Distribute FTS data
• Maintain a list of registered

customers

• Post a FAQ
• Post notifications

Future possible support

• Collect community feedback

(e.g. issue tracker)

• Facilitate community discussion

(e.g. forum)

Redmine is a web application that provides the functionality to distribute data and register customers.

25

Data Distribution: Data Repository Viewer

• Functionality provided by Redmine.
• The Repository Viewer shows the

available inventory.

• Customers can:

– Browse the directory structure

• n the web.

– View and download data. – Automate downloads using tools such as wget or curl.

26

Progress to Date

• The new FTS implementation plan was accepted by the Ground, PSE,

and NJO management, presented at the JPSS Customer Forum (Nov 2013), and discussed with key stake holders (Dec 2013)

• Upgraded HRD link receiver provided by the Svalbard Ground Station
• Successfully awarded grants to NASA/DRL and University of Wisconsin.
• The FTS SRR/SDR was successfully held on Apr 21, 2014.
• The FTS CDR was successfully held on Sept 17, 2014.
• FTS Software Development – FTS V1.0 had two incremental

builds, with Peer Reviews. To be completed by June 2015.

• FTS Hardware – Ordered, received and tested at NSOF – March

2015.

27

FTS Schedule

• FTS V1.0 will be operational with the integrators (GSFC DRL and University of

Wisconsin) in July 2015.

• This version will be utilized for testing with the JPSS-1 Ground System during

the summer of 2015.

• The FTS team will work with the integrators to further define lower level details
• f the FTS design (e.g. the directory structure) and to enhance the basic

functionality of FTS.

• FTS V1.1 will become operational in January 2016 for all FTS customers.
• The release of FTS V1.1 will be coordinated with the integrators, who will

interact directly with the Direct Broadcast user community.

28

Summary

• FTS is providing the necessary building blocks (software, documentation, and

mission support data) on a web portal. – The proposed FTS implementation plan leverages ongoing activities to support needs of Direct Broadcast community and meets all the FTS requirements. – The proposed FTS implementation will ensure to meet NASA and NOAA Standards, Software Engineering Requirements (NPR 7150.2A), IT Security, and Safety Mission Assurance

• The JPSS Program is also supporting the development and maintenance of user

friendly software packages (IPOPP/CSPP) from GSFC DRL and the University of Wisconsin, to demonstrate the ability to produce ready-to-use products from the SNPP/JPSS HRD link

• FTS will leverage existing annual workshops to provide a forum for the Direct

Broadcast community to present, discuss, learn, and provide feedback to the JPSS Program. For more info: Bob Lutz (Robert.J.Lutz@nasa.gov)

Liam Gumley, Allen Huang, Kathy Strabala, Scott Mindock, Ray Garcia, Graeme Martin, Geoff Cureton, Elisabeth Weisz, Nadia Smith, Nick Bearson, James Davies, Jessica Braun. CIMSS/SSEC, University of Wisconsin-Madison. NOAA Satellite Conference 2015/04/29

Community Satellite Processing Package (CSPP) Polar-Orbiting Satellite Software and Products

What is CSPP?

CSPP (Community Satellite Processing Package) is a collection of software systems for processing data from meteorological satellites. The primary goal of CSPP is to support users who

• Receive satellite data via direct broadcast;
• Create Level 1B and higher level products and

images in real time. Funding is supplied by JPSS and NOAA.

2

CSPP Software Philosophy

The CSPP software Creates useful products for the DB community, Includes up-to-date algorithms, Is pre-compiled for 64-bit Intel Linux (CentOS), Is easy to install and operate, Includes test data for verification, Runs efficiently on modest hardware, Has prompt user support.

3

CSPP by the numbers

Satellites supported: 7 Software packages: 10 Sensors supported: 25 Releases and updates: 29 Registered users: 913 Individual downloads: > 5000

4

CSPP Software (Apr 2015)

5

CSPP Software Product Description

• 1. SDR

VIIRS, CrIS, and ATMS geolocated and calibrated earth observations.

• 2. VIIRS EDR

VIIRS imager cloud mask, active fires, surface reflectance, vegetation indices, sea surface temperature, land surface temperature, and aerosol optical depth.

• 3. HSRTV

Hyperspectral infrared sounder retrievals of temperature and moisture profiles, cloud properties, total ozone, and surface properties.

• 4. Polar2grid

Reprojected imagery (single and multi-band) in GeoTIFF and AWIPS formats.

• 5. Hydra

Interactive visualization and interrogation of multispectral imagery and hyper spectral soundings.

• 6. MIRS

Microwave sounder retrievals of temperature and moisture profiles; surface properties; snow and ice cover; rain rate; and cloud/rain water paths.

• 7. CLAVR-x

Multispectral imager retrievals of cloud properties; aerosol optical depth; surface properties; ocean properties.

• 8. NUCAPS

Combined hyperspectral infrared sounder and microwave sounder retrievals of temperature and moisture profiles, cloud cleared radiances, and trace gases.

• 9. IAPP

Combined infrared sounder and microwave sounder retrievals of temperature and moisture profiles, water vapor, total ozone, and cloud properties.

• 10. ACSPO

Multispectral imager retrievals of sea surface temperature.

Satellite Multispectral Imager Infrared Sounder Microwave Sounder Suomi NPP VIIRS SDRs (Level 1B), Images, Visualization, Clouds, Aerosols, Land, Ocean CrIS SDRs (Level 1B) Atmospheric Profiles, Clouds, Visualization ATMS SDRs (Level 1B), Atmospheric Profiles, Precipitation, Visualization Metop-A/B AVHRR Clouds, Aerosols, Land Surface, SST, Visualization IASI, HIRS Atmospheric Profiles, Clouds, Visualization AMSU, MHS Atmospheric Profiles, Precipitation NOAA-18/19 AVHRR Clouds, Aerosols, Land Surface, SST, Visualization HIRS Atmospheric Profiles AMSU, MHS Atmospheric Profiles, Precipitation Terra MODIS Images, Visualization N/A N/A Aqua MODIS Images, Visualization AIRS Atmospheric Profiles, Clouds, Visualization AMSU Atmospheric Profiles, Precipitation, Visualization

CSPP Satellite/Sensor/Product Matrix

6

CSPP Registered User Locations

7

February, 2015

MIRS Examples

8

SNPP ATMS Surface Skin Temperature with Rain Rate contours and isosurface of Rain Mass Profile

Metop-B 2015/03/30 02:01 UTC SNPP 2015/03/18 11:03 UTC

Metop-B AMSU/MHS 840 hPa temperature and water vapor

CLAVR-x Examples

9

SNPP 2013/03/10 23:00 UTC

VIIRS False Color SST Ancillary Data Cloud Masked SST Cloud Top Temperature Cloud Water Path Rain Rate

NUCAPS Examples

10

SNPP 2015/04/03 19:07 UTC

Temperature Water Vapor Mixing Ratio

ACSPO Examples

11

2015/04/02

VIIRS SST 17:44 UTC MODIS SST 18:35 UTC AVHRR SST 18:31 UTC VIIRS SST 2015/03/18 07:40 UTC

CSPP Summary

• CSPP continues to support the polar orbiting

satellite DB community with a wide range of software and products supporting Suomi NPP, Metop, NOAA, and EOS satellites.

• CSPP GEO now supports geostationary satellites.
• We look forward to JPSS-1 in early 2017.

http://cimss.ssec.wisc.edu/cspp/

12

8

3.1e Q & A with Session Speakers