JEDI Applications Jedi Academy IV, Monterey CA 26 th February 2020 - - PowerPoint PPT Presentation

jedi applications
SMART_READER_LITE
LIVE PREVIEW

JEDI Applications Jedi Academy IV, Monterey CA 26 th February 2020 - - PowerPoint PPT Presentation

JEDI Applications Jedi Academy IV, Monterey CA 26 th February 2020 JEDI Applications Numerical weather prediction (global and regional) Marine data assimilation (ocean and sea-ice) * Constituent data assimilation * Land and snow


slide-1
SLIDE 1

JEDI Applications

Jedi Academy IV, Monterey CA 26th February 2020

slide-2
SLIDE 2

JEDI Applications

  • Numerical weather prediction (global and regional)
  • Marine data assimilation (ocean and sea-ice) *
  • Constituent data assimilation *
  • Land and snow data assimilation *

* JCSDA project directives

slide-3
SLIDE 3

NWP Projects

  • FV3 (GEOS, GFS, FV3SAR) – cubed sphere
  • MPAS – icosahedral
  • UM – lat/lon
  • LFRic – cubed sphere
  • Neptune – cubed sphere
  • WRF – regional

Future

  • FV3SAR
  • Hurricane
slide-4
SLIDE 4

JEDI

FV3-JEDI

OOPS UFO

SABER

IODA

FV3- JEDI FV3-JEDI overlaps the generic interfaces, methods, applications and configuration of the JEDI system with models that use the FV3 dynamical core. It aims to implement various data assimilation applications directly on the cubed sphere grid. Specifically it implements geometry, states and increments, parallel IO, variable changes, interpolation to observation locations, the forecast model tangent linear and adjoint and the ability to advance the nonlinear model. It also provides specific unit testing, example configuration scripts for running applications and infrastructure for building JEDI with the forecast models. GEOS

RTTOV

CRTM

GFS

GEOS Aero/Chem GFS GSD Chem

FV3-JEDI- TOOLS FV3- JEDI-LM

FEMPS Core repositories FV3-JEDI repositories Models

BUMP

NCDIAG

slide-5
SLIDE 5

FV3 Generic

FV3-JEDI Interfaces

Generic implementations Specific implementations OOPS abstract applications and interfaces

Forecast 4DVar 4DEnVar State Increment Linear Model Observation Operator EnKF SOCA QG Model EnDA Observation Space H(x) UFO IODA Background Error SABER … … Application layer MAGIC FV3-JEDI GEOS, GFS, FV3SAR, GEOS-CHEM, GFS GSDChem, GFDL

slide-6
SLIDE 6

FV3 Model interfacing status

Milestone GFS GEOS FV3 Solo 3DEnVar ✓ 4DEnsVar ✓ ✓ NA 4DVar ✓ ✓ ✓ 4DVar with linear physics ✘ ✓ NA Ensemble H(X) ✓ 4D H(x) in-core ✓ ✓ ✓ Multiple outer loops (IO) ✓ Multiple outer loops in-core ✓ ✘ ✓ Multiple resolutions ✓ EDA ✓ Multiple resolution outer loops ✘ ✘ ✓ (simple B)

slide-7
SLIDE 7

In core data assimilation – H(x)

  • GFS C768 (~12km) forecast model called from FV3-

JEDI for 6 hour window beginning 2019-11-18 18Z.

  • GFS v16 model.
  • Background from operations.
  • H(x) calculated in core as a post processor of the

model step, no storing of 4D State anywhere.

  • Interpolation is from C768 cubed sphere grid to
  • bservation locations.

GEOS-R ABI Channel 9 AMSU-A NOAA 19 Channel 9 Satellite winds

slide-8
SLIDE 8
  • C768 background (from ops) and forecast.
  • Native grid and resolution observer.
  • Pure ensemble B matrix from C384 (25km) 40

member ensemble (from ops).

  • C192 (50km) increment.
  • All AMSU-A NOAA 19 (~20,000 obs).
  • 3 hour window
  • 2 outer loops in-core.
  • BUMP for localization, interpolation etc.

In core data assimilation – 4DVar

slide-9
SLIDE 9

Static B and cubed-sphere Poisson Solver

Initial D-Grid winds (correlation length scales ~200km) Final D-Grid winds Stream function (and velocity potential) Correlation length scales ~4000km Work done with John Thuburn (University of Exeter, UK) and Benjamin Menetrier (JCSDA)

B = KhKvDCD>K>

v K> h

<latexit sha1_base64="WOZreMKxQ0vYxwvTN+5fP/R47Z4=">ACDXicbZBNS8MwGMfT+TbnW9Wjl+AUPI1WBL0IY9tB2GWCe4GtljRL17A0LUk6GNfwItfxYsHRbx69+a3Mesq6OYfAr/8n+chef5ezKhUlvVl5FZW19Y38puFre2d3T1z/6Alo0Rg0sQRi0THQ5IwyklTUcVIJxYEhR4jbW9YndXbIyIkjfidGsfECdGAU59ipLTlmicVeA3rblB3R7Vq7b6nolhfRz8QpOCaRatkpYLYGdQBJkarvnZ60c4CQlXmCEpu7YVK2eChKYkWmhl0gSIzxEA9LVyFIpDNJt5nCU+30oR8JfbiCqft7YoJCKcehpztDpAK5WJuZ/9W6ifKvnAnlcaIx/OH/IRBFcFZNLBPBcGKjTUgLKj+K8QBEgrHWBh2AvrwMrfOSbZXs24tiuZLFkQdH4BicARtcgjK4AQ3QBg8gCfwAl6NR+PZeDPe5605I5s5BH9kfHwDNEGaA=</latexit><latexit sha1_base64="WOZreMKxQ0vYxwvTN+5fP/R47Z4=">ACDXicbZBNS8MwGMfT+TbnW9Wjl+AUPI1WBL0IY9tB2GWCe4GtljRL17A0LUk6GNfwItfxYsHRbx69+a3Mesq6OYfAr/8n+chef5ezKhUlvVl5FZW19Y38puFre2d3T1z/6Alo0Rg0sQRi0THQ5IwyklTUcVIJxYEhR4jbW9YndXbIyIkjfidGsfECdGAU59ipLTlmicVeA3rblB3R7Vq7b6nolhfRz8QpOCaRatkpYLYGdQBJkarvnZ60c4CQlXmCEpu7YVK2eChKYkWmhl0gSIzxEA9LVyFIpDNJt5nCU+30oR8JfbiCqft7YoJCKcehpztDpAK5WJuZ/9W6ifKvnAnlcaIx/OH/IRBFcFZNLBPBcGKjTUgLKj+K8QBEgrHWBh2AvrwMrfOSbZXs24tiuZLFkQdH4BicARtcgjK4AQ3QBg8gCfwAl6NR+PZeDPe5605I5s5BH9kfHwDNEGaA=</latexit><latexit sha1_base64="WOZreMKxQ0vYxwvTN+5fP/R47Z4=">ACDXicbZBNS8MwGMfT+TbnW9Wjl+AUPI1WBL0IY9tB2GWCe4GtljRL17A0LUk6GNfwItfxYsHRbx69+a3Mesq6OYfAr/8n+chef5ezKhUlvVl5FZW19Y38puFre2d3T1z/6Alo0Rg0sQRi0THQ5IwyklTUcVIJxYEhR4jbW9YndXbIyIkjfidGsfECdGAU59ipLTlmicVeA3rblB3R7Vq7b6nolhfRz8QpOCaRatkpYLYGdQBJkarvnZ60c4CQlXmCEpu7YVK2eChKYkWmhl0gSIzxEA9LVyFIpDNJt5nCU+30oR8JfbiCqft7YoJCKcehpztDpAK5WJuZ/9W6ifKvnAnlcaIx/OH/IRBFcFZNLBPBcGKjTUgLKj+K8QBEgrHWBh2AvrwMrfOSbZXs24tiuZLFkQdH4BicARtcgjK4AQ3QBg8gCfwAl6NR+PZeDPe5605I5s5BH9kfHwDNEGaA=</latexit><latexit sha1_base64="WOZreMKxQ0vYxwvTN+5fP/R47Z4=">ACDXicbZBNS8MwGMfT+TbnW9Wjl+AUPI1WBL0IY9tB2GWCe4GtljRL17A0LUk6GNfwItfxYsHRbx69+a3Mesq6OYfAr/8n+chef5ezKhUlvVl5FZW19Y38puFre2d3T1z/6Alo0Rg0sQRi0THQ5IwyklTUcVIJxYEhR4jbW9YndXbIyIkjfidGsfECdGAU59ipLTlmicVeA3rblB3R7Vq7b6nolhfRz8QpOCaRatkpYLYGdQBJkarvnZ60c4CQlXmCEpu7YVK2eChKYkWmhl0gSIzxEA9LVyFIpDNJt5nCU+30oR8JfbiCqft7YoJCKcehpztDpAK5WJuZ/9W6ifKvnAnlcaIx/OH/IRBFcFZNLBPBcGKjTUgLKj+K8QBEgrHWBh2AvrwMrfOSbZXs24tiuZLFkQdH4BicARtcgjK4AQ3QBg8gCfwAl6NR+PZeDPe5605I5s5BH9kfHwDNEGaA=</latexit>

D : C : Kh : Kv :

<latexit sha1_base64="Jduau6HMIcK+15xce/ihy96sTrE=">ACAXicbVBNS8MwGE7n16xfVS+Cl+AQPI1WBGWn4TwIXia4D1hLSbN0C0vTkqSDUebFv+LFgyJe/Rfe/DdmXQ+6+UDyPjzP+5K8T5AwKpVtfxuldW19Y3yprm1vbO7Z+0ftGWcCkxaOGax6AZIEkY5aSmqGOkmgqAoYKQTjBozvzMmQtKYP6hJQrwIDTgNKUZKS751dFODrms28vOHxZ1XPOtil21c8Bl4hSkAgo0fevL7c4jQhXmCEpe46dKC9DQlHMyNR0U0kShEdoQHqachQR6WX5BlN4qpU+DGOhD1cwV39PZCiSchIFujNCaigXvZn4n9dLVXjlZQnqSIczx8KUwZVDGdxwD4VBCs20QRhQfVfIR4igbDSoZk6BGdx5WXSPq86dtW5v6jUr4s4yuAYnIAz4IBLUAe3oAlaAINH8AxewZvxZLwY78bHvLVkFDOH4A+Mzx/EAZPi</latexit><latexit sha1_base64="Jduau6HMIcK+15xce/ihy96sTrE=">ACAXicbVBNS8MwGE7n16xfVS+Cl+AQPI1WBGWn4TwIXia4D1hLSbN0C0vTkqSDUebFv+LFgyJe/Rfe/DdmXQ+6+UDyPjzP+5K8T5AwKpVtfxuldW19Y3yprm1vbO7Z+0ftGWcCkxaOGax6AZIEkY5aSmqGOkmgqAoYKQTjBozvzMmQtKYP6hJQrwIDTgNKUZKS751dFODrms28vOHxZ1XPOtil21c8Bl4hSkAgo0fevL7c4jQhXmCEpe46dKC9DQlHMyNR0U0kShEdoQHqachQR6WX5BlN4qpU+DGOhD1cwV39PZCiSchIFujNCaigXvZn4n9dLVXjlZQnqSIczx8KUwZVDGdxwD4VBCs20QRhQfVfIR4igbDSoZk6BGdx5WXSPq86dtW5v6jUr4s4yuAYnIAz4IBLUAe3oAlaAINH8AxewZvxZLwY78bHvLVkFDOH4A+Mzx/EAZPi</latexit><latexit sha1_base64="Jduau6HMIcK+15xce/ihy96sTrE=">ACAXicbVBNS8MwGE7n16xfVS+Cl+AQPI1WBGWn4TwIXia4D1hLSbN0C0vTkqSDUebFv+LFgyJe/Rfe/DdmXQ+6+UDyPjzP+5K8T5AwKpVtfxuldW19Y3yprm1vbO7Z+0ftGWcCkxaOGax6AZIEkY5aSmqGOkmgqAoYKQTjBozvzMmQtKYP6hJQrwIDTgNKUZKS751dFODrms28vOHxZ1XPOtil21c8Bl4hSkAgo0fevL7c4jQhXmCEpe46dKC9DQlHMyNR0U0kShEdoQHqachQR6WX5BlN4qpU+DGOhD1cwV39PZCiSchIFujNCaigXvZn4n9dLVXjlZQnqSIczx8KUwZVDGdxwD4VBCs20QRhQfVfIR4igbDSoZk6BGdx5WXSPq86dtW5v6jUr4s4yuAYnIAz4IBLUAe3oAlaAINH8AxewZvxZLwY78bHvLVkFDOH4A+Mzx/EAZPi</latexit><latexit sha1_base64="Jduau6HMIcK+15xce/ihy96sTrE=">ACAXicbVBNS8MwGE7n16xfVS+Cl+AQPI1WBGWn4TwIXia4D1hLSbN0C0vTkqSDUebFv+LFgyJe/Rfe/DdmXQ+6+UDyPjzP+5K8T5AwKpVtfxuldW19Y3yprm1vbO7Z+0ftGWcCkxaOGax6AZIEkY5aSmqGOkmgqAoYKQTjBozvzMmQtKYP6hJQrwIDTgNKUZKS751dFODrms28vOHxZ1XPOtil21c8Bl4hSkAgo0fevL7c4jQhXmCEpe46dKC9DQlHMyNR0U0kShEdoQHqachQR6WX5BlN4qpU+DGOhD1cwV39PZCiSchIFujNCaigXvZn4n9dLVXjlZQnqSIczx8KUwZVDGdxwD4VBCs20QRhQfVfIR4igbDSoZk6BGdx5WXSPq86dtW5v6jUr4s4yuAYnIAz4IBLUAe3oAlaAINH8AxewZvxZLwY78bHvLVkFDOH4A+Mzx/EAZPi</latexit>

Standard deviation Correlation (BUMP) Horizontal Balance (Poisson solver) Vertical balance (BUMP)

Poisson

slide-10
SLIDE 10

MPAS-JEDI

For MPAS the focus is on Cloud Analysis and Forecasting (CAF)

  • Important, unsolved problem for data assimilation

§ Multivariate: Can’t analyze cloud in isolation from other fields § Multiscale: Fast/small scales with sensitive dependence on slower, larger scales § Reliance on remotely sensed observations with strongly nonlinear forward operators § Substantial errors in both forecast models and observation operators

  • Not a priority application for existing operational global DA systems
  • CAF is a top priority for the USAF.
slide-11
SLIDE 11

MPAS-JEDI PANDA-C

2018 2020

Today

May Aug Nov Feb May Aug Nov Feb May PANDA-C

May 1

MPAS-JEDI, prototype I

Aug 1

MPAS-JEDI, prototype II

Nov 1

demo EnVar cycling

Jan 15

MPAS-JEDI: extended cycling

Aug 1

cycling w/ AMSU-A

Dec 1

JEDI automated testing

Oct 1

static B

Feb 15

higher res, many PEs

Feb 15

demo all-sky MW, IR

May 1

ExaDA for JEDI

Jul 1

LFRic-JEDI, prototype I

Mar 1

NGMS: continue w/ JEDI

Apr 1

NGMS: JEDI for DA, OPS

Dec 17

PANDA-C = Prediction and Data Assimilation for Cloud

  • USAF funded
  • Joint NCAR-JCSDA project
  • Coordination with Met Office
slide-12
SLIDE 12

MPAS Cycling Experiments

  • 6-hourly cycling for 15 April-15 May 2018, 120-km MPAS mesh
  • Observations from NCEP/EMC
  • Processing, “pre-QC,” and bias correction of radiances from GSI
  • EnVar (pure ensemble)
  • First background is 6-h forecast from GFS analysis (18Z 14 April 2018)
  • 20 ensemble members, 6-h forecasts from GEFS ICs
  • Localization: 2000 km, 5 vertical levels
  • Running on 36 processors (NCAR cheyenne)
slide-13
SLIDE 13

Effects of AMSU-A Assimilation

  • Forecast fit (m/s) to GFS analysis, 300-hPa meridional wind, NH

extratropics

NH extratropics SH extratropics

slide-14
SLIDE 14

Future plans

  • FV3-JEDI
  • Moving to running cycled near real time and retrospectively for GEOS with 4D data

assimilation.

  • Complete static B matrix model.
  • Refactoring towards more generic State, Increment and GetValues.
  • Fully in-core with GEOS and GFS.
  • MPAS
  • Multivariate static background covariance
  • Ensemble generation
  • Experiments at higher resolution
  • Configure MPAS with higher model top
  • Met Office
  • Building out an interface based on Atlas for the Unified Model (UM)
slide-15
SLIDE 15

Marine Projects

  • MOM-6 ocean – tripolar grid
  • SIS2 sea-ice – tripolar grid
  • CICE6 sea-ice – tripolar grid

These projects come under the SOCA project within the JCSDA, Led by Guillaume Vernieres

slide-16
SLIDE 16

What is SOCA?

Sea-ice Ocean Coupled Assimilation (SOCA)

  • Towards the integration of marine JEDI in NASA/GEOS
  • Multidomain observing operator (direct radiance assimilation)
  • Continuous Integration and Real time ocean monitoring testbed at the

JCSDA

  • Implementation of a JEDI based marine DA system at EMC/NOAA
  • MOM6 interface to JEDI

16

slide-17
SLIDE 17

D C

SABER/BUMP. Correlation on the ¼ degree MOM6/CICE5 tripolar grid

Background dependent parametric “B-matrix”

slide-18
SLIDE 18
  • October 1, 2011 to November 2, 2011
  • Forecast model: MOM6-CICE5-DATAATM at ¼ degree

resolution

  • 24hr window ~1M obs per cycle
  • 3DVAR with background dependent parametric B

Sensor Satellite In Situ SST-IR AVHRR NOAA-19 METOP-A SST-MW WindSat WindSat ADT Jason-1 Jason-2 CryoSat-2 Ice con. SSMI SSMIS F-16 F-17 Temp Salt Argo, CTD, XBT, TAO, PIRATA, RAMA, ...

Cycling experiment

slide-19
SLIDE 19

CRTM UFO for GMI Atmospheric State (FV3) Ocean State (MOM6)

Ocean Surface sensitive channel Atmosphere sensitive channel

Prototype multi-domain UFO (ocean/atmosphere):

Example of GMI for April 15, 2018 Locations

slide-20
SLIDE 20

Future plans

Towards a 30 year ocean sea ice reanalysis: GODAS project (EMC). Due July 2020.

  • LETKF in workflow
  • Hyb-EnVAR + LETKF perturbations implemented in the EMC workflow
  • Observations: Freeboard, SST retrievals prior to 2003
  • Muli-Domain UFO: Direct assimilation of radiances to constrain SST & SSS
slide-21
SLIDE 21

Constituents

  • NASA GEOS-CHEM – cubed-sphere
  • NOAA GFS GSDChem – cubed-sphere

Constituents are a project within the JCSDA, led by Sarah Lu.

slide-22
SLIDE 22

FV3-JEDI for aerosols

Both of NOAA and NASA’s efforts leverage the fv3-jedi interface to build constituent data assimilation. The classes behave identically to the way they do in the global NWP applications but with different fields allocated. The code is built to be generic (to FV3 grid applications)

slide-23
SLIDE 23

GEOS-CHEM

GEOS-CHEM GOCART C90 (~100km) 3DEnVar 20 members 550nm Neural Network Retrieval of AOD ~70,000 observations Work done with Virginie Buchard (NASA GMAO) Total aerosol mass increment

slide-24
SLIDE 24

GFS GSDChem

GFS GSD Chem C48 (~200km) 3DEnVar 10 members CRTM simulated aerosol optical depth VIIRS and SUOMI-NPP Work done with Mariusz Pagowski (NOAA ESRL) Dust bin 1 mass increment

slide-25
SLIDE 25

Future plans

GSDChem

  • Development of 4DEnVar with FV3-GOCART model
  • Cross channel error correlation
  • Thinning and variational bias correction
  • Development of 3DVar system for FV3-CMAQ.
  • Improved static background error representation.

GEOS-CHEM

  • Develop a 3DEnVar system for GEOS aerosols
  • Aerosol concentrations or profiles of extinction as control variable
  • Coding UFO (without using CRTM) for AOD at one or multiple wavelengths
  • using aerosols concentrations
  • using profiles of extinction
  • using ensemble members produced by the GEOS meteorological system
  • perturbation of emissions to increase ensemble spread
slide-26
SLIDE 26

Snow and Land DA

  • Noah-MP

Land/Snow is a project within the JCSDA, led by Andy Fox.

slide-27
SLIDE 27

Land and snow

  • 1. Snow DA into the National Water Model

§ NOAA’s operational implementation of WRF-Hydro for CONUS § Land surface model: Noah-MP § Observations: In-situ snow depth and Snow Water Equivalent (SWE)

  • 2. Snow and soil moisture DA into the Unified Forecast System

§ Aim to support coupled and standalone offline capabilities § Land surface model: TBD § Observations: Interactive Multisensor Snow and Ice Mapping System (IMS) and in-situ SWE

slide-28
SLIDE 28

Future plans

  • Soil moisture assimilation
  • Advanced observation operators
  • Additional observations (e.g. LAI, LST, albedo, SIF, roughness, biomass)
  • Additional land models (e.g. Community Terrestrial System Model)
  • Advancing algorithms