Team Exercises Michael R. Gunson Jet Propulsion Laboratory - - PowerPoint PPT Presentation

▶
team exercises
SMART_READER_LITE
LIVE PREVIEW

Team Exercises Michael R. Gunson Jet Propulsion Laboratory - - PowerPoint PPT Presentation

Jun 17, 2023 243 likes •557 views

Team Exercises Michael R. Gunson Jet Propulsion Laboratory Michael.Gunson@jpl.nasa.gov 818 354 2124 February 22, 2001 1 AIRS Team Exercise mrg Objectives for Team Exercise 1/22 - 1/26/01 A. Processing Verification Infrared RTA

slide-1
SLIDE 1

February 22, 2001 mrg 1

AIRS Team Exercise

Team Exercises

Michael R. Gunson Jet Propulsion Laboratory Michael.Gunson@jpl.nasa.gov 818 354 2124

slide-2
SLIDE 2

February 22, 2001 mrg 2

AIRS Team Exercise

Objectives for Team Exercise 1/22 - 1/26/01

  • A. Processing Verification

– Infrared RTA Implementation – Flow Control – Channel Properties File – Review and revise channel properties list following Science Team Meeting – Tuning/Angle Corrections – New predictor required for Tuning. – Channel Selection – Climatological Bound Testing – Use AVN forecast to provide first order evaluation with real data – Regression Coefficient Testing

slide-3
SLIDE 3

February 22, 2001 mrg 3

AIRS Team Exercise

Objectives for Team Exercise 1/22 - 1/26/01

  • B. Product Verfication

– Temperature product – Humidity product – Cloud product – Surface product – Q/A parameter verification – Cloud-cleared radiance verification – Visible cloud flag – Visible diagnostics

slide-4
SLIDE 4

February 22, 2001 mrg 4

AIRS Team Exercise

Objectives for Team Exercise 1/22 - 1/26/01

  • C. File Verification

– Level 2 Standard product – Level 2 Support product – Browse product – Cloud-cleared Radiance product

slide-5
SLIDE 5

February 22, 2001 mrg 5

AIRS Team Exercise

Sherlock Holmes Stuff

All stages successful for TRUTH CLEAR FOVs FINAL IR Retrieval_type = 0 Truth: clear_flag = 1

7

MW successful, FIRST unsuccessful, FINALsuccessful FINAL IR Retrieval_type = 10

6

MW successful, FIRST unsuccessful, FINAL falls back to MW & Strat IR MWSIR Retrieval_type = 30

5

MW and FIRST successful, FINAL falls back to MW & Strat IR MWSIR Retrieval_type = 20

4

All retrieval stages successful FINAL IR Retrieval_type = 0

3

slide-6
SLIDE 6

February 22, 2001 mrg 6

AIRS Team Exercise

Microwave-Only Temperature Retrieval

  • 2
  • 1

1 2 MW Temperature Bias (K) 1 10 100 1000 Layer Geometric Mean Pressure (mb) Case 3 Case 4 Case 5 Case 6 Case 7 3.5 3.0 2.5 2.0 1.5 1.0 0.5 0.0 MW Temperature Bias RMS (K) 1 10 100 1000 Layer Geometric Mean Pressure (mb) Case 3 Case 4 Case 5 Case 6 Case 7

slide-7
SLIDE 7

February 22, 2001 mrg 7

AIRS Team Exercise

FIRST TEMPERATURE RETRIEVAL

  • 2
  • 1

1 2 First Retrieval Temperature Bias (K) 1 10 100 1000 Layer Geometric Mean Pressure (mb) Case 3 Case 4 Case 5 Case 6 Case 7 3.5 3.0 2.5 2.0 1.5 1.0 0.5 0.0 First Retrieval Temperature Bias RMS (K) 1 10 100 1000 Layer Geometric Mean Pressure (mb) Case 3 Case 4 Case 5 Case 6 Case 7

slide-8
SLIDE 8

February 22, 2001 mrg 8

AIRS Team Exercise

FINAL TEMPERATURE RETRIEVAL

  • 2
  • 1

1 2 Final Retrieval Temperature Bias (K) 1 10 100 1000 Layer Geometric Mean Pressure (mb) Case 3 Case 4 Case 5 Case 6 Case 7 3.5 3.0 2.5 2.0 1.5 1.0 0.5 0.0 Final Retrieval Temperature Bias RMS (K) 1 10 100 1000 Layer Geometric Mean Pressure (mb) Case 3 Case 4 Case 5 Case 6 Case 7

slide-9
SLIDE 9

February 22, 2001 mrg 9

AIRS Team Exercise

CASE 3 TEMPERATURE RETRIEVAL

2 1

  • 1

Temperature bias (K) 1 10 100 1000 Layer Geometric Mean Pressure (mb) MW FIRST FINAL 3.0 2.5 2.0 1.5 1.0 0.5 0.0 Temperature RMS (K) 1 10 100 1000 Layer Geometric Mean Pressure (mb) MW FIRST FINAL

slide-10
SLIDE 10

February 22, 2001 mrg 10

AIRS Team Exercise

WATER VAPOR RETRIEVAL

  • 60x10
  • 3
  • 40
  • 20

20 H2O bias (g cm

  • 2

) 1 10 100 1000 Layer Geometric Mean Pressure (mb) MW FIRST FINAL 0.20 0.15 0.10 0.05 0.00 H2O rms (g cm

  • 2

) 1 10 100 1000 Layer Geometric Mean Pressure (mb) MW FIRST FINAL

slide-11
SLIDE 11

February 22, 2001 mrg 11

AIRS Team Exercise

OZONE RETRIEVAL

  • 60
  • 40
  • 20

O3 bias (DU) 1 10 100 1000 Layer Geometric Mean Pressure (mb) CLIMATOLOGY FIRST FINAL 80 60 40 20 O3 rms (DU) 1 10 100 1000 Layer Geometric Mean Pressure (mb) CLIMATOLOGY FIRST FINAL

slide-12
SLIDE 12

February 22, 2001 mrg 12

AIRS Team Exercise

Granule-401 FOV Distribution Retrieval Type and Truth Clear Flag

slide-13
SLIDE 13

February 22, 2001 mrg 13

AIRS Team Exercise

SURFACE TEMPERATURE RETRIEVAL

284 282 280 278 276 274 272 270 Temperature (K) 7 6 5 4 3 Case Number Mean Surface Temperature Retrieval (K)

slide-14
SLIDE 14

February 22, 2001 mrg 14

AIRS Team Exercise

MW Tsurf RETRIEVAL

  • 3
  • 2
  • 1

1 Bias (K) 7 6 5 4 3 Case Number Surface Temperature Retrieval - MW Bias (K) 7 6 5 4 3 2 1 RMS (K) 7 6 5 4 3 Case Number Surface Temperature Retrieval - MW rms (K)

slide-15
SLIDE 15

February 22, 2001 mrg 15

AIRS Team Exercise

FIRST Tsurf RETRIEVAL

  • 3
  • 2
  • 1

1 Bias (K) 7 6 5 4 3 Case Number Surface Temperature Retrieval - first retrieval Bias (K) 7 6 5 4 3 2 1 RMS (K) 7 6 5 4 3 Case Number Surface Temperature Retrieval - first retrieval rms (K)

slide-16
SLIDE 16

February 22, 2001 mrg 16

AIRS Team Exercise

FINAL Tsurf RETRIEVAL

  • 3
  • 2
  • 1

1 Bias (K) 7 6 5 4 3 Case Number Surface Temperature Retrieval - final retrieval Bias (K) 7 6 5 4 3 2 1 RMS (K) 7 6 5 4 3 Case Number Surface Temperature Retrieval - final retrieval rms (K)

slide-17
SLIDE 17

February 22, 2001 mrg 17

AIRS Team Exercise

Comparison of Clear FOV Detection

slide-18
SLIDE 18

February 22, 2001 mrg 18

AIRS Team Exercise

Comparison of Clear FOV Detection

slide-19
SLIDE 19

February 22, 2001 mrg 19

AIRS Team Exercise

Distribution of Combined Cloud Fraction

slide-20
SLIDE 20

February 22, 2001 mrg 20

AIRS Team Exercise

INITIAL Clear FOV Detection Cloud Fraction

slide-21
SLIDE 21

February 22, 2001 mrg 21

AIRS Team Exercise

INITIAL False and True Clear FOV Detection Cloud Fractions

slide-22
SLIDE 22

February 22, 2001 mrg 22

AIRS Team Exercise

FINAL Clear FOV Detection Cloud Fraction

slide-23
SLIDE 23

February 22, 2001 mrg 23

AIRS Team Exercise

FINAL False and True Clear FOV Detection Cloud Fractions

slide-24
SLIDE 24

February 22, 2001 mrg 24

AIRS Team Exercise

VIS Clear FOV Detection Cloud Fraction

slide-25
SLIDE 25

February 22, 2001 mrg 25

AIRS Team Exercise

VIS False and True Clear FOV Detection Cloud Fractions

slide-26
SLIDE 26

February 22, 2001 mrg 26

AIRS Team Exercise

General Conclusions

  • Core algorithm in place and working at V2.1.5 !
  • Characteristics of the retrievals are not significantly changed from previous

simulations and Team Exercises – Cold bias still present

  • GSFC test code and L2_PGE have the same pathology of biases and

rms errors

  • 8 track set behaves better than the current simulations

– Sampling difference – Rejection criteria refinement

  • Only major new capabilities needed in L2_PGE is to put in place simple flow

control - V2.1.5 need not change for some time

  • Are the current simulations and 8-track set are not suitable for closure testing?

– To many uncertainties in their provenance

slide-27
SLIDE 27

February 22, 2001 mrg 27

AIRS Team Exercise

More General Conclusions

  • Changing the characteristics of the instrument performance (e.g., Ne∆T)

highlighted the sensitivity of the results to threshold settings by changing yields and ultimately the gross statistics of the retrievals BUT not the quality

  • Clear sky detection

– Yield and reliability seem to be mutually exclusive – Simple clouds but are they too complex? – Do we need a new pre-L2_PGE processor to always be run

  • Run clear sky detection
  • Cloud-clearing on some near-clear observations
slide-28
SLIDE 28

February 22, 2001 mrg 28

AIRS Team Exercise

On the use of simulations

  • Global simulations with the AVN forecast are useful in training and debugging

the retrieval system

  • Global simulations with the AVN forecast create a smooth world with limited

variability – Variability has to be forced upon the simulation – The subset granules 401, 411, and 421 are very representative of all the granules - will this be true for real data?

slide-29
SLIDE 29

February 22, 2001 mrg 29

AIRS Team Exercise

Future Team Exercises

  • TDS data access and storage

– Given how few files we are focusing on, this may not be critical to the Science Team (yet) – Delivery in May will contain critical capablities for routine ingest and for data production

  • Limited truth

– Matchups to RaObs, ARM/CART site data, sea surface data

  • L1b -> L1a simulation
  • Off-nominal instrument performance issues
  • Cloud properties and simulation variability

– Transmissive clouds particularly cirrus – Cloud variability

  • Aerosols
slide-30
SLIDE 30

February 22, 2001 mrg 30

AIRS Team Exercise

Schedule

  • Next Two Exercises

– May 28 - June 1, 2001 will focus on sparse truth validation based on a simulation with one AVN forecast and a later AVN forecast used for “truth” statistics generation (Gstats files) with radiance biases – If launch is delayed THEN later in October will upgrade the simulation system to include grey clouds, variability etc.