QA4ECV: A traceable quality assurance system for multi-decadal ECVs - - PowerPoint PPT Presentation

▶
qa4ecv a traceable quality assurance system for multi
SMART_READER_LITE
LIVE PREVIEW

QA4ECV: A traceable quality assurance system for multi-decadal ECVs - - PowerPoint PPT Presentation

Apr 05, 2023 376 likes •682 views

QA4ECV: A traceable quality assurance system for multi-decadal ECVs . Boersma 1,2 , J.P . Muller 3 , C. Brockman 4 , K.F A. De Rudder 5 , N. Fox 6 , N. Gobron 7 , J.-C. Lambert 5 , A. Lw 8 , J. Nightingale 6 , A. Richter 9 , R. van der A 1 , M.

slide-1
SLIDE 1

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

QA4ECV: A traceable quality assurance system for multi-decadal ECVs

K.F . Boersma1,2, J.P . Muller3, C. Brockman4,

  • A. De Rudder5, N. Fox6, N. Gobron7, J.-C. Lambert 5,
  • A. Löw8, J. Nightingale6, A. Richter9, R. van der A1,
  • M. Van Roozendael5, and J.-L. Widlowski7

1 Royal Netherlands Meteorological Institute (KNMI), De Bilt, The Netherlands 2 Wageningen University, Wageningen, The Netherlands 3 University College London (UCL), United Kingdom 4 Brockman Consult GmbH (BC), Geesthacht, Germany 5 Belgian Institute for Space Aeronomy (IASB-BIRA), Brussels, Belgium 6 National Physical Laboratory (NPL), Teddington, United Kingdom 7 EC Joint Research Centre (JRC), Ispra, Italy 8 Max Planck Institute for Meteorology (MPI-M), Hamburg, Germany 9 Institute of Environmental Physics, University of Bremen (IUP-UB), Germany

slide-2
SLIDE 2

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

Funding progr.: EU FP7 Duration: 48 months : Feb. 2014 – Jan. 2018 Coordinators: KNMI (PI, ATMOSPHERE) & UCL (LAND)

QA4ECV

QA4ECV partners 17 partners from 6 EU countries

slide-3
SLIDE 3

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

QA4ECV mission statement

  • Show how assessment of satellite data quality facilitates users’

appreciation of fitness-for-purpose of Essential Climate Variable (ECV) records.

  • Provide quality assured long-term Climate Data Records (CDR)
  • f ECV or ECV precursors relevant for policy and climate

change assessment, namely the following 6 parameters. 3 land ECVs

  • Spectral albedo
  • Leaf Area Index (LAI)
  • Fraction of Absorbed

Photosynthetically Active Radiation (fAPAR) 3 atmospheric ECVs Tropospheric columns of

  • Nitrogen monoxide (NO2)
  • Formaldehyde (HCHO)
  • Carbon monoxide (CO)

Precursors for tropospheric O3 & secondary aerosols (radiatively active + pollutants)

slide-4
SLIDE 4

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

QA4ECV objectives

  • 1. Establish a rigorous QA methodology for satellite ECV data
  • QA framework applicable virtually to all ECVs
  • S/W tools for ‘do-it-yourself’ QA
  • Traceability to SI as recommended in QA4EO
  • 2. Provide multi-decadal satellite-derived global ECV records
  • 3 terrestrial and 3 atmospheric ECVs with global coverage; 20-30 yr
  • Not yet covered by ESA (CCI) nor EUMETSAT (SAF) activities;
  • 3. Apply the generic QA system to ECV retrieval chain & products

QA4ECV approach applied to independent reference data, ECV retrieval process, and final data products

  • 4. Provide information on quality and fitness-for-purpose of

datasets

  • QA Office to audit ECV records against GCOS, WMO criteria
  • Assess impact of ECV records on typical applications
slide-5
SLIDE 5

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

WP2

Generic QA system

WP3

QA of ref. data

WP4

ECV retrieval

WP5

QA of ECV records

WP6

Fitness-for-purpose of ECV records

WP1

User enga- gement

WP8 – FP7 project interaction WP10 - Project management

QA4ECV organisation wrt objectives

Users Users

WP9 - Project coordination WP7

Disse- mina- tion

  • 1. Rigorous QA

methodology for satellite ECV products

  • 3. Application
  • f QA system to

ECV retrieval & products

  • 4. Provision of

information on quality and fitness-for-purpose

  • f datasets
  • 2. Multi-decadal

satellite-derived global ECV records

Atmosphere Land

slide-6
SLIDE 6

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

QA4ECV methodology

  • 1. Development of Quality Assurance System (WP2)

Potential framework for QA4ECV service provision.

  • Users obtain a one-stop shop for all QA info
  • The QA4ECV Office provides independent verification of ECV QA
  • Traceability to SI & community reference standards through metrology experts
  • Support the retrieval groups with QA tools, S/W and uncertainty analysis practices
slide-7
SLIDE 7

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

Data and service validation protocols

(IASB-BIRA)

slide-8
SLIDE 8

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

QA4ECV methodology

  • 2. Generation of multi-decadal ECV records (WP4)

Land

  • Spectral albedo, LAI & fAPAR
  • Surface and vegetation state
  • Indicators for land use change,

biosphere activity

  • Measured since 1980s
  • Evaluate carbon cycle & water

cycle in climate models

Atmosphere

  • NO2, HCHO & CO
  • Air pollutants
  • Drive ozone and aerosol

formation

  • Measured since 1995 / 2000
  • Evaluate atm. chemistry modules

in climate models

  • Provide info on effectiveness of

policies, trends in fires etc. ECV datasets do exist to some extent, but they are not necessarily mutually consistent and their quality assurance rarely QA4EO compliant.

slide-9
SLIDE 9

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

QA4ECV methodology

  • 3. Application of QA system to ECV retrieval and products (WP5)

ECV n° n QA office ECV n° n Science Group QA4ECV coordinated multi-ECV delivery

QA of independent reference data (WP3) QA of the ECV retrieval algorithm (steps) QA of complete ECV record & test against GCOS criteria

slide-10
SLIDE 10

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

3’. Application of QA system to reference data (WP3)

QA4ECV methodology

MAX-DOAS Network NO2 and HCHO CO NDACC and TCCON FTIR Networks

Atmospheric reference data

slide-11
SLIDE 11

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

QA4ECV methodology

  • 4. Assessment of fitness-for-purpose of ECV records (WP6)

Confrontation to user requirements (WP1) QA4ECV user requirement collection May 2014 Ongoing exercise (feedback loops)

slide-12
SLIDE 12

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

Atmosphere / Oceans / Terrestrial

Update scheduled in 2015

User requirement documents

GCOS

slide-13
SLIDE 13

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

User requirement documents

IGACO Report, September 2004 IGOS

slide-14
SLIDE 14

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

HARMOZ L2

Total uncertainty Stability

Ex- ante rnd error Consistency representation

UTLS LS MA UTLS LS MA

TROP MID POL TROP MID POL TROP MID POL

NETWORK NETWORK NETWORK

BIAS COMP.

SPREAD

DRIFT

User req. – 8–15% – 1–3% / decade – – GOMOS

< 30 hPa < 50 hPa high S high S

< 30 hPa low

< 50 hPa

MIPAS

< 50 hPa < 80 hPa high S

low

Trop. UTLS < 50 hPa

SCIA

< 50 hPa < 70 hPa high S

4–10 hPa

high

Trop. UTLS < 50 hPa

OSIRIS

< 50 hPa < 70 hPa high S

> 4 hPa low

Trop. UTLS < 50 hPa

SMR

no data

single profile noise > 20%

no data > 8 hPa

< 50 hPa

ACE-FTS

– – < 80 hPa high S –

– low

< 50 hPa

Compliant with user requirements? YES UTLS TP ± 3km TROPICS 0–30° PARTIAL LS TP – 25km MID 30–60° NO MA > 25km POLAR 60–90°

Courtesy D. Hubert, ESA Ozone_cci Final Review

Compliance of limb O3 profile data with user requirements

ESA Ozone CCI Phase I (2010-2013)

slide-15
SLIDE 15

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

Web portal functionalities

  • Provide detailed information on QA procedures to land &

atmospheric ECV record producers and users

  • Step-by-step checklist for ‘good practice’ QA
  • Access to QA tools to support community in establishing and

tracing quality

  • Atmosphere QA/validation server and Land QA/validation tools

providing end-to-end quality information of in-house satellite- derived ECV precursor records wrt ground-based reference

  • bservations
  • Common gate to the 6 ECV data records
  • Forum devoted to ECV QA questions (and answers)
  • Dissemination of public and restricted project documents
  • Links to related standards and projects
slide-16
SLIDE 16

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

QA4ECV website http://www.qa4ecv.eu/

slide-17
SLIDE 17

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

Heritage validation websites

http://validation.aeronomie.be/ ESA’s GMES Service Element: Atmosphere PROMOTE 2006-2009

slide-18
SLIDE 18

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

http://pasodoble.aeronomie.be/

Heritage validation websites

EC FP7 PASODOBLE (GMES Air Quality Downstream Service) QA/Val archive 2010-2013

slide-19
SLIDE 19

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

Gas: NO2 Platform: METOP_A Instrument: DOAS corrected for diurnal cycle Validation reference: ground-based Station: Harestua

Heritage validation websites: O3M-SAF

EUMETSAT CDOP-2 2012-2017

slide-20
SLIDE 20

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

Importance

  • f

traceability Comparison between GOME-2A NO2 (including photochemical correction) and BIRA-IASB DOAS at NDACC station of Harestua.

Heritage validation websites: O3M-SAF results viewer

slide-21
SLIDE 21

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

Heritage validation server: NORS

EC FP7 NORS validation server for Copernicus Atmosphere Monitoring Service (CAMS) http://nors-server.aeronomie.be/

slide-22
SLIDE 22

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

Heritage website: GlobAlbedo

Project funded by the Data User Element of ESA’s Earth Observation Envelope Programme

http://globalbedo.org

slide-23
SLIDE 23

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

Rewrite and stock Queries (first come, first serve) www.globalabedo.org

Reproject Region of interest from lat,lon to SIN Extract, Filter, Calculate Statistics

  • Region of interest
  • Time period
  • Product/Bands
  • Landcover classes
  • Email address

Albedo fAPAR LAI

csv files & Plots (timeseries)

MSSL-UCL CEMS-JASMIN

Query

On-line statistics (Albedo, LAI/fAPAR, filtered by landcover) by Region of Interest: point, line or polygon.

Being integrated into Microsoft-Azure

Stat by band

NERC Big Data grant for 726Tb disk & 7k linux cores

Example use of CEMS-JASMIN for near-line subsetting

slide-24
SLIDE 24

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

Traceable ECV production chains

LAI

MODIS LAI per pixel

slide-25
SLIDE 25

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

Traceable ECV production chain

Example: top level for HCHO vertical column density

slide-26
SLIDE 26

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

Traceability of QA / validation process

Keppens et al., AMTD 2014

Example: validation of nadir ozone profile retrievals (1)

slide-27
SLIDE 27

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

Keppens et al., AMTD 2014

Validation of nadir ozone profile retrievals (2)

slide-28
SLIDE 28

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

CDR maturity matrix & adequacy check

With update and evolution from CORE -CLIMAX

slide-29
SLIDE 29

CLIPC Workshop on the design of scientific portals – De Bilt, 18 November 2014

Conclusions

  • Combined top-down & bottom-up approaches re. QA
  • Synergy between experts from the land & atmospheric fields
  • QA4ECV will define a generic QA method virtually applicable to all

ECVs and will also go into the detail of QA procedures applying to (very different) specific ECVs

  • QA4ECV will consider the unbroken data generation chain
  • Importance of user involvement
  • Legacy of NDACC and TCCON; PROMOTE, MACC, PASODOBLE;

GEOmon, SECPEA/A3C, Multi-TASTE, GECA, NORS; ESA CCI

  • Iteration with Copernicus climate projects, EU and global community
  • incl. ESA CCI, EUMETSAT SAFs, EEA, CEOS, INSPIRE, CHARMe, CORE-

CLIMAX, MACC-III/CAMS, GAIA-CLIM, GIO Global Land, CLIPC, …

  • QA/Val server and tools will form the core of the QA4ECV portal

QA4EO Data handlers