The Atmospheric Model Evaluation Tool K. Wyat Appel and Robert C. - - PowerPoint PPT Presentation
The Atmospheric Model Evaluation Tool K. Wyat Appel and Robert C. Gilliam 9 th Modeling Conference, RTP, NC October 10, 2008 Office of Research and Development October 10, 2008 National Exposure Research Laboratory, Atmospheric Modeling
October 10, 2008
Office of Research and Development National Exposure Research Laboratory, Atmospheric Modeling Division, Applied Modeling Research Branch
9th Modeling Conference, RTP, NC October 10, 2008
Office of Research and Development Atmospheric Modeling Division, National Exposure Research Laboratory
–Meteorology (Rob Gilliam) –Air Quality (Wyat Appel)
–MYSQL –R –Perl
meteorological (e.g. MM5, WRF) and air quality model (e.g. CMAQ, CAMx) predictions –Does not export all gridded data to database
Office of Research and Development Atmospheric Modeling Division, National Exposure Research Laboratory
Generate database records (FORTRAN) Populate Database (PERL)
Model Evaluation Database
MySQL server database stores model-observation pairs in tables for access by analysis programs.
Other, User-developed tools
The MySQL database is a standard, widely used and easily connectable database that allows users to easily connect and extract data using
Perl, SAS, etc.)
Analyses
Model Performance Plots Diurnal Statistics Time series Spatial Statistics Box Plots Scatter Plots Bar Plots “Soccer Goal” Plots Bugle Plots
Observations
STN, IMPROVE, CASTNet, NADP, AQS, SEARCH, MDN
Model Output
Match obs. with model values in time and space using site compare and compare airs programs
Observation-Model Synchronization
Office of Research and Development Atmospheric Modeling Division, National Exposure Research Laboratory
– Data from multiple simulations stored in a single location – Allows data queries based on many factors
– Same analysis for multiple simulations – Common analyses between different groups
– Easy to create new scripts (if you know R)
Office of Research and Development Atmospheric Modeling Division, National Exposure Research Laboratory
– includes various plots (scatter, box, etc.) along with various statistics
– various statistical values (e.g. NMB, NME, etc.)
– error, bias, etc.
Temperature Wind Direction
Aircraft Mean WRF Mean
Mean Absolute Error Distribution by level
Office of Research and Development Atmospheric Modeling Division, National Exposure Research Laboratory
– model to observation – model to model (at observation points)
– various statistical values (e.g. NMB, NME, etc.) – concentrations (predicted, observed, and difference)
– select statistics
– additional statistics
– monthly, seasonal, annual
– NMB, NME, Correlation, etc.
– model, observation, difference
Diurnal Box Plot Monthly Box Plot
“Bugle” Plot “Soccer Goal” Plot
Office of Research and Development Atmospheric Modeling Division, National Exposure Research Laboratory
be used
Office of Research and Development Atmospheric Modeling Division, National Exposure Research Laboratory
– Both Met and AQ versions available – Script based version – Extensive users guide included
Office of Research and Development Atmospheric Modeling Division, National Exposure Research Laboratory
–Currently under development –Runs AMET locally and accesses remote database –Interactive tabs –User friendly –Portable (to a degree)
–Developed internally –Developed externally (user community)