ges disc data operations and services
play

GES DISC Data Operations and Services Mike Theobald GES DISC - PowerPoint PPT Presentation

GES DISC Data Operations and Services Mike Theobald GES DISC Production Highlights Completed V5.0 Reprocessing with a net rate of 13X. Integrated V5.2 algorithms and reprocessed from start of AMSU Ch. 4 degradation. Integrated L3


  1. GES DISC Data Operations and Services Mike Theobald GES DISC

  2. Production Highlights  Completed V5.0 Reprocessing with a net rate of 13X.  Integrated V5.2 algorithms and reprocessed from start of AMSU Ch. 4 degradation.  Integrated L3 Support Algorithm  Starting to replace/upgrade some hardware

  3. Data Production Latency NRT AIRI2CCF Latency Standard AIRI2CCF Latency 100% 100% 80% 80% 60% 60% 40% 40% 20% 20% 0% 0% 1 2 3 4 5 24 26 28 30 32 34 36 38 40 NRT vs Standard 30% 20% Standard NRT 10% 0% 0 3 6 9 12 15 18 21 24 27 30 33 36 39 Hours since Observation

  4. Archive Highlights  S4PA archive and distribution system  6 separate servers  100 TB  8,000,000 granules  All data backed up on tape  Redundant disk copies of L0 data  Disk files and tapes verified regularly  Additional capacity is planned  Technology refresh of L0 servers underway

  5. Archive Capacity Data Years Terabytes 20 100 Free L3 In Use L2 80 15 L1 L0 Years 60 TB 10 40 5 20 0 0 L0 L1 L2 L3 In Use Free Product Level

  6. 2008 Distribution Highlights  146 TB Net Volume  10 Million Granules  L1: 106.3 TB  L1: 2,700,000  L2: 26.4 TB  L2: 6,500,000  L3: 0.4 TB  L3: 7,000  NRT: 6.6 TB  NRT: 500,000  L0: 6.6 TB  L0: 100,000  Peak Distribution  1477 distinct network addresses  2 TB/day  50+ different top-level  220,000 granules domains

  7. Data Distribution – Volume 2.5 L0 L1 L2 2 L3 NRT 1.5 TB 1 0.5 0 Jan Feb Mar Apr May Jun Jul Aug Sep Oct

  8. Data Distribution – Granules 250 L0 L1 200 L2 Granules (Thousands) L3 NRT 150 100 50 0 Jan Feb Mar Apr May Jun Jul Aug Sep Oct

  9. Volume (TB) 100 120 20 40 60 80 0 Data Distribution – by Product AIRIBRAD AIRABRAD AIRVBRAD AIRXBCAL AIRX2RET AIRX2SUP AIRI2CCF AIRX3STD AIRX2RET_NRT AIRIBRAD_NRT AIRX2SUP_NRT All Others 0 1 2 3 4 5 6 Granules (Millions)

  10. Data Distribution – by Domain Volume (TB) Granules (Millions) 15.2 2.8 5.2 37.7 5.3 5.3 6.4 1.8 18.4 noaa.gov 1.4 umbc.edu wisc.edu nasa.gov 2.4 37.5 princeton.edu 2.6 25.3 0.3 umich.edu 1.6 ac.jp all others

  11. Services Overview  Format conversion  Data portals  NetCDF for L2, L3  Direct ftp/http  L1 soon  Mirador  Granule and global  WHOM browse  ECHO  OPeNDAP  Science support  Subsetting  ARCTAS  Channel  CEOP  Parameter  SO2 Map

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend


More recommend