CLASS Access 2015 NOAA Satellite Conference, April 27 May 1, 2015 - - PowerPoint PPT Presentation

class access
SMART_READER_LITE
LIVE PREVIEW

CLASS Access 2015 NOAA Satellite Conference, April 27 May 1, 2015 - - PowerPoint PPT Presentation

NOAAs National Centers for Environmental Information CLASS Access 2015 NOAA Satellite Conference, April 27 May 1, 2015 NOAA Satellite and Information Service | National Centers for Environmental Information Key Discussion Points


slide-1
SLIDE 1

2015 NOAA Satellite Conference, April 27 – May 1, 2015

NOAA Satellite and Information Service | National Centers for Environmental Information

NOAA’s National Centers for Environmental Information

CLASS Access

slide-2
SLIDE 2

2

NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Key Discussion Points

  • CLASS’s role verses NCEI’s role
  • Current plans for future access
  • Datasets in CLASS
  • Access statistics and patterns
  • Users accessing data
  • Levels of data access in CLASS
slide-3
SLIDE 3

3

NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

CLASS Role vs. NCEI Role

  • Comprehensive Large Array-data Stewardship System (CLASS) is

managed by the NESDIS Office of Satellite Ground Services (OSGS). CLASS’s current responsibilities include ingest, management, archival and access to its information holdings.

  • NOAA’s National Centers for Environmental Information (NCEI), in

addition to providing similar services as CLASS, are responsible for data stewardship and user support of all information holdings in CLASS and in NCEI.

slide-4
SLIDE 4

4

NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

CLASS’s Evolution to an Enterprise Archival Storage System

Preservation Planning Administration

Ingest Access Data Managemen t Archival

Storage

P R O D U C E R C O N S U M E R

requests results

Present CLASS

Satellite

NOAA Enterprise Archival Storage System

Ingest Interface Diss. Interface Access Interface

Administration and Preservation

Climate.

Gov

Ordering Discovery

Commercial Cloud Services

Dissemination Services

Access Services

Model Insitu

Pre-ingest Services

Future CLASS (in red)

Data Gateway Data Gateway Data Gateway Private Cloud Services Web Accessible Folders Direct Delivery

Admin. Interface

4

slide-5
SLIDE 5

5

NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

CLASS M2M Interface

CLASS Core System

Machine-to- Machine Interface (RESTful Services) AccessService (SOAP-based Services) NCEI- NC NCEI- CO NCEI- MD

Users Users Users

CLASS Backend CLASS Middleware

Users

CLASS Frontend (Web)

The M2M API implements a set of RESTful web services for searching, ordering, and order status querying of CLASS’s information holdings.

slide-6
SLIDE 6

6

NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

What Data can be Accessed?

  • There are 80 data families in CLASS.
  • Each family of data may contain many data types.
  • Altogether there are 300 datasets in CLASS

accessible through its web interface.

  • The most popular are the original radiance datasets

from GOES, POES, and S-NPP.

slide-7
SLIDE 7

7

NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Most Popular Datasets

Satellite/instruments Period of record Volume archived S-NPP VIIRS xDRs 2012 to current 4400 TB GOES GVAR and pre-GVAR Imager datasets 1979 to current 335 TB POES/MetOp AVHRR and ATOVS Level 1b datasets 1978 to current 116 TB MetOp IASI datasets 2007 to current 109 TB

slide-8
SLIDE 8

8

NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Most Popular Datasets by Volume*

*Based on ad hoc orders from Jan 2013 to Mar 2015

VIIRS-SDRs GOES GVAR AVHRR IASI L 1C

23 CLASS data families with over 2 TB delivered

slide-9
SLIDE 9

9

NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Access Statistics by File Age

Based on orders placed from Jan 2013 to Dec 2014

slide-10
SLIDE 10

10

NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Monthly Totals (TB) Accessed

Subscriptions Ad Hoc Orders

S-NPP compression began

slide-11
SLIDE 11

11

NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Total Archive Growth in CLASS

Total archive volume in CLASS is around 11.5 PB

S-NPP Launched Oct 2011

slide-12
SLIDE 12

12

NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Who are the users of CLASS?

slide-13
SLIDE 13

13

NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Step 1: Register for a user id account at www.class.noaa.gov (minimal information: your name, e- mail address, a password) Step 2: Select from the drop down product menu and highlight a dataset Step 3: On the Search page make your selections (geographic region, start/end dates and times, and data types). Step 4: Determine if you need greater access or a subscription

Note: Always provide your user ID when contacting the CLASS helpdesk

How do I access data from CLASS?

slide-14
SLIDE 14

14

NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Levels of Access Services (1)

CLASS order types: Average completion time Average File Limit Contact the CLASS Help Desk?

Ad hoc orders (Use Search button to

  • btain inventory)

Usually within 12 to 24 hours Up to 500 files No Large orders (use Quick Search button to skip inventory ) 24 to 48 hours 1000 to 3000 No Block orders (use Quick Search button) > 48 hours 3000 to 6000 Yes Subscription (standing orders) < 6-7 hours No limit Yes

slide-15
SLIDE 15

15

NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Subscription Delivery Times

slide-16
SLIDE 16

16

NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

Levels of Access Services (2)

CLASS provides daily tar files containing publicly available S-NPP products (excluding the Raw Data Records) for easy anonymous FTP download at: ftp://ftp-npp.class.ngdc.noaa.gov/

  • Most recent 85 days
  • 76 datatypes (including Geolocation files)
  • Data are compressed and “tar”-ed by datatype
  • Sorted by date/instrument-processing

level/product

  • Includes manifest files (xml format)
  • No registration required
slide-17
SLIDE 17

17

NOAA’s NATIONAL CENTERS FOR ENVIRONMENTAL INFORMATION

For technical questions regarding access in CLASS: class.help@noaa.gov axel.graumann@noaa.gov Tutorial on using CLASS: SNPP Access tutorial - on CLASS Home Page in the News section Please see me for a hands on overview of CLASS website!

Assistance and Support