Towards Categorical Metadata Alternative 3 Tasks for Unreduced - - PowerPoint PPT Presentation

▶
towards categorical metadata
SMART_READER_LITE
LIVE PREVIEW

Towards Categorical Metadata Alternative 3 Tasks for Unreduced - - PowerPoint PPT Presentation

Nov 14, 2022 179 likes •291 views

Towards Categorical Metadata C. Grainger slides Status Quo Towards Categorical Metadata Alternative 3 Tasks for Unreduced Climate Observations Functions Interfaces References Colton Grainger University of Colorado Boulder July

slide-1
SLIDE 1

Towards Categorical Metadata

  • C. Grainger

Status Quo Alternative

3 Tasks Functions Interfaces

References

slides

  • Towards Categorical Metadata

for Unreduced Climate Observations

Colton Grainger

University of Colorado Boulder

July 31, 2019

slide-2
SLIDE 2

Towards Categorical Metadata

  • C. Grainger

Status Quo Alternative

3 Tasks Functions Interfaces

References

unreduced data from ∼100 Tb collection of images (ACRE) marine logbooks 1870–1950 land stations 1870–1930 Indian Daily Weather Reports, Todd Folios, etc.

slide-3
SLIDE 3

Towards Categorical Metadata

  • C. Grainger

Status Quo Alternative

3 Tasks Functions Interfaces

References

Example (reduction of 6Mb image to a 2Kb time series)

Figure 1: 24 hours on the USS Jeannette (P. Brohan)

slide-4
SLIDE 4

Towards Categorical Metadata

  • C. Grainger

Status Quo Alternative

3 Tasks Functions Interfaces

References

url

twitter.com/NCAR_RDA/status/1144058111654711296

qrcode

Figure 2: CISL Seminar,

  • P. Brohan (2019)

Example

  • 26 bytes ∼ 70 ASCII characters
  • 212 bytes ∼ 441 × 441 pixels
  • a qrcode reduces to a url

$ exiftool brohan_qrcode.png File Size : 2.7 kB Image Size : 441x441 MIME Type : image/png

slide-5
SLIDE 5

Towards Categorical Metadata

  • C. Grainger

Status Quo Alternative

3 Tasks Functions Interfaces

References

metadata

{’key:value’ for key in <schema>}

what available metadata has low noise-to-signal ratio?

Figure 3: May 1944, Idaho (BB-42)

$ exiftool Idaho-BB-0034.JPG File Size : 4.6 MB Image Size : 3744x5616 MIME Type : image/jpeg

arc archive doc document img image

  • bs observation

plt platform

slide-6
SLIDE 6

Towards Categorical Metadata

  • C. Grainger

Status Quo Alternative

3 Tasks Functions Interfaces

References

  • Roughly, an image in the category img approximates a

time-series σ: [t0, t1] → S, where S is the state space of meteorological variables.

  • An observation is ρ(t) evaluated at a time t.
  • A platform in the category plt approximates a time-series

λ: [t0, t1] → M, where M is a differentiable manifold. arc archive doc document img image

  • bs observation

plt platform

dependencies

arc plt

  • doc

∃!

  • img
  • bs

update

slide-7
SLIDE 7

Towards Categorical Metadata

  • C. Grainger

Status Quo Alternative

3 Tasks Functions Interfaces

References

1 Gather images into (at least) one repository. 2 Establish a common description framework for image

metadata.

3 Provide bulk, programmatic access to image subsets.

slide-8
SLIDE 8

Towards Categorical Metadata

  • C. Grainger

Status Quo Alternative

3 Tasks Functions Interfaces

References

repo MySQL schema with Makefile. assign_uuid(). framework Agnostic ingest scripts. Bundle metadata. access rda.ucar.edu/i/<uuid>

slide-9
SLIDE 9

Towards Categorical Metadata

  • C. Grainger

Status Quo Alternative

3 Tasks Functions Interfaces

References

repo Conflict resolution for assign-uuid(). framework RELAX NG validator. access rda.ucar.edu/i/<query>

slide-10
SLIDE 10

Towards Categorical Metadata

  • C. Grainger

Status Quo Alternative

3 Tasks Functions Interfaces

References

Figure 4: git repo