Marco Molinaro Astronomical Data Center Forum 10-11 June 2013, - - PowerPoint PPT Presentation

▶
marco molinaro astronomical data center forum 10 11 june
SMART_READER_LITE
LIVE PREVIEW

Marco Molinaro Astronomical Data Center Forum 10-11 June 2013, - - PowerPoint PPT Presentation

Jun 04, 2023 199 likes •421 views

Marco Molinaro Astronomical Data Center Forum 10-11 June 2013, Heidelberg Putting together Formats Protocols Models Registry to reach a goal interoperable astrophysical data resources How? Implementation/coding

slide-1
SLIDE 1

Marco Molinaro Astronomical Data Center Forum 10-11 June 2013, Heidelberg

slide-2
SLIDE 2

Marco Molinaro [INAF-OATs IA2] – Astronomical DC Forum, 10 June 2013, Heidelberg

Putting together

Formats – Protocols – Models – Registry

to reach a goal

interoperable astrophysical data resources

How?

Implementation/coding Datasets/archives/DBs Dynamical content, data policy Resource Registry details

slide-3
SLIDE 3

Marco Molinaro [INAF-OATs IA2] – Astronomical DC Forum, 10 June 2013, Heidelberg

IVOA – Publishing in the VO

http://wiki.ivoa.net/twiki/bin/view/IVOA/PublishingInTheVONew

slide-4
SLIDE 4

Marco Molinaro [INAF-OATs IA2] – Astronomical DC Forum, 10 June 2013, Heidelberg

IVOA – Publishing in the VO

http://wiki.ivoa.net/twiki/bin/view/IVOA/PublishingInTheVONew

slide-5
SLIDE 5

Marco Molinaro [INAF-OATs IA2] – Astronomical DC Forum, 10 June 2013, Heidelberg

IVOA – Publishing in the VO

http://wiki.ivoa.net/twiki/bin/view/IVOA/PublishingInTheVONew

slide-6
SLIDE 6

Marco Molinaro [INAF-OATs IA2] – Astronomical DC Forum, 10 June 2013, Heidelberg

 Identify your path to goal, consider:

  • Technological expertise

▪ Including coding longing

  • Dataset complexity

▪ Single table, set of images, images and catalogues, multiple tablesets, tablestes with image and/or spectra access, …

  • Structural starting point

▪ From sparse files to fully structured archive

 but also…

  • Dataset content dynamics

▪ One-shot DR / incremental dataset

  • Release data policy

▪ Public, private, mixed

slide-7
SLIDE 7

Marco Molinaro [INAF-OATs IA2] – Astronomical DC Forum, 10 June 2013, Heidelberg

 Identify your path helps in

  • Not loosing your mind while diving in the IVOA-Doc
  • cean

▪ TECHNOLOGICAL EXPERTS must consider themselves good divers!

 First step in defining your strategy

  • Clear ideas of what you want to expose
  • How you want to structure the deployed

resource(s)

slide-8
SLIDE 8

Marco Molinaro [INAF-OATs IA2] – Astronomical DC Forum, 10 June 2013, Heidelberg

 Toolkits  Aided DC or toolkit publishing

  • National VO project contact
  • Existing VO involved DC

 Registration  Issues

  • Data formats / metadata content
  • Dataset complexity
slide-9
SLIDE 9

Marco Molinaro [INAF-OATs IA2] – Astronomical DC Forum, 10 June 2013, Heidelberg

 Toolkits  Libraries  Specifications  Publishing Registry?  Issues

  • Starting dataset structure
  • Data policy
slide-10
SLIDE 10

Marco Molinaro [INAF-OATs IA2] – Astronomical DC Forum, 10 June 2013, Heidelberg

 Standards & Protocols  Code from scratch

  • Probably implementing existing library efforts

 Publishing (or full) Registry?  Issues

  • Archive translation layer
  • Dataset dynamic upgrade
slide-11
SLIDE 11

Marco Molinaro [INAF-OATs IA2] – Astronomical DC Forum, 10 June 2013, Heidelberg

 Saada  ESA  CDS  IA2

slide-12
SLIDE 12

Saada: A tool for data publishing

 Saada builds databases from data

files

No Code to write Storage of heterogeneous dataset Can host multiple data collections Support persistent links between data Meta-data tagging (ucd, units…) « by hand » Access via Web interface or VO protocols

 A Java layer on the top of an RDBMS

PostgresQL, MySQL or SQLite

12

Laurent MICHEL: Observatoire de Strasbourg http://saada.u-strasbg.fr

Used by the XMM-Newton Suvery Science Centre

slide-13
SLIDE 13

Observatoire de Strasbourg http://saada.u- strasbg.fr 13

SAADA Admin tool

slide-14
SLIDE 14

ESA Science Archives Publishing to the VO

Science Archive

Data Processing System Other internal ESA functions

Science Products Raw Data Raw Data Science Products Calibration files Users VO links to External Archives SIAP, SSAP, SLAP, SAMP

External Archives / Tools

slide-15
SLIDE 15

Centre de Données astronomiques de Strasbourg

Reference service for object names Access to journal catalogue data An interactive ‘portal’

VO interfaces alongside web and other interfaces

slide-16
SLIDE 16

16

e.g. query VizieR via:

  • dedicated web interface
  • Topcat
  • Aladin, via DS9
  • scripts or web services
  • TAP – Table Access Protocol
slide-17
SLIDE 17

VizieR TAP Interface (also useable via other TAP

clients)

slide-18
SLIDE 18
  • M. Molinaro – SPIE “Software and Cyberinfrastructure for Astronomy II”, Amsterdam 1 July 2012

User Layer DB / Resource Layer

DB storage storage storage storage DB DB DB DB

VO-Dance

SQL Composer Service Publisher Policy Manager Universal Controller Service Publisher restful endpoint

internal DB VO-Dance Administration Interface

slide-19
SLIDE 19

Marco Molinaro [INAF-OATs IA2] – Astronomical DC Forum, 10 June 2013, Heidelberg

 Resource

  • Data collections
  • Services

▪ Registry

 Curation and Content  Capabilities and Interfaces  Validation  Where? (RofR, full harvestable, publishing)

slide-20
SLIDE 20

Marco Molinaro [INAF-OATs IA2] – Astronomical DC Forum, 10 June 2013, Heidelberg

http://registry.euro-vo.org

slide-21
SLIDE 21