Working with ADQL Astronomy Data Query Language D.Morris Institute - - PowerPoint PPT Presentation

working with adql astronomy data query language
SMART_READER_LITE
LIVE PREVIEW

Working with ADQL Astronomy Data Query Language D.Morris Institute - - PowerPoint PPT Presentation

Working with ADQL Astronomy Data Query Language D.Morris Institute for Astronomy, Edinburgh University June 2016 Topcat The problem Different platforms Different languages Different formats Aladin D.Morris Institute for Astronomy,


slide-1
SLIDE 1

D.Morris Institute for Astronomy, Edinburgh University June 2016

Working with ADQL Astronomy Data Query Language

slide-2
SLIDE 2

D.Morris Institute for Astronomy, Edinburgh University June 2016

Topcat Aladin The problem Different platforms Different languages Different formats

slide-3
SLIDE 3

D.Morris Institute for Astronomy, Edinburgh University June 2016

Topcat Aladin The abstraction The data

slide-4
SLIDE 4

D.Morris Institute for Astronomy, Edinburgh University June 2016

Database Database Database Database

Topcat Aladin Virtual Observatory

Registry

TAP TAP TAP

Data discovery Registry Data access Table Access Protocol

slide-5
SLIDE 5

D.Morris Institute for Astronomy, Edinburgh University June 2016

TAP

Database Database

TAP TAP

Database Database

Topcat Aladin Virtual Observatory

A D Q L A D Q L A D Q L

Astronomy Data Query Language

SELECT … FROM table WHERE …

slide-6
SLIDE 6

D.Morris Institute for Astronomy, Edinburgh University June 2016

TAP

Database Database

TAP TAP

Database Database

Topcat Aladin Virtual Observatory

A D Q L A D Q L A D Q L

Observation Core Data Model

  • who
  • what
  • when
  • where
slide-7
SLIDE 7

D.Morris Institute for Astronomy, Edinburgh University June 2016

Topcat Aladin Virtual Observatory The data

Registry Table Access Protocol Astronomy Data Query Language Observation Core Data Model

slide-8
SLIDE 8

D.Morris Institute for Astronomy, Edinburgh University June 2016

Topcat Aladi n

TAP

Database Database

A D Q L

Data provider role

Observation Core Data Model

  • tables
  • columns
  • name
  • type
  • units
  • UCD

TAP schema

slide-9
SLIDE 9

D.Morris Institute for Astronomy, Edinburgh University June 2016

Topcat Aladi n

Software developer

TCP/IP HTTP REST … Java Spring Hibernate JDBC … Python Django Flask WebPy ... PostgreSQL MySQL SQLServer Oracle ...

TAP

A D Q L

Database Database

slide-10
SLIDE 10

D.Morris Institute for Astronomy, Edinburgh University June 2016

Topcat Aladi n

IVOA member

Database Database

TAP

A D Q L

##

Afwfwf Fafas Af ju lk Asf kget hipnd

!? ADQL ADQL TAP TAP

slide-11
SLIDE 11

D.Morris Institute for Astronomy, Edinburgh University June 2016

OFFSET ?

Afwfwf Fafas Af ju lk Asf kget hipnd

!! ADQL ADQL

OFFSET

SELECT …. FROM …. WHERE …. OFFSET n Initial proposal and group discussion Sometimes the complicated ones are easy, and sometimes the simple ones are hard.

slide-12
SLIDE 12

D.Morris Institute for Astronomy, Edinburgh University June 2016

OFFSET ADQL ADQL SELECT …. FROM …. WHERE …. OFFSET n Consensus and updated specification Optional features vs range of platforms What do we do if Oracle does not support OFFSET

slide-13
SLIDE 13

D.Morris Institute for Astronomy, Edinburgh University June 2016

Docker containers, providing basic install

  • f each database platform.

A simple platform for experimenting with ADQL syntax. https://github.com/ivoa/cosmopterix GitHub project

  • contributions welcome

Cosmopterix

Working

  • PostgreSQL
  • MySQL
  • MariaDB
  • HSQLDB
  • Apache Derby
  • Oracle (*)

Future

  • H2
  • SQLite
  • SQLServer
  • Qserv
  • SpiderEngine
  • Hadoop
slide-14
SLIDE 14

D.Morris Institute for Astronomy, Edinburgh University June 2016

A place to share example ADQL and SQL queries. Initial goals

  • Provide source material for ADQL parser tests
  • Provide source material for ADQL query tests

Medium term goals

  • Provide reference material for science use cases

Long term goal

  • Future work on validating the BNF grammar

https://github.com/ivoa/lyonetia GitHub project

  • contributions welcome

Lyonetia

ADQL ADQL ##

Afwfwf Fafas Af ju lk Asf kget hipnd

!?

slide-15
SLIDE 15

D.Morris Institute for Astronomy, Edinburgh University June 2016

Public GitHub projects. Make a clone, add your changes and send me a pull request.

Lyonetia – ADQL queries

https://github.com/ivoa/lyonetia

Open to collaboration Cosmopterix- Docker containers

https://github.com/ivoa/cosmopterix

ADQL-2.1 working draft

http://www.ivoa.net/documents/ADQL/20160502/index.html Dave Morris dmr@roe.ac.uk

ADQL document - LaTex source

https://volute.g-vo.org/viewvc/volute/trunk/projects/dal/ADQL/