The ARCHES SED archive of 3XMM sources by Mauro Lpez - - PowerPoint PPT Presentation

the arches sed archive of 3xmm sources
SMART_READER_LITE
LIVE PREVIEW

The ARCHES SED archive of 3XMM sources by Mauro Lpez - - PowerPoint PPT Presentation

The ARCHES SED archive of 3XMM sources by Mauro Lpez (mauro@cab.inta- csic.es) Spanish Virtual Observatory ARCHES Scientific Workshop. Paris. 30 Nov - 2 Dec. 2015 ARCHES WP5 Objective: SED tool development & SED creation We aim to


slide-1
SLIDE 1

The ARCHES SED archive of 3XMM sources

by Mauro López (mauro@cab.inta- csic.es) Spanish Virtual Observatory

ARCHES Scientific Workshop. Paris. 30 Nov - 2 Dec. 2015

slide-2
SLIDE 2

Objective: SED tool development & SED creation We aim to produce a scientifically validated, VO-compliant set of spectral energy distributions of the objects included in the 3 XMM-Newton Serendipitous Source Catalogue. Team: Enrique Solano (SVO boss) and Mauro López (SVO minion)

ARCHES WP5

2

slide-3
SLIDE 3

The SVO job

More than 10 years focused in Virtual Observatory activities. For ARCHES: Calculate SED fluxes Create web service Create VO service Provide access and support to the community

3

slide-4
SLIDE 4

The fellowship of ARCHES

Arches WP4: Provides the input catalogue/s Arches WP5 Arches WP8: Testing Arches WP13: Upload SEDs to Vizier

4

slide-5
SLIDE 5

ARCHES data - Resume (personal pov)

1. Where is the data? I will create synthetic data 2. Is this the data? Great! Life is good 3. But, are you sure we are not going to change the data again? 4. OH MY GOD! Data has changed and we are out of time. Run you fool! (Two heart attacks later…) Data is already available (user/password is required): sdc.cab.inta-csic.es/arches/

5

slide-6
SLIDE 6

Arches WP5- Data access service

WP5 Database Controller Interface - VO

  • HTML
  • Hibernate
  • PSQL
  • Java
  • Struts
  • Flux calculations
  • Code metrics
  • Documentation
  • Analysis
  • Design

6

slide-7
SLIDE 7

Data path

WP4: Data CSV S V O F i l t e r p r

  • f

i l e s e r v i c e WP5 SEDs VO SEDs ASCII SEDs

7

slide-8
SLIDE 8

Filter profile service

We use it to calculate fluxes/errors using magnitudes Most sub-catalogs covered http://svo2.cab.inta-csic.es/theory/fps3/index.php

8

slide-9
SLIDE 9

Database

Multiple “multi catalog” information

  • 3XMM, 2Mass, Sloan, Ucac4, Wise, Mingo, Akarifis and Galex67
  • 3XMM, UKidss, Sloan, Ucac4, Wise, Mingo, Akarifis and Galex67

Input data was two single, big tables. Lots of rows (150.000+30.000) and lots of columns (CSV format). Query by ID (3XMM) is fast, pretty, reliable… Query by position is slower. Why?: Harvesine formula to calculate the distance

2.0*asin(sqrt(pow(sin(toRadians((archesDec-dec)/2.0)),2)+cos(toRadians(dec))*cos(toRadians (archesDec))*pow(sin(toRadians((ra-archesRa)/2)),2)))/PI/648000

9

slide-10
SLIDE 10

Database structure - KISS

One main table:

  • Each row is an ARCHES instance
  • All info is stored in it

One “index” table:

  • With only RA, DEC and

3XMM_IAUNAME info Auxiliary tables:

  • Login and access information

10

slide-11
SLIDE 11

Database creation

Avoid SQL statement. Only a create database arches_wp5 was executed during this project. For everything else there’s

  • Do you need another subcatalog? Just create the JAVA class and Hibernate

will transform it into a database structure.

  • Do you need to query by ID? Just create an ARCHES object, fill the ID value

and Hibernate will query it. Advantages: easy to expand, independent on the architecture (PSQL, MySQL, Oracle,...), everything inside the same project. Hibernate

11

slide-12
SLIDE 12

Web service

Front end for accessing to the data Query by 3xmm id, Sesame or position Multiple query allowed Hide/unhide catalogs Access to external plots (thanks Laurent et al) Direct communication with VOTools through SAMP protocol HTML or ASCII output Full catalogue available to download

12

slide-13
SLIDE 13

13

slide-14
SLIDE 14

14

slide-15
SLIDE 15

Downloaded data is structured into different folders:

  • Level 1: catalog reference
  • Level 2: version (VO or ASCII)

15

slide-16
SLIDE 16

SAMP interop.

16

slide-17
SLIDE 17

Web technologies

Client: Only standards as HTML5, CSS and Javascript Server: JAVA, JSP and Struts. Objective in mind: to split as best as I could the View from the Controller

17

slide-18
SLIDE 18

VO queries

We have SEDs, we have a way to query data, but we also need to provide access to VO registries (when data is public). We have done it (access to SEDs is disabled at this moment). Simple SSAP example: http://sdc.cab.inta-csic.es/arches/queryVOAction.action?pos=351.98535,-2.10475

18

slide-19
SLIDE 19

19

slide-20
SLIDE 20

Future work

  • Add some tooltips and finding charts when available
  • Documentation:

○ Finish a “Bible for the Arches-WP5 Server”

  • Maintenance:

○ Several input catalogs have been used. A cleaning of the code is required ○ Continuous surveillance work (is the server down? is the server room on fire? do we store the backups properly? ○ Generate statistics

  • Training:

○ Does anything need help? I am at your service.

20