the vamdc infrastructure standard procedures to publish
play

The VAMDC infrastructure Standard procedures to publish, search and - PowerPoint PPT Presentation

Nov 16, 2022 •269 likes •481 views

The VAMDC infrastructure Standard procedures to publish, search and process atomic and molecular data N.Moreau Paris Observatory, LERMA Asterics - Heidelberg Gathering heterogeneous data Many services provide atomic and molecula data

  1. The VAMDC infrastructure Standard procedures to publish, search and process atomic and molecular data N.Moreau Paris Observatory, LERMA Asterics - Heidelberg

  2. Gathering heterogeneous data  Many services provide atomic and molecula data  Content of data is different (atomic and molecular spectroscopy, collisions, solids) but we sometimes users have to compare or merge them  Many services have defined their own data format  Problematics :  How to query multiple databases  How to identify comparable data  Which data format to use  Goal of Virtual Atomic and Molecular Data Center project : to provide an interoperable e-Infrastructure for the exchange of atomic and molecular data. Asterics - Heidelberg

  3. The VAMDC project  Supported by EU in the framework of the FP7 (2009-2012)  Involved 15 administrative partners representing 24 teams from 6 European Union member states  Built an interoperable e-Infrastructure for the exchange of atomic and molecular data  Now managed by the VAMDC Consortium  30 databases available Asterics - Heidelberg

  4. The VAMDC infrastructure  Organization of the infrastructure capitalized on IVOA experience :  Registry  Extension of VOResource data model to describe VAMDC resources  Services query protocol is a simplified version of TAP (VAMDC- TAP) Asterics - Heidelberg

  5. The VAMDC infrastructure Asterics - Heidelberg

  6. VAMDC standards : XSAMS Asterics - Heidelberg

  7. VAMDC standards : XSAMS  XSAMS stands for XML Schema for Atomic, Molecular and Solids (http://www.vamdc.org/documents/vamdc-xsams-guide_v12.07.pdf)  A common format was necessary because VAMDC includes databases providers from very different fields ( atomic, molecular and solid spectroscopy )  Standard for exchange of atomic, molecular and particle-surface-interaction (AMPSI) data  Informations concerning sources and generation of the data must be provided  Correctness or applicability of the data is left to the producer responsibility Asterics - Heidelberg

  8. VAMDC standards : VAMDC-TAP Asterics - Heidelberg

  9. VAMDC standards : VAMDC-TAP  Based on IVOA TAP ( sync, async requests, all services have capabilities / availability)  SQL-like requests  Simplified to avoid join :  The data model is seen as one big table  All quantities are well defined into a dictionary  http://dictionary.vamdc.eu  Example : select * where ((AtomSymbol = 'he') OR (AtomSymbol = 'li')) Asterics - Heidelberg

  10. VAMDC standards : VAMDC-TAP Asterics - Heidelberg

  11. VAMDC standards : VAMDC-TAP Asterics - Heidelberg

  12. VAMDC registry Asterics - Heidelberg

  13. VAMDC registry  Astrogrid registry ( UK's virtual observatory development project )  http://registry.vamdc.eu/  Contains several types of resources  VAMDC nodes ( databases )  Processors ( data conversion tools )  VAMDC species database  All services registered their capabilities  Services endpoints  Queryable and returnables quantities ( using dictionary ) Asterics - Heidelberg

  14. VAMDC node Asterics - Heidelberg

  15. Data node  A node is a database registered in the VAMDC infrastructure  It can understand VAMDC-TAP query and returns data in XSAMS  We provide a middleware to implement the VAMDC layer in two versions :  Java  Python ( used by the majority of nodes)  Source code available on github Asterics - Heidelberg

  16. Data node  If the standards are updated, the node simply updates its middleware version.  Requirements :  Data have to be stored in a relational database  Data provider writes a mapping between the column of its database and VAMDC dictionary columns  Node can respond to « select species » query that returns all the species contained in the database  Before inclusion in the registry, node conformity is checked :  Is returned XSAMS valid ?  Is « Select species » implemented ? Asterics - Heidelberg

  17. VAMDC portal Asterics - Heidelberg

  18. Species database  Repository of all species contained in the infrastructure, sorted by database  http://species.vamdc.eu  Browsable through a web site to find quickly where a species can be found,  Data can be exported in a xls file, easy to sort or to convert to csv  Queryable through an API :  http://species.vamdc.eu/api/v12.07/nodes  http://species.vamdc.eu/api/v12.07/species  Returns JSON structured data Asterics - Heidelberg

  19. VAMDC Portal  http://portal.vamdc.eu  Main entry point to look for data  Provides two interfaces to build VAMDC-TAP requests and query all nodes  Uses all elements of the infrastructure :  Registry to get a list of nodes that are queried  Species database to autocomplete species names  XSAMS transformation tools (xml is converted to html) Asterics - Heidelberg

  20. Further evolutions  Updates in the XSAMS schema  Including new data nodes ( NIST is almost done )  Providing a «simplified » database registration procedure into the infrastructure :  Answer only to «select species »  Get visibility in the species database  Not included in the VAMDC portal Asterics - Heidelberg

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Asterics European Data Provider Forum Some updates from the VAMDC Infrastructure C.M. Zwlf,

Asterics European Data Provider Forum Some updates from the VAMDC Infrastructure C.M. Zwlf,

Asterics European Data Provider Forum Some updates from the VAMDC Infrastructure C.M. Zwlf, N.Moreau, Y.A. Ba Paris Observatory Plan of this talk: IVOA -part: convergence between XSAMS-VAMDC standard and SLAP-IVOA RDA

542 views • 33 slides
From RDA Data Cita-on Recommenda-ons to new paradigms for ci-ng data from VAMDC C.M. Zwlf and

From RDA Data Cita-on Recommenda-ons to new paradigms for ci-ng data from VAMDC C.M. Zwlf and

From RDA Data Cita-on Recommenda-ons to new paradigms for ci-ng data from VAMDC C.M. Zwlf and VAMDC consor-um Heidelberg June 2016 Importance of cita-on in building new knowledge Gives credits to the author of the intellectual product cited

655 views • 34 slides
Standard Operating Procedures Shirley Bennett & Mikkel Broholt 26 Stop TB Partnership

Standard Operating Procedures Shirley Bennett & Mikkel Broholt 26 Stop TB Partnership

Stop TB Partnership Standard Operating Procedures Shirley Bennett & Mikkel Broholt 26 Stop TB Partnership Coordinating Board Meeting Standard Operatin ing Procedures Follow-up to a need identified during discussions on the hosting

82 views • 5 slides
Welcome to the Risk Management Webinar Series Standard Operating Procedures (SOPs) Joy McElroy

Welcome to the Risk Management Webinar Series Standard Operating Procedures (SOPs) Joy McElroy

Welcome to the Risk Management Webinar Series Standard Operating Procedures (SOPs) Joy McElroy McElroy Training and Consultancy, LLC September 1, 2020 Standard Operating Procedures (SOPs) A set of written instructions that document a routine

577 views • 42 slides
February 2015 UASC Task force Background These standard operating procedures (SOPs) establish

February 2015 UASC Task force Background These standard operating procedures (SOPs) establish

Unaccompanied and Separated children Standard Operating Procedures (UASC SOPs) February 2015 UASC Task force Background These standard operating procedures (SOPs) establish the roles and responsibilities of government agencies (Family

587 views • 13 slides
problems for which standard operating procedures do not currently exist, and working with new

problems for which standard operating procedures do not currently exist, and working with new

Human work will increasingly shift toward two kinds of tasks: solving problems for which standard operating procedures do not currently exist, and working with new information acquiring it, making sense of it, communicating it to others

94 views • 7 slides
PostgreSQL + ZFS Best Practices and Standard Procedures "If you are not using ZFS, you are

PostgreSQL + ZFS Best Practices and Standard Procedures "If you are not using ZFS, you are

PostgreSQL + ZFS Best Practices and Standard Procedures "If you are not using ZFS, you are losing data*." Clark's Three Laws 3 1. When a distinguished but elderly scientist states that something is possible, he is almost certainly

1.64k views • 110 slides
Publish/Subscribe Publish/Subscribe Model Producers publish information Consumers

Publish/Subscribe Publish/Subscribe Model Producers publish information Consumers

Publish/Subscribe Publish/Subscribe Model Producers publish information Consumers subscribe to information Usually producers and consumers both in push mode Decoupling of participants In time In space In flow

653 views • 27 slides
MANUAL OF BIOSECURITY AND STANDARD OPERATING PROCEDURES FOR SHRIMP

MANUAL OF BIOSECURITY AND STANDARD OPERATING PROCEDURES FOR SHRIMP

Kingdom of Saudi Arabia Ministry of Agriculture Deputy of Fisheries Resources Affairs Department of Aquaculture Biosecurity Division MANUAL OF BIOSECURITY AND STANDARD OPERATING PROCEDURES FOR SHRIMP

927 views • 54 slides
VAMDC Virtual Atomic and Molecular Data Centre C. Mendoza (IVIC, CeCalCULA) With the

VAMDC Virtual Atomic and Molecular Data Centre C. Mendoza (IVIC, CeCalCULA) With the

VAMDC Virtual Atomic and Molecular Data Centre C. Mendoza (IVIC, CeCalCULA) With the collaboration of: J.Gonzlez (UCV), L.A. Nez (CeCalCULA) M.C.Witthoeft, J. Garca, T.R. Kallman (NASA) F. Delahaye, C.J. Zeippen (Obs. Paris)

365 views • 24 slides
The SPS Agreement & International Standards Codex standard setting procedures Current

The SPS Agreement & International Standards Codex standard setting procedures Current

The SPS Agreement & International Standards Codex standard setting procedures Current activities of International Standard setting at Inception Workshop: Principles & further activities for Codex implementation (17-19 September 2012,

952 views • 39 slides
Outline Project Goals and Objectives Green Infrastructure Sizing Calculator Standard

Outline Project Goals and Objectives Green Infrastructure Sizing Calculator Standard

11/14/2017 Green Infrastructure Standard Specifications and Plan Templates Central States Water Environment Association November 14, 2017 Outline Project Goals and Objectives Green Infrastructure Sizing Calculator Standard Plan

489 views • 24 slides
Standard Operating Procedures (SOP) Drafting Manufacturing Industry SOP Drafting

Standard Operating Procedures (SOP) Drafting Manufacturing Industry SOP Drafting

Case Study Standard Operating Procedures (SOP) Drafting Manufacturing Industry SOP Drafting Manufacturing Industry Objective: To conduct Profitability Analysis of the 3 star hotel. Aim: The aim of the SOP is to lay down necessary

513 views • 4 slides
Public-key Infrastructure Computer Center, CS, NCTU Public-key Infrastructure A set of

Public-key Infrastructure Computer Center, CS, NCTU Public-key Infrastructure A set of

Public-key Infrastructure Computer Center, CS, NCTU Public-key Infrastructure A set of hardware, software, people, policies, and procedures. To create, manage, distribute, use, store, and revoke digital certificates. Encryption,

906 views • 34 slides
To Publish or Not to Publish? CSE545 - Fall 2006 Introduction Computer and Network Security

To Publish or Not to Publish? CSE545 - Fall 2006 Introduction Computer and Network Security

447 views • 12 slides
Mobile ad hoc networks Standard Mobile IP needs an infrastructure Home Agent/Foreign Agent in

Mobile ad hoc networks Standard Mobile IP needs an infrastructure Home Agent/Foreign Agent in

Mobile ad hoc networks Standard Mobile IP needs an infrastructure Home Agent/Foreign Agent in the fixed network DNS, routing etc. are not designed for mobility Sometimes there is no infrastructure! remote areas, ad-hoc meetings,

284 views • 24 slides
Accelerating Exascale How the End of Moores Law Scaling is Changing the Machines You Use, the

Accelerating Exascale How the End of Moores Law Scaling is Changing the Machines You Use, the

Accelerating Exascale How the End of Moores Law Scaling is Changing the Machines You Use, the Way You Code, and the Algorithms You Use Steve Oberlin CTO, Accelerated Computing NVIDIA TEGRA K1 Mar 2, 2014 NVIDIA Confidential 1 A Little

624 views • 41 slides
Foolproof Ansible Playbooks with Molecule Nathaniel Beckstead 1 Nathaniel Beckstead

Foolproof Ansible Playbooks with Molecule Nathaniel Beckstead 1 Nathaniel Beckstead

Foolproof Ansible Playbooks with Molecule Nathaniel Beckstead 1 Nathaniel Beckstead Automation extraordinaire Never enough infrastructure Favorite ice cream flavor is mint chocolate chip 2 Ansible 3 Ansible

831 views • 27 slides
A Sub-pA Current Sensing Front-End for Transient Induced Molecular Spectroscopy Da Ying, Ping-Wei

A Sub-pA Current Sensing Front-End for Transient Induced Molecular Spectroscopy Da Ying, Ping-Wei

A Sub-pA Current Sensing Front-End for Transient Induced Molecular Spectroscopy Da Ying, Ping-Wei Chen, Chi-Yang Tseng, Yu-Hwa Lo, and Drew A. Hall University of California, San Diego, CA, USA Symposia on VLSI Technology and Circuits New Drug

812 views • 32 slides
Whats New With Ansible Collections Diving into the How to use Collections with Ansible

Whats New With Ansible Collections Diving into the How to use Collections with Ansible

INSERT CONFIDENTIAL designator Whats New With Ansible Collections Diving into the How to use Collections with Ansible 2.9.10+ and beyond Andrius Benokraitis Iftikhar Khan Bradley Thornton Sr. Principal Product Manager Sr. Manager,

423 views • 19 slides
Using cold molecules to detect molecular parity violation Joost van den Berg KVI SSP2012

Using cold molecules to detect molecular parity violation Joost van den Berg KVI SSP2012

Using cold molecules to detect molecular parity violation Joost van den Berg KVI SSP2012 Groningen Outline Parity violation in diatomic molecules Ultracold molecules Experiment Stark decelerator Laser cooling 2 Parity

458 views • 19 slides
Long range behavior of the van der Waals forces between a molecule and a perfectly conducting

Long range behavior of the van der Waals forces between a molecule and a perfectly conducting

Long range behavior of the van der Waals forces between a molecule and a perfectly conducting metallic plate based on joint work with Mariam Badalyan and Dirk Hundertmark Ioannis Anapolitanos special thanks to: Kurt Busch, Francesco

644 views • 25 slides
Hardware Accelerated Similarity Search George Williams Who Am I? Director, GSI Technology

Hardware Accelerated Similarity Search George Williams Who Am I? Director, GSI Technology

Hardware Accelerated Similarity Search George Williams Who Am I? Director, GSI Technology Previously, Chief Data Scientist Senior Data Scientist AI Research Scientist Software Engineer Recent Headlines Convergence and Integration That was

923 views • 56 slides
ASGN: an Active Semi-supervised Graph Neural Network for Molecular Property Prediction Zhongkai

ASGN: an Active Semi-supervised Graph Neural Network for Molecular Property Prediction Zhongkai

ASGN: an Active Semi-supervised Graph Neural Network for Molecular Property Prediction Zhongkai Hao, Chengqiang Lu, Zhenya Huang, Hao Wang, Zheyuan Hu, Qi Liu, Enhong Chen, Cheekong Lee University of Science and Technology of China Introduction

534 views • 21 slides

More recommend