DIASource Association CHRIS MORRISON, UNIVERSITY OF WASHINGTON - PowerPoint PPT Presentation

DIASource Association CHRIS MORRISON, UNIVERSITY OF WASHINGTON

ap_association Overview Updated/New New DIASources DIAObjects Association DIASource Associated DIAObjects History DIASources � 2

ap_association Overview One of the few pipelines that needs tight DAX integration during execution. ap_association’s job: Needs from PPDB interface: • Associate previously existing • Retrieve or be given previous DIAObjects with newly observed DIAObjects in a sky region. DIASources • Update DIAObject summary statistics • Retrieve or be given the DIASource or create new DIAObjects history of previous DIAObjects • Send updated/new DIAObjects and • Format conversion to/from native DB associated DIASources off to storage. types from/to pipelines objects. DPDD- ification of DIASources from ip_diffim. 3 �

What Tasks exist AssociationDBSqliteTask: AssociationTask: AssociationL1DBProtoTask: • Wrapper of Andy S.’s • Wrapper for Python’s • Requests/Stores 
 l1dbproto package. sqlite3 module DIAObjects/Sources by calling one of the two DB • Can be swapped in as a • Load/Stores DIAObjects/ subtasks subtask of AssociationTask. Sources in sqlite DB • Simple nearest neighbor • Still needs to perform • Very simplistic database “Handshake” match DPDD-ification on the structure DIASources output by • Computes DIAObject: • Does its own DPDD- ip_diffim • mean positions ification and 
 • Doesn’t currently use all of afwTable<->DB conversion • mean/scatter/err fluxes 1dbproto’s features. 4 �

Current AP data flow ip_diffim Updated/ List of New Update/Create Associate New DIAObjects DIASources DIAObjects DIAObjects To Update Associated DIASource DIAObjects DIASources History Science Pipelines Databases DIAObject DIASource DIASource DIAObject Table Table Table Table 5 �

The pipeline is running. • Integrated as part of ap_pipe • Successfully running on DECam-HiTS data • More datasets to come • Next steps (outside of data interface) • Time series features • ForcedPhotometry at DIAObject locations • Fancier association algorithm. credit: M. Rawls � 6

credit: M. Rawls Summary • A task for DIASource association exists • Can use a simple sqlite3 DB or Andy’s l1dbproto. • Successfully runs on real data and produces “light curves”. • Other summary statistics coming. • Needs a proper interface to DAX. • Currently both DB wrappers spend most of their time DPDD-ing and converting afw<->DB types. � 7