ALMA science software development Mark Lacy Monday, January 30, - - PowerPoint PPT Presentation

alma science software development
SMART_READER_LITE
LIVE PREVIEW

ALMA science software development Mark Lacy Monday, January 30, - - PowerPoint PPT Presentation

ALMA science software development Mark Lacy Monday, January 30, 2012 Workshop logistics Wireless is nraoPUBLIC Lunch provided, conference dinner tonight, Downtown Grille, Charlottesville, on the Downtown Mall. www.downtowngrille.com See


slide-1
SLIDE 1

ALMA science software development

Mark Lacy

Monday, January 30, 2012

slide-2
SLIDE 2

ALMA SCIENCE SOFTWARE DEVELOPMENT WORKSHOP 12-14TH OCTOBER 2011 MARK LACY, NRAO

Workshop logistics

Wireless is nraoPUBLIC Lunch provided, conference dinner tonight, Downtown Grille, Charlottesville, on the Downtown

  • Mall. www.downtowngrille.com

See Lyndele for reimbursement information (invited speakers) Twitter hash tag #ALMASW11

Monday, January 30, 2012

slide-3
SLIDE 3

ALMA SCIENCE SOFTWARE DEVELOPMENT WORKSHOP 12-14TH OCTOBER 2011 MARK LACY, NRAO

Aims of the workshop

Explore collaborations for development of software for ALMA (and other radio astronomy facilities, particularly EVLA). Varied participation from NRAO through Universities to private companies. Seed funding for US collaborations will be available (similar schemes in EU and EA, on different timings). Ultimate results are proposals to the ALMA development program (Al Wootten’s talk), perhaps to other funding sources (NSF in the US).

Monday, January 30, 2012

slide-4
SLIDE 4

ALMA SCIENCE SOFTWARE DEVELOPMENT WORKSHOP 12-14TH OCTOBER 2011 MARK LACY, NRAO

Data processing challenges

Large data volume (~1TB/day+) Pipeline “heuristics” (decision engine) Imaging algorithms and image reconstruction using incomplete information. (Compressive sensing)

Monday, January 30, 2012

slide-5
SLIDE 5

ALMA SCIENCE SOFTWARE DEVELOPMENT WORKSHOP 12-14TH OCTOBER 2011 MARK LACY, NRAO

Image theory digression (why interferometry is hard)

SKY PUPIL (APERTURE) PLANE IMAGE PLANE FOURIER TRANSFORM (OPTICS) FOURIER TRANSFORM (SOFTWARE) SPARSELY FILLED APERTURE FOR INTERFEROMETRY MEANS ONLY PARTIAL IMAGE INFORMATION CAPTURED

Monday, January 30, 2012

slide-6
SLIDE 6

ALMA SCIENCE SOFTWARE DEVELOPMENT WORKSHOP 12-14TH OCTOBER 2011 MARK LACY, NRAO

Example: Einstein’s face

10 MIN 8HR

Monday, January 30, 2012

slide-7
SLIDE 7

ALMA SCIENCE SOFTWARE DEVELOPMENT WORKSHOP 12-14TH OCTOBER 2011 MARK LACY, NRAO

Imaging challenges

Large degeneracy in reconstructed image given data, even when spatial frequencies are within sampled range. Missing information has important implications for automated feature identification and analysis. “Human element” - essentially a set of sophisticated priors - needs to be captured by pipeline software.

Monday, January 30, 2012

slide-8
SLIDE 8

ALMA SCIENCE SOFTWARE DEVELOPMENT WORKSHOP 12-14TH OCTOBER 2011 MARK LACY, NRAO

Data visualization challenges

Interaction with a large datacube

  • Rendering
  • Server vs client side

(3840x1024x1024x4B=16GB)

  • Interpretation of x,y,velocity data

Integration of software from other fields into astronomy, or roll our own?

Monday, January 30, 2012

slide-9
SLIDE 9

ALMA SCIENCE SOFTWARE DEVELOPMENT WORKSHOP 12-14TH OCTOBER 2011 MARK LACY, NRAO

Data analysis challenges

Automated feature extraction from data cubes Feature characterization in datacubes Line forest identification Modeling of complex ISM emission

Monday, January 30, 2012

slide-10
SLIDE 10

ALMA SCIENCE SOFTWARE DEVELOPMENT WORKSHOP 12-14TH OCTOBER 2011 MARK LACY, NRAO

Other astronomical fields

Large astronomical surveys in the optical/near-IR use automated extraction based on isophotal analysis or point source fitting (SExtractor/ DAOPhot/Mopex/Starfinder) No astronomer looks at every galaxy (citizen scientists may). But images all 2D, sources discrete (usually). Only limited work on cubes (IFUs)

Monday, January 30, 2012

slide-11
SLIDE 11

ALMA SCIENCE SOFTWARE DEVELOPMENT WORKSHOP 12-14TH OCTOBER 2011 MARK LACY, NRAO

Broad questions

Path from “art” “priors” “heuristics” image cube Path from image cube to Nobel Prize

  • How do we understand and interact with a

100GB datacube?

  • How do we model the complex structures and

chemistry?

Monday, January 30, 2012

slide-12
SLIDE 12

ALMA SCIENCE SOFTWARE DEVELOPMENT WORKSHOP 12-14TH OCTOBER 2011 MARK LACY, NRAO

Narrow questions

How do I include my script in CASA? Which software applications can we start writing the specs for now? Which collaborations can we form to work on these problems?

Monday, January 30, 2012

slide-13
SLIDE 13

ALMA SCIENCE SOFTWARE DEVELOPMENT WORKSHOP 12-14TH OCTOBER 2011 MARK LACY, NRAO

Outline

Today - intros to program, CASA, broad questions

  • f interaction with image cubes.

Tomorrow - Spectral line forest modeling, automated feature detection and characterization in datacubes. Friday (am) - data processing algorithms, methods and incorporation into CASA. Wrap-up.

Monday, January 30, 2012

slide-14
SLIDE 14

ALMA SCIENCE SOFTWARE DEVELOPMENT WORKSHOP 12-14TH OCTOBER 2011 MARK LACY, NRAO

Dinner 6:30pm Downtown Grille

DIRECTIONS ALSO ON WIKI PAGE. DRIVERS: AMY, MARK (3)... PLEASE REGISTER ON DOODLE POLL OT TELL LYNDELE

Monday, January 30, 2012

slide-15
SLIDE 15

ALMA SCIENCE SOFTWARE DEVELOPMENT WORKSHOP 12-14TH OCTOBER 2011 MARK LACY, NRAO

Peta data on the human scale

Visualization - roll our own or not?

  • other stuff out there (National Labs, medical imaging),

but hard to do coordinates.

  • Adapt current viewer? (ds9, casa, gaia...)
  • How do you train people to see structures in x,y,v

space?

  • server vs client side.

maintenance social collaboration and networking

Monday, January 30, 2012

slide-16
SLIDE 16

ALMA SCIENCE SOFTWARE DEVELOPMENT WORKSHOP 12-14TH OCTOBER 2011 MARK LACY, NRAO

Thanks

Lyndele von Schill Dale Nordstrom and Gene Runion Dong-Chan Kim SOC, session chairs, panelists Everyone for coming!

Monday, January 30, 2012

slide-17
SLIDE 17

ALMA SCIENCE SOFTWARE DEVELOPMENT WORKSHOP 12-14TH OCTOBER 2011 MARK LACY, NRAO

Thanks

Lyndele von Schill Dale Nordstrom and Gene Runion Dong-Chan Kim SOC, session chairs, panelists Everyone for coming!

SEND ME YOUR TALKS!

Monday, January 30, 2012

slide-18
SLIDE 18

ALMA SCIENCE SOFTWARE DEVELOPMENT WORKSHOP 12-14TH OCTOBER 2011 MARK LACY, NRAO

Wrap up - portals and interfaces

User portal/archive access/pipeline job control - can ALMA/ NRAO learn from CyberSka and/or VAO? 3D Astronomical Visualization - the time is right?

  • pick something as a basic platform to build WCS support
  • n etc that can work on client or server side.
  • Most of the optical/NIR community not so interested right

now? But ESO is - ALL E-ELT spectrographs will be IFUs!

  • Use broader community (including outside academic

astronomy?) to help pick, document etc...

Monday, January 30, 2012

slide-19
SLIDE 19

ALMA SCIENCE SOFTWARE DEVELOPMENT WORKSHOP 12-14TH OCTOBER 2011 MARK LACY, NRAO

Chemistry

Numerous opportunities small (WEEDS-level) to large scale ISM chemistry modeling projects.

  • WEEDS small effort but well-documented and useful.
  • Maps of molecules clearly of great value and will be a

major product of ALMA. Radiative transfer and excitation issues may limit what can be done, but this mapping should be supported. Clear opportunities for public engagement (adopt-a- molecule etc)

Monday, January 30, 2012

slide-20
SLIDE 20

ALMA SCIENCE SOFTWARE DEVELOPMENT WORKSHOP 12-14TH OCTOBER 2011 MARK LACY, NRAO

Feature finding and identification

Clump/source finding

  • quick but robust and user-friendly implementation
  • f existing algorithm(s) (SExtractor model) or
  • try to write something better? (but algorithm

development timescale long)

  • Use cases important to develop specific software.

Simulations/toy models (cf. artdata in IRAF).

Monday, January 30, 2012

slide-21
SLIDE 21

ALMA SCIENCE SOFTWARE DEVELOPMENT WORKSHOP 12-14TH OCTOBER 2011 MARK LACY, NRAO

Small projects

Clearly identified need for small efforts for specific projects (few FTE months) that could be part of CASA. If we can make CASA even more easy to produce tasks for (easy to use toolkit, easy integration) this will help. Also need a good path for contributed tasks in CASA (user forum to integration into regular CASA releases). “Survival

  • f the fittest”
  • Way to involve the community for “free”

No obvious funding line for these small projects though.

Monday, January 30, 2012

slide-22
SLIDE 22

ALMA SCIENCE SOFTWARE DEVELOPMENT WORKSHOP 12-14TH OCTOBER 2011 MARK LACY, NRAO

Maintenance

Maintenance... the several $M question...

  • Hardware needs to be built to certain standards (e.g.

new receivers should fit in FE, not draw too much power, interface with ALMA electronics...) So why not software?

  • Strict (CASA) software standards? Or looser (e.g. must

work in CASA environment). But either way maintainable by CASA engineers.

  • Proposals to the ALMA development funds should

include a maintenance plan.

Monday, January 30, 2012

slide-23
SLIDE 23

ALMA SCIENCE SOFTWARE DEVELOPMENT WORKSHOP 12-14TH OCTOBER 2011 MARK LACY, NRAO

Call for development studies is coming soon.

  • Modern (and forward looking) Viewer
  • Simplified Access to data products to enable

small scale development (1 month projects) Other opportunities:

  • Chemical & Radiative transfer modeling

Monday, January 30, 2012