Deblending in LSST DM Today Jim Bosch - DM DRP Scientist / Princeton - - PowerPoint PPT Presentation

deblending in lsst dm today
SMART_READER_LITE
LIVE PREVIEW

Deblending in LSST DM Today Jim Bosch - DM DRP Scientist / Princeton - - PowerPoint PPT Presentation

Deblending in LSST DM Today Jim Bosch - DM DRP Scientist / Princeton Images to Catalogs in Four Steps Inspired by the SDSS Photo Pipeline, the DM Pipelines decomposes the process of generating a catalog from an image into four steps:


slide-1
SLIDE 1

Deblending in LSST DM Today

Jim Bosch - DM DRP Scientist / Princeton

slide-2
SLIDE 2

2

Images to Catalogs in Four Steps

Inspired by the SDSS Photo Pipeline, the DM Pipelines decomposes the process of generating a catalog from an image into four steps:

  • Detection
  • Association
  • Deblending
  • Measurement

This is not the only decomposition of the problem, and it's probably not the best one for certain science analyses. It's just one that worked well for SDSS (and to a lesser extent, HSC).

slide-3
SLIDE 3

3

Four Steps

  • 1. Detect: find above-threshold footprints

and peaks in all images.

  • 2. Associate: merge footprints and peaks

into a single consistent set.

  • 3. Deblend: apportion flux to each peak,

generating children.

  • 4. Measure: run algorithms on child pixels.
slide-4
SLIDE 4

4

  • 1. Detect: find above-threshold footprints

and peaks in all images.

  • 2. Associate: merge footprints and peaks

into a single consistent set.

  • 3. Deblend: apportion flux to each peak,

generating children.

  • 4. Measure: run algorithms on child pixels.

Four Steps

slide-5
SLIDE 5

5

Four Steps

  • 1. Detect: find above-threshold footprints

and peaks in all images.

  • 2. Associate: merge footprints and peaks

into a single consistent set.

  • 3. Deblend: apportion flux to each peak,

generating children.

  • 4. Measure: run algorithms on child pixels.
slide-6
SLIDE 6

6

Four Steps

  • 1. Detect: find above-threshold footprints

and peaks in all images.

  • 2. Associate: merge footprints and peaks

into a single consistent set.

  • 3. Deblend: apportion flux to each peak,

generating children.

  • 4. Measure: run algorithms on child pixels.
slide-7
SLIDE 7

7

Reusing the Four Steps

The Four Steps are mid-level reusable algorithms ("Tasks"), and we use each of them in slightly different ways in different parts of the pipelines, as we produce several different catalogs:

  • Source (single-epoch direct image processing)
  • DIASource (single-epoch difference image processing)
  • Object (multi-epoch/coadd direct image processing)
  • DIAObject/SSObject (multi-epoch difference image processing)
  • ForcedSource (single-epoch forced photometry)
slide-8
SLIDE 8

Data Release Production (Future)

slide-9
SLIDE 9

Data Release Production (Today)

slide-10
SLIDE 10

Alert Production

Association Alert Generation

slide-11
SLIDE 11

Where Deblending Happens

Detection, Deblending, Measurement (only one image at a time, so no association)

slide-12
SLIDE 12

Where Deblending Happens

Detection, Deblending, Measurement Association into DIAObjects happens after Deblending and Measurement

slide-13
SLIDE 13

Where Deblending Happens

Detection, Association, Deblending, Measurement

slide-14
SLIDE 14

Where Deblending Happens

(Partial) Deblending and Measurement only.

slide-15
SLIDE 15

15

  • Doesn't work in crowded stellar fields: need to subtract bright stars before trying to

detect faint stars.

  • Doesn't work around bright galaxies: wings push noise peaks above detection

threshold.

  • Measurement errors don't account for uncertainty in deblending.

15

Problems with the Four Steps

slide-16
SLIDE 16

The SDSS Deblender (in 1-d)

16

a) True profiles (unknown). b) Construct a symmetric template for each peak by taking the maximum of the pixels on opposite sides. c) Jointly fit (linear least squares) amplitudes for all templates in the blend, and reapportion pixel values based on the fractional contribution of each template to each pixel. d) Residuals.

slide-17
SLIDE 17

17

The SDSS Deblender (in 2-d)

Much more likely to have a pristine pixel on one side in 2-d. Three-in-a-row alignments are still a problem, but they were rare enough in SDSS not to be a major problem.

slide-18
SLIDE 18

18

The SDSS Deblender: Heuristics

  • If a template looks like the PSF model, use the PSF model

instead.

  • Don't permit templates to have unphysically sharp features.
  • If two templates are very similar (defined by their dot product),

drop one of them.

  • Assign "stray flux" using 1/r2 law.
slide-19
SLIDE 19

19

The LSST Deblender: Heuristics

  • If a template looks like the PSF model, use the PSF model

instead.

  • Don't permit templates to have unphysically sharp features.
  • If two templates are very similar (defined by their dot product),

drop one of them.

  • Assign "stray flux" using 1/r2 law.
slide-20
SLIDE 20

20

Deblender Status

The LSST reimplementation of the SDSS deblender has worked well enough for HSC to do some great science, but it's also the single biggest problem in the quality of our outputs.

  • Many more blends, and many more three-in-a-row cases,

especially in crowded regions (e.g. galaxy clusters), and those can lead to catastrophic deblending.

  • Faint detections on the outskirts of large objects steal flux from

larger neighbors.

slide-21
SLIDE 21

21

Measuring Deblended Objects

In order to measure a deblended object, we:

  • 1. Replace all above-threshold regions with random noise

generated to match that of the background.

  • 2. Insert the deblended pixels for the target object back into the

image.

  • 3. Run the suite of measurement algorithms.

This assigns flux outside above-threshold regions to all sources instead of assigning it to none.

slide-22
SLIDE 22

22

  • "Deblender" means something very specific in the pipeline right

now: given above-threshold regions and peaks, generated deblended peaks. It doesn't have to always mean that.

  • We run the deblender in several places in the pipelines, and

each time it has a slightly different relationship to the steps before and after it.

  • We're currently using a reimplementation of the SDSS

deblender, but at (coadded) LSST depths, it doesn't work nearly as well as it did for SDSS: the problem is simply much harder.

Summary