Siamese Tracking of Cell Behaviour Patterns #109, MIDL 2020 - - PowerPoint PPT Presentation

siamese tracking of cell behaviour patterns
SMART_READER_LITE
LIVE PREVIEW

Siamese Tracking of Cell Behaviour Patterns #109, MIDL 2020 - - PowerPoint PPT Presentation

Siamese Tracking of Cell Behaviour Patterns #109, MIDL 2020 University of Amsterdam Andreas Panteli, Deepak K. Gupta, Nathan de Bruijn, Efstratios Gavves Content Motivation Problem introduction Our solution Results Finding cells


slide-1
SLIDE 1

Siamese Tracking of Cell Behaviour Patterns

#109, MIDL 2020

Andreas Panteli, Deepak K. Gupta, Nathan de Bruijn, Efstratios Gavves University of Amsterdam

slide-2
SLIDE 2

Content

  • Motivation
  • Problem introduction
  • Our solution
  • Results
slide-3
SLIDE 3

Finding cells

slide-4
SLIDE 4

Finding cells

  • Impartial Information
slide-5
SLIDE 5

Finding cells

  • Impartial Information
  • Fluid/Biological movement
slide-6
SLIDE 6

Finding cells

  • Impartial Information
  • Fluid/Biological movement
  • Different cell morphologies
slide-7
SLIDE 7

Goal

  • Correctly identify cells in frames
  • Track them through time
  • Identify cell mitosis, collision and apoptosis
slide-8
SLIDE 8

Problem introduction

  • Trade-off in segmentation algorithms between:

– Detecting large cells with non-colliding boundaries – Over-segmenting cells to smaller ones

slide-9
SLIDE 9

Problem introduction

  • Over-parametrised approaches for specific cell

morphologies

slide-10
SLIDE 10

Problem introduction

  • Ignore biological cell behaviour

Collision Mitosis

slide-11
SLIDE 11

Our approach

t-1 t-2 t

Siamese Matching Re-segmentation

slide-12
SLIDE 12

Our approach

  • Model cell behaviour:

– Collision (2 cells collide) – Mitosis (1 cell divides into 2) – Consider it the same but in

  • pposite temporal direction

– Cell apoptosis/death (cell does not continue in the next

frame

t-1 t-2 t

Siamese Matching

Re-segmentation

slide-13
SLIDE 13

Our approach

  • Model cell behaviour
  • Siamese matching:

– Track cells in both the forward

and backward direction

– Matches and corrects the location

  • f the cell to be split

– Ensures splitting the cell correctly by predicting its location

t-1 t-2 t

Siamese Matching

Re-segmentation

slide-14
SLIDE 14

Our approach

  • Model cell behaviour
  • Siamese matching
  • Re-segment collided cells:

– Use watershed deconvolution

with the centroids of the pre-collision cells

t-1 t-2 t

Siamese Matching

Re-segmentation

slide-15
SLIDE 15

Results

DIC-C2DH-HeLa Fluo-N2DH- SIM+ PhC-C2DL-PSC Method OPCSB OPCTB OPCSB OPCTB OPCSB OPCTB ISBI CTC1 3rd entry 0.884 0.848 0.887 0.882 0.808 0.804 ISBI CTC1 2nd entry 0.895 0.894 0.890 0.889 0.809 0.804 ISBI CTC1 1st entry 0.912 0.909 0.896 0.895 0.841 0.836 Ours 0.905 0.904 0.897 0.896 0.846 0.843

  • 1. http://celltrackingchallenge.net/, as of 30th of January
slide-16
SLIDE 16

Our approach benefits

  • Enhances segmentation performance by re-

segmenting and correcting initial predictions

  • Robust to morphology variations and

fluid/biological cell behaviour

  • Generalises well across different datasets
slide-17
SLIDE 17

Summary

t-1 t-2 t

Siamese Matching Re-segmentation

slide-18
SLIDE 18

Thank you for your attention

  • Code available at:

gitlab.com/Baggsy/cell_tracking_2019