Tracking H akan Ard o February 22, 2012 H akan Ard o Tracking - - PowerPoint PPT Presentation

tracking
SMART_READER_LITE
LIVE PREVIEW

Tracking H akan Ard o February 22, 2012 H akan Ard o Tracking - - PowerPoint PPT Presentation

Introduction Tracking Tracking H akan Ard o February 22, 2012 H akan Ard o Tracking February 22, 2012 1 / 51 Introduction Tracking Sliding Window Detection Outline Introduction 1 Sliding Window Detection Tracking 2


slide-1
SLIDE 1

Introduction Tracking

Tracking

H˚ akan Ard¨

  • February 22, 2012

H˚ akan Ard¨

  • Tracking

February 22, 2012 1 / 51

slide-2
SLIDE 2

Introduction Tracking Sliding Window Detection

Outline

1

Introduction Sliding Window Detection

2

Tracking Greedy Kalman filter Particle filter

H˚ akan Ard¨

  • Tracking

February 22, 2012 2 / 51

slide-3
SLIDE 3

Introduction Tracking Sliding Window Detection

Sliding window detectors

H˚ akan Ard¨

  • Tracking

February 22, 2012 3 / 51

slide-4
SLIDE 4

Introduction Tracking Sliding Window Detection

Detection probability

H˚ akan Ard¨

  • Tracking

February 22, 2012 4 / 51

slide-5
SLIDE 5

Introduction Tracking Greedy Kalman filter Particle filter

Greedy tracker

H˚ akan Ard¨

  • Tracking

February 22, 2012 5 / 51

slide-6
SLIDE 6

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 1

STC Lecture Series An Introduction to the Kalman Filter

Greg Welch and Gary Bishop

University of North Carolina at Chapel Hill Department of Computer Science

http://www.cs.unc.edu/~welch/kalmanLinks.html

H˚ akan Ard¨

  • Tracking

February 22, 2012 6 / 51

slide-7
SLIDE 7

Introduction Tracking Greedy Kalman filter Particle filter

Sanjay Patil1 and Ryan Irwin2 Graduate research assistant1, REU undergrad2 Human and Systems Engineering

URL: www.isip.msstate.edu/publications/seminars/msstate/2005/particle/

HUMAN AND SYSTEMS ENGINEERING:

Gentle Introduction to Particle Filtering

H˚ akan Ard¨

  • Tracking

February 22, 2012 7 / 51

slide-8
SLIDE 8

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 5

Some Intuition

H˚ akan Ard¨

  • Tracking

February 22, 2012 8 / 51

slide-9
SLIDE 9

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 6

First Estimate

ˆ x

1 = z1

ˆ σ

2 1 = σ 2 z1

Conditional Density Function

14 12 10 8 6 4 2

  • 2

N(z1,σz1

2 )

z1 σ 2

z1

,

H˚ akan Ard¨

  • Tracking

February 22, 2012 9 / 51

slide-10
SLIDE 10

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 7

Second Estimate

Conditional Density Function

z2 σ 2

z2

,

ˆ x

2 =...?

ˆ σ

2 2 = ...?

14 12 10 8 6 4 2

  • 2

N(z2,σz2

2 )

H˚ akan Ard¨

  • Tracking

February 22, 2012 10 / 51

slide-11
SLIDE 11

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 8

Combine Estimates

= σ z2

2

σ z1

2 + σ z2 2

( )

[ ]z1+ σ z1

2

σ z1

2 + σ z2 2

( )

[ ]z2

ˆ

x

2

= ˆ x

1 + K2 z2 − ˆ

x

1

[ ]

where

K2 = σ z1

2

σ z1

2 + σ z2 2

( )

H˚ akan Ard¨

  • Tracking

February 22, 2012 11 / 51

slide-12
SLIDE 12

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 9

Combine Variances

1 σ 2 = 1 σ z1

2

( )+ 1 σ z2

2

( )

2

H˚ akan Ard¨

  • Tracking

February 22, 2012 12 / 51

slide-13
SLIDE 13

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 10

Combined Estimate Density

ˆ x = ˆ σ

2 = σ 2

2

ˆ

x

2

14 12 10 8 6 4 2

  • 2

Conditional Density Function N( σ 2)

ˆ

x,ˆ

H˚ akan Ard¨

  • Tracking

February 22, 2012 13 / 51

slide-14
SLIDE 14

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 11

Add Dynamics dx/dt = v + w

where v is the nominal velocity w is a noise term (uncertainty)

H˚ akan Ard¨

  • Tracking

February 22, 2012 14 / 51

slide-15
SLIDE 15

Introduction Tracking Greedy Kalman filter Particle filter

Page 7 of 20 Particle Filtering – Gentle Introduction and Implementation Demo

Particle filtering algorithm step-by-step (1)

H˚ akan Ard¨

  • Tracking

February 22, 2012 15 / 51

slide-16
SLIDE 16

Introduction Tracking Greedy Kalman filter Particle filter

Page 8 of 20 Particle Filtering – Gentle Introduction and Implementation Demo

Particle filtering step-by-step (2)

H˚ akan Ard¨

  • Tracking

February 22, 2012 16 / 51

slide-17
SLIDE 17

Introduction Tracking Greedy Kalman filter Particle filter

Page 9 of 20 Particle Filtering – Gentle Introduction and Implementation Demo

Particle filtering step-by-step (3)

H˚ akan Ard¨

  • Tracking

February 22, 2012 17 / 51

slide-18
SLIDE 18

Introduction Tracking Greedy Kalman filter Particle filter

Page 10 of 20 Particle Filtering – Gentle Introduction and Implementation Demo

Particle filtering step-by-step (4)

H˚ akan Ard¨

  • Tracking

February 22, 2012 18 / 51

slide-19
SLIDE 19

Introduction Tracking Greedy Kalman filter Particle filter

Page 11 of 20 Particle Filtering – Gentle Introduction and Implementation Demo

Particle filtering step-by-step (5)

H˚ akan Ard¨

  • Tracking

February 22, 2012 19 / 51

slide-20
SLIDE 20

Introduction Tracking Greedy Kalman filter Particle filter

Page 12 of 20 Particle Filtering – Gentle Introduction and Implementation Demo

Particle filtering step-by-step (6)

H˚ akan Ard¨

  • Tracking

February 22, 2012 20 / 51

slide-21
SLIDE 21

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 13

Some Details

x x A A x x w w z z H H x x . . . . . . . . = + =

H˚ akan Ard¨

  • Tracking

February 22, 2012 21 / 51

slide-22
SLIDE 22

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 14

Discrete Kalman Filter

Maintains first two statistical moments

process state (mean) error covariance z y x

H˚ akan Ard¨

  • Tracking

February 22, 2012 22 / 51

slide-23
SLIDE 23

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 16

Necessary Models

measurement model dynamic model

previous state next state state measurement

image plane

( u , v )

H˚ akan Ard¨

  • Tracking

February 22, 2012 23 / 51

slide-24
SLIDE 24

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 17

The Process Model

x k+1 = Axk + wk zk = Hxk + vk

Process Dynamics Measurement

H˚ akan Ard¨

  • Tracking

February 22, 2012 24 / 51

slide-25
SLIDE 25

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 18

Process Dynamics

x k+1 = Axk + wk

xk ∈ Rn contains the states of the process

state vector

H˚ akan Ard¨

  • Tracking

February 22, 2012 25 / 51

slide-26
SLIDE 26

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 19

Process Dynamics

nxn matrix A relates state at time step k to time step k+1

state transition matrix

x k+1 = Axk + wk

H˚ akan Ard¨

  • Tracking

February 22, 2012 26 / 51

slide-27
SLIDE 27

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 20

Process Dynamics process noise

wk ∈ Rn models the uncertainty of the process wk ~ N(0, Q)

x k+1 = Axk + wk

H˚ akan Ard¨

  • Tracking

February 22, 2012 27 / 51

slide-28
SLIDE 28

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 21

Measurement

zk = Hxk + vk

zk ∈ Rm is the process measurement

measurement vector

H˚ akan Ard¨

  • Tracking

February 22, 2012 28 / 51

slide-29
SLIDE 29

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 22

Measurement

zk = Hxk + vk

state vector

H˚ akan Ard¨

  • Tracking

February 22, 2012 29 / 51

slide-30
SLIDE 30

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 23

Measurement

mxn matrix H relates state to measurement

measurement matrix

zk = Hxk + vk

H˚ akan Ard¨

  • Tracking

February 22, 2012 30 / 51

slide-31
SLIDE 31

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 24

Measurement measurement noise

zk ∈ Rm models the noise in the measurement vk ~ N(0, R)

zk = Hxk + vk

H˚ akan Ard¨

  • Tracking

February 22, 2012 31 / 51

slide-32
SLIDE 32

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 25

State Estimates

a priori state estimate a posteriori state estimate

ˆ x –

k

ˆ xk

H˚ akan Ard¨

  • Tracking

February 22, 2012 32 / 51

slide-33
SLIDE 33

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 26

Estimate Covariances

a priori estimate error covariance a posteriori estimate error covariance

Pk

– = E[(xk- xk –)(xk - xk –)T]

ˆ ˆ

Pk = E[(xk- xk)(xk - xk)T]

ˆ ˆ

H˚ akan Ard¨

  • Tracking

February 22, 2012 33 / 51

slide-34
SLIDE 34

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 27

Filter Operation

Time update (a priori estimates) Measurement update (a posteriori estimates)

Project state and covariance forward to next time step, i.e. predict Update with a (noisy) measurement

  • f the process, i.e. correct

H˚ akan Ard¨

  • Tracking

February 22, 2012 34 / 51

slide-35
SLIDE 35

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 28

Time Update (Predict)

state error covariance

H˚ akan Ard¨

  • Tracking

February 22, 2012 35 / 51

slide-36
SLIDE 36

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 29

Measurement Update (Correct)

H˚ akan Ard¨

  • Tracking

February 22, 2012 36 / 51

slide-37
SLIDE 37

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 30

Time Update (Predict)

a priori state and error covariance

ˆ

xk+1 = Axk

Pk+1 = APk A + Q

H˚ akan Ard¨

  • Tracking

February 22, 2012 37 / 51

slide-38
SLIDE 38

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 31

Measurement Update (Correct)

a posteriori state and error covariance Kalman gain

ˆ

xk = xk + Kk (zk - Hxk )

ˆ ˆ

– –

Pk = (I - Kk H)Pk

Kk = Pk HT(HPk HT + R)-1

– –

H˚ akan Ard¨

  • Tracking

February 22, 2012 38 / 51

slide-39
SLIDE 39

Introduction Tracking Greedy Kalman filter Particle filter

UNC Chapel Hill Computer Science Slide 32

Filter Operation

Time Update (Predict) Measurement (Correct) Update

H˚ akan Ard¨

  • Tracking

February 22, 2012 39 / 51

slide-40
SLIDE 40

Introduction Tracking Greedy Kalman filter Particle filter

Kalman filter tracker

H˚ akan Ard¨

  • Tracking

February 22, 2012 40 / 51

slide-41
SLIDE 41

Introduction Tracking Greedy Kalman filter Particle filter

Kalman filter tracker

H˚ akan Ard¨

  • Tracking

February 22, 2012 41 / 51

slide-42
SLIDE 42

Introduction Tracking Greedy Kalman filter Particle filter

Kalman filter tracker

H˚ akan Ard¨

  • Tracking

February 22, 2012 42 / 51

slide-43
SLIDE 43

Introduction Tracking Greedy Kalman filter Particle filter

Kalman filter tracker

H˚ akan Ard¨

  • Tracking

February 22, 2012 43 / 51

slide-44
SLIDE 44

Introduction Tracking Greedy Kalman filter Particle filter

Particle filter

H˚ akan Ard¨

  • Tracking

February 22, 2012 44 / 51

slide-45
SLIDE 45

Introduction Tracking Greedy Kalman filter Particle filter

Patricle filter states

Current state

  • x(1)

k , x(2) k , x(3) k , · · · , x(n) k

  • Predicted state (a priori state extimate)
  • x−(1)

k+1 , x−(2) k+1 , x−(3) k+1 , · · · , x−(n) k+1

  • Corrected state (a posteriori state extimate)
  • x(1)

k+1, x(2) k+1, x(3) k+1, · · · , x(n) k+1

akan Ard¨

  • Tracking

February 22, 2012 45 / 51

slide-46
SLIDE 46

Introduction Tracking Greedy Kalman filter Particle filter

Patricle filter states

Current state

  • x(1)

k , x(2) k , x(3) k , · · · , x(n) k

  • Predicted state (a priori state extimate)
  • x−(1)

k+1 , x−(2) k+1 , x−(3) k+1 , · · · , x−(n) k+1

  • Corrected state (a posteriori state extimate)
  • x(1)

k+1, x(2) k+1, x(3) k+1, · · · , x(n) k+1

akan Ard¨

  • Tracking

February 22, 2012 45 / 51

slide-47
SLIDE 47

Introduction Tracking Greedy Kalman filter Particle filter

Patricle filter states

Current state

  • x(1)

k , x(2) k , x(3) k , · · · , x(n) k

  • Predicted state (a priori state extimate)
  • x−(1)

k+1 , x−(2) k+1 , x−(3) k+1 , · · · , x−(n) k+1

  • Corrected state (a posteriori state extimate)
  • x(1)

k+1, x(2) k+1, x(3) k+1, · · · , x(n) k+1

akan Ard¨

  • Tracking

February 22, 2012 45 / 51

slide-48
SLIDE 48

Introduction Tracking Greedy Kalman filter Particle filter

Dynamic model

Any sthocastic model from which we can sample f (xk+1 |xk ) Example: The dynamic model from the kalman filter xk+1 = Axk + wk f (xk+1 |xk ) = N(Axk, Q)

H˚ akan Ard¨

  • Tracking

February 22, 2012 46 / 51

slide-49
SLIDE 49

Introduction Tracking Greedy Kalman filter Particle filter

Dynamic model

Any sthocastic model from which we can sample f (xk+1 |xk ) Example: The dynamic model from the kalman filter xk+1 = Axk + wk f (xk+1 |xk ) = N(Axk, Q)

H˚ akan Ard¨

  • Tracking

February 22, 2012 46 / 51

slide-50
SLIDE 50

Introduction Tracking Greedy Kalman filter Particle filter

Particle filter prediction step

Propagate each particle i, separately The prediction x−(i)

k+1 is choosen as a sample from

f

  • xk+1
  • x(i)

k

akan Ard¨

  • Tracking

February 22, 2012 47 / 51

slide-51
SLIDE 51

Introduction Tracking Greedy Kalman filter Particle filter

Measurement model

Any sthocastic model from which we can calculate likelihoods f (zk |xk ) Example: The measurement model from the kalman filter zk = Hxk + vk f (zk |xk ) = N(Hxk, R)

H˚ akan Ard¨

  • Tracking

February 22, 2012 48 / 51

slide-52
SLIDE 52

Introduction Tracking Greedy Kalman filter Particle filter

Measurement model

Any sthocastic model from which we can calculate likelihoods f (zk |xk ) Example: The measurement model from the kalman filter zk = Hxk + vk f (zk |xk ) = N(Hxk, R)

H˚ akan Ard¨

  • Tracking

February 22, 2012 48 / 51

slide-53
SLIDE 53

Introduction Tracking Greedy Kalman filter Particle filter

Particle filter correction step

The measurement model gives a weight for each particle, i w(i)

k

= f

  • zk
  • x−(i)

k

  • Resample the set of particles using the weights

Each corrected particle, x(i)

k , is choosen randomly

x(i)

k

= x−(j)

k

for some random j The probability of choosing sample j is w(j)

k

  • l w(l)

k

The same particle may be choosen several times

H˚ akan Ard¨

  • Tracking

February 22, 2012 49 / 51

slide-54
SLIDE 54

Introduction Tracking Greedy Kalman filter Particle filter

Particle filter correction step

The measurement model gives a weight for each particle, i w(i)

k

= f

  • zk
  • x−(i)

k

  • Resample the set of particles using the weights

Each corrected particle, x(i)

k , is choosen randomly

x(i)

k

= x−(j)

k

for some random j The probability of choosing sample j is w(j)

k

  • l w(l)

k

The same particle may be choosen several times

H˚ akan Ard¨

  • Tracking

February 22, 2012 49 / 51

slide-55
SLIDE 55

Introduction Tracking Greedy Kalman filter Particle filter

Particle filter correction step

The measurement model gives a weight for each particle, i w(i)

k

= f

  • zk
  • x−(i)

k

  • Resample the set of particles using the weights

Each corrected particle, x(i)

k , is choosen randomly

x(i)

k

= x−(j)

k

for some random j The probability of choosing sample j is w(j)

k

  • l w(l)

k

The same particle may be choosen several times

H˚ akan Ard¨

  • Tracking

February 22, 2012 49 / 51

slide-56
SLIDE 56

Introduction Tracking Greedy Kalman filter Particle filter

Particle filter correction step

The measurement model gives a weight for each particle, i w(i)

k

= f

  • zk
  • x−(i)

k

  • Resample the set of particles using the weights

Each corrected particle, x(i)

k , is choosen randomly

x(i)

k

= x−(j)

k

for some random j The probability of choosing sample j is w(j)

k

  • l w(l)

k

The same particle may be choosen several times

H˚ akan Ard¨

  • Tracking

February 22, 2012 49 / 51

slide-57
SLIDE 57

Introduction Tracking Greedy Kalman filter Particle filter

Particle filter correction step

The measurement model gives a weight for each particle, i w(i)

k

= f

  • zk
  • x−(i)

k

  • Resample the set of particles using the weights

Each corrected particle, x(i)

k , is choosen randomly

x(i)

k

= x−(j)

k

for some random j The probability of choosing sample j is w(j)

k

  • l w(l)

k

The same particle may be choosen several times

H˚ akan Ard¨

  • Tracking

February 22, 2012 49 / 51

slide-58
SLIDE 58

Introduction Tracking Greedy Kalman filter Particle filter

Particle filter

H˚ akan Ard¨

  • Tracking

February 22, 2012 50 / 51

slide-59
SLIDE 59

Introduction Tracking Greedy Kalman filter Particle filter

Particle filter tracker

H˚ akan Ard¨

  • Tracking

February 22, 2012 51 / 51