Video Based Heart Rate Monitoring Jian LIN, David ROZADO, Andreas - - PowerPoint PPT Presentation

video based heart rate monitoring
SMART_READER_LITE
LIVE PREVIEW

Video Based Heart Rate Monitoring Jian LIN, David ROZADO, Andreas - - PowerPoint PPT Presentation

Video Based Heart Rate Monitoring Jian LIN, David ROZADO, Andreas DUENSER 04 August 2015 DIGITAL PRODUCTIVITY HR monitoring https://itunes.apple.com/au/app/instant-heart-rate-heart-rate/id409625068?mt=8 http://www.newegg.com 2 | Video Based


slide-1
SLIDE 1

Video Based Heart Rate Monitoring

DIGITAL PRODUCTIVITY

Jian LIN, David ROZADO, Andreas DUENSER 04 August 2015

slide-2
SLIDE 2

Video Based Heart Rate Monitoring | Andreas Duenser

HR monitoring

2 |

http://www.newegg.com https://itunes.apple.com/au/app/instant-heart-rate-heart-rate/id409625068?mt=8

slide-3
SLIDE 3
  • Why?
  • Contact / touch-less; untethered
  • Existing hardware
  • Cheap (webcam)
  • Non-proprietary

hardware & software

Video Based Heart Rate Monitoring | Andreas Duenser

Video based HR monitoring

3 |

slide-4
SLIDE 4
  • Application areas
  • Medical
  • Self monitoring
  • Human Computer Interaction

– novel interfaces / monitoring

  • Exergaming

Video Based Heart Rate Monitoring | Andreas Duenser

Video based HR monitoring

4 |

http://www.fitness-gaming.com/news/markets/schools/ekho-heart-rate-team-system-for- schools.html#.VbsF97eQPqo http://www.geek.com/games/playing-halo-hooked-up-to-heart-rate- monitor-1308673/ L Tarassenko and M Villarroel and A Guazzi and J Jorge and D A Clifton and C Pugh. (2014). Non-contact video-based vital sign monitoring using ambient light and auto-regressive models. Physiological

  • Measurement. 35(5), pp. 807.
slide-5
SLIDE 5
  • Application areas
  • Affective / physiological computing
  • Monitoring mental work load
  • Biofeedback
  • Occupational health and safety

Video Based Heart Rate Monitoring | Andreas Duenser

Video based HR monitoring

5 |

http://www.truckaccidentattorneysroundtable.com/blog/facial-recognition-technology- predict-truck-accidents/

slide-6
SLIDE 6
  • Detect HR through:
  • hidden signal (blood flow) underneath the skin

– face detection and a skin color filter – exclude background and unwanted information in the frame

  • Use Red, Green, and Blue video channel as an independent time-

series signal

  • Independent Component Analysis (ICA) to extract the hidden HR

signal from the three components

Video Based Heart Rate Monitoring | Andreas Duenser

Our Approach

6 |

slide-7
SLIDE 7

Video Based Heart Rate Monitoring | Andreas Duenser

Our Approach

7 |

http://people.csail.mit.edu/mrub/vidmag/

slide-8
SLIDE 8

Our Approach

Video Based Heart Rate Monitoring | Andreas Duenser 8 |

slide-9
SLIDE 9
  • Approach based on method by Poh et al.
  • We introduce several enhancements:
  • skin color filter
  • raw data detrending
  • pulse spectral maximum frequency-density selection (PSMFS)
  • Kalman filter into the methodology

Video Based Heart Rate Monitoring | Andreas Duenser

Our Approach

9 |

slide-10
SLIDE 10

Process

Video Based Heart Rate Monitoring | Andreas Duenser 10 |

Video capture Face tracker ICA Skin colour filter Signal enhancement (data detrending)

Pulse Spectral Maximum Frequency-Density Selection

(PSMFS) Kalman filter

slide-11
SLIDE 11

Video Based Heart Rate Monitoring | Andreas Duenser 11 |

slide-12
SLIDE 12
  • 15 participants (2 females) 20-35 years
  • 3 minute sessions
  • Web cam (30 fps, 640*480)
  • 2 participants
  • 5 * 2-minute recordings after exercise

(jump squats)

  • Pulse Oximeter: CONTEC CMS60D

Video Based Heart Rate Monitoring | Andreas Duenser

Evaluation

12 |

http://www.newegg.com

slide-13
SLIDE 13

Results

Video Based Heart Rate Monitoring | Andreas Duenser 13 |

slide-14
SLIDE 14

Results

Video Based Heart Rate Monitoring | Andreas Duenser 14 |

slide-15
SLIDE 15

Discussion / Conclusion

  • Our approach improves accuracy over original approach
  • 7.7 bpm vs. 2.7 bpm difference to benchmark
  • Accuracy after exertion low (error 23.4 bpm)
  • Maybe due to faster changes in HR – frequency smearing
  • Lighting has impact (e.g. natural vs. artificial light)
  • Background potential impact
  • Webcams sampling rate relatively low
  • at least 5 second video needed
  • better cameras may improve performance

Video Based Heart Rate Monitoring | Andreas Duenser 15 |

slide-16
SLIDE 16

Discussion / Conclusion

  • Many new opportunities & limitations
  • Medical applications - accuracy?
  • Human Computer Interaction, Gaming,
  • Self monitoring
  • Occupational health and safety

Video Based Heart Rate Monitoring | Andreas Duenser 16 |

slide-17
SLIDE 17

Digital Productivity Andreas Duenser t +61 3 6237 5678 E andreas.duenser@csiro.au w www.csiro.au

DIGITAL PRODUCTIVITY