Streaming Sensor Data from the Home What does it all mean? How can - - PowerPoint PPT Presentation
Streaming Sensor Data from the Home What does it all mean? How can it help you? ! Holly%Jimison,%Misha%Pavel,%% Xuan%Sean%Li,%Krissy%Mainello% College%of%Computer%&%InformaAon%Science% Bouve%College%of%Health%Sciences%
!
College%of%Computer%&%InformaAon%Science% Bouve%College%of%Health%Sciences% ConsorAum%on%Technology%for%ProacAve%Care%
Northeastern%University%
%
!
!
!
What does it all mean? How can it help you?
– Na&onal!Science!Founda&on! – Na&onal!Ins&tute!on!Aging! – Alzheimer’s!Associa&on!/!Intel!Company! – Na&onal!Ins&tute!on!Standards!&!Technology! – TEKES!(Finland!Government)!
'
– Oregon!Health!&!Science!University! – University!of!California!at!Berkeley!
! Sensors, algorithms, mobile communications for
lifestyle interventions
! Remote, just-in-time, continuous care ! Incorporate principles of health behavior change ! Optimal use of lower cost personnel ! Integrate family & informal caregivers into the health
care team (untapped resource)
! Platform for testing sustained cognitive interventions
in the home
! Cognitive Exercise (computer game format) ! Novelty exercise ! Physical Exercise ! Sleep Management ! Socialization ! Medication Management ! Mood Management (depression)
Behavioral Markers = Continuous Monitoring & Computational Models
Home health based on unobtrusive, continuous monitoring
6
Pavel et al., IEEE Special Issue, in press
Hayes, ORCATECH 2007
Bedroom Bathroom Living Rm Front Door Kitchen
Sensor Events Private Home Activity Monitoring in the Home
Hayes et al., www.orcatech.org
Hayes, ORCATECH 2007
Sensor Events Residential Facility
Bedroom Bathroom Living Rm Front Door Kitchen
Activity Monitoring in the Home
Hayes et al., www.orcatech.org
infrared'(PIR)'sensors'<'Hagler,%et%al.,%IEEE%Trans%Biomed%Eng,%2010% – Four!restricted!view!PIR!sensors! – Measure!gait!velocity!whenever!a! – ! subjects!passes!through!the!! – ! “sensorVline”! – Deployed!for!the!Intelligent!! – !!!!Systems!for!Assessing!! – !!!!Aging!Changes!(ISAAC)!study! – 200+!subjects!monitored!for!>!4!years!
9
12/07 08/08 11/09 12/10 30 40 50 60 70 80 90
Time Velocity (cm/s)
0.005 0.01 0.015 0.02 0.025 0.03 0.035 Stroke
10
Aus&n!et!al,!Sept!2011!V!EMBC!(Gait)!
07/07 02/09 09/10 50 60 70 80 90
Time Velocity (cm/s)
0.005 0.01 0.015 0.02 0.025 0.03 0.035 0.04 0.045 0.05 CDR=0.5 and MCI diagnosis
11
Aus&n!et!al,!Sept!2011!V!EMBC!(Gait)!
Family Interface
monitoring
care
– Oregon!Health!and!Science!University! – University!California!Berkeley!
tailored'exercise'and'Kinect' Camera'
image'interpreta5on'from'Kinect' skeleton'representa5on'
strength,'endurance'
14
Assessment
Tailored Intervention
! Web cams and Skype software given to participants
and their remote family partner
! Frequent spontaneous use among participants
16
17
18
Search for Next Target Move to Next Target
Recall Next Target
19
2
0.78 R = 0.0001 p <
B B A B A C B A C D B A C D A B C D E C D E B C D E B C D E B F D E B F B D E F G D E F G H E F G H D E F G H D G E F H D E F H D I
Characterize Memory Capacity
Simple Memory Model: Discrete Buffer
5 10 15 0.5 1
Subject 1020, N = 8687 Probability of Correct Intervening Number of Events
5 10 15 20 25 0.5 1
Probability of Correct Intervening Time [sec]
Characterize Memory Capacity with a Single Parameter
M Pavel, et al., www.ORCATECH.org
Family Interface
monitoring
care
Family Caregiver Interface
Link to Demo
– Adap&ve!Computer!Games!–!Divided!Aaen&on,!Planning,!Memory,! Verbal!Fluency,!+++! – Linguis&c!Complexity!–!Emails,!phone!
– Speed!of!Walking,!Computer!Typing,!Mouse!Movements!
23