BALANCE: Towards a Usable Pervasive Wellness Application with - - PowerPoint PPT Presentation

balance towards a usable pervasive wellness application
SMART_READER_LITE
LIVE PREVIEW

BALANCE: Towards a Usable Pervasive Wellness Application with - - PowerPoint PPT Presentation

BALANCE: Towards a Usable Pervasive Wellness Application with Pervasive Wellness Application with Accurate Activity Inference Tamara Denning, Adrienne Andrew, Rohit Chaudhri, Carl Hartung, Jonathan Lester, Gaetano Borriello, Glen Duncan


slide-1
SLIDE 1

BALANCE: Towards a Usable Pervasive Wellness Application with Pervasive Wellness Application with Accurate Activity Inference

Tamara Denning, Adrienne Andrew, Rohit Chaudhri, Carl Hartung, Jonathan Lester, Gaetano Borriello, Glen Duncan Presented by: Minh Huynh

CS525 M bil d CS525m – Mobile and Ubiquitous Computing

slide-2
SLIDE 2

BALANCE System (Bioengineering Approaches for Lifestyle Activity (Bioengineering Approaches for Lifestyle Activity and Nutrition Continuous Engagement)

  • Provide a way to monitor the balance between caloric

intake and caloric expenditure intake and caloric expenditure

  • Provide a way to log calorie intake of the user
  • Encourage healthier lifestyles and weight loss

2

  • Make it easy to use

Worcester Polytechnic Institute 2

slide-3
SLIDE 3

BALANCE O i BALANCE Overview

  • Automatically detects the user‘s physical activity via sensor

Automatically detects the user s physical activity via sensor data from a MSP(Mobile Sensing Platform) unit worn on the hip

  • MSP data is transmitted to the mobile phone over a

Bluetooth link

  • Users logs food intake information through the interface of

the mobile phone 3

  • 87% accurate compared to actual results

Worcester Polytechnic Institute 3

slide-4
SLIDE 4

Activity Recognition - Mobile Sensing Platform (MSP)

  • 3-D accelerometer
  • Senses barometric pressure, light,

humidity, sound, position

  • Able to sense sitting, walking,

g, g, running, and bicycling

  • Other activities may be added by

gathering training data and associating that data to the new associating that data to the new activity (Naïve Bayes classifier)

  • MSP computes the step rate and

the number of steps taken S d ti it d t t th ll

4

  • Sends activity data to the cell

phone

  • Only the accelerometer was

utilized in this study

Worcester Polytechnic Institute 4

slide-5
SLIDE 5

BALANCE Software Interface – Main Screen Main Screen

  • Activity data is sent to

the cell phone and the cell phone utilizes this data to determine how many calories the user has burned

  • Can be adjusted to help

the user lose weight in a healthy manner

5 Worcester Polytechnic Institute 5

slide-6
SLIDE 6

BALANCE Software Interface - Summary Screen Summary Screen

  • Serving size is

d i C l i measured in Calorie Hundred Impact Points (CHIPS)

  • 1 CHIP = 100

calories Food items can be

  • Food items can be

grouped for ease of use

6 Worcester Polytechnic Institute 6

slide-7
SLIDE 7

BALANCE Software Interface – Custom Meal Screen Custom Meal Screen

  • Meal items comes from 2
  • Meal items comes from 2

different databases

  • Can add customized meals
  • People usually eat the

similar things for breakfast

  • Future work on adding

location and time awareness features

7 Worcester Polytechnic Institute 7

slide-8
SLIDE 8

BALANCE Software Interface – Daily Activity Screen Daily Activity Screen

  • Activities are
  • Activities are

automatically detected through MSP

  • Activities can be

customized manually

  • Step count obtained

from the MSP F t k i l

8

  • Future work involve

adding more types of activities

Worcester Polytechnic Institute 8

slide-9
SLIDE 9

Usage Scenarios

  • Usage Scenario involving time awareness
  • User sits down for breakfast
  • User begins to eat
  • The time hits 6AM
  • The time hits 6AM
  • Phone reminds the user to enter in food data based
  • n the time
  • Balance is aware of the user’s breakfast time and pulls up

the food database containing breakfast items such as the food database containing breakfast items such as toast and orange juice

  • Usage Scenario involving location awareness

U d id t t t f l h i t d f

  • User decides to eat out for lunch instead of

work cafeteria

  • User drives to favorite restaurant
  • Phone is aware the user is at his favorite

t t

9

restaurant

  • Phone reminds the user to enter food data

based on current location

  • Balance pulls up a food database containing the food

it th ll d

Worcester Polytechnic Institute 9

items the user usually orders

slide-10
SLIDE 10

Metabolic Equations Metabolic Equations

H d BALANCE l l h f l i How does BALANCE calculate the amount of calories burned? By first calculating the amount of oxygen a person uses in liters per minute How is the amount of oxygen a person uses in liters per minute calculated? 10 VO2 = R + H + V Worcester Polytechnic Institute 10

slide-11
SLIDE 11

Metabolic Equations (cont) Metabolic Equations (cont)

VO2 = R + H + V R = The resting metabolic rate of a person R = 3.5ml * kg-1 * min-1

11 Worcester Polytechnic Institute 11

slide-12
SLIDE 12

Metabolic Equations (cont) Metabolic Equations (cont)

VO2 = R + H + V VO2 R H V H = The horizontal component of movement V = The vertical component of movement V The vertical component of movement (walking) H = 0.1 * speed(m/min)ml * kg-1 * min-1 V = 1.8 * speed(m/min) * grade(as decimal)ml * kg-1 * min-1

12 Worcester Polytechnic Institute 12

slide-13
SLIDE 13

Metabolic Equations (cont) Metabolic Equations (cont)

(running) H 0 2 d( / i ) l * k

1 *

i

1

H = 0.2 x speed(m/min)ml * kg-1 * min-1 V = 0.9 x speed(m/min)ml x grade(as decimal)ml * kg-1 * min-1 13 Worcester Polytechnic Institute 13

slide-14
SLIDE 14

Metabolic Equations (cont) Metabolic Equations (cont)

How do we convert oxygen consumption to calories burned? VO2 x 5 kcal/min = caloric expenditure

14 Worcester Polytechnic Institute 14

slide-15
SLIDE 15

Validation

Several treadmill experiments were conducted to compare the estimated caloric expenditure against the actual caloric expenditure How was the actual caloric expenditure. expenditure obtained? Whil i th MSP While wearing the MSP device, subjects were also connected to a metabolic cart that measured the

15

actual oxygen consumption.

Worcester Polytechnic Institute 15

slide-16
SLIDE 16

Validation (cont)

  • 10 people chosen to carry out the lab tests
  • Lab tests were designed to test sitting, standing, walking, and running
  • 3 minute sitting stage
  • 2 minute standing stage

6 th i t lki / i t

  • 6 three minute walking/running stages
  • 5 minute sitting stage
  • Subjects were fitted with heart rate monitors to detect if they were

Subjects were fitted with heart rate monitors to detect if they were being over exercised (when heart-rate exceeded 220 – age)

  • Overall accuracy was 87%

16

  • Estimates were generally lower than the actual results

Worcester Polytechnic Institute 16

slide-17
SLIDE 17

S l D t f lki / i t Sample Data of walking/running stages

MPH 1 8 2 5 3 0 3 5 4 5 4 5 MPH 1.8 2.5 3.0 3.5 4.5 4.5 Grade 0% 5% 0% 7.5% 0% 2.5% Experimental Walking/Running Stages

17 Worcester Polytechnic Institute 17

slide-18
SLIDE 18

18 Worcester Polytechnic Institute 18

slide-19
SLIDE 19

Estimated (red, rectilinear) vs. actual caloric expenditure ( , ) p 19 Worcester Polytechnic Institute 19

slide-20
SLIDE 20

Future Work

  • Execute field tests
  • Use change in barametric pressure to calculate the incline

instead of using treadmill data

  • Utilize the GPS on the phone instead of having to rely on

data from the treadmill data from the treadmill

  • Add more common daily activities for the calculations of

caloric consumption Add 65 t t bj t ith i d i ht

  • Add 65 test subjects with varying ages and weights
  • Add time, context and location awareness to improve the interface

20

  • Conduct focus groups to obtain feedback on use of BALANCE system

Worcester Polytechnic Institute 20

slide-21
SLIDE 21

Related Works

  • DietTV.com – Commercial web application for managing

exercise and food choices exercise and food choices

  • Keyoe – PDA-based application for recording consumed foods

and exercises

  • iShape and Absolute Fitness – Apps from the iPhone app store
  • Wellness Diary – Application made for the Nokia S60 phone

y pp p (inputs and tracks exercise and food choices)

  • PmEB system – Mobile phone application also similar to

BALANCE food tracking abilities

21

BALANCE food tracking abilities

Worcester Polytechnic Institute 21

slide-22
SLIDE 22

Related Works (cont) ( )

  • UbiFit Wellness system – Automatically detects five activities

from a fitness device attached to the user’s hip: from a fitness device attached to the user s hip: walking, running, bicycling, elliptical trainer, and stair stepping machine; Activities nurture an electronic garden display on the user’s cell phone

  • PDA based application - For semi-literate patients with kidney

disease; system offers barcode scanning and voice recording for entering food data g g

  • DietSense – Food tracking is done through photographic input

from the user’s cell phone camera

22

  • BALANCE system is the first system to combine food tracking

with real-time activity inference

Worcester Polytechnic Institute 22

slide-23
SLIDE 23

Questions? Q

23 Worcester Polytechnic Institute 23