Capture and Access Ubiquitous Computing Spring 2007 Matthew Lee - - PowerPoint PPT Presentation
Capture and Access Ubiquitous Computing Spring 2007 Matthew Lee 02-April-2007 your name Readings Remembrance Agent by Bradley Rhodes Designing Capture Applications to Support the Education of Children with Autism by Gillian R. Hayes, Julie
your name
Ubiquitous Computing Spring 2007 Matthew Lee 02-April-2007
your name
Remembrance Agent
by Bradley Rhodes
Designing Capture Applications to Support the Education of Children with Autism
by Gillian R. Hayes, Julie A. Kientz, Khai N. Truong, David R. White, Gregory D. Abowd, Trevor Pering
your name
Software agent monitors in background thread and acts on behalf of the user Remembrance agent senses user’s context and suggests semantically- and contextually- relevant documents, notes, and emails from user’s past
your name
Human memory is associative and contextually-indexed Encoding specificity principle [Tulving 1972] Ubicomp (wearables) can sense context and bring up relevant information
your name
Wearable version of desktop remembrance agent Physical location (GPS) People close by (active badge) Time Content/subject Other context? Scenarios Conference notes/names Classroom notes/related readings Others?
your name
100Mhz 486 Twiddler chord keyboard (30-50wpm) Heads up display (80x25 character screen) IR sensors/beacons
your name
Portable operation Minimize manual input Sensors Proactive Always on, always running Use anytime, not distracting from user’s task
your name
Continuous suggestions (noisy) Notification for important message Authoring documents on the fly Retrieving documents automatically and manually Alternative modalities? (Bluetooth headset) Would you use it?
your name
Remembrance Agent
by Bradley Rhodes
Designing Capture Applications to Support the Education of Children with Autism
by Gillian R. Hayes, Julie A. Kientz, Khai N. Truong, David R. White, Gregory D. Abowd, Trevor Pering
your name
Remembrance Agent
by Bradley Rhodes
Designing Capture Applications to Support the Education of Children with Autism
by Gillian R. Hayes, Julie A. Kientz, Khai N. Truong, David R. White, Gregory D. Abowd, Trevor Pering
your name
Therapy for children with autism (CWA) requires recording, storing, and analyzing large amounts of behavioral data Needfinding ethnography of families and teachers of CWA. Duration, Performance, and Narrative data Three prototypes for three different capture and access tasks: Walden Monitor Abaris CareLog
your name
Setting: Evidence-based assessment Capture: 10 sec video of child with autism, wearer’s notes on tablet PC How: head-mounted camera, tablet PC Access: longitudinal snippets of video of a child, synchronized with notes and ratings
your name
Setting: Speech training therapy Capture: Video of session, performance data entered on tablet PC form How: video camera, tablet PC Access: Synchronized performance data and video
your name
Setting: informal logging children’s behavior anywhere, for diagnosis Capture: occurrence of children’s problem behaviors How: distributed architecture, mobile application, personal server, any wireless device as input Access: graphs of behaviors over time, annotations, narratives
your name
Care Cycle
captured data used for diagnosis, goals, intervention, assessment
Need for rich data
indexing data makes it easier to access
Balance of effort / carer burden
costs are often offset by benefit
Privacy and control
public setting, teachers, liability, ok-zones, discrete data
Financial burdens
costly to instrument every environment, automation reduces costs
your name
Good capture is: minimally intrusive pervasively available comprehensive minimally noisy Capture approaches: always-on manually-initiated sensor-initiated experience-buffer
your name
Good access: not overwhelming well-organized data easy to find and process important information Access approaches: rapid presentation automatic summarization coordinated data streams annotation search and filters
your name
Finding specific information Support episodic memory Share experiences with others Providing evidence Information Permanence Others?