Interaction in older adults with Mild Cognitive Impairments - - PowerPoint PPT Presentation

Human Robot Interaction in older adults with Mild Cognitive Impairments

Eleonora Zedda ~ University of Pisa and ISTI-CNR eleonora.zedda@phd.unipi.it

Outline

Motivation Cognitive Degeneration Mild Cognitive Impairments Socially Assistive Robots First study Preliminary Results Future Works

Motivation-Aging of Italian Population

istat.it

Average Age

Motivation-Aging of Italian Population

istat.it

Average Age

Average Age 2017

Degeneration in cognitive and physical domain Gap health system Increased number of caregivers Assistive technologies

Motivation

Cognitive decline normal age Mild Cognitive Impairments (MCI) Alzheimer's disease

Cognitive Degeneration

Dementia Predementia Preclinical Asymptomatic stage Severe cognitive degeneration Middle cognitive degeneration

completion of complex tasks reduced coordination of brain activity performance of different cognitive domains (attention, memory, ..) maintain their independence during the activities of daily living Mild Cognitive Impairments Predementia

Cognitive Degeneration

The MCI people are at high risk of dementia; every year about 10% of MCI people progress to dementia

Mild Cognitive Impairments

Assistive technologies Reducing the incidence of dementia. Cognitive and physical training Improve cognitive performance Intervene as soon as possible

MCI Interventions

Assistive technologies paper-based material Assistive technologies computer-based support

Assistive Technologies

Socially Assistive Robot

Providing assistance and achieving measurable progress in convalescence, rehabilitation, learning

Socially Assistive Robotics(SAR)

More engagement Different type of interaction (voice, gesture, …) Fill the gap between current healthcare and self-care Users did not experience any anxiety

Benefit SAR

Features helps the user to facilitate the interaction with the robot Secure environments

HIIS Laboratory ISTI-CNR collaboration with Institute of Neuroscience-CNR Investigate how seniors with MCI relate and perceived a cognitive game accessed through a humanoid robots, as a part a training program aimed to improve their cognitive status 12 Session at CNR Test

Goal Stages

Familiarization with devices

Session

First study

14 participants (average age 75.3) with MCI Low level of computer experience (UES, demographic and computer experience questionnaires)

First study- Familiarization

Picture taken by our group during the familiarization with the robot at the Institute of Neuroscience of CNR

First study-Test

User Engagement Scale questionnaire

Questionnaire

Demographic questionnaire Computer experience questionnaires

Groups

Tablet (control group) Pepper Robot

Picture taken during the Pepper Session

Interaction is one of the key features of the Pepper robot’s capabilities Robot developed by Softbanks robotics Different laser sensors, cameras, tactile and movement sensors Tablet

Pepper Robot

First Study – Test set up

Cognitive Training Domains Memory

Music Quiz 15 songs of 20 seconds each Recognize singer and song retrograde memory (known songs) anterograde memory (unknown songs) autobiographical memory (known songs evoke personal memories) attention, memory, reasoning

First study

Ionic Python

Game - App

Connection Receives events Pepper controller Game

Game - Example

Timer Singer

Wrong answer Expired time Question

Game - Ionic App

Adaptive Feedback Tablet

Changes depending on the answer chosen

Game Feedback

Adaptive Feedback Answer Robot

Voice Visuals Changes depending on the answer chosen Voice Visuals Animation Coloured led Sounds

Game Feedback

Positive feedback Negative feedback

Data still under analysis Talked about the game after the training session and with persons external to the programme “Pepper you are so cute” Robot perceive as a friends and describe it in a human-like manner “Ciao Pepper, you know…I woke up with back pain and I was deciding whether to come this morning ... I decided to come because I knew I would play with you” Game did not perceive as a tasks but as a stimolous

Preliminary Results

Adaptive behaviour (Reinforcement Learning) Gesture interaction Robot Operating System (ROS) is a set of software libraries and tools that help you build robot applications

Future works

Different training games for different domain (math, logical, ..)

Summary

Motivation of the study linked with the aging of population and the increased of cognitive impairments create a gap in the health system The benefit of the Socially Assistive robot as an Assistive technologies to fill the gap in the health system Develop a cognitive training for elderly with MCI using a Socially Assistive Robot Preliminary results of the project and future works

Calvo, R. A., D’Mello S., et al. (Eds.). (2015). The Oxford Handbook of Affective Computing. Oxford University Press. USA. DOI: 10.1093/oxfordhb/9780199942237.001.0001 Bechade, Lucile, et al. (2019) Towards Metrics of Evaluation of Pepper Robot as a Social Companion for the Elderly. In Advanced Social Interaction with Agents. Lecture Notes in Electrical Engineering, 89-101. Springer, Cham. DOI: https://doi.org/10.1007/978-3-319-92108-2_11 Pino, Olimpia, et al. (2019) The Humanoid Robot NAO as Trainer in a Memory Program for Elderly People with Mild Cognitive Impairment. International Journal of Social Robotics, 1-13. DOI: https://doi.org/10.1007/s12369-019-00533-y Pandey, A.K., and Gelin, R. (2018) A Mass-Produced Sociable Humanoid Robot: Pepper: The first Machine of Its kind, IEEE Robotics & Automation Magazine. 25(3), 40-48, DOI: 10.1109/MRA.2018.2833157 Broekens, J., and Chetouani. (2019) “Towards Transparent Robot Learning through TDRL-based Emotional Expressions. IEEE Transactions on Affective Computing. DOI: 10.1109/TAFFC.2019.2893348

References