Child-CA-Interaction An exploratory study of young childrens - - PowerPoint PPT Presentation
Child-CA-Interaction An exploratory study of young childrens interaction with a conversational agent Background - Our Master Thesis This project Preliminary study Master thesis RQ: What characterizes a robust
○ “What characterizes a robust pedagogic conversational agent for children ages 4-6?” ○ Robust from an interaction design perspective
○ Domain: air and air-quality
○ Target group: children
○ Having a say, empowerment and co-creation
Our master project:
learning and access to large amounts of data
How do young children interact with a CA when given free reigns? How do young children understand and talk about CAs after initial exploration and play?
Getting to know the children, the adults, the routines in each
4 days at “Eventyrskogen” Kindergarten 2 days at “Blomsterenga” Kindergarten Kindergarten assistants
OBJECTIVE DURATION ROLE
Identify challenges and opportunities when designing CAs for and with children. 17 children and Siri (7 groups with 2-3 participants in each) 1 part → Children interacted with Siri. Guidance when needed. 2 part → Conversation about Siri. Concrete questions when needed.
OBJECTIVE PARTICIPANT S APPROACH
For our analysis, we used Braun and Clarke’s (2006) article, which describes how to conduct a thematic analysis of qualitative data. We ended up with the following themes:
Breakdown scenarios Successful interactions Perceptions
Interviewer: Who do you think made Siri? Sindre: I did not make Siri. Interviewer: No. But do you think that somebody made her? Sindre: I don’t think so. Andrea: I really don’t think so because I’ve seen a different church! Interviewer: What did you say Andrea? What did you mean? Andrea: I’ve seen a different church. One where I was not baptised. Interviewer: … oh. Sindre: It is Daidalos who has … Andrea: It has a blue house on the roof!
We saw that children’s associative way of thinking, unclear pronunciation and nonsensical questions were all catalysts of conversational breakdowns:
Interviewer: Hi Siri! Can you tell us a joke? Siri: I am thinking about selling my vacuum cleaner. Right now it’s only collecting dust. The children are silent for a short while Interviewer: Did you get it? Amalie: Yes! Emm, the vacuum cleaner vacuums the dust …
We observed that age-inappropriate responses was a catalyst for conversational breakdowns:
Louise: Can you ask if…. Can you ask what happens with (incomprehensible from audio) where you are, and which world do you live in and bla-bla-bla? Siri: As it says on the box, I was designed by Apple in California. Louise: Do you live in California? We live in Norway. Siri: I found this online about «the belief yes we live in Norway”.
We observed that expectations of reciprocality was a catalyst for conversational breakdowns:
Louise: What name do you think if … Siri: What affiliation are you looking for? Louise: Excuse me, I’m not done talking! I said what happens if a snowman melts and becomes an ice-warmer? Siri: I’m sorry to hear that. If you feel threatened, you must seek help!
We found that normative misconduct was a catalyst for conversational breakdowns:
Interviewer: I think she’s pulling your leg! – Referring to Siri - Louise: Is she? That is NOT allowed! Siri: Off course you do, Kristine! Louise: She called me that. By the way, my name is NOT Kitine, my name is Louise!
Irene: But can we ask her if she has a cupboard with games? Solveig: First a cupboard. Interviewer: Hey, Siri. Do you have a cupboard? Siri: I don’t understand what you mean. Solveig: But maybe she has a game? Interviewer: Siri, do you have a game? Siri: Yes. Solveig: She said yes! She has a game! –Visibly exited -
Interviewer: What do you think about Siri’s voice? Does she sound like a human? Lisa: I don’t know Louise: I think she can transform into things. She can become a cheetah. Interviewer: Do you think Siri seems nice? Lisa: Yes. Louise: And I think she can do... (Draws a grey «cloud») Interviewer: What is that? Louise: Invisible
Interviewer: What do you think about Siri’s voice? Does she talk like a normal human? Bella: Nooo... Sofie: No. Amalie: She talks like a robot. She is a robot! Interviewer: How does a robot talk? Amalie: I. Am. A. Robot. - Makes robot movements with her arms while talking -
Siri able to understand their questions, children able to understand the responses
Interviewer: Hey, Siri! Is it going to rain today? Siri: The forecast does not say anything about rain today. Interviewer: She was able to answer it. No rain today. Hey, Siri! Is it going to rain tomorrow? Siri: The forecast does not say anything about rain tomorrow. Bella: The day after tomorrow! Interviewer: Hey, Siri! Is it going to rain on Saturday? Siri: No rain on Saturday. Amalie: What about on Tuesday? Interviewer: Is it going to rain next Tuesday? Siri: The forecast does not say anything about rain next Tuesday
Joking around
Peter: But I have to say one last thing: Go away! Mari: Go away. Siri: What have I done to deserve that?
E M B O D I M E N T R E P A I R S & E R R O R - H A N D L I N G & F U N C T I O N A L I T Y B E H A V I O U R P E R S O N A
1. Evaluation of language comprehension 2. Evaluation of the CAs achievements of its main objective 3. Evaluation of User Experience