NAO Robot Music Application for Children Fabrianne Effendi EEE30 - - PowerPoint PPT Presentation
Development of Interactive NAO Robot Music Application for Children Fabrianne Effendi EEE30 Why NAO? Interactive and engaging, thus children learn better from NAO Caters to needs of various children Autism kids more receptive to
Fabrianne Effendi EEE30
◎ Interactive and engaging, thus children learn better from NAO ◎ Caters to needs of various children ◉ Autism kids more receptive to NAO than humans ◎ Immense potential in the field of music education
Overview of music application
3-step process to impart new music skills
Speech Recognition Feature
Allows NAO to recognise predefined words or phrases, subsequently responding to it.
Animated Say Box
Used to increase interactivity and make the robot more human-like through carrying out human-like gestures while it speaks
Python Script Box
Allows for more complex and precise behaviours to be programmed
Timeline Box
Contains a motion layer and multiple behaviour layers, allowing NAO to do multiple things simultaneously
Flashcards
Help children in their learning as they are visually appealing, capturing children’s attention
Finding Optimal Speech Recognition Confidence Threshold
Environment Accurate detection Confidence level Quiet ✓ 25-45% Noisy ✗ <25% Thus, NAO’s optimal speech recognition confidence threshold was set to 25% for optimal detection accuracy. Confidence level for speech recognition
Mode of detection Able to differentiate flashcards Accurate detection under various lighting conditions Speed of detection (1: slowest; 3: fastest) Main disadvantage Detects images based
the recognition
key points ✗ (only able to differentiate 3D
✓ 1 Unable to detect external shape
2D objects
ALColourBlob Detection
Mode of detection Able to differentiate flashcards Accurate detection under various lighting conditions Speed of detection (1: slowest; 3: fastest) Main disadvantage Detects 2 dimensional vision-based colour blob. ✓ ✗ (since it is dependent on predefined RGB colour) 2 May detect similar colour from surroundings before flashcard is shown, resulting in incorrect detection
flashcard
NAOmark
Mode of detection Able to differentiate flashcards Accurate detection under various lighting conditions Speed of detection (1: slowest; 3: fastest) Detects unique NAOmark. ✓ ✓ 3 Each unique NAOmark corresponds to a unique integer output
NAO Video
◎ Successfully developed NAO robot music application ◎ Demonstrates future potential for humanoid robots to be used as an educational learning tool in classrooms ◎ Future work: ◎ To test the application
children ◎ To customise music application for children with autism