NAO Robot Eye Tracking Robot Via Internet of Things Motivation - PowerPoint PPT Presentation

NAO Robot Eye Tracking Robot Via Internet of Things

Motivation & Research Objective Objective :

Literature Review Eye Tracking NAO Control by daboApps

Methodology Hardware and Software Used

Virtual Reality Softbank Headset Robotics NAO robot Hardware Laptop / computer

Choregraphe Software Microsoft Visual Studio Community 2015

Monitor The camera feed from the robot Software

Methodology The Approach

The Idea Live feed from the NAO’s camera(s) here

Using Professor Song’s Eye Tracking Program which will be equipped with a virtual on- screen keyboard… Two more things are needed : 1. NAO robot controller program to control the robot using arrow keys 2. Live feed from the cameras on the NAO robot displayed on-screen ( Using Monitor)

Movement script : Initial Approach for the controller Using Python

Controller script : Importing all necessary libraries and .py movement files :

Flaw of the initial approach: The code will be executed However , laptop as ‘middle - man’ is on the robot needed for the approach to work ‘Middle - man’

Final Setup Approach for ----------------- the controller Using Choregraphe

Code ------------------------- Using Choregraphe 15

DEMO (in Choregraphe) 16

Live feed from the NAO’s camera(s) here 17

“ =Discussion= Pro : NAO Robot can be controlled through eye-tracking Cons : Small arrow keys => Hard to gaze • Position of the arrow keys at the right • corner => Eye Fatigue 18

There are better ways to control NAO robot …

Integrating Object Identification and Distance Data ------------------------- Calculation with NAO Robot Controller ------------------------- Future Work 20

THANK YOU! An Any qu y ques estio tions? ns? 21