NAO Robot Eye Tracking Robot Via Internet of Things Motivation - - PowerPoint PPT Presentation

▶
nao robot
SMART_READER_LITE
LIVE PREVIEW

NAO Robot Eye Tracking Robot Via Internet of Things Motivation - - PowerPoint PPT Presentation

Sep 25, 2023 187 likes •422 views

NAO Robot Eye Tracking Robot Via Internet of Things Motivation & Research Objective Objective : Literature Review Eye Tracking NAO Control by daboApps Methodology Hardware and Software Used Virtual Reality Softbank Headset

slide-1
SLIDE 1

NAO Robot

Eye Tracking Robot Via Internet of Things

slide-2
SLIDE 2

Motivation & Research Objective Objective :

slide-3
SLIDE 3

Literature Review Eye Tracking NAO Control by daboApps

slide-4
SLIDE 4

Methodology

Hardware and Software Used

slide-5
SLIDE 5

Laptop / computer

Hardware

Softbank Robotics NAO robot Virtual Reality Headset

slide-6
SLIDE 6

Software

Choregraphe

Microsoft Visual Studio Community 2015

slide-7
SLIDE 7

Software

Monitor

The camera feed from the robot

slide-8
SLIDE 8

Methodology

The Approach

slide-9
SLIDE 9

The Idea Live feed from the NAO’s camera(s) here

slide-10
SLIDE 10

Using Professor Song’s Eye Tracking Program which will be equipped with a virtual on-screen keyboard…

Two more things are needed :

  • 1. NAO robot controller program to control the

robot using arrow keys

  • 2. Live feed from the cameras on the NAO robot

displayed on-screen ( Using Monitor)

slide-11
SLIDE 11

Initial Approach for the controller Using Python

Movement script :

slide-12
SLIDE 12

Controller script :

Importing all necessary libraries and .py movement files :

slide-13
SLIDE 13

Flaw of the initial approach:

The code will be executed

  • n the robot

However, laptop as ‘middle-man’ is needed for the approach to work ‘Middle-man’

slide-14
SLIDE 14

Setup

  • Final

Approach for the controller Using Choregraphe

slide-15
SLIDE 15

Code

  • Using

Choregraphe

15

slide-16
SLIDE 16

DEMO

(in Choregraphe)

16

slide-17
SLIDE 17

17

Live feed from the NAO’s camera(s) here

slide-18
SLIDE 18

“

=Discussion=

18

Pro : NAO Robot can be controlled through eye-tracking Cons :

  • Small arrow keys => Hard to gaze
  • Position of the arrow keys at the right

corner => Eye Fatigue

slide-19
SLIDE 19

There are better ways to control NAO robot

…

slide-20
SLIDE 20

Future Work

20

  • Integrating Object

Identification and Distance Data Calculation with NAO Robot Controller

slide-21
SLIDE 21

21

THANK YOU!

An Any qu y ques estio tions? ns?