INTELLIGENT ROBOT GUIDANCE IN FIXED EXTERNAL CAMERA NETWORK FOR - - PowerPoint PPT Presentation

intelligent robot guidance in fixed external
SMART_READER_LITE
LIVE PREVIEW

INTELLIGENT ROBOT GUIDANCE IN FIXED EXTERNAL CAMERA NETWORK FOR - - PowerPoint PPT Presentation

1 INTELLIGENT ROBOT GUIDANCE IN FIXED EXTERNAL CAMERA NETWORK FOR NAVIGATION IN CROWDED AND NARROW PASSAGES Abhijeet Ravankar, Ankit Ravankar, Yukinori Kobayashi, Takanori Emaru Laboratory of Robotics and Dynamics, Human Mechanical Systems and


slide-1
SLIDE 1

INTELLIGENT ROBOT GUIDANCE IN FIXED EXTERNAL CAMERA NETWORK FOR NAVIGATION IN CROWDED AND NARROW PASSAGES

3rd International Electronic Conference on Sensors and Applications, 2016

Laboratory of Robotics and Dynamics, Human Mechanical Systems and Design, Graduate School of Engineering, Hokkaido University, Sapporo, Japan abhijeet@eis.hokudai.ac.jp

Abhijeet Ravankar, Ankit Ravankar, Yukinori Kobayashi, Takanori Emaru

ECSA-3

1

slide-2
SLIDE 2

Video Download Information

2

This entire presentation with narration can be downloaded as video from:

 (40 MB, medium video quality)

http://bit.ly/2fbgodt

 (16 MB, low video quality)

http://bit.ly/2eA4T34

In case the link does not work, kindly contact: Abhijeet Ravankar, abhijeetravankar@gmail.com (c) Abhijeet Ravankar, Hokkaido University, Sapporo, Japan, 3rd International Electronic Conference on Sensors and Applications, 2016

slide-3
SLIDE 3

Robots in Ubiquitous Sensor Network

 USN: Collection and utilization of information in real time,

and at any-time and any-where

 USN’s broad idea:  There will be sensors able to exchange information with gateways and  Perform assigned tasks  In coming years, service robots will have to be integrated with USN

@southmead

Service robot at home and public places are expected to increase in coming years.

@kinghtscope @hospi @roomba

SERVICE ROBOTS

(c) Abhijeet Ravankar, Hokkaido University, Sapporo, Japan, 3rd International Electronic Conference on Sensors and Applications, 2016

3

slide-4
SLIDE 4

Problem 1: Limitation of sensor specs

 Sensors (ex: camera) are mostly ‘forward’ facing

 Blind about moving entities on the back side

 Sensors are generally attached at a lower height

 Blind about far-off obstacles  Occlusion causes loss of information Robot is blind about these people Problem of occlusion

(c) Abhijeet Ravankar, Hokkaido University, Sapporo, Japan, 3rd International Electronic Conference on Sensors and Applications, 2016

4

slide-5
SLIDE 5

 There are narrow passages in

warehouses, libraries, etc.

 Multiple robots cannot simultaneously

access narrow passages

 Causes deadlock  Requires intelligent resource

sharing and conflict resolve

 Must consider factors like robot’s

task priority, battery life, …

 Intelligent path planning

Problem 2: Deadlock in narrow passages

(c) Abhijeet Ravankar, Hokkaido University, Sapporo, Japan, 3rd International Electronic Conference on Sensors and Applications, 2016

5

slide-6
SLIDE 6

Example of a narrow passages in library

(c) Abhijeet Ravankar, Hokkaido University, Sapporo, Japan, 3rd International Electronic Conference on Sensors and Applications, 2016

6

slide-7
SLIDE 7

Idea: Robots access external camera info

 Provides a birds-eye view  Robot is no longer

constrained by sensor spec

 A resource allocator can be

designed using ubiquitous robot location information

(c) Abhijeet Ravankar, Hokkaido University, Sapporo, Japan, 3rd International Electronic Conference on Sensors and Applications, 2016

7

slide-8
SLIDE 8

Power Estimation and Task Priority

Power Estimator

DB

Total power for multiple tasks:

(c) Abhijeet Ravankar, Hokkaido University, Sapporo, Japan, 3rd International Electronic Conference on Sensors and Applications, 2016

8

slide-9
SLIDE 9

Modified Priority Queue

 Request from robot comes as pair, where

  • Ri: Robot ID
  • Ti: Task Priority
  • Pi: Current Power Level
  • Xi: Current X Coordinate
  • Yi : Current X Coordinate

Emergency

  • WP: Power Weight
  • WT: Task Priority Weight
  • PTH: Threshold Power

(c) Abhijeet Ravankar, Hokkaido University, Sapporo, Japan, 3rd International Electronic Conference on Sensors and Applications, 2016

9

slide-10
SLIDE 10

JSON Request Example

Both Robot and Camera Nodes have a JSON parser

(c) Abhijeet Ravankar, Hokkaido University, Sapporo, Japan, 3rd International Electronic Conference on Sensors and Applications, 2016

10

slide-11
SLIDE 11

Flowchart of Path Allocation

1 1

Person is prioritized

(c) Abhijeet Ravankar, Hokkaido University, Sapporo, Japan, 3rd International Electronic Conference on Sensors and Applications, 2016

11

slide-12
SLIDE 12

Experiment Setup

Pioneer P3-DX Turtlebot

  • Microsoft Kinect Sensor
  • UHG08LX LRF
  • Robot Operating System
  • Ubuntu 14.04 OS
  • Mapping: Grid Mapping
  • Localization: Particle Filter

Sensors and System SLAM Raspberry Pi + Camera

(c) Abhijeet Ravankar, Hokkaido University, Sapporo, Japan, 3rd International Electronic Conference on Sensors and Applications, 2016

12

slide-13
SLIDE 13

Results: Narrow Path Sharing

(c) Abhijeet Ravankar, Hokkaido University, Sapporo, Japan, 3rd International Electronic Conference on Sensors and Applications, 2016

13

slide-14
SLIDE 14

Results: Robot-view vs External Camera-view

Robot’s camera-view

External camera-view

(c) Abhijeet Ravankar, Hokkaido University, Sapporo, Japan, 3rd International Electronic Conference on Sensors and Applications, 2016

14

slide-15
SLIDE 15

Assumption: Map Available. Robots Localize

(c) Abhijeet Ravankar, Hokkaido University, Sapporo, Japan, 3rd International Electronic Conference on Sensors and Applications, 2016

15

VIDEO

slide-16
SLIDE 16

Results: Utilizing External Cam Info

(c) Abhijeet Ravankar, Hokkaido University, Sapporo, Japan, 3rd International Electronic Conference on Sensors and Applications, 2016

16

VIDEO

slide-17
SLIDE 17

Robot’s Position Estimation in Occlusion

Prediction by camera side Kalman Filter

(c) Abhijeet Ravankar, Hokkaido University, Sapporo, Japan, 3rd International Electronic Conference on Sensors and Applications, 2016

17

slide-18
SLIDE 18

Intelligent Path Planning

Shortest path via narrow passage Many waiting robots. Taking alternate long path is more efficient

(c) Abhijeet Ravankar, Hokkaido University, Sapporo, Japan, 3rd International Electronic Conference on Sensors and Applications, 2016

18

slide-19
SLIDE 19

Conclusion and Discussion

 External camera sensor network can provide a lot of relevant

information to the robots to do their tasks efficiently.

 Robots can plan better trajectories and plan optimal paths towards

their goal.

 It’s feasible to design a resource allocator in such sensor network.

Resource is not limited to narrow path & can be extended to other resources like docking/charging points.

 External camera N/W can provide remote information to robots to

perform tasks with better efficiency.

(c) Abhijeet Ravankar, Hokkaido University, Sapporo, Japan, 3rd International Electronic Conference on Sensors and Applications, 2016

19

slide-20
SLIDE 20

THANK YOU

Questions, Comments & Research Collaborations abhijeet@eis.hokudai.ac.jp

20