Introduction to Information Science and Technology (IST) Part IV: - PowerPoint PPT Presentation

Introduction to Information Science and Technology (IST) Part IV: Intelligent Machines and Robotics Sören Schwertfeger / 师泽仁 ShanghaiTech University

2 IST ShanghaiTech University - SIST - May 16 2016 Instructor • Sören Schwertfeger 师泽仁 • Email: soerensch@shanghaitech.edu.cn • Website: https://robotics.shanghaitech.edu.cn • Office/ lab: Research Building 2 nd floor • Office hours: Tuesdays & Fridays 2pm – 4pm • Research: Robotics (Computer Science)

3 IST ShanghaiTech University - SIST - May 16 2016 Organization • Organized by School of Information Science and Technology (SIST) • Putting it all together: Programming; Electronics; Signals and Systems for Robotics • Class A: Labs next three Saturdays. • Register in groups of 5 students. If not yet done do it here: https://www.wenjuan.com/s/nqAVNrF/ • Instructions on this weeks lab will be posted today. • Location: Auditorium in Admin building Haike Road

4 IST ShanghaiTech University - SIST - May 16 2016 Grading • Class A: • 2 Homework: 55% • Robotics HW 2 will have additional ”Class A only” tasks • 3 Quizzes: 15% • At random times during random lectures • 3 Labs: 30% • Checkoff certain tasks during the lab • Class B: • 2 Homework: 70% • 3 Quizzes: 30%

5 IST ShanghaiTech University - SIST - May 16 2016 Schedule

6 IST ShanghaiTech University - SIST - May 16 2016 Material • See website: http://shtech.org/course/ist/ • All material is freely available: • LaValle Mobile Robotics and LaValle Planning Algorithms • Read the material – basic facts from the material might be asked in the Quiz

7 IST ShanghaiTech University - SIST - May 16 2016 Outline • What is a Robot? • Why Mobile Robotics? • Why Autonomous Mobile Robotics? • Brief History • Kinematics

8 IST ShanghaiTech University - SIST - May 16 2016 What is a Robot? Pictures on the following slides all from http://commons.wikimedia.org

9 IST ShanghaiTech University - SIST - May 16 2016

25 IST ShanghaiTech University - SIST - May 16 2016 What is your definition for the term ROBOT ?

26 IST ShanghaiTech University - SIST - May 16 2016 Definitions: A Robot is ... A machine capable of performing complex tasks in the physical world, that is using sensors to perceive the environment and acts tele-operated or autonomous.

27 IST ShanghaiTech University - SIST - May 16 2016 Industry vs Mobile Robots • Industrial Robots rule: • 2013: 179,000 industrial robots sold • Over 1.4 million industrial robots installed • China biggest robot market regarding annual sales - also fasted growing market worldwide • Industrial Robots stay at one place! • Almost all other robots move => Mobile Robotics

28 IST ShanghaiTech University - SIST - May 16 2016 Why Autonomous Mobile Robotics? • Tele-operating robots: boring and inefficient • Autonomous robots: Robots that act by their own reasoning • Human operator might be present: Gives high level tasks • Why autonomy? • Autonomous behaviors might be better than remote control by humans • Remote control might be boring or stressful and tiresome • Human operators might be a scarce resource or expensive • Multi robot approaches: One operator for many robots • Semi-autonomy: • Autonomous behaviors that help the operator, for example: • Way-point navigation, autonomous stair climbing, assisted manipulation • Gradual development from tele-operation to full autonomy possible

29 IST ShanghaiTech University - SIST - May 16 2016 • Autonomous mobile robots move around in the environment. Therefore ALL of them: • They need to know where they are . • They need to know where their goal is. • They need to know how to get there.

30 IST ShanghaiTech University - SIST - May 16 2016 • Autonomous mobile robots • Where am I? move around in the environment. Therefore ALL of • Global Positioning System: them: outdoor, error measured in meters • They need to know where they are . • Guiding system: (painted lines, inductive guides), • They need to know where their markers, iBeacon goal is. • They need to know how to get there. • Model of the environment: • Map, Localize yourself in this model • Mapping: Build the map while driving

31 IST ShanghaiTech University - SIST - May 16 2016 • Autonomous mobile robots • Where is my goal? move around in the • Two part problem: environment. Therefore ALL of • What is the goal? them: • Expressed using the world model (map) • They need to know where they • Using object recognition are . • No specific goal (random) • They need to know where their • Where is that goal? goal is. • Coordinates in the map • They need to know how to get • Localization step at the end of the there. object recognition process • User input

32 IST ShanghaiTech University - SIST - May 16 2016 • Autonomous mobile robots • Different levels: move around in the • Control: environment. Therefore ALL of • How much power to the motors to move in that direction, reach desired them: speed • They need to know where they • Navigation: are . • Avoid obstacles • They need to know where their • Classify the terrain in front of you goal is. • Follow a path • They need to know how to get • Planning: there. • Long distance path planning • What is the way, optimize for certain parameters

33 IST ShanghaiTech University - SIST - May 16 2016 Most important capability (for autonomous mobile robots) How to get from place A to place B? (safely and efficiently)

34 IST ShanghaiTech University - SIST - May 16 2016 How to get from A to B? What are the components of a ROBOT?

35 IST ShanghaiTech University - SIST - May 16 2016 Sensors: Overview Hardware Battery, Switches, IMU (Gyro, Power LEDs, Plugs Accelerometer), DC/ DC Cameras, Laser Wheel, Range Finders Track, Motor Driver/ Battery (LRF), GPS, Joint, Motor Servos … Motor Controller management Microphone Finger, … Computer: Micro Controller: Computer: Real time, Motor Driver/ Sensing, Control and Navigation Wheel Motor PWM signals, Motor Controller Computing, Planning Analog In- and Output Perception Storage Digital In- and Output Vision Artificial Intelligence Speed sensor Quadrature Encoding Storage Networking (Hard Disk) Micro Controller Mechanics: Structure, Housing, Tracks, Flippers Operator Interface Other Robots Micro Controller

36 IST ShanghaiTech University - SIST - May 16 2016 How to get from A to B? How to program an intelligent ROBOT to go from A to B?

37 IST ShanghaiTech University - SIST - May 16 2016 General Control Scheme for Mobile Robot Systems Lecture 6: Artificial Intelligence (AI) Lecture 7: Machine Learning Lecture 3: Localization Cognition & AI Position Planning Map Building Path Planning Global Map Environment Model Path Local Map Lecture 5: Information Path Vision Extraction Execution Motion Control Vision Perception Lecture 2: Navigation Actuator Commands Raw data Control and Navigation Lecture 4: Sensing Acting Perception Real World Environment With material from Roland Siegwart and Davide Scaramuzza, ETH Zurich

38 IST ShanghaiTech University - SIST - May 16 2016 Brief History Robota “forced labor”: Czech ( 捷克共和國 ), Karel Čapek R.U.R. 'Rossum's Universal Robots' (1920).

39 IST ShanghaiTech University - SIST - May 16 2016 Shakey the robot (1970) • First general-purpose mobile robot to be able to reason about its own actions • Advanced hardware: • radio communication • sonar range finders • television camera • on-board processors • bump detectors • Advanced software: • Sensing and reasoning • Very big impact • Video: http://robotics.shanghaitech.edu.cn/static/videos/external/Shakey. mkv

40 IST ShanghaiTech University - SIST - May 16 2016 KINEMATICS

41 IST ShanghaiTech University - SIST - May 16 2016 How to get from A to B? Which (physical) methods can be used to move a robot? (Propulsion Systems)

Introduction to Information Science and Technology (IST) Part IV: - PowerPoint PPT Presentation

Introduction to Information Science and Technology (IST) Part IV: Intelligent Machines and Robotics Sren Schwertfeger / ShanghaiTech University 2 IST ShanghaiTech University - SIST - May 16 2016 Instructor Sren

Semantic Filtering Qingxiong Yang School of Information Science and Technology, University of

Introduction to Information Science and Technology (IST) Part IV: Intelligent Machines and

Introduction to Information Science and Technology (IST) Part IV: Intelligent Machines and

Introduction to Information Science and Technology (IST) Part IV: Intelligent Machines and

I. Introduction I. Introduction Importance of Information Technology (IT) Importance of

Wearable Technology: the wave of the future Omid Dehzangi Computer and Information Science

Introduction to Eir A science and business park within health science and technology located

INTRODUCTION COMS W1001 Introduction to Information Science Boyi Xie 2 Todays Topics

Information Technology Security Presentation to Joint Legislative Committee on Information

Multicast Monitoring System for Access Grid 18 th APAN Meeting - Cairns - Jul. 2004 Jinyong Jo

Introduction to Bioinformatics: Chapter 11: Measuring Expression of Genome Information Jarkko

Networking and Information Technology Computer Science Jeannette M. Wing Presidents Professor of

Bachelor of Computer Science and Bachelor of Computer Science Advanced (Honours) Information

Bachelor of Computer Science and Bachelor of Computer Science Advanced (Honours) Information

Welcome to School of Information Technology Bachelor of Computer Science (Honours) (C3702)

IT Telecommunication Technology 1 Information System (IS) Model Performance Control System

Digital Games An Introduction What are Digital Games? Commonly referred to as video games

Week 4 Create content. Drive traffic. Pre-sell MVP. Week 5 - Email marketing funnel. More

Effectors CSCI545 Introduction to Robotics Hadi Moradi Previous Lecture Introduction to

Mercy Housing reflections on NOAH with support from JPMorganChase 4/4/2018 1 4/4/2018 2

Hyperbolicity in dissipative polygonal billiards Joint work with P. Duarte, G. del Magno, J.P.

Interferometer-based white light measurement of neutral rubidium density and gradient at AWAKE

Applied Machine Learning Clustering Siamak Ravanbakhsh COMP 551 (Fall 2020) Learning objectives

The Computational Nature of Phonological Generalizations Jeffrey Heinz heinz@udel.edu