co compute mputer r vision 3 detection segmentation and
play

Co Compute mputer r Vision 3: Detection, , Segmentation and - PowerPoint PPT Presentation

Dec 23, 2022 •359 likes •703 views

Co Compute mputer r Vision 3: Detection, , Segmentation and and Tr Trac acking king CV3DST | Prof. Leal-Taix 1 The The Te Team Lecturers Prof. Dr. Laura Dr. Aljosa Leal-Taix Osep CV3DST | Prof. Leal-Taix 2 Wh What at

  1. Co Compute mputer r Vision 3: Detection, , Segmentation and and Tr Trac acking king CV3DST | Prof. Leal-Taixé 1

  2. The The Te Team Lecturers Prof. Dr. Laura Dr. Aljosa Leal-Taixé Osep CV3DST | Prof. Leal-Taixé 2

  3. Wh What at this cou ourse e is: • A course on Computer Vision – Object detection – Instance and semantic segmentation – Multiple object tracking in 2D and 3D • Other CV courses: – Computer Vision 2: Multiple View Geometry (WS) CV3DST | Prof. Leal-Taixé 3

  4. Wh What at this cou ourse e is NOT: • An Introduction to Deep Learning – Take “Introduction to Deep Learning” if you are not familiar with basic DL concepts • A practical project course – Take “Advanced Deep Learning for Computer Vision” • A theoretical introduction into 3D Vision – Take “Computer Vision 2: Multiple View Geometry (WS)” CV3DST | Prof. Leal-Taixé 4

  5. Wh What at is Com omputer er Vi Vision on? First defined in the 60s in artificial intelligence groups • “Mimic the human visual system” • Center block of robotic intelligence • CV3DST | Prof. Leal-Taixé 5

  6. CV3DST | Prof. Leal-Taixé 6

  7. Comp Computer er Vis ision ion Give eyes to a computer CV3DST | Prof. Leal-Taixé 9

  8. Comp Computer er Vis ision ion Understand every pixel of an image CV3DST | Prof. Leal-Taixé 10

  9. Comp Computer er Vis ision ion Understand every pixel of an image tree car person Semantic segmentation road CV3DST | Prof. Leal-Taixé 11

  10. Comp Computer er Vis ision ion Understand every pixel of an image tree person 2 car Instance- based segmentation Semantic person 1 segmentation person 3 road CV3DST | Prof. Leal-Taixé 12

  11. Comp Computer er Vis ision ion Understand every pixel of a video Multiple object tracking Instance- based segmentation Semantic segmentation CV3DST | Prof. Leal-Taixé 13

  12. Dyn Dynamic c Sce Scene Understa tanding Understand every pixel of a video Multiple object tracking Instance- based segmentation Semantic segmentation CV3DST | Prof. Leal-Taixé 14

  13. Au Auto tono nomous drivi ving ng CV3DST | Prof. Leal-Taixé 15

  14. Au Auto tono nomous drivi ving ng CV3DST | Prof. Leal-Taixé 16

  15. Un Underst standin ing a an ima image CV3DST | Prof. Leal-Taixé 17 Credit: Li/Karpathy/Johnson

  16. Un Underst standin ing a an ima image K. He, G. Gkioxari, P. Dollar, R. Girshick. Mask R-CNN. ICCV 2017. CV3DST | Prof. Leal-Taixé 18

  17. Un Underst standin ing a an ima image CV3DST | Prof. Leal-Taixé 19

  18. Un Underst standin ing a an ima image CV3DST | Prof. Leal-Taixé 20

  19. Un Underst standin ing a an ima image CV3DST | Prof. Leal-Taixé 21

  20. Un Underst standin ing a an ima image • Different representations depending on the granularity – Detections (coarse) – Segmentations (precise) – Semantic with/without instances (person 1, person 2) • Goes well with Deep Learning CV3DST | Prof. Leal-Taixé 22

  21. Un Underst standin ing a an v vid ideo • Temporal domain which brings us advantages – A lot of redundancy – A smoothness assumption: things do not change much from one frame to another • … but also disadvantages – At 30 FPS, image the computation one has to do to process a video…. – Occlusions, multiple objects moving and interacting… CV3DST | Prof. Leal-Taixé 23

  22. Un Underst standin ing a an v vid ideo: t : then CV3DST | Prof. Leal-Taixé 24

  23. Un Underst standin ing a an v vid ideo: n : now CV3DST | Prof. Leal-Taixé 25

  24. Un Underst standin ing a an v vid ideo • Where is every object going? • How are objects interacting? • Get consistent results in the temporal dimension CV3DST | Prof. Leal-Taixé 26

  25. Rou Rough schedu edule/c e/con onten ent • 1. Introduction • 2. Object Detection 1 • 3. Object Detection 2 • 4. Single/Multiple object tracking • 5. Multiple object tracking • 6. Trajectory prediction • 7. Semantic segmentation • 8. Instance Segmentation • 9. Video object segmentation • 10. Going towards 3D tracking and segmentation CV3DST | Prof. Leal-Taixé 27

  26. Rou Rough schedu edule/c e/con onten ent • RCNN, Fast RCNN and Faster RCNN • YOLO, SSD, RetinaNet • Siamese networks – Person Re-Identification • Message Passing Networks • Network (non-neural) flow for tracking • Generative Adversarial Networks – trajectory prediction Mask-RCNN, UPSNet (panoptic segmentation) • Deformable/atrous convolutions • 3D – data, algorithms. • CV3DST | Prof. Leal-Taixé 28

  27. Our Our Research rch Lab Dynamic Vision and Learning Group https://dvl.in.tum.de/ CV3DST | Prof. Leal-Taixé 29

  28. Ab About t the the lectu ture Theory: 10-11 lectures • Every Wednesday 16:00-18:00 (MI HS 2) • Lectures will be recorded this year! • – Due to the virus situation, we will make all slides and video recordings available every Wednesday https://dvl.in.tum.de/teaching/cv3dst-ss20/ CV3DST | Prof. Leal-Taixé 30

  29. Gra Grading syst g system Exam: tbd tbd • There will be a retake exam as this course will be • moved permanently to Summer Semester Completing the practical part successfully gives a • bonus of 0.3 CV3DST | Prof. Leal-Taixé 31

  30. Pr Pract ctica cal l pa part • Internal Kaggle competition • We will have a tracking challenge. • You will all start from the same point (code) • After that, it will be an open competition. • Check out the video of the presentation of the challenge! CV3DST | Prof. Leal-Taixé 32

  31. Moodl Moodle • Announcements via Moodle - IMPORT PORTANT ANT! – Sign up in TUM online for access: https://www.moodle.tum.de/ – We will share common information (e.g., regarding exam) – Ask content questions online so others benefit – Don’t post solutions CV3DST | Prof. Leal-Taixé 33

  32. Ema Email ils & Slid ides es • All material will be uploaded on Moodle and the web • Questions regarding the syllabus, exercises or contents of the lecture, use Moodle! • Questions regarding organization of the course: dst@dvl.in.tum.de • Emails to the individual addresses will not be answered. CV3DST | Prof. Leal-Taixé 34

  33. Co Compute mputer r Vision 3: Detection, , Segmentation and and Tr Trac acking king CV3DST | Prof. Leal-Taixé 40

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Detection and Segmentation CS60010: Deep Learning Abir Das IIT Kharagpur March 04 and 05, 2020

Detection and Segmentation CS60010: Deep Learning Abir Das IIT Kharagpur March 04 and 05, 2020

Detection and Segmentation CS60010: Deep Learning Abir Das IIT Kharagpur March 04 and 05, 2020 Detection RCNN Architectures YOLO Segmentation Agenda To get introduced to two important tasks of computer vision - detection and segmentation

1.41k views • 115 slides
Detection and Segmentation CS60010: Deep Learning Abir Das IIT Kharagpur Feb 28, 2020

Detection and Segmentation CS60010: Deep Learning Abir Das IIT Kharagpur Feb 28, 2020

Detection and Segmentation CS60010: Deep Learning Abir Das IIT Kharagpur Feb 28, 2020 Introduction Datasets Localization Agenda To get introduced to two important tasks of computer vision - detection and segmentation along with deep neural

755 views • 38 slides
An Introduction to Modern Object Detection Gang Yu yugang@megvii.com Visual Recognition A

An Introduction to Modern Object Detection Gang Yu yugang@megvii.com Visual Recognition A

An Introduction to Modern Object Detection Gang Yu yugang@megvii.com Visual Recognition A fundamental task in computer vision Classification Object Detection Semantic Segmentation Instance Segmentation Key point Detection

1.13k views • 83 slides
Semantic segmentation Image classification Object detection Semantic segmentation Evolution

Semantic segmentation Image classification Object detection Semantic segmentation Evolution

Accel : A Corrective Fusion Network for Efficient Semantic Segmentation on Video Samvit Jain , Xin Wang , Joseph Gonzalez RISE Lab, UC Berkeley Semantic segmentation Image classification Object detection Semantic segmentation Evolution

857 views • 13 slides
Modern Object Detection Gang Yu Face++ Researcher yugang@megvii.com Visual Recognition A

Modern Object Detection Gang Yu Face++ Researcher yugang@megvii.com Visual Recognition A

Lecture 6: Modern Object Detection Gang Yu Face++ Researcher yugang@megvii.com Visual Recognition A fundamental task in computer vision Classification Object Detection Semantic Segmentation Instance Segmentation Key point

1.24k views • 85 slides
Segmentation and Contour Detection Image segmentation is the process of assigning a

Segmentation and Contour Detection Image segmentation is the process of assigning a

Segmentation and Contour Detection Image segmentation is the process of assigning a label to every pixel in an image such that pixels with the same label share certain visual characteristics. Contours are the lines separating

676 views • 32 slides
Real-Time Object Detection and Semantic Segmentation Geetank Raipuria Wei Li Corporate

Real-Time Object Detection and Semantic Segmentation Geetank Raipuria Wei Li Corporate

Real-Time Object Detection and Semantic Segmentation Geetank Raipuria Wei Li Corporate Development manager Computer Vision Engineer NavInfo Europe Presented at GTC 2019 Session S9351 NavInfo - our growth benefits from AI Smart Mobility

735 views • 34 slides
Rich feature hierarchies for accurate object detection and semantic segmentation Ross Girshick, Je

Rich feature hierarchies for accurate object detection and semantic segmentation Ross Girshick, Je

Rich feature hierarchies for accurate object detection and semantic segmentation Ross Girshick, Je ff Donahue, Trevor Darrell, Jitendra Malik UC Berkeley Tech Report @ http://arxiv.org/abs/1311.2524 Detection & Segmentation input

704 views • 37 slides
Introduction to Object Detection & Image Segmentation Abel Brown (abelb@nvidia.com) November

Introduction to Object Detection & Image Segmentation Abel Brown (abelb@nvidia.com) November

Introduction to Object Detection & Image Segmentation Abel Brown (abelb@nvidia.com) November 2, 2017 Outline What is Object Detection and Segmentation? Examples Before Deep Learning Common Issues with Algorithms Quality Assessment and

512 views • 47 slides
Edge-based Segmentation Transform Hough Edge Tracking Linking Edge Detection Canny Edge

Edge-based Segmentation Transform Hough Edge Tracking Linking Edge Detection Canny Edge

Edge-based Marr-Hildreth http://vision.ouc.edu.cn/~zhenghaiyong CVBIOUC ZhaoHaiwei DaiJialun WangRuchen Edge-based Segmentation Transform Hough Edge Tracking Linking Edge Detection Canny Edge Techniques

690 views • 31 slides
Segmentation Professor Fei Fei Li Stanford Vision Lab 1 19 Apr 11 Lecture 8 -

Segmentation Professor Fei Fei Li Stanford Vision Lab 1 19 Apr 11 Lecture 8 -

Segmentation Professor Fei Fei Li Stanford Vision Lab 1 19 Apr 11 Lecture 8 - Fei-Fei Li Image Segmentation Goal: identify groups of pixels that go together 2 19 Apr 11 Lecture 8 - Fei-Fei Li Success Story 3 19 Apr

1.12k views • 64 slides
Practical Object Detection and Segmentation Vincent Chen and Edward Chou Agenda Why would

Practical Object Detection and Segmentation Vincent Chen and Edward Chou Agenda Why would

Practical Object Detection and Segmentation Vincent Chen and Edward Chou Agenda Why would understanding different architectures be useful? Modular Frameworks Describe Modern Frameworks Detection Segmentation

641 views • 38 slides
Object Detection and Segmentation from Joint Embedding of Parts and Pixels Michael Maire 1 ,

Object Detection and Segmentation from Joint Embedding of Parts and Pixels Michael Maire 1 ,

Object Detection and Segmentation from Joint Embedding of Parts and Pixels Michael Maire 1 , Stella X. Yu 2 , Pietro Perona 1 1 California Institute of Technology - Pasadena, CA 91125 2 Boston College - Chestnut Hill, MA 02467 Segmentation

740 views • 59 slides
FUZZY COLOUR IMAGE FUZZY COLOUR IMAGE SEGMENTATION APPLIED SEGMENTATION APPLIED TO ROBOT VISION

FUZZY COLOUR IMAGE FUZZY COLOUR IMAGE SEGMENTATION APPLIED SEGMENTATION APPLIED TO ROBOT VISION

FUZZY COLOUR IMAGE FUZZY COLOUR IMAGE SEGMENTATION APPLIED SEGMENTATION APPLIED TO ROBOT VISION TO ROBOT VISION J. Chamorro-Martnez D. Snchez B. Prados-Surez Department of Computer Science and Artificial Intelligence. University of

164 views • 15 slides
Beyond Detection: Towards Multi-Object Tracking and Segmentation Andreas Geiger Autonomous

Beyond Detection: Towards Multi-Object Tracking and Segmentation Andreas Geiger Autonomous

Beyond Detection: Towards Multi-Object Tracking and Segmentation Andreas Geiger Autonomous Vision Group University of T ubingen / MPI for Intelligent Systems June 17, 2018 University of Tbingen MPI for Intelligent Systems Autonomous

639 views • 60 slides
Introduction to Spectral Clustering 1 / 42 Motivation Image segmentation in computer vision 2 /

Introduction to Spectral Clustering 1 / 42 Motivation Image segmentation in computer vision 2 /

ECS 231 Introduction to Spectral Clustering 1 / 42 Motivation Image segmentation in computer vision 2 / 42 Motivation Community detection in network analysis 3 / 42 Outline I. Graph and graph Laplacian Graph Weighted graph

1.07k views • 42 slides
CS344M Autonomous Multiagent Systems Patrick MacAlpine Department of Computer Science The

CS344M Autonomous Multiagent Systems Patrick MacAlpine Department of Computer Science The

CS344M Autonomous Multiagent Systems Patrick MacAlpine Department of Computer Science The University of Texas at Austin Good Afternoon, Colleagues Are there any questions? Patrick MacAlpine Logistics Surveys due Wednesday at 9pm Patrick

467 views • 24 slides
Introduction to Particle Physics Masterclasses Konrad Jende, High School Teacher Programme 2014 1

Introduction to Particle Physics Masterclasses Konrad Jende, High School Teacher Programme 2014 1

Bringing the world s largest science experiment into the classroom Introduction to Particle Physics Masterclasses Konrad Jende, High School Teacher Programme 2014 1 Outline Introduction

542 views • 26 slides
I. Introduction Highly parallel Graphics computing GPU (Parallel computing) 4 cores 512

I. Introduction Highly parallel Graphics computing GPU (Parallel computing) 4 cores 512

Talk outline [25 slides ] Medical Image Analysis on GPUs: 1. Introduction [2 slides] Challenges and Future Trends 2. Programming GPUs: OpenACC/CUDA [8 slides] 3. Hardware designs: Kepler/Echelon [14 slides] 4. Conclusions [1 slide] Manuel

241 views • 8 slides
CS 488 Computer Graphics 1 Introduction to Real-Time Rendering Dr. Angus Forbes, Instructor Kyle

CS 488 Computer Graphics 1 Introduction to Real-Time Rendering Dr. Angus Forbes, Instructor Kyle

CS 488 Computer Graphics 1 Introduction to Real-Time Rendering Dr. Angus Forbes, Instructor Kyle Almryde, TA Creative Coding Research Group at EVL Department of Computer Science University of Illinois at Chicago

515 views • 14 slides
M4 meeting Sept 2004 Steve Renals University of Edinburgh Agenda - Thursday 0900-0930 -

M4 meeting Sept 2004 Steve Renals University of Edinburgh Agenda - Thursday 0900-0930 -

M4 meeting Sept 2004 Steve Renals University of Edinburgh Agenda - Thursday 0900-0930 - Introduction 0930 - 1030 WP2 (video) TUM - Head Tracking Brno - Body part tracking and facer verif. Brno - Unrolling 360 video

313 views • 13 slides
Virtual Address Translation via Learned Page Table Indexes Artemiy Margaritovy Dmitrii Ustiugovz

Virtual Address Translation via Learned Page Table Indexes Artemiy Margaritovy Dmitrii Ustiugovz

Virtual Address Translation via Learned Page Table Indexes Artemiy Margaritovy Dmitrii Ustiugovz Edouard Bugnionz Boris Groty 1 Learned Address Translation Model Previous work: T. Kraska, A. Beutel, E. H. Chi, J. Dean, and N.

400 views • 10 slides
Two-photon experiments with detector MD1 at VEPP-4 Valery Telnov Budker INP and Novosibirsk St.

Two-photon experiments with detector MD1 at VEPP-4 Valery Telnov Budker INP and Novosibirsk St.

Two-photon experiments with detector MD1 at VEPP-4 Valery Telnov Budker INP and Novosibirsk St. Univ. PHOTON 2015 , June 16, 2015 1 16 June, 2015 . . Contents View on future of e+e- physics in 1970 A concept of an

484 views • 24 slides
-ray detector CATANA for E1 response of neutron-rich nuclei Tokyo Institute of Technology

-ray detector CATANA for E1 response of neutron-rich nuclei Tokyo Institute of Technology

-ray detector CATANA for E1 response of neutron-rich nuclei Tokyo Institute of Technology Yasuhiro Togano 10 March, ELPH calorimeter workshop E1 response of n-rich nuclei nuclei B(E1) strength Pygmy: Ex~10 MeV Giant: Ex~80A -1/3 MeV ~5% of TRK

202 views • 16 slides

More recommend