distributed multi sensor data fusion for 3d mapping ai
play

Distributed multi-sensor data fusion for 3D mapping & AI - PowerPoint PPT Presentation

Mar 23, 2024 •161 likes •310 views

Prof. Rozenn Dahyot Associate Professor in Statistics School of Computer Science & Statistics Trinity College Dublin https://www.scss.tcd.ie/Rozenn.Dahyot/ Distributed multi-sensor data fusion for 3D mapping & AI applications

  1. Prof. Rozenn Dahyot Associate Professor in Statistics School of Computer Science & Statistics Trinity College Dublin https://www.scss.tcd.ie/Rozenn.Dahyot/ Distributed multi-sensor data fusion for 3D mapping & AI applications https://www.meetup.com/Machine-Learning-Dublin/events/251878496/ #MLDublin meets Valeo @ DogPatch Labs 2018/06/25 The ADAPT Centre is funded under the SFI Research Centres Programme (Grant 13/RC/2106) and is co-funded under the European Regional Development Fund.

  2. Why do we need a Digital twin of the world? www.adaptcentre.ie • City planning (Future cities) • Virtual visits • Games, education • Data visualisation • Navigation (cars, drones) • Creating data for training AI ! • Driverless cars • Autonomous drones • Asset management • Environment monitoring (e.g. vegetation, Multiple source of Data pollution, ..) • Drones • Disaster prevention & emergency response • Social media (floods, earthquakes,…) • Google Street view • OpenStreetMap • Satellite imagery • Lidar • …

  3. Importance of virtual environments in AI www.adaptcentre.ie Closing the Simulation-to-Reality Gap for Deep Robotic Learning https://arxiv.org/abs/1709.07857 (2017, Google Brain)

  4. Digital Twin of the world using online data www.adaptcentre.ie Google Street View navigation TCD AI: using GSV imagery and OSM in game engine EU FP7 GRAISearch: https://www.youtube.com/channel/UCY_bkYqwO4K_jZzodE-LP5Q • Social Media based 3D Visual Popularity A. Bulbul and R. Dahyot, Computer & Graphics (2017) DOI:10.1016/j.cag.2017.01.005 • Populating Virtual Cities using Social Media A. Bulbul and R. Dahyot, Computer Animation and Virtual Worlds journal (2016) DOI:10.1002/cav.1742

  5. Digital Twin of the world with Drones www.adaptcentre.ie Trinity College Dublin Drone Survey Dataset J. Byrne, J. Connelly, J. Su, V. Krylov, M. Bourke, D. Moloney & R. Dahyot, Tech Report and Dataset (2017). http://www.tara.tcd.ie/handle/2262/81836 Applications of the VOLA Format for 3D Data Knowledge Discovery. Byrne, Jonathan & al (2017). International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery Interactive Demo Virtual visit at https://www.scss.tcd.ie/Rozenn.Dahyot/TCDCampusWebGL2/

  6. Digital Twin of the world with Semantic labelling www.adaptcentre.ie EU project VARCITY (Variation & the City) (2012-2017, PI: Luc S. J. Van Gool) https://varcity.ethz.ch/ Target . Automatic discovery and geotagging of recurring stationary objects from Street Level imagery: • Utility companies’ assets • Street signage • Vegetation Info @ https://www.adaptcentre.ie/case-studies/aimapit " Automatic Discovery and Geotagging of Objects from Street View Imagery ". V. A. Krylov, E. Kenny, R. Dahyot. Remote Sensing (2018). https://doi.org/10.3390/rs10050661

  7. Digital Twin of the world with sensor data fusion www.adaptcentre.ie  Vision module: fully convolutional neural networks (FCNN) for semantic segmentation and monocular depth estimation Mapillary Vistas Dataset Average processing speed of 200km/h on desktop PC  Sensor fusion module: Markov Random Fields (MRF) V. A. Krylov, R. Dahyot. "Object Geolocation using MRF-based Multi-sensor Fusion", IEEE International Conference on Image Processing (ICIP 2018 - to appear )

  8. Bringing AI on the edge www.adaptcentre.ie https://www.bonseyes.com/ BONSEYES: Platform for Open Development of Systems of Artificial Intelligence T. Llewellynn et al., ACM International Conference on Computing Frontiers 2017 DOI:10.1145/3075564.3076259

  9. Mathematics of AI www.adaptcentre.ie y machine g(y) x f(x) • Supervised scenario: When observations are paired • (𝒋) (𝒋) • Unsupervised scenario: When observations are not paired (𝒋) (𝒌) •

  10. Mathematics of AI www.adaptcentre.ie Example f 𝑦 ∈ ℝ � and g 𝑧 ∈ ℝ � 𝑧 � � = 𝜒 � � 𝑦 𝑧 � � = 𝜒 � � 𝑦 Shape Registration with Directional Data M. Grogan & R. Dahyot, Pattern Recognition (2018) DOI:10.1016/j.patcog.2018.02.021

  11. Mathematics of AI www.adaptcentre.ie Video credit @gabrielpeyre https://youtu.be/FLhabslT4y4 Automated Colour Grading using Colour Distribution Transfer F. Pitie, A. Kokaram & R. Dahyot, Computer Vision and Image Understanding (2007) DOI:10.1016/j.cviu.2006.11.011 Robust Registration of Gaussian Mixtures for Colour Transfer User Interaction for Image Recolouring using L2 M. Grogan and R. Dahyot M. Grogan, R. Dahyot and A. Smolic, in Conference on Visual Media arxiv.org/abs/1705.06091 (2017) Production (CVMP), London, December 2017 DOI:10.1145/3150165.3150171

  12. Expertise for designing intelligent systems www.adaptcentre.ie Computer Vision Signal processing Computer Graphics Machine Learning Statistics Engineering Algorithms Mathematics Environment, Energy, Geospatial Data Analytics Smart cities,… …

  13. www.adaptcentre.ie Questions? Thank you! Prof. Rozenn Dahyot & Co https://www.scss.tcd.ie/Rozenn.Dahyot/Research.html#Team

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Distributed Fusion in Sensor Distributed Fusion in Sensor Networks Networks Jie Gao Computer

Distributed Fusion in Sensor Distributed Fusion in Sensor Networks Networks Jie Gao Computer

Distributed Fusion in Sensor Distributed Fusion in Sensor Networks Networks Jie Gao Computer Science Department Stony Brook University Papers Papers [Xiao04] Lin Xiao, Stephen Boyd, Fast Linear Iterations for Distributed Averaging ,

659 views • 50 slides
ASYNCHRONOUS MULTI-SENSOR FUSION FOR 3D MAPPING AND LOCALIZATION Patrick Geneva, Kevin Eckenhoff,

ASYNCHRONOUS MULTI-SENSOR FUSION FOR 3D MAPPING AND LOCALIZATION Patrick Geneva, Kevin Eckenhoff,

ASYNCHRONOUS MULTI-SENSOR FUSION FOR 3D MAPPING AND LOCALIZATION Patrick Geneva, Kevin Eckenhoff, and Guoquan Huang Presented by Yulin Yang September 24, 2017 Department of Mechanical Engineering, University of Delaware, USA MOTIVATIONS

235 views • 10 slides
Introduction to Sensor Data Fusion Methods and Applications Last lecture: Why Sensor Data

Introduction to Sensor Data Fusion Methods and Applications Last lecture: Why Sensor Data

Introduction to Sensor Data Fusion Methods and Applications Last lecture: Why Sensor Data Fusion? Motivation, general context Discussion of examples Today: Steep climb to a first algorithm. oral examination: 6 credit points

1.02k views • 56 slides
Introduction to Sensor Data Fusion Methods and Applications Last lecture: Why Sensor Data

Introduction to Sensor Data Fusion Methods and Applications Last lecture: Why Sensor Data

Introduction to Sensor Data Fusion Methods and Applications Last lecture: Why Sensor Data Fusion? Motivation, general context Discussion of examples Today: Steep climb to a first algorithm. oral examination: 6 credit points

995 views • 42 slides
Sequential Monte Carlo Methods Particle Filter Martin Ulmke Head of Research Group

Sequential Monte Carlo Methods Particle Filter Martin Ulmke Head of Research Group

Sequential Monte Carlo Methods Particle Filter Martin Ulmke Head of Research Group Distributed Sensor Systems Sensor Data and Information Fusion Fraunhofer FKIE Lecture: Introduction to Sensor Data Fusion 12 December 2018 Inhalt

1.27k views • 74 slides
Software-Defined Multi-Spectral Imaging System Image and Information Fusion Experiments for

Software-Defined Multi-Spectral Imaging System Image and Information Fusion Experiments for

Software-Defined Multi-Spectral Imaging System Image and Information Fusion Experiments for Aviation and Marine Sensor Networks Sam Siewert, AIAA SciTech 2017 - January 10, 2017 Fusion of Networked Sensor Systems Goals and Objectives

429 views • 32 slides
vil : Dri Drift ft with th De Devi Security of Multi-Sensor Fusion based Localization in

vil : Dri Drift ft with th De Devi Security of Multi-Sensor Fusion based Localization in

vil : Dri Drift ft with th De Devi Security of Multi-Sensor Fusion based Localization in High-Level Autonomous Driving under GPS Spoofing Junjie Shen , Jun Yeon Won, Zeyuan Chen, Qi Alfred Chen ASGuard A utonomous S ystem Gu Guard

394 views • 20 slides
On-line Fusion of Functional Knowledge Within Distributed Sensor Networks Dominik Fisch, Bernhard

On-line Fusion of Functional Knowledge Within Distributed Sensor Networks Dominik Fisch, Bernhard

On-line Fusion of Functional Knowledge Within Distributed Sensor Networks Dominik Fisch, Bernhard Sick Intelligent Embedded Systems Group University of Kassel www.ies-research.de Final Colloquium of the DFG Priority Program 1183 Organic

575 views • 21 slides
On-line Fusion of Functional Knowledge Within Distributed Sensor Networks Dominik Fisch, Bernhard

On-line Fusion of Functional Knowledge Within Distributed Sensor Networks Dominik Fisch, Bernhard

On-line Fusion of Functional Knowledge Within Distributed Sensor Networks Dominik Fisch, Bernhard Sick Research Group Computationally Intelligent Systems University of Applied Sciences Deggendorf www.cis-research.de 11th Colloquium of

435 views • 22 slides
Exploration of a Multi-Sensor Approach for the Detection and Mapping of Coal Mine Fires in the

Exploration of a Multi-Sensor Approach for the Detection and Mapping of Coal Mine Fires in the

Office of Surface Mining Reclamation and Enforcement Geospatial Information Services Exploration of a Multi-Sensor Approach for the Detection and Mapping of Coal Mine Fires in the United States Alex Sivitskis AmeriCorps Member GIS and Remote

214 views • 20 slides
Efficient Algorithm for Serial Data Fusion in Wireless Sensor

Efficient Algorithm for Serial Data Fusion in Wireless Sensor

Efficient Algorithm for Serial Data Fusion in Wireless Sensor Networks A. Mostefaoui 1 , M. Melkemi 2 and A. Boukerche 3 1 University of Franche-Comt, France

701 views • 51 slides
Figure 1: Visual representation of M 3 Fusion . II. D ATA The study was carried out on Reunion

Figure 1: Visual representation of M 3 Fusion . II. D ATA The study was carried out on Reunion

M 3 Fusion : A Deep Learning Architecture for Multi- { Scale/Modal/Temporal } satellite data fusion P. Benedetti, D. Ienco, R. Gaetano, K. Os e, R. Pensa and S. Dupuy Abstract Modern Earth Observation systems provide sensing data at different

107 views • 9 slides
Data Fusion in Sensor Networks Hugh Durrant-Whyte ARC Federation Fellow, Research Director ARC

Data Fusion in Sensor Networks Hugh Durrant-Whyte ARC Federation Fellow, Research Director ARC

Data Fusion in Sensor Networks Hugh Durrant-Whyte ARC Federation Fellow, Research Director ARC Centre of Excellence for Autonomous Systems The University of Sydney, Australia hugh@cas.edu.au ARC=Australian version of NSF Slide 1 IPAM Sensor

805 views • 36 slides
Data Assimilation and Detection in Multi-Sensor & Multi-Scale Environments N. Sri

Data Assimilation and Detection in Multi-Sensor & Multi-Scale Environments N. Sri

Data Assimilation and Detection in Multi-Sensor & Multi-Scale Environments N. Sri Namchchivaya Andrea Barreiro, Shanshan Liu, Kristjan Onu, Jun Park Pete Sauer, and Richard Sowers Department of Aerospace Engineering University of Illinois

379 views • 34 slides
A method of personal positioning based on sensor data fusion of wearable camera and

A method of personal positioning based on sensor data fusion of wearable camera and

A method of personal positioning based on sensor data fusion of wearable camera and self-contained sensors. *1 *2 *1 Makasakatsu Kourogi and Takeshi Kurata *1 National Institute of Advanced Industrial Science and Technology (AIST) *2 HIT

483 views • 24 slides
Multi-scale Geometric Summaries for Similarity-based Upstream Sensor Fusion Christopher Tralie,

Multi-scale Geometric Summaries for Similarity-based Upstream Sensor Fusion Christopher Tralie,

Multi-scale Geometric Summaries for Similarity-based Upstream Sensor Fusion Christopher Tralie, Paul Bendich, John Harer Duke University, ECE / Math 3/6/2019 Christopher Tralie, Paul Bendich, John Harer Multi-scale Geometric Summaries for

292 views • 28 slides
Bayesian Variable Selection via Spike-and-Slab Priors: Annotated Bibliography Marina

Bayesian Variable Selection via Spike-and-Slab Priors: Annotated Bibliography Marina

Bayesian Variable Selection via Spike-and-Slab Priors: Annotated Bibliography Marina Vannucci Department of Statistics, Rice University, Houston, TX 77030, USA June 10, 2013 This is a collection of references and readings related to the

334 views • 11 slides
Toric Fiber Products Seth Sullivant North Carolina State University June 8, 2011 Seth Sullivant

Toric Fiber Products Seth Sullivant North Carolina State University June 8, 2011 Seth Sullivant

Toric Fiber Products Seth Sullivant North Carolina State University June 8, 2011 Seth Sullivant (NCSU) Toric Fiber Products June 8, 2011 1 / 26 Families of Ideals Parametrized by Graphs Let G be a finite graph Let R G a polynomial ring

370 views • 26 slides
BRAID: Discovering Lag Correlations in Multiple Streams Yasushi Sakurai (NTT Cyber Space Labs)

BRAID: Discovering Lag Correlations in Multiple Streams Yasushi Sakurai (NTT Cyber Space Labs)

BRAID: Discovering Lag Correlations in Multiple Streams Yasushi Sakurai (NTT Cyber Space Labs) Spiros Papadimitriou (Carnegie Mellon Univ.) Christos Faloutsos (Carnegie Mellon Univ.) Motivation n Data-stream applications q Network analysis q

728 views • 59 slides
Declaring Independence via the Sketching of Sketches Piotr Indyk Andrew McGregor Massachusetts

Declaring Independence via the Sketching of Sketches Piotr Indyk Andrew McGregor Massachusetts

Declaring Independence via the Sketching of Sketches Piotr Indyk Andrew McGregor Massachusetts Institute of Technology University of California, San Diego Until August 08 -- Hire Me! The Problem The Problem Center for Disease Control

1.12k views • 63 slides
WHAT CLERKS NEED TO KNOW ABOUT PUBLIC EMPLOYMENT LAW IIMC Clerks Certification Institute February

WHAT CLERKS NEED TO KNOW ABOUT PUBLIC EMPLOYMENT LAW IIMC Clerks Certification Institute February

Diane M. Juffras School of Government (919) 843-4926 juffras@sog.unc.edu WHAT CLERKS NEED TO KNOW ABOUT PUBLIC EMPLOYMENT LAW IIMC Clerks Certification Institute February 15, 2019 EMPLOYMENT AT WILL A. The Rule : Absent a statute or ordinance

681 views • 34 slides
Recap: ADA Provisions that Apply to All Applicants and Employees Retaliation Improper

Recap: ADA Provisions that Apply to All Applicants and Employees Retaliation Improper

Reasonable Accommodation Update DBTAC 8/18/15 Jeanne Goldberg, Senior Attorney Advisor Office of Legal Counsel U.S. Equal Employment Opportunity Commission 1 Recap: ADA Provisions that Apply to Individuals with Disabilities Disparate

287 views • 14 slides
LIBRA FIELD Leveraging Brazilian Pre-Salt Development and Technological Innovation from Petrobras

LIBRA FIELD Leveraging Brazilian Pre-Salt Development and Technological Innovation from Petrobras

LIBRA FIELD Leveraging Brazilian Pre-Salt Development and Technological Innovation from Petrobras ultra-deep water projects China-Brazil Forum for Subsea Technology MAY 16 th , 2016 RIO DE JANEIRO, RJ, BRAZIL Orlando Ribeiro Subsea,

506 views • 19 slides
PBS Documentary Series Nerds 2.0.1: A Brief History of the Internet Part 1: Networking the

PBS Documentary Series Nerds 2.0.1: A Brief History of the Internet Part 1: Networking the

CS101 Lecture 07: History of the Internet Aaron Stevens 2 February 2009 1 PBS Documentary Series Nerds 2.0.1: A Brief History of the Internet Part 1: Networking the Nerds: Part 1: Networking the Nerds:

259 views • 4 slides

More recommend