Semantic Grid Map based LiDAR Localization in Highly Dynamic Urban - - PowerPoint PPT Presentation

semantic grid map based lidar localization
SMART_READER_LITE
LIVE PREVIEW

Semantic Grid Map based LiDAR Localization in Highly Dynamic Urban - - PowerPoint PPT Presentation

Semantic Grid Map based LiDAR Localization in Highly Dynamic Urban Scenarios 12 th IROS20 Workshop on Planning, Perception and Navigation for Intelligent Vehicles Oct. 2020 Chenxi Yang, Lei He, Hanyang Zhuang, Chunxiang Wang, Ming Yang *


slide-1
SLIDE 1

Semantic Grid Map based LiDAR Localization in Highly Dynamic Urban Scenarios

▪ Chenxi Yang, Lei He, Hanyang Zhuang, ▪ Chunxiang Wang, Ming Yang* ▪ * mingyang@sjtu.edu.cn ▪ This work is supported by the National Natural Science Foundation of China (U1764264/61873165)

12th IROS20 Workshop on Planning, Perception and Navigation for Intelligent Vehicles

  • Oct. 2020
slide-2
SLIDE 2

Contents 1

Intr troducti duction

  • n

2 3

Se Semantic tic grid id map

4

Local alization ization

5

Experi riment ent Related ated wo work k

slide-3
SLIDE 3

Introduction

Planni nning ng Perce ceptio ption Navigatio gation Contr trol

  • l

Ke Key tech.

  • h. of

autonom nomous

  • us

driving iving

Loca caliza ization ion

slide-4
SLIDE 4

Lo Localiza alization tion in AD

GNSS SS

Signal denial Multipath effect

Map-bas ased ed pose estim imation ation

Robust to illuminance High reliability

Dynam namic ic interferen rferences ces

Illuminance changes Low reliability

Introduction

slide-5
SLIDE 5

Contents 1 2 3 4 5

Intr troducti duction

  • n

Se Semantic tic grid id map Local alization ization Experi riment ent Related ated wo work k

slide-6
SLIDE 6

Environ ironme menta ntal l ma mapp pping

 GNSS-based sed

✓ global consistency

  • signal denial

 SLAM-base sed

✓ local consistency

  • cumulative error

Map Map fo form

 Point nt cloud

  • ud map

✓ accuracy

  • data size
  • real-time performance

 2D 2D gr grid d map

✓ data size & speed

  • information lost

 Feature re map

✓ accuracy & speed

  • sensitive to the environment

Related work

slide-7
SLIDE 7

LiDAR-based localization Non- semantics Point

IMLS-SLAM (ICRA2018)

Grid

Probabilistic Maps (ICRA2010) Robust Localization (ICRA2017)

Feature

LOAM (ICRA2014) SuMa (ICRA2018)

Descriptor

Segmatch (RSS2018) L3-Net (CVPR2019)

Semantics Semantic

feature

Lane (IROS2018) Pole-like (IROS2016)

Point cloud segmentation

Semantic ICP (BMVC2018)

Represent esentati ative ve methods

  • ds

Non-real time Dynamic interference Dynamic interference Dynamic interference

Feature missing Robustness Non-real time

Non-semantics: dynamic interference Semantics: difficult to find a balance between real-time and robustness

Multiple semantic features

MINES Stanford Baidu CMU Bonn KIT Freie

UMich

Agency cy

ETH Baidu

Non-real time Dynamic interference

Challe lenges ges

slide-8
SLIDE 8

Contents 1 2 3 4 5

Intr troducti duction

  • n

Se Semantic tic grid id map Local alization ization Experi riment ent Related ated wo work k

slide-9
SLIDE 9

Semantic grid map

▪ Featur ture e selecti ection

  • n

▪ Abundant in urban scenarios ▪ Strongly imply static ▪ Extractable from scan-level sparse point cloud ▪ Sufficient pose constraints from multiple layers

▪ Seman antic tic grid d map

▪ To speed up the calculation ▪ Semantic category with a trust rate

slide-10
SLIDE 10

Contents 1 2 3 4 5

Intr troducti duction

  • n

Se Semantic tic grid id map Local alization ization Experi riment ent Related ated wo work k

slide-11
SLIDE 11

Localization

▪ On On-li line ne pose se initiali ializa zation tion

▪ Large range search ▪ Limited to the first several frames ▪ Relatively low real-time requirements

  • > to keep as much map detail as possible, the SGM is in 3D formed by cubes

▪ Real-tim time e traje jecto ctory ry tracki cking ng

▪ Can inherit an accurate initial position from the previous frame ▪ Every frame ▪ Strict real-time requirements (typically 100ms)

  • > to ensure the calculation speed, the SGM is in 2D formed by squares
slide-12
SLIDE 12

▪ On On-li line ne pose se initiali ializa zation tion

▪ Notation Map Cubes Scan Cubes

Semantic Category

Localization

GMM

slide-13
SLIDE 13

Real-time trajectory tracking

▪ Real-tim time traje jecto ctory ry tracki cking

▪ Notation ▪ Residual error

slide-14
SLIDE 14

1 2 3 4 5

Intr troducti duction

  • n

Se Semantic tic grid id map Local alization ization Experi riment ent Related ated wo work k

Contents

slide-15
SLIDE 15

Experiment

▪ Proces cesso sor

▪ Intel i7-7567U @3.5GHz with 16GB memory

▪ Express press road

▪ 5.2km long

slide-16
SLIDE 16

Experiment

▪ On On-li line ne pose se initiali ializa zation tion

▪ (0.2m) 3 cube ▪ horizontal offset uniform distribution in 50m circle ▪ up to 90 degree offset ▪ a s speci cial al case Conjuncti nction

  • n

Initial ial position ion CPD Ours 2nd

d iterat

ation

  • n

Result lt

slide-17
SLIDE 17

▪ Real-tim time traje jecto ctory ry tracki cking

▪ (0.1m) 2 square

Experiment

slide-18
SLIDE 18

▪ Proces cesso sor

▪ Intel i7-7567U @3.5GHz with 16GB memory

▪ Facto ctory

▪ 1.5km long

Experiment

slide-19
SLIDE 19

Thank you for your attention!