Remember last year ? Key takeaways from 2019 DSC speech : 1. Epic - - PowerPoint PPT Presentation

▶
remember last year
SMART_READER_LITE
LIVE PREVIEW

Remember last year ? Key takeaways from 2019 DSC speech : 1. Epic - - PowerPoint PPT Presentation

Oct 19, 2022 550 likes •799 views

DSC 2020 EUROPE VR Driving Simulation & Virtual Reality Conference & Exhibition Title Accelerate automotive simulation development Presenter Seb Loze | Simulation Industry Manager T : @SLFeeding #DSC2020 | sebastien.loze@epicgames.com

slide-1
SLIDE 1

DSC 2020 Europe VR

DSC 2020 EUROPE VR

Driving Simulation & Virtual Reality Conference & Exhibition

Palais des Congrès - Antibes September 9, 2020

Title

Presenter

Accelerate automotive simulation development Seb Loze | Simulation Industry Manager T : @SLFeeding #DSC2020 | sebastien.loze@epicgames.com

slide-2
SLIDE 2

#UE4 | @UNREALENGINE

Remember last year ?

Key takeaways from 2019 DSC speech :

1. Epic Games is strongly investing in some core non-game industries including Simulation

  • 2. Unreal Engine is free (source code is available

for free on GitHub as well)

  • 3. Eager to aggregate insights coming from

the simulation experts

slide-3
SLIDE 3

#UE4 | @UNREALENGINE

Remember yesterday ?

If you missed James Butcher Unreal Engine tutorial : https://learn.unrealengine.com/

slide-4
SLIDE 4

#UE4 | @UNREALENGINE

Driving Simulations | Smart and beautiful (and vice versa)

Depending on their goals, priorities in the development process of driving simulators is focussing

  • n 8 criterias impacting the way images are displayed (or not) :
  • Image accuracy
  • Photorealism
  • Dynamics Engine Integration
  • HIL Integration
  • AI Integration
  • Open Architecture
  • Support of standards
  • Pipeline Optimization

“One thing that we're not necessarily doing is we're not doing a fancy 3D world like this because we are simulating perception.” - Uber, Matt Ranney “UE4 allowed us to achieve an impressive graphics quality, allowing top quality lighting effects, and rain/wet terrain simulation” - Kunos Assetto Corsa, Marco Massarutto

slide-5
SLIDE 5

#UE4 | @UNREALENGINE

Driving Simulations | Smart and beautiful (and vice versa)

(Attributed values are projections based on typical use cases observations) Automotive digital marketing Man in the loop Simulator AV Simulator / machine learning Racing video game

slide-6
SLIDE 6

#UE4 | @UNREALENGINE

Unreal Engine | Driving Simulation use cases examples

https://www.infoq.com/presentations/uber-self-driving-software/

Inside a self-driving Uber

https://venturebeat.com/2019/04/20/gms-cruise-is-preparing-for-a-self- driving-future-in-the-cloud/

GM’s Cruise is preparing for a self-driving future in the cloud

https://www.extremetech.com/extreme/281649-nvidia-ai-can-render- complete-urban-environments-in-unreal-engine-4

Nvidia AI Can Render Complete Urban Environments in Unreal Engine 4

https://zoox.com/journal/

Zoox merging Simulation & Reality

https://www.vertechs.jp/autocity

Reikko and Vertechs create Auto City

https://www.prnewswire.com/news-releases/otsl-strengthens-its-3d- real-time-sensor-simulator-framework-cosmosim-r-ecosystem-for- autonomous-driving-300883916.html

OTSL strengthens 3D Real-Time Sensor Simulator Framework COSMOsim (R) Ecosystem

https://www.microsoft.com/en-us/garage/blog/2018/04/project-road- runner-train-autonomous-driving-algorithms-for-road-safety/

Microsoft Road-Runner photo-realistic simulation and deep learning to train autonomous driving algorithms

https://www.ijrte.org/wp-content/uploads/papers/v8i1/A7288058119.pdf

Development of Pedestrian Artificial Intelligence Utilizing Unreal Engine 4

slide-7
SLIDE 7

#UE4 | @UNREALENGINE

https://www.youtube.com/watch?v=FJsn2OGsLOc https://www.youtube.com/watch?v=wv5UeSZST5w https://www.youtube.com/watch?v=CUH5hwkl7dI&t=10s https://www.youtube.com/watch?v=feteiyjsHOQ https://www.youtube.com/watch?v=SyUQ2IImObA https://www.youtube.com/watch?v=5Xqqe9WcZnk

Digital Marketing - 2020 - Examples

slide-8
SLIDE 8

#UE4 | @UNREALENGINE

AV simulation and Engineering - 2020 - Examples

https://www.youtube.com/watch?v=skanz-dzaAg https://www.youtube.com/watch?v=ORpo_cpDH4s https://www.unrealengine.com/en-US/spotlights/ike-develops-virtual- simulator-for-automated-trucks-with-unreal-engine https://carla.org/ https://www.dspace.com/en/pub/home/news/sensor_realistic_simulation. cfm#143_54589 https://www.unrealengine.com/en-US/spotlights/cm-labs-links-best-in- class-real-time-toolsets-for-highest-fidelity-engineering-and-training- simulation

slide-9
SLIDE 9

#UE4 | @UNREALENGINE

Driving Simulations | Smart and beautiful (and vice versa)

(Attributed values are projections based on typical use cases observations) Automotive digital marketing Man in the loop Simulator AV Simulator / machine learning Racing video game

slide-10
SLIDE 10

#UE4 | @UNREALENGINE

slide-11
SLIDE 11

#UE4 | @UNREALENGINE

slide-12
SLIDE 12

#UE4 | @UNREALENGINE

What is so special about Driving Sim?

Challenges Content Creation Non visible spectrum Data accuracy Deployment Solutions Handling formats / GIS / Terrain Data / Stream the world Sensors ( handling / representation ) Identifying potential integrations Cloud vs local

slide-13
SLIDE 13

#UE4 | @UNREALENGINE

Content creation - the “classic” approach

UE4 integrated Landscape - Create your own procedural geotypical environment

  • Hand-crafted landscape, Terrain splines, Foliage tools, Marketplace assets
  • Several training zones in same environment
  • https://docs.unrealengine.com/en-

US/Engine/OpenWorldTools/index.html

  • https://docs.unrealengine.com/en-US/Engine/Landscape/index.html
  • With terrain generation tools (World Machine, Instant Terra,

World Creator, TerraForm)

  • …)
slide-14
SLIDE 14

#UE4 | @UNREALENGINE

Content creation - The “GIS data integration” approach

Adapting to traditional simulation content creation pipelines

VectorZero RoadRunner ESRI CityEngine TrianGraphics Trian3DBuilder Presagis O2U OpenStreetMap (free plugin) Presagis Terra Vista (UE4 output compiler WIP) LiDAR Point Cloud (UE 4.24 free plugin)

slide-15
SLIDE 15

#UE4 | @UNREALENGINE

Content creation - The “GIS data integration” approach

Adapting to traditional simulation content creation pipelines

VectorZero RoadRunner ESRI CityEngine TrianGraphics Trian3DBuilder Presagis O2U OpenStreetMap (free plugin) Presagis Terra Vista (UE4 output compiler WIP) LiDAR Point Cloud (UE 4.24 free plugin)

slide-16
SLIDE 16

#UE4 | @UNREALENGINE

Content creation - The “Standard DB” approach

ESRI ArcGIS Presagis CDB ORB Viewer Simblocks CDB RTP for UE CESIUM 3D Tiles

slide-17
SLIDE 17

#UE4 | @UNREALENGINE

slide-18
SLIDE 18

#UE4 | @UNREALENGINE

Content creation - your “Homemade” solution

< Insert here your challenges > Using Unreal Engine source code and open structure allows you to create your own importers and your optimization process from your source data

slide-19
SLIDE 19

#UE4 | @UNREALENGINE

Non visible spectrum

slide-20
SLIDE 20

#UE4 | @UNREALENGINE

Non visible spectrum

LIDAR semantic

slide-21
SLIDE 21

#UE4 | @UNREALENGINE

Non visible spectrum

< Insert here your challenges > We are using the sensors from our partners. We can help you to implement

  • yours. Some implementations are being done internally by Epic Games.

Your voices are important to help us to define what is our next step.

slide-22
SLIDE 22

#UE4 | @UNREALENGINE

Simulation data accuracy

slide-23
SLIDE 23

#UE4 | @UNREALENGINE

Deployment

slide-24
SLIDE 24

#UE4 | @UNREALENGINE

How to conclude ?

Progress have been made. Challenges have been taken care of. Partners are being supported to provide new solutions to the community. We can do better. Let’s make sure we don’t wait until the next DSC to chat. Send us a line ---> Simulation@epicgames.com Seb Loze | Simulation Industry Manager T : @SLFeeding #DSC2020 | sebastien.loze@epicgames.com