Computer Vision Meets Visual Computing : Augmented Reality & The - - PowerPoint PPT Presentation

▶
computer vision meets visual computing augmented reality
SMART_READER_LITE
LIVE PREVIEW

Computer Vision Meets Visual Computing : Augmented Reality & The - - PowerPoint PPT Presentation

Jun 16, 2023 363 likes •643 views

Computer Vision Meets Visual Computing : Augmented Reality & The GPU Trak Lord, US Marketing & Media Relations http://www.facebook.com/metaio @twitt_AR http://twitter.com/#!/twitt_AR http://augmentedblog.wordpress.com/ feedback

slide-1
SLIDE 1

Computer Vision Meets Visual Computing: Augmented Reality & The GPU

Trak Lord, US Marketing & Media Relations

slide-2
SLIDE 2

info@metaio.com www.metaio.com Phone (EMEA): +49-89-5480-198-0 Phone (US): +1-415-814-3376 http://www.youtube.com/user/metaioAR http://www.flickr.com/photos/metaio/ http://augmentedblog.wordpress.com/ @twitt_AR http://www.facebook.com/metaio http://twitter.com/#!/twitt_AR

feedback encouraged

@traklord @metaioUS

#SIGGRAPH

slide-3
SLIDE 3

Something to talk about

  • Company background
  • AR Graphics pipeline
  • The Demand for AR
  • AR for hardware
  • NVIDIA
  • Conclusion Q&A
slide-4
SLIDE 4

Who is Metaio?

  • Leading Augmented Reality Software

& Solutions Provider

  • Extensive Patent & IP Portfolio
  • Decade of AR
  • AR SDK with 50k Developers
  • Over 300 AR apps powered by Metaio
  • 500+ B2B customers (IKEA, Lego,

Audi, Mitsubishi Electric)

  • Munich HQ + San Francisco Office
  • Only AR Company to offer solutions,

middleware, hardware IP & content

slide-5
SLIDE 5

Who is Metaio?

http://www.youtube.com/watch?v=-24ySXEMq1U

slide-6
SLIDE 6

How can AR help Graphics?

The Dream:

A graphic designer can take any 3-D asset and instantly transfer it to the real world, where he or she can instantly do two things:

  • Visualize it in its natural

environment

  • Compare it to its real-world

counterpart

slide-7
SLIDE 7

Augmented Graphics

  • More precise models
  • Simplified content creation

pipeline

  • Bone animations
  • Motion builder
  • .FBX support
slide-8
SLIDE 8

Augmented Graphics

http://www.youtube.com/watch?v=_Ij9kcWsni4

slide-9
SLIDE 9

Augmented Graphics

http://www.youtube.com/watch?v=DKEcQ9uiII0

slide-10
SLIDE 10

The Demand for Augmented Reality

Things we already know

  • Augmented Reality is a

useful technology

  • It provides value to

companies all over the world

  • Visualization technology

can reduce need for physical materials

  • 2-D has limits
slide-11
SLIDE 11

The Demand for Augmented Reality

+22M Views +4M Views +20M Views +330K Views

slide-12
SLIDE 12

The Demand for Augmented Reality

The software is there, the algorithms are there, the capabilities are there, but the hardware just isn’t.

slide-13
SLIDE 13

The AREngine: A hardware solution for AR

http://www.youtube.com/watch?v=6br7NreTwD4

slide-14
SLIDE 14

More Compute Power Is Good For AR

CPU Compute Tasks (software level)

  • Descriptors matching
  • Feature extraction
  • Algorithms
  • Camera
  • Display
  • Cloud connectivity
slide-15
SLIDE 15

More Compute Power Is Good For AR

slide-16
SLIDE 16

More Compute Power Is Good For AR

slide-17
SLIDE 17

More Compute Power Is Good For AR

slide-18
SLIDE 18

Algorithmic hot spots Image Capture Pre-Processing / Color Conversion Feature Extraction Building Feature Descriptors Feature Matching Pose Estimation Rendering 3D Objects Sensor Capture Capture Image Upload Image Composition

3-D Sensor Pipeline

slide-19
SLIDE 19
  • Far more expensive to MOVE data than

COMPUTE data

  • Energy efficiency is important for both silicon

AND software design

  • Core stays idle when HW IP is ON
  • Local SRAM for power efficient zero latency

access

  • Need to use hardware acceleration
  • Feature Matching by AREngine gets up to

60X faster than doing it on core

  • Efficient caching and memory usage
  • Reduces data movement
  • A must for comparing large databases
  • Faster object recognition and location
  • Smoother user experience
  • No longer limited to 2-D planar tracking

32-bit Integer Add 1pJ 32-bit Float Operation 7pJ 32-bit Register Write 0.5pJ Send 32-bits 2mm 24pJ Send 32-bits Off-chip 50pJ

For 40nm, 1V process

Write 32-bits to Memory 600pJ

Energy spent during typical MOVE/COMPUTE operations (Source: Khronos Group/NVIDIA)

More Compute Power Is Good For AR

slide-20
SLIDE 20

20

More Compute Power Is Good For AR

slide-21
SLIDE 21

More Compute Power Is Good For AR

Problems

  • power consumption
  • feature matching (most

expensive in memory matching and energy)

  • data and end user

experience varies, but feature matching is always the same process

slide-22
SLIDE 22

More Compute Power Is Good For AR

Solutions

  • GPU / CPU Optimization
  • OpenCL (software)
  • CUDA
  • Dedicated Hardware IP
slide-23
SLIDE 23

More Compute Power Is Good For AR

Results

  • Feature Matching by AREngine

gets up to 60X faster than doing it on core

  • Faster object recognition and

location

  • Smoother user experience
  • No longer limited to 2-D planar

tracking

  • Reality becomes a canvas,

upon which we can design the virtual intersection of the two worlds

slide-24
SLIDE 24
  • Optimized client-based visual

search for +100 images

  • Improved stability, robustness

and performance of ID Marker and 2-D markerless tracking

  • Improved performance of 3-D
  • bject tracking and training
  • SLAM integration
  • Sensor fusion for visual-based

tracking

  • AREL (HTML5 & JavaScript)

Metaio SDK (metaio.com/products/sdk)

http://www.youtube.com/watch?v=EltxfrbDZIg

slide-25
SLIDE 25
slide-26
SLIDE 26

Join us at this year’s InsideAR

metaio.com/insideAR

http://www.youtube.com/watch?v=SvU1pDANDkU

slide-27
SLIDE 27

http://bit.ly/metaioblog info@metaio.com @metaioUS

thank you + Q&A

http://youtube.com/MetaioAR