Tegra gra Go Goes s Ind ndustry: ustry: Emb mbedded edded Hyp - - PowerPoint PPT Presentation

www.perception-park.com

Tegra gra Go Goes s Ind ndustry: ustry: Emb mbedded edded Hyp ypersp erspectral ectral Imaging maging

GPU Technology Conference Munich, 11 October 2017 Michael Schoeffmann Session Id: 23161

www.perception-park.com

Embedded Hyperspectral Imaging

2

• Introduction
• What is Hyperspectral Imaging?
• Hyperspectral Environment / Workflow
• Application Examples
• Embedded Hyperspectral Imaging

www.perception-park.com

Introductory Example

3

Rice Processing:

• Customers Expect Pure Rice

www.perception-park.com

Introductory Example

4

Rice Processing:

• Customers Expect Pure Rice
• In Production Rice Is Contaminated

www.perception-park.com

Introductory Example

5

Rice Processing:

• Customers Expect Pure Rice
• In Production Rice Is Contaminated
• Undesired, e.g. Wood

www.perception-park.com

Introductory Example

6

Rice Processing:

• Customers Expect Pure Rice
• In Production Rice Is Contaminated
• Undesired, e.g. Wood
• Forbidden, e.g. Maggots
• Indistinguishable in Visible Light

www.perception-park.com

Introductory Example

7

Rice Processing:

• Customers Expect Pure Rice
• In Production Rice Is Contaminated
• Undesired, e.g. Wood
• Forbidden, e.g. Maggots
• Indistinguishable in Visible Light
• Clearly visible in Extended Light Range

www.perception-park.com

What is Light?

8

• Many object properties detectable in visible range, what if we extend this by the invisible range?

www.perception-park.com

What is Light?

9

• Many object properties detectable in visible range, what if we extend this by the invisible range?
• Common ranges: Visible, Infrared
• Also used: Terahertz, UV

www.perception-park.com

• Molecules interact with light
• A certain wavelength may be
• reflected,
• transmitted,
• absorbed or
• altered to some extent

Object consisting of Molecules

Light Measurement

10

Transmitted Light Reflected Light Absorbed Light Light Source

• Transmitted and reflected light

can be measured directly

• Measurement provides a

spectral fingerprint of a substance

www.perception-park.com

Hyperspectral Data vs RGB

11

• Hyperspectral cubes can have any number of channels instead of only RGB
• Depending on the acquisition technology, currently up to 1000+ wavelength positions

www.perception-park.com

Hyperspectral Data Models

12

• Hyperspectral models extract desired information
• Hyperspectral models project information to e.g. RGB or grayscale
• Hyperspectral models provide information in interpretable images

www.perception-park.com

Hyperspectral Imaging – What we heard so far

13

• Light is not limited to the visual range
• Reflected or transmitted light provides a spectral fingerprint of examined objects
• Hyperspectral cubes contain much more information than RGB images
• Hyperspectral models provide desired information in interpretable images

www.perception-park.com

Hyperspectral Environment - Motivation

14

www.perception-park.com

Hyperspectral Imaging – Two Main Challenges

15

Find the application relevant information. Apply the application in the field.

www.perception-park.com

Hyperspectral Environment – Two-tier approach

16

Perception STUDIO

• Acquire and work with hyperspectral data
• WYSIWYG Editor for hyperspectral models
• Compile configurations for real-time

processing Perception CORE

• GPU accelerated processing engine for configurations
• Camera abstraction, standardization and calibration
• Standard machine vision interfaces
• Ready for Deployment in Industry

Deploy

www.perception-park.com

Perception Studio – Develop an Application

17

• Customer needs no experience in
• Spectroscopy
• Image processing
• Acquisition technology
• Simple world of images
• Workflow
• Setup camera
• Acquire data cube
• Describe data cube
• Select method
• See output
• Generate model
• Apply to Core

www.perception-park.com

Perception Core – Deployed Application

18 Camera Application Machine Vision Appl.

GEV UDP

CamLink

GEV UDP

CamLink

... ...

device camera input streaming outp. configuration memory user cal.pac k

Eth.

... ...

RAM

GPU PU

line scan CI – Chemical Imaging CCI – Chemical Color Imaging C – Colorimetry IF – Interferometry area scan (snapshot) wavelength scan (MEMS)

Performance, Applicability Usability, Selectivity Compatibility Abstraction, Standardization

Industrial PC Processing Box Module Chip

www.perception-park.com

Application Example: Pharmaceutical in Blister

19

www.perception-park.com

Application Example: Mining

20

www.perception-park.com

Application Example: Polymer Recycling

21

www.perception-park.com

Application Example: API Distribution

22

www.perception-park.com

Embedded Hyperspectral Imaging: Why Tegra?

23

Performance

Size, Weight & Power Consumption

Efficient Code Development

Development Processing Power

No moving parts

www.perception-park.com

Embedded Hyperspectral Imaging: Special Purpose Device

24

Blood Vessel Camera

Vein Model

Output Object Moisture Camera Output Object

Moisture Model

www.perception-park.com

Distribution of Hyperspectral Systems

25

www.perception-park.com

Thank you for your attention!