INF5470 Fall 2010 Philipp Hfliger Lecture 6: Retinomorphic Vision - - PowerPoint PPT Presentation

▶

Nov 10, 2022 416 likes •825 views

INF5470 Fall 2010 Philipp Hfliger Lecture 6: Retinomorphic Vision Content The Eye and Retina Photo Active CMOS Elements CMOS Photo Circuits Read-Out Strategies Retinomorphic Circuits Further (Neural?) Image Processing Motion

SLIDE 1

INF5470 — Fall 2010

Philipp Häfliger Lecture 6: Retinomorphic Vision

SLIDE 2

Content

The Eye and Retina Photo Active CMOS Elements CMOS Photo Circuits Read-Out Strategies Retinomorphic Circuits Further (Neural?) Image Processing Motion Processing Feature Extraction

Lecture 6: Retinomorphic Vision 2

SLIDE 3

Content

The Eye and Retina Photo Active CMOS Elements CMOS Photo Circuits Read-Out Strategies Retinomorphic Circuits Further (Neural?) Image Processing Motion Processing Feature Extraction

Lecture 6: Retinomorphic Vision 3

SLIDE 4

Eyeball Cross Section

Lecture 6: Retinomorphic Vision 4

SLIDE 5

Retina Cells

Lecture 6: Retinomorphic Vision 5

SLIDE 6

Schematized Retinal Cells

Lecture 6: Retinomorphic Vision 6

SLIDE 7

Content

The Eye and Retina Photo Active CMOS Elements CMOS Photo Circuits Read-Out Strategies Retinomorphic Circuits Further (Neural?) Image Processing Motion Processing Feature Extraction

Lecture 6: Retinomorphic Vision 7

SLIDE 8

Photo Diode, Impact Ionization

Lecture 6: Retinomorphic Vision 8

SLIDE 9

Photo Diode Layout

Lecture 6: Retinomorphic Vision 9

SLIDE 10

Photo Transistor Layout

Lecture 6: Retinomorphic Vision 10

SLIDE 11

Photo Gate

Lecture 6: Retinomorphic Vision 11

SLIDE 12

Content

The Eye and Retina Photo Active CMOS Elements CMOS Photo Circuits Read-Out Strategies Retinomorphic Circuits Further (Neural?) Image Processing Motion Processing Feature Extraction

Lecture 6: Retinomorphic Vision 12

SLIDE 13

Amplification by Early Effect

Lecture 6: Retinomorphic Vision 13

SLIDE 14

Logarithmic Amplification

Lecture 6: Retinomorphic Vision 14

SLIDE 15

Common Source Amplifier

Lecture 6: Retinomorphic Vision 15

SLIDE 16

Common Source, Negative Feedback

Lecture 6: Retinomorphic Vision 16

SLIDE 17

Source Follower

3-transistor Active Pixel Sensor (APS)

Lecture 6: Retinomorphic Vision 17

SLIDE 18

Content

The Eye and Retina Photo Active CMOS Elements CMOS Photo Circuits Read-Out Strategies Retinomorphic Circuits Further (Neural?) Image Processing Motion Processing Feature Extraction

Lecture 6: Retinomorphic Vision 18

SLIDE 19

Overview

◮ Addressing/Scanning ◮ Charge Coupled Devices (CCD) ◮ Address Event Representation (AER)

Lecture 6: Retinomorphic Vision 19

SLIDE 20

Scanning

Lecture 6: Retinomorphic Vision 20

SLIDE 21

CCD

Lecture 6: Retinomorphic Vision 21

SLIDE 22

AER

Lecture 6: Retinomorphic Vision 22

SLIDE 23

Content

The Eye and Retina Photo Active CMOS Elements CMOS Photo Circuits Read-Out Strategies Retinomorphic Circuits Further (Neural?) Image Processing Motion Processing Feature Extraction

Lecture 6: Retinomorphic Vision 23

SLIDE 24

Adaptive Pixel

Lecture 6: Retinomorphic Vision 24

SLIDE 25

Non-Linear Element (Tobi-Element)

Lecture 6: Retinomorphic Vision 25

SLIDE 26

Retina Pixel (Mahowald)

Lecture 6: Retinomorphic Vision 26

SLIDE 27

Retina Pixel (Boahen)

Lecture 6: Retinomorphic Vision 27

SLIDE 28

Dynamic Vision Sensor (DVS) Pixel (Lichtsteiner)

Lecture 6: Retinomorphic Vision 28

SLIDE 29

Content

The Eye and Retina Photo Active CMOS Elements CMOS Photo Circuits Read-Out Strategies Retinomorphic Circuits Further (Neural?) Image Processing Motion Processing Feature Extraction

Lecture 6: Retinomorphic Vision 29

SLIDE 30

Token Based Motion Processing: Reichardt Detector

Lecture 6: Retinomorphic Vision 30

SLIDE 31

Intensity Based Motion Processing

Lecture 6: Retinomorphic Vision 31

SLIDE 32

Content

The Eye and Retina Photo Active CMOS Elements CMOS Photo Circuits Read-Out Strategies Retinomorphic Circuits Further (Neural?) Image Processing Motion Processing Feature Extraction

Lecture 6: Retinomorphic Vision 32

SLIDE 33

A Natural Scene

Lecture 6: Retinomorphic Vision 33

SLIDE 34

‘Difference of Gaussians’ Kernel(1/2)

Lecture 6: Retinomorphic Vision 34

SLIDE 35

‘Difference of Gaussians’ Kernel(2/2)

Lecture 6: Retinomorphic Vision 35

SLIDE 36

Contrast Enhanced Natural Scene

Lecture 6: Retinomorphic Vision 36

SLIDE 37

45 Degrees Edge Kernel (1/2)

Lecture 6: Retinomorphic Vision 37

SLIDE 38

45 Degrees Edge Kernel (2/2)

Lecture 6: Retinomorphic Vision 38

SLIDE 39

45 Degrees Edges Extracted from Natural Scene

Lecture 6: Retinomorphic Vision 39