INF5470 Fall 2010 Philipp Hfliger Lecture 6: Retinomorphic Vision - PowerPoint PPT Presentation

INF5470 — Fall 2010 Philipp Häfliger Lecture 6: Retinomorphic Vision

Content The Eye and Retina Photo Active CMOS Elements CMOS Photo Circuits Read-Out Strategies Retinomorphic Circuits Further (Neural?) Image Processing Motion Processing Feature Extraction Lecture 6: Retinomorphic Vision 2

Content The Eye and Retina Photo Active CMOS Elements CMOS Photo Circuits Read-Out Strategies Retinomorphic Circuits Further (Neural?) Image Processing Motion Processing Feature Extraction Lecture 6: Retinomorphic Vision 3

Eyeball Cross Section Lecture 6: Retinomorphic Vision 4

Retina Cells Lecture 6: Retinomorphic Vision 5

Schematized Retinal Cells Lecture 6: Retinomorphic Vision 6

Content The Eye and Retina Photo Active CMOS Elements CMOS Photo Circuits Read-Out Strategies Retinomorphic Circuits Further (Neural?) Image Processing Motion Processing Feature Extraction Lecture 6: Retinomorphic Vision 7

Photo Diode, Impact Ionization Lecture 6: Retinomorphic Vision 8

Photo Diode Layout Lecture 6: Retinomorphic Vision 9

Photo Transistor Layout Lecture 6: Retinomorphic Vision 10

Photo Gate Lecture 6: Retinomorphic Vision 11

Content The Eye and Retina Photo Active CMOS Elements CMOS Photo Circuits Read-Out Strategies Retinomorphic Circuits Further (Neural?) Image Processing Motion Processing Feature Extraction Lecture 6: Retinomorphic Vision 12

Amplification by Early Effect Lecture 6: Retinomorphic Vision 13

Logarithmic Amplification Lecture 6: Retinomorphic Vision 14

Common Source Amplifier Lecture 6: Retinomorphic Vision 15

Common Source, Negative Feedback Lecture 6: Retinomorphic Vision 16

Source Follower 3-transistor Active Pixel Sensor (APS) Lecture 6: Retinomorphic Vision 17

Content The Eye and Retina Photo Active CMOS Elements CMOS Photo Circuits Read-Out Strategies Retinomorphic Circuits Further (Neural?) Image Processing Motion Processing Feature Extraction Lecture 6: Retinomorphic Vision 18

Overview ◮ Addressing/Scanning ◮ Charge Coupled Devices (CCD) ◮ Address Event Representation (AER) Lecture 6: Retinomorphic Vision 19

Scanning Lecture 6: Retinomorphic Vision 20

CCD Lecture 6: Retinomorphic Vision 21

AER Lecture 6: Retinomorphic Vision 22

Content The Eye and Retina Photo Active CMOS Elements CMOS Photo Circuits Read-Out Strategies Retinomorphic Circuits Further (Neural?) Image Processing Motion Processing Feature Extraction Lecture 6: Retinomorphic Vision 23

Adaptive Pixel Lecture 6: Retinomorphic Vision 24

Non-Linear Element (Tobi-Element) Lecture 6: Retinomorphic Vision 25

Retina Pixel (Mahowald) Lecture 6: Retinomorphic Vision 26

Retina Pixel (Boahen) Lecture 6: Retinomorphic Vision 27

Dynamic Vision Sensor (DVS) Pixel (Lichtsteiner) Lecture 6: Retinomorphic Vision 28

Content The Eye and Retina Photo Active CMOS Elements CMOS Photo Circuits Read-Out Strategies Retinomorphic Circuits Further (Neural?) Image Processing Motion Processing Feature Extraction Lecture 6: Retinomorphic Vision 29

Token Based Motion Processing: Reichardt Detector Lecture 6: Retinomorphic Vision 30

Intensity Based Motion Processing Lecture 6: Retinomorphic Vision 31

Content The Eye and Retina Photo Active CMOS Elements CMOS Photo Circuits Read-Out Strategies Retinomorphic Circuits Further (Neural?) Image Processing Motion Processing Feature Extraction Lecture 6: Retinomorphic Vision 32

A Natural Scene Lecture 6: Retinomorphic Vision 33

‘Difference of Gaussians’ Kernel(1/2) Lecture 6: Retinomorphic Vision 34

‘Difference of Gaussians’ Kernel(2/2) Lecture 6: Retinomorphic Vision 35

Contrast Enhanced Natural Scene Lecture 6: Retinomorphic Vision 36

45 Degrees Edge Kernel (1/2) Lecture 6: Retinomorphic Vision 37

45 Degrees Edge Kernel (2/2) Lecture 6: Retinomorphic Vision 38

45 Degrees Edges Extracted from Natural Scene Lecture 6: Retinomorphic Vision 39