What does the visual system know about shadows Patrick Cavanagh - - PowerPoint PPT Presentation

what does the visual system know about shadows
SMART_READER_LITE
LIVE PREVIEW

What does the visual system know about shadows Patrick Cavanagh - - PowerPoint PPT Presentation

Laboratoire Psychologie de la Perception What does the visual system know about shadows Patrick Cavanagh Universit Paris Descartes Processing shadows 1. Recognize shadows 2. Use their information for relative position and surface shape


slide-1
SLIDE 1

Laboratoire Psychologie de la Perception

Patrick Cavanagh Université Paris Descartes

What does the visual system know about shadows

slide-2
SLIDE 2
  • 1. Recognize shadows
  • 2. Use their information for

relative position and surface shape

  • 3. Throw them out

Processing shadows

slide-3
SLIDE 3

!

Shadow terms

slide-4
SLIDE 4

Some simple rules Help from conjoint shape-shadow recovery

  • 1. Recognizing shadows
slide-5
SLIDE 5
  • No. 277, Jiro Takamatsu, 1968

Shadow-object inconsistency OK as long as shadow is darker Can’t always check the shape

Simple rules for what is a shadow

Cavanagh & Leclerc 1989

slide-6
SLIDE 6

Inconsistency goes unnoticed

Fra Carnevale, Birth of the Virgin, 1467

slide-7
SLIDE 7

When is an inconsistency noticed?

Pawan Sinha altering newpaper photo

  • f photographer Cornell Capa

Shadows must be consistent within object

slide-8
SLIDE 8

How quickly do we find a BAD illuminant?

Ostrovsky, Cavanagh, Sinha, 2005

About 5000 ms

slide-9
SLIDE 9

A shadow should not have its own contour or texture

Simple rules for what is a shadow

Cavanagh & Leclerc 1989

Cavanagh & Kennedy, Science 2000

slide-10
SLIDE 10

But not darker, not good Can be wrong color

Maurice de Vlaminck, Still Life Georges Braque

Simple rules for what is a shadow

Cavanagh & Leclerc 1989

slide-11
SLIDE 11

Can be wrong color but must be darker

Simple rules for what is a shadow

Cavanagh & Leclerc 1989

slide-12
SLIDE 12

Simple rules for what is a shadow

Cavanagh & Leclerc 1989

Shadows should not have volume — must appear to lie flat on surface

slide-13
SLIDE 13

2-tone images: cannot tell black shadow from black pigment Unless you already know what the object is But cannot identify object until you identify shadow vs pigment

Recognizing object and shadow together

Tolstoy, Giorgio Kienerk, 1904

slide-14
SLIDE 14

How?

Two-tone image Contours Ignore cast shadow contours 2D match finds some characteristic contours of a face Retrieve prototypical head from memory, check against image

Cavanagh, 1991

slide-15
SLIDE 15

The contours alone are often impossible to recognize

slide-16
SLIDE 16

The recognition requires a familiar object Here same, parts, different arrangements

slide-17
SLIDE 17

Recognize a shadow

Simple shadow rules: darker, no border, no volume Can be checked LOCALLY Do not need to check if shadows consistent across the whole scene. Sometimes shadows come as part of object recognition

slide-18
SLIDE 18
  • 2. Recover information

Relative position Object shape Surface shape

slide-19
SLIDE 19

Relative position

Pascal Mamassian

slide-20
SLIDE 20

Relative position

!

slide-21
SLIDE 21

Relative position

slide-22
SLIDE 22

Relative position

Offset or absent cast shadow can make you float

slide-23
SLIDE 23

Object shape

Shadows are silhouettes of the casting object Seen from the light’s viewpoint Silhouettes are sometimes interpretable

slide-24
SLIDE 24

Object shape

But often not And a different viewpoint is not readily integrated into object information

!

slide-25
SLIDE 25

Surface structure

Often too complicated

!

slide-26
SLIDE 26
  • 3. Throw them out

Image All contours “Depth sketch”

Shadow contours are noise when it comes to identifying object shapes At some point they need to be removed

slide-27
SLIDE 27

Rensink & Cavanagh, 2004

Visual search for an odd tilt Much slower if the tilted element appears to be a shadow Than if not Slow Faster When are they thrown out?

slide-28
SLIDE 28

Search was slow

Target Distractor

Search was fast

Target Distractor

Darker, no contour Taken as shadow and removed before search can access them

slide-29
SLIDE 29

How quickly do we determine what is a shadow? Faster than the beginning of rapid visual search About 150 msec

slide-30
SLIDE 30
  • 3. Throw them out

Where are they thrown out? Areas of visual system that no longer represent shadow borders.

slide-31
SLIDE 31
  • 1. Recognize shadows
  • 2. Use their information for

relative position and surface shape

  • 3. Throw them out

Processing shadows