Display Blocks EE367/CS448I: Computational Imaging and Display - - PowerPoint PPT Presentation

▶
display blocks
SMART_READER_LITE
LIVE PREVIEW

Display Blocks EE367/CS448I: Computational Imaging and Display - - PowerPoint PPT Presentation

Mar 31, 2023 509 likes •1.4k views

Display Blocks EE367/CS448I: Computational Imaging and Display stanford.edu/class/ee367 Lecture 14 Gordon Wetzstein Stanford University Logistics final project poster presentations: Wed 3/11, 3:00-5:30pm, Packard Atrium use poster

slide-1
SLIDE 1

Display Blocks

Gordon Wetzstein Stanford University EE367/CS448I: Computational Imaging and Display stanford.edu/class/ee367 Lecture 14

slide-2
SLIDE 2

Logistics

  • final project poster presentations: Wed 3/11, 3:00-5:30pm, Packard Atrium
  • use poster template from website – poster printing instructions to follow
  • your poster must be up by 2:30pm; at least one of your team should be at the

poster until both the instructor and your project mentor talked to you

  • 3-4 minute presentations for each poster – get to the point quickly: what is the

goal of your project? what is your approach to getting there? what results did you get? where were the challenges? how does it compare to other approaches? how did you evaluate your method?

slide-3
SLIDE 3

Logistics

  • final project poster presentations: Wed 3/11, 3:00-5:30pm, Packard Atrium
  • there’s

s another eve vent at 6pm in the sa same location, so so we must st clear the area!

  • inst

structors s will st start at 3pm sh sharp! if we are at yo your post ster and yo you’re not ready y to prese sent, yo your team will get a sc score of 0

  • if yo

you prese sent for more than 4 minutes, s, we will decrease se the sc score of yo your prese sentation! You sh should rehearse se and time yo your post ster pitch!

slide-4
SLIDE 4

Logistics – see website

  • final reports & commented source code due Friday 3/13, midnight
  • CO

CODE DE: should run out of the box! should be commented. should contain all data necessary to run it. should contain a README file and be obvious what to run

  • REPORT: ~6 pages (2000 words avg, 4000 max), use latex template provided on

website (or comparable), should look like a conference paper: abstract, introduction, related work, your method (with equations, pseudo-code, algorithmic details, flow chart, …), experimental results, analysis and evaluation, comparison to previous work, discussion, limitations, conclusion, references

slide-5
SLIDE 5

Tupac & Snoop Dogg – Live at Coachella 2012

slide-6
SLIDE 6

Gorillaz & Madonna @ Grammy Awards 2006

slide-7
SLIDE 7

Pepper’s Ghost

John Henry Pepper, 1862

slide-8
SLIDE 8

http://www.redbubble.com/people/melek0197/works/9472644-childs-reflection-in-train-window

slide-9
SLIDE 9

Pepper’s Ghost

wikipedia

hidden room not directly visible! visible room beam splitter (green) viewing window (red)

slide-10
SLIDE 10

Pepper’s Ghost - Lighting

Same as all near-eye augmented reality displays!

wikipedia

slide-11
SLIDE 11

Google Glass

slide-12
SLIDE 12

Google Glass

electroembedded.blogspot.com/2014/03/google-glass.html

slide-13
SLIDE 13

Google Glass

slide-14
SLIDE 14

Digital Displays - Overview

  • spatial light modulators
  • liquid crystal displays
  • projection displays
  • gamut mapping
  • stereo displays
  • light field displays
  • f course: digital

pepper’s ghost & AR!

displayblocks.org

slide-15
SLIDE 15

Spatial Light Modulators (SLMs)

Liquid Crystal Display (LCD) Liquid Crystal Display

  • n Silicon (LCoS)

Digital Micromirror Device (DMD) Light Emitting Diodes (LEDs) and OLEDs E Ink

  • mirasol
  • pixtronix
  • Ost

stendo

  • quantum dots …
  • so

some typ ype of sp spatially-va varyi ying light modulation (amplitude or phase se)

slide-16
SLIDE 16

Light Emitting Diodes (LED)

wikipedia

slide-17
SLIDE 17

Light Emitting Diodes (LED)

wikipedia

slide-18
SLIDE 18

LED Displays

slide-19
SLIDE 19

White LEDs

  • either multiple dies

s (i.e. R+G+B dies) s)

  • r blue die + phosp

sphor

blue LED blue LED + phosphor (Ce:YAG)

wikipedia

slide-20
SLIDE 20

Organic Light Emitting Diodes (OLEDs)

Samsung Galaxy Note Edge LG

  • electroluminesc

scent material is s organic

  • can

can be be pr print nted, ed, e. e.g.

  • g. on
  • n

flexi xible su subst strates

slide-21
SLIDE 21

OLED – Active vs Passive Matrix

howstuffworks.com

slide-22
SLIDE 22

Active vs Passive Matrix Addressing Scheme

  • more complex electronics (1

capacitor & 1 transistor per pixel)

  • pixel can “store” information, e.g.

while scanning over the rest of the screen

  • similar to phosphor lifetime in CRT
  • simpler electronics
  • “dead” time between pixel

updates – can lead to flicker (slow response)

  • imprecise voltage control

active ve matrix passi ssive ve matrix

slide-23
SLIDE 23

Active vs Passive Matrix Addressing Scheme

https://www.youtube.com/watch?v=mnh3lt8rnUk

slide-24
SLIDE 24

Liquid Crystal Displays

  • most common displays for monitors and TVs
slide-25
SLIDE 25

LCDs - Twisted Nematic (TN)

slide-26
SLIDE 26

LCDs - Twisted Nematic (TN)

plc.cwru.edu/tutorial/enhanced/files/lcd/tn/tn.htm

relaxed (twisted), crystalline state

slide-27
SLIDE 27

LCDs - Twisted Nematic (TN)

plc.cwru.edu/tutorial/enhanced/files/lcd/tn/tn.htm

voltage applied: un-twisting – liquid state

slide-28
SLIDE 28

LCDs – In-plane Switching (IPS)

wikipedia

  • electrodes on same side
  • in-plane LC alignment
  • pro: more consistent

across viewing angles, don’t change color when touched

  • con: more power, slower,

more expensive than TN

slide-29
SLIDE 29

wikipedia

slide-30
SLIDE 30

LCD Subpixels

wikipedia

TN subpixels IPS S-IPS IPS

slide-31
SLIDE 31

LCD Subpixels - Pentile Pixels

  • exotic subpixel layouts with different advantages and disadvantages
slide-32
SLIDE 32

LCD Backlight

extremetech.com wikipedia

slide-33
SLIDE 33

LCD Backlight – CCFL vs LED

  • used to be: cold-cathode fluorescent lamps
  • now mostly LEDs: last longer, brighter, thinner, lower power, but a bit

more expensive

slide-34
SLIDE 34

LCD Backlight

… at the end, you have a “light box” backlight enhancing films

Cornelissen, SPIE 2008 extremetech.com

slide-35
SLIDE 35

Directional Backlight - Leia

Fattal et al. 2013

slide-36
SLIDE 36

Quantum Dots (QD)

  • se

semiconductor nanocryst ystal

  • ext

xtremely y narrow, tunable emissi ssion sp spectrum (vi visi sible+IR)

  • band gap (which determines

s emitted wave velength) is s inve verse sely y proportional to dot si size ze

  • quantum dot disp

splays ys use sed in LCD backl klight (we’ll get back k to that a but later) by y QD Visi sion

slide-37
SLIDE 37

Quantum Dots

wikipedia

slide-38
SLIDE 38

Quantum Dot Backlight – QD Vision

http://www.ravepubs.com/ quantum-dots-the-end-of-white-leds-in-backlights/

slide-39
SLIDE 39

Liquid Crystal on Silicon (LCoS)

  • basi

sically y a reflective ve LCD

  • st

standard component in projectors s and head mounted disp splays ys

  • use

sed e.g. in googl google glass ss

  • wit

without 2nd

nd polarize

zer: phase se modulation!

slide-40
SLIDE 40

Electronic Ink (E Ink)

  • reflective

ve disp splay y – no active ve lighting!

  • high contrast

st, low power

  • bist

stable

  • inve

vented by y Jo Joe Ja Jacobse sen

slide-41
SLIDE 41

Mirasol (Qualcomm)

  • in

interferometric ic modulator disp splay y (IMOD (IMOD)

  • color from gap si

size ze (changed vi via MEMS)

  • intensi

sity y from su subpixe xels – low res?! s?!

slide-42
SLIDE 42

Digital Micromirror Device (DMD)

  • deve

veloped by y Texa xas s Inst struments

  • MEMS devi

vice

  • binary

y st states s (e.g. +/- 10 10 degrees) s)

  • gr

gray ay-leve vel through pulse se width mo modulati tion (P (PWM) M)

Texas Instruments

slide-43
SLIDE 43

Digital Micromirror Device (DMD)

  • when use

sed in projector, usu sually y called digital light processi ssing devi vice (DLP)

slide-44
SLIDE 44
  • color multiplexe

xed in time (field se sequential color)

  • for exa

xample usi sing color wheel in DPL projectors

Digital Light Processing (DLP) Projectors

slide-45
SLIDE 45

Modulator Projection Lens Diffuse Screen Viewer

Anatomy of a Projector (without the light)

slide-46
SLIDE 46

LCD Projectors

  • pticsbalzers.com/en/237/LCD-projector.htm
  • 3 se

separate optical paths s (1 per per col color

  • r channel

channel)

  • sp

splitting vi via dichroic mirrors

  • se

separate modulation vi via transm smissi ssive ve LC LCDs

  • combination vi

via x-cube cube prism sm

  • pr

proj

  • ject

ection

  • n lens

ens

slide-47
SLIDE 47

LCD Projectors

http://wordpress.mrreid.org/

pr proj

  • ject

ection

  • n lens

ens (d (dichro roic) ) mi mirro rrors rs LC LCDs x-cube prism sm light so source

slide-48
SLIDE 48

Scanned Laser Pico Projectors

1 mm

  • biaxi

xial MEMS sc scanner

  • 43.

43.2° by y 24.3° at at 60 60 Hz

Microvision, Freeman et al. 2009

slide-49
SLIDE 49

Scanned Laser Pico Projectors

Microvision, Freeman et al. 2009

slide-50
SLIDE 50

Holographic Laser Projectors

  • deve

veloped by y light blue optics

  • coher

coherent ent light ght – phase se modulation in Fourier plane

slide-51
SLIDE 51
slide-52
SLIDE 52

Laser/LCD Projector

announced by Sony

  • phosp

sphor+blue lase ser = white (sa same as s white LED)

slide-53
SLIDE 53

Scanning Fiber Projector

  • Schow

Schowenger engerdt dt et al., Unive versi sity y of Wash shington

  • now

now at at Magi agic c Leap Leap

slide-54
SLIDE 54

Questions?

slide-55
SLIDE 55

Stereoscopic and 3D / Light Field Displays

many slides from Douglas Lanman (thanks)

slide-56
SLIDE 56

binocular disp sparity mo motion para rallax accom accommod

  • dat

ation/

  • n/blur

ur conve vergence current glasse sses-base sed (st stereosc scopic) disp splays ys near near-term: compressi ssive ve light field disp splays ys lo longer-term: holographic disp splays ys

Some Depth Cues of the HVS

slide-57
SLIDE 57

Taxonomy of Direct 3D Displays:

Glasses-bound vs. Unencumbered Designs

Glasses-bound Stereoscopic Immersive

(blocks direct-viewing of real world)

See-through

(superimposes synthetic images onto real world)

Head-mounted

(eyepiece-objective and microdisplay)

Multiplexed

(stereo pair with same display surface)

Spatially-multiplexed (field-concurrent)

(color filters, polarizers, autostereograms, etc.)

Temporally-multiplexed (field-sequential)

(LCD shutter glasses)

Unencumbered Automultiscopic Parallax-based

(2D display with light-directing elements)

Volumetric

(directly illuminate points within a volume)

Holographic

(reconstructs wavefront using 2D element)

Parallax Barriers

(uniform array of 1D slits or 2D pinhole arrays)

Integral Imaging

(lenticular sheets or fly’s eye lenslet arrays)

Multi-planar

(time-sequential projection onto swept surfaces)

Transparent Substrates

(intersecting laser beams, fog layers, etc.)

Static

(holographic films)

Dynamic

(holovideo)

Taxonomy adapted from Hong Hua

slide-58
SLIDE 58

Taxonomy of 3D Displays:

Immersive Head-mounted Displays (HMDs)

Glasses-bound Stereoscopic Immersive

(blocks direct-viewing of real world)

Head-mounted

(eyepiece-objective and microdisplay)

Multiplexed

(stereo pair with same display surface)

slide-59
SLIDE 59

Taxonomy of 3D Displays:

See-through Head-mounted Displays (HMDs)

Glasses-bound Stereoscopic Immersive

(blocks direct-viewing of real world)

See-through

(superimposes synthetic images onto real world)

Head-mounted

(eyepiece-objective and microdisplay)

Multiplexed

(stereo pair with same display surface)

slide-60
SLIDE 60

Taxonomy of 3D Displays:

Spatial Multiplexing (e.g., Anaglyphs)

Glasses-bound Stereoscopic Immersive

(blocks direct-viewing of real world)

See-through

(superimposes synthetic images onto real world)

Head-mounted

(eyepiece-objective and microdisplay)

Multiplexed

(stereo pair with same display surface)

Spatially-multiplexed (field-concurrent)

(color filters, polarizers, etc.)

slide-61
SLIDE 61

Taxonomy of 3D Displays:

Temporal Multiplexing (e.g., Shutter Glasses)

Glasses-bound Stereoscopic Immersive

(blocks direct-viewing of real world)

See-through

(superimposes synthetic images onto real world)

Head-mounted

(eyepiece-objective and microdisplay)

Multiplexed

(stereo pair with same display surface)

Spatially-multiplexed (field-concurrent)

(color filters, polarizers, autostereograms, etc.)

Temporally-multiplexed (field-sequential)

(LCD shutter glasses)

slide-62
SLIDE 62

Visual Discomfort

Comfort zone Screen Object in left eye Object in right eye Object perceived in 3D Pixel disparity Vergence Depth

Viewing discomfort

Accommodation

(focal plane)

A perceptual model for disparity, SIGGRAPH 2011 [Didyk et al.]

Perceptual Issues of Stereo Displays

slide-63
SLIDE 63

Visual Discomfort

Comfort zone

Viewing discomfort Viewing comfort

Scene manipulation

A perceptual model for disparity, SIGGRAPH 2011 [Didyk et al.]

Perceptual Issues of Stereo Displays

slide-64
SLIDE 64

Disparity Remapping

A perceptual model for disparity, SIGGRAPH 2011 [Didyk et al.]

Perceptual Issues of Stereo Displays

slide-65
SLIDE 65

Disparity Remapping

“Nonlinear Disparity Mapping for Stereoscopic 3D” by Lang et al. 2010

Nonlinear disparity retargeting Introduce more distortions where they will be less perceived

Perceptual Issues of Stereo Displays

slide-66
SLIDE 66

Disparity Remapping

“Nonlinear Disparity Mapping for Stereoscopic 3D” by Lang et al. 2010

Visual Importance based on saliency

Perceptual Issues of Stereo Displays

slide-67
SLIDE 67

Taxonomy of Direct 3D Displays:

Parallax Barriers

Unencumbered Automultiscopic Parallax-based

(2D display with light-directing elements)

Volumetric

(directly illuminate points within a volume)

Holographic

(reconstructs wavefront using 2D element)

Parallax Barriers

(uniform array of 1D slits or 2D pinhole arrays)

NewSight MV-42AD3 42'' (1920x1080, 1x8 views)

slide-68
SLIDE 68

2D display barrier

Parallax Barriers – Ives 1903

  • low resolution & very dim
slide-69
SLIDE 69

Taxonomy of Direct 3D Displays:

Integral Imaging

Unencumbered Automultiscopic Parallax-based

(2D display with light-directing elements)

Volumetric

(directly illuminate points within a volume)

Holographic

(reconstructs wavefront using 2D element)

Parallax Barriers

(uniform array of 1D slits or 2D pinhole arrays)

Integral Imaging

(lenticular sheets or fly’s eye lenslet arrays)

Alioscopy 3DHD 42'' (1920x1200, 1x8 views)

slide-70
SLIDE 70

Integral Imaging – Lippmann 1908

  • low-res, but brighter than parallax barriers

2D display lenslets

slide-71
SLIDE 71

Integral Imaging – Light Field

slide-72
SLIDE 72

Integral Imaging – Interlaced Light Field # Display Pixels X # Display Pixels Y

slide-73
SLIDE 73

Integral Imaging – Observed Central View # Display Pixels X / # Views X # Display Pixels Y / # Views Y

slide-74
SLIDE 74

Directional Backlighting

§ Currently promoted by 3M § Requires a high-speed (120 Hz) LCD panel, an additional double-sided prism film, and a pair of LEDs § Allows multi-view display, but requires higher-speed LCD and additional light sources for each view

Nelson and Brott, 2010 US Patent 7,847,869

slide-75
SLIDE 75

Taxonomy of Direct 3D Displays:

Multi-planar Volumetric Displays

Unencumbered Automultiscopic Parallax-based

(2D display with light-directing elements)

Volumetric

(directly illuminate points within a volume)

Holographic

(reconstructs wavefront using 2D element)

Parallax Barriers

(uniform array of 1D slits or 2D pinhole arrays)

Integral Imaging

(lenticular sheets or fly’s eye lenslet arrays)

Multi-planar

(time-sequential projection onto swept surfaces)

slide-76
SLIDE 76

Taxonomy of Direct 3D Displays:

Transparent-substrate Volumetric Displays

Unencumbered Automultiscopic Parallax-based

(2D display with light-directing elements)

Volumetric

(directly illuminate points within a volume)

Holographic

(reconstructs wavefront using 2D element)

Parallax Barriers

(uniform array of 1D slits or 2D pinhole arrays)

Integral Imaging

(lenticular sheets or fly’s eye lenslet arrays)

Multi-planar

(time-sequential projection onto swept surfaces)

Transparent Substrates

(intersecting laser beams, fog layers, etc.)

slide-77
SLIDE 77

Taxonomy of Direct 3D Displays:

Static Holograms

Unencumbered Automultiscopic Parallax-based

(2D display with light-directing elements)

Volumetric

(directly illuminate points within a volume)

Holographic

(reconstructs wavefront using 2D element)

Parallax Barriers

(uniform array of 1D slits or 2D pinhole arrays)

Integral Imaging

(lenticular sheets or fly’s eye lenslet arrays)

Multi-planar

(time-sequential projection onto swept surfaces)

Transparent Substrates

(intersecting laser beams, fog layers, etc.)

Static

(holographic films)

capture reconstruction

slide-78
SLIDE 78

Taxonomy of Direct 3D Displays:

Dynamic Holograms (Holovideo)

Unencumbered Automultiscopic Parallax-based

(2D display with light-directing elements)

Volumetric

(directly illuminate points within a volume)

Holographic

(reconstructs wavefront using 2D element)

Parallax Barriers

(uniform array of 1D slits or 2D pinhole arrays)

Integral Imaging

(lenticular sheets or fly’s eye lenslet arrays)

Multi-planar

(time-sequential projection onto swept surfaces)

Transparent Substrates

(intersecting laser beams, fog layers, etc.)

Static

(holographic films)

Dynamic

(holovideo)

Tay et al. [Nature, 2008] MIT Media Lab Spatial Imaging Group

[Holovideo, 1989 – present]

slide-79
SLIDE 79

Cyclostereoscope, France, 1940-50s Seymon Palovich Ivanov, Russia, 1935 Inventors & Filmmakers, 1950s

Glasses-free 3D Theaters

slide-80
SLIDE 80

USC ICT – SIGGRAPH 2013 ETech Holografika

Multi-projector Glasses-free 3D

slide-81
SLIDE 81

Modulator Projection Lens Diffuse Screen Viewer

Anatomy of a Projector

slide-82
SLIDE 82

Lenticular

Building a 3D Projector

slide-83
SLIDE 83

Side View Vertical-Only Diffuser

Building a 3D Projector

slide-84
SLIDE 84

Pepper’s Ghost

John Henry Pepper, 1862

slide-85
SLIDE 85

Gorillaz & Madonna @ Grammy Awards 2006

slide-86
SLIDE 86

Next: Computational Displays

  • HDR displays
  • projection displays
  • volumetric and other 3D displays
  • vision-correcting displays

Huang et al. 2014 Jones et al. 2009 Favalora et al.

slide-87
SLIDE 87

References and Further Reading

  • many more details on LCDs: http://www.personal.kent.edu/~mgu/LCD/index.htm
  • good article for LCDs: http://en.wikipedia.org/wiki/LCD_television (better than the wikipedia LCD article)
  • Freeman, Champion, Madhaven “Scanned Laser Pico-projectors”, Microvision, 2009
  • Fattal, Peng, Tran, Vo, Fiorentino, Brug, Beausoleil, “A Multi-directional backlight for a wide-angle, glasses-free three-dimensional display”,

Nature 2013

  • Jones, McDowall, Yamada, Bolas, Debevec “Rendering for an Interactive 360° Light Field Display”, SIGGRPH 2007
  • Favalora, Napoli, Hall, Dorval, Dorval, Giovinco, Richmond, Chun “100-million-voxel volumetric display”, SPIE 4712, 2002