2D-to-3D conversion: market overview, conversion workflow and basic - - PowerPoint PPT Presentation

▶
2d to 3d conversion market overview conversion workflow
SMART_READER_LITE
LIVE PREVIEW

2D-to-3D conversion: market overview, conversion workflow and basic - - PowerPoint PPT Presentation

Mar 13, 2023 385 likes •731 views

2D-to-3D conversion: market overview, conversion workflow and basic rules for good 3D Dr.-Ing. Sebastian Knorr (Director R&D and Knowledge Management, MD) - imcube labs GmbH, Berlin 15.03.20 11 Overview Market overview - Cinema

slide-1
SLIDE 1

Dr.-Ing. Sebastian Knorr

(Director R&D and Knowledge Management, MD)

  • imcube labs GmbH, Berlin

2D-to-3D conversion: market overview, conversion workflow and basic rules for good 3D

15.03.20 11

slide-2
SLIDE 2

Overview

15.03.20 11 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D 1

  • Market overview
  • Cinema market
  • Home entertainment market
  • Conversion workflow
  • High quality conversion
  • Realtime conversion
  • Basic rules for good 3D
  • Conflicts of depth cues and binocular rivalry
  • Conclusion
slide-3
SLIDE 3

Market overview – 3D movies

15.03.20 11 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D 2

10 20 30 40 50 60 70 80 90 100

slide-4
SLIDE 4

3D cinema screen penetration

15.03.20 11 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D 3

Source: PwC Report

  • Nov. 2010
slide-5
SLIDE 5

3D vs. 2D (turnover at box offices)

Source: Screen Digest

Example: Monsters vs. Aliens

  • Less than 20% of the screens were 3D capable
  • More than 40% of the revenues came from 3D

 3D achieves around 2.5 times the turnover at box offices

3D gross (in mill. $) % screens 3D Total gross (in mill. $) 3D % of gross 3D ratio x Chicken Little 17,3 1,5% 314,4 5,5% 3,67 Monster House 15,3 4,2% 140,2 10,9% 2,60 Meet the Robinsons 47,9 13,2% 169,3 28,3% 2,14 Monsters vs. Aliens 71,5 18,0% 161,6 44,0% 2,44 Bolt 60,0

  • 180,0

33,0%

  • My Bloody Valentine

44,2 47,0% 51,5 85,0% 1,81 Coraline 51,9

  • 75,2

69,0%

  • Avatar

1771,7 31,1% 2.684,4 66,0% 2,11 Average 260 19,2% 472,1 42,7% 2,46

slide-6
SLIDE 6

2D and 3D box office in the US and Canada

  • in 2010: 20% of box
  • ffice came from 3D
  • 8 of the top 20

grossing films were 3D!

Source: MPAA 03/2010

slide-7
SLIDE 7

3D @ home

  • In 2010 the major TV makers, including Samsung, LG, Sony and

Panasonic, expand to more than 40 3D TV models

  • First 3D TV channels in 2010 from ESPN, DirecTV and Sky
  • 3D Blu-ray players from all major home entertainment manufacturers
  • 3D over IP: e.g. YouTube 3D

Forecast of 3D TV unit shipments by regions

slide-8
SLIDE 8

Worldwide 3D TV channels

15.03.20 11 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D 7

Source: PwC Report Nov. 2010

Currently: about 40 3D TV channels are existing or are announced for 2011

slide-9
SLIDE 9

3D @ home

Source: PwC 11/2010

  • According to market analysis organization PricewaterhouseCoopers up to a

quarter of the US households will watch 3D TV at home in 2014

  • Research firm In-Stat predicts that one in five TVs purchased in the US in 2013

will be 3D sets. Sales are expected to grow by 231 % between 2010 and 2011

slide-10
SLIDE 10

Is Enough 3D Content Available?

15.03.20 11 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D 9

  • Currently: about 40 3D Blu-ray titles are

available

  • chicken-and-egg problem
  • The lack of „A‟-list 3D content has

created a second-hand market: e.g. $400,- for Avatar in 12/2010

  • 2D-to-3D conversion may reduce the

enormous gap

slide-11
SLIDE 11

Overview

15.03.20 11 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D 10

  • Market overview
  • Cinema market
  • Home entertainment market
  • Conversion workflow
  • High quality conversion
  • Realtime conversion
  • Basic rules for good 3D
  • Conflicts of depth cues and binocular rivalry
  • Conclusion
slide-12
SLIDE 12

Classification of conversion methods

15.03.20 11 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D 11

  • JVC, Samsung,

DDD, HDLogix, ...

  • bad quality =>

headache, sickness

slide-13
SLIDE 13

Recovering of depth information

15.03.20 11 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D 12

  • original image
  • depth map

?

slide-14
SLIDE 14

Perception of depth

15.03.20 11 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D 13

  • Monocular depth cues
  • Motion parallax, depth from motion, light and shading,

relative size, familiar size, interposition, blur, perspective, arial perspective, texture gradient, accommodation

  • 11 monocular depth cues
  • Binocular depth cues
  • Convergence and stereopsis (retinal disparity)
  •  2 binocular depth cues
slide-15
SLIDE 15

Automatic and realtime conversion

15.03.20 11 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D 14

  • error-prone depth maps: conflicts of depth cues, pseudo 3D 

visual discomfort

  • please: keep your hands off realtime conversion!!!
slide-16
SLIDE 16

Workflow principles for high-quality 2D-to-3D conversion

15.03.20 11 15 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D

  • Rotoscoping/ Object Segmentation
  • Depth Assignment/ Depth Grading (3D-Compositing)
  • Inpainting (Occlusion Filling)
  • Rendering
slide-17
SLIDE 17

1) Rotoscoping/ object segmentation

  • Commercial Tools: Motor/ Mocha from Imagineer Systems, Adobe

After Effects CS5 (Roto-Brush), Eyeon Fusion

15.03.20 11 16 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D

slide-18
SLIDE 18

2) Depth Assignment/ 3D-Object-Shaping

15.03.20 11 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D 17

to increase object roundness and to reduce cardboard-effects

  • simple and efficient 3D-object-shaping directly within the 2D-image

 depth map to shift pixels according to their depth in a second stereoscopic view

  • ellipse tool
  • mesh-grid tool
slide-19
SLIDE 19

3) Occlusion Handling - Inpainting

?

  • riginal left view

virtual right view foreground object disoccluded background

15.03.20 11 18 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D

slide-20
SLIDE 20

Interpolation vs. Patch-based Inpainting

15.03.20 11 19 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D

slide-21
SLIDE 21

Overview

15.03.20 11 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D 20

  • Market overview
  • Cinema market
  • Home entertainment market
  • Conversion workflow
  • High quality conversion
  • Realtime conversion
  • Basic rules for good 3D
  • Conflicts of depth cues and binocular rivalry
  • Conclusion
slide-22
SLIDE 22

Visual discomfort

15.03.20 11 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D 21

  • Reasons for visual discomfort:
  • Conflicts of depth cues and binocular rivalry
  • When all cues line up, stereo is excellent
  • In case of a conflict of cues, stereo breaks down
  • Not all cues have to be “perfect”, but it helps
slide-23
SLIDE 23

Conflicts of depth cues

22

slide-24
SLIDE 24

Stereopsis vs. interposition

15.03.20 11 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D 23

Example: frame violation (or “framing”)

  • object has negative parallax (in front of the screen)
  • but is truncated by the image borders
slide-25
SLIDE 25

Stereopsis vs. depth from motion

15.03.20 11 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D 24

slide-26
SLIDE 26

Binocular rivalry in 3D projects

15.03.20 11 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D 25

  • 1. Vertical misalignment
  • 2. Luminance
  • 3. Reflections, Flares, Polarization
  • 4. Contamination
  • 5. Depth of field
  • 6. Pseudo 3D
  • 7. Partial pseudo 3D
  • 8. Synchronization
  • 9. Hyperconvergence

10.Hyperdivergence 11.Depth mismatch 12.Visual mismatch 13.Ghosting mostly occurs in:  3D live production  3D live production  3D live production  3D live production  3D live production  3D live production  realtime conversion  3D live production  3D live production  3D live production  realtime conversion  conversion  all

slide-27
SLIDE 27

Vertical misalignment & reflections, flares

15.03.20 11 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D 26

vertical misalignment: reflections, flares and polarization:

slide-28
SLIDE 28

Hyperconvergence & hyperdivergence

15.03.20 11 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D 27

hyperdivergence hyperconvergence

slide-29
SLIDE 29

Screen size

d e* D e s

perceived depth:

slide-30
SLIDE 30

Screen size

d e* D e s

screen of half size: compression of the depth range screen of double size: expansion of the depth range  hyperdivergence!!!

slide-31
SLIDE 31

3D-Screen-Size-Adjustment

  • Mobile 3DTV (small

screen size)

  • 3DTV (medium

screen size)

  • 3D cinema (large

screen size)

15.03.20 11 30 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D

for perfect and comfortable 3D viewing conditions

slide-32
SLIDE 32

From 2D to Stereo 3D to Multiview 3D

15.03.20 11 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D 31

for the next generation of 3D display technology

slide-33
SLIDE 33

Conclusion - 3D Blu-ray is coming!

15.03.20 11 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D 32

  • There is an enormous mass market potential for 3D, especially

for the home entertainment market

  • Blu-ray currently offers the best way of delivering 3D to the home
  • 3D is an additional and maybe the best driver for Blu-ray
  • BUT: 3D Blu-ray has to be positioned in the high quality sector to

generate strong Blu-ray sales

  • Visual discomfort may dilute the overall excitement about 3D
  • An imcube product for the Blu-ray market will be available in the

middle of 2011

slide-34
SLIDE 34

Thank you for your attention!

15.03.20 11 2D-to-3D conversion: market overview, Conversion workflow and basic rules for good 3D 33

Dr.-Ing. Sebastian Knorr email: knorr@imcube.de phone: +49 - 30 - 314 28501 web: www.imcube.de

Contact: