Solid Texture Synthesis Solid Texture Synthesis Solid Texture - - PDF document

▶
solid texture synthesis solid texture synthesis solid
SMART_READER_LITE
LIVE PREVIEW

Solid Texture Synthesis Solid Texture Synthesis Solid Texture - - PDF document

Jan 09, 2023 167 likes •270 views

Solid Textures Solid Textures Solid Texture Synthesis Solid Texture Synthesis Solid Texture Synthesis from 2D Exemplars from 2D Exemplars from 2D Exemplars Johannes Kopf, University of Konstanz Chi-Wing Fu, Hong Kong Sc & Tech Daniel

slide-1
SLIDE 1

1

Solid Texture Synthesis from 2D Exemplars Solid Texture Synthesis Solid Texture Synthesis from 2D Exemplars from 2D Exemplars

Johannes Kopf, University of Konstanz Chi-Wing Fu, Hong Kong Sc & Tech Daniel Cohen-Or, Tel Aviv University Oliver Deussen, University of Konstanz Dani Lischinski, The Hebrew University Tien-Tsin Wong, The Chinese University

Solid Textures Solid Textures

Input: 3D Input: 2D

Solid Textures Solid Textures Modeling Natural Materials Modeling Natural Materials No Complex Parameterization No Complex Parameterization Textured interior Textured interior

slide-2
SLIDE 2

2

Related Work Related Work Related Work

Procedural Textures Procedural Textures 3D to 3D synthesis 3D to 3D synthesis

  • Simple extension of

2D2D algorithms

  • 3rd dimension

mostly time

  • Many, many papers

[Szummer and Picard 1996] [Schödl et al. 2000] [Wei and Levoy 2000] [Bar-Joseph et al. 2001] [Soatto et al. 2001] [Kwatra et al. 2003] ...

Parametric approach [Heeger and Bergen 1995] Parametric approach [Heeger and Bergen 1995] Non-parametric approach [Wei 2002; 2003] Non-parametric approach [Wei 2002; 2003] Stereology [Jagnow et al. 2004] Stereology [Jagnow et al. 2004]

+ =

... ...

slide-3
SLIDE 3

3

Our Technique Our Technique Our Technique

Hybrid Approach Hybrid Approach

  • Non-parametric: texture optimization

texture optimization

– [Kwatra et al. 2005, Wexler et al. 2007] – Enforces local neighborhoods

  • Parametric: histogram matching

histogram matching

– [Heeger and Bergen 1995] – Enforces global statistics

Solid Texture Optimization Solid Texture Optimization Solid Texture Optimization Solid Texture Optimization

  • Two phases:

– Optimization – Search

Solid Texture Optimization Solid Texture Optimization Optimization Phase Optimization Phase

  • Iteratively re-weighted least squares (IRLS)

– [Kwatra et al. 2005]

slide-4
SLIDE 4

4

Optimization Phase Optimization Phase Optimization Phase Optimization Phase

Exemplar Synthesized Texture

Average Average

Search Search

  • Nearest neighbor in high-dimensional space

(standard problem)

  • Speed-ups

– PCA projection (6X-20X) – ANN (approximate nearest neighbor) (10X-100X) – Sparsity (4X)

Histogram Matching Histogram Matching

Exemplar Synthesis Exemplar Synthesis

Histogram Matching Histogram Matching Histogram Matching Histogram Matching

…

slide-5
SLIDE 5

5

Histogram Matching Histogram Matching Histogram Matching Histogram Matching

Results Results Results

Implementation Details Implementation Details

  • Three level multi-resolution
  • Fixed 8x8 neighborhood size
  • Synthesis time:

– 128³ volume: 10 – 90 minutes – Has to be done only once and for all – Preview after 10-20 seconds

Results Results Results Results

slide-6
SLIDE 6

6

Multi-Channel Textures Multi-Channel Textures

RGB Specular Shininess Displacement

Multi-Channel Textures Multi-Channel Textures Finished Wood Finished Wood

Diffuse Fiber reflectance Fiber axis

[Marschner et al. 2005]

Finished Wood Finished Wood Synthesis Control Synthesis Control

  • Different exemplar for each view

Synthesis Control Synthesis Control

  • Constrain Colors
slide-7
SLIDE 7

7

Synthesis Control Synthesis Control Synthesis Control Synthesis Control Limitations Limitations Limitations Limitations Conclusions Conclusions

  • New method for solid texture synthesis
  • Optimization + Histogram matching
  • Widely applicable

– Anisotropic textures – Large coherent structures – Multi-channel textures

Try it out at home! Try it out at home!

  • http://www.johanneskopf.de/solid

http://www.johanneskopf.de/solid

  • Available Online:

– Volume files – Plugin for Maya

  • Coming soon

– Synth application

slide-8
SLIDE 8

8

Video Video Thank You Thank You

Unused Slides Unused Slides Unused Slides

Future Research Future Research

  • Improve quality & speed
  • Additional kinds of histograms

– Heeger & Bergen’s steerable pyramids

  • Wang cubes
  • More control

Related Work Related Work

  • Shell Textures [Chen et al. 2004]

Aura 3D Textures Aura 3D Textures

  • Basic Gray Level Aura Matrices (BGLAM)

[Qin and Yang 2007]

slide-9
SLIDE 9

9

decorrrcrvtfvytvy decorrrcrvtfvytvy

Our Result Independent Synth Decorrelated Color Channels Exemplar

Optimization Phase Optimization Phase

  • Mean Shift

Comparison with [Wei 2002, 2003] Comparison with [Wei 2002, 2003]

Our Result Wei’s result

Comparison with Aura 3D Textures Comparison with Aura 3D Textures

Aura 3D Result Aura 3D Result Our Result Our Result Aura 3D Result Our Result

Comparison with [Jagnow 2004] Comparison with [Jagnow 2004]

Our Result Jagnow’s result

Histogram Matching Histogram Matching

  • Hs,j – j-th histogram of the synth‘ed solid
  • He,j – j-th histogram of the exemplar
  • bj(c) – bin containing c
slide-10
SLIDE 10

10

Limitations Limitations