Structure-aware Synthesis for Predictive Woven Fabric Appearance - - PowerPoint PPT Presentation

▶
structure aware synthesis for predictive woven fabric
SMART_READER_LITE
LIVE PREVIEW

Structure-aware Synthesis for Predictive Woven Fabric Appearance - - PowerPoint PPT Presentation

Jan 25, 2024 307 likes •715 views

Structure-aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Wenzel Jakob Steve Marschner Kavita Bala Cornell University Woven Fabric Essential to our life Challenging to model and render Denim fabric Silk

slide-1
SLIDE 1

Structure-aware Synthesis for Predictive Woven Fabric Appearance

Shuang Zhao Wenzel Jakob Steve Marschner Kavita Bala Cornell University

slide-2
SLIDE 2

Woven Fabric

  • Essential to our life
  • Challenging to model and render

Polyester brocade Silk brocade Denim fabric

slide-3
SLIDE 3

Fabric Appearance Models

  • Volumetric models

[Jakob et al. 2010] [Zhao et al. 2011] [Kajiya and Kay 1989] [Xu et al. 2001]

slide-4
SLIDE 4
  • Using micro computed tomography (CT) imaging [Zhao et al. 2011]
  • Assuming identical fibers, no large-scale designs

Velvet Silk satin

Building Volumetric Models

Fabric samples Processed CT images Rendered images

slide-5
SLIDE 5

Our Goal

  • Creating volumetric models for woven fabrics

Yarn-level geometries User-specified designs Predictive

≈

slide-6
SLIDE 6

Related Work

  • Cloth appearance models
  • General:

[Wang et al. 2008], [Jakob et al. 2010], …

  • Specialized:

[Sadeghi et al. 2011], [Irawan and Marschner 2012], …

  • Cloth model construction
  • [Adabala et al. 2003], [Zhao et al. 2011], …
  • Example-based synthesis
  • Pixel-based:

[Heeger and Bergen 1995], [Ashikhmin 2001], …

  • Patch-based:

[Efros and Freeman 2001], [Cohen et al. 2003], …

[Ashikhmin 2001] [Wang et al. 2008] [Efros and Freeman 2001] [Irawan and Marschner 2012] [Adabala et al. 2003] [Zhao et al. 2011]

slide-7
SLIDE 7

Weaving

Woven fabric Weave pattern Industrial loom Real fabric

slide-8
SLIDE 8

Our System

Physical material Weave pattern

+

Real fabric

Industrial loom

Scanned database Weave pattern

+

Volumetric model

Our system

slide-9
SLIDE 9

Contribution

Scanned database Weave pattern

+

Volumetric model

Our system Structure-aware Synthesis

  • Highly efficient algorithm

Database Construction

  • End-to-end pipeline
slide-10
SLIDE 10

Pipeline

Fabric samples Structural information Exemplar database

Micro CT imaging Database construction Structure-aware synthesis

Volumetric model

slide-11
SLIDE 11

Structure-aware Synthesis

slide-12
SLIDE 12

Problem Specification

… …

Weave patterns Volume data

Exemplar database

Input weave pattern Output volume

?

slide-13
SLIDE 13

Problem at the Yarn-level

Output volume

…

Exemplar database

25 blocks 25 blocks 1 million blocks

Copy a voxel Reference a block

Block: a sub-volume corresponding to one yarn crossing

slide-14
SLIDE 14

Principles for Example Block Selection

  • Correctness
  • Matching user-specified design
  • Consistency
  • Matching neighboring blocks
  • Continuity
  • Copying continuous content

Break ties Break ties

Exemplars Output Volume

slide-15
SLIDE 15

Naïve Solution

Input weave pattern Output volume (top view)

slide-16
SLIDE 16

Consistency

Maximized consistency

  • r
slide-17
SLIDE 17

Optimizing Consistency

Without consistency With consistency

slide-18
SLIDE 18

Continuity

Output volume Exemplar volumes Output volume Exemplar volume

slide-19
SLIDE 19

Continuity

2D continuity 1D continuity

  • Optimizing 2D continuity
  • Generally NP-hard
  • Approximation algorithms
  • Optimizing 1D continuity
  • Solvable in polynomial time
  • Dynamic programming
slide-20
SLIDE 20

Continuity

Without continuity In the database Not in the database With continuity

slide-21
SLIDE 21

Post-processing

  • Edge fixing

Without edge-fixing With edge-fixing

slide-22
SLIDE 22

Pipeline

Fabric samples Structural information Exemplar database

Micro CT imaging Database construction Structure-aware synthesis

Volumetric model

slide-23
SLIDE 23

Database Construction

slide-24
SLIDE 24

Database Creation: Overview

Density, orientation Yarn ID information Weave pattern

+

CT image processing

[Zhao et al. 2011]

Yarn tracking Weave pattern detection

slide-25
SLIDE 25

Yarn Tracking

  • Tracking process
  • Correction
  • Voxel segmentation
slide-26
SLIDE 26

Yarn Tracking Result

slide-27
SLIDE 27

Experimental Results

slide-28
SLIDE 28

Exemplar Database

  • 8 Exemplars
  • Exemplar volume
  • Resolution: 575 × 350 × 300
  • 25 Blocks

Twill patterns Satin patterns

slide-29
SLIDE 29

Validation

Photographs

  • f fabricated

fabrics Rendered images

Our system Industrial loom

slide-30
SLIDE 30

Input Weave Pattern: 𝟘𝟏𝟏 × 𝟐𝟔𝟏𝟏 𝟒. 𝟑𝟕 × 𝟐𝟏𝟐𝟑 effective voxels

slide-31
SLIDE 31

Input Weave Pattern: 𝟐𝟗𝟏𝟏 × 𝟐𝟔𝟏𝟏 𝟕. 𝟔𝟑 × 𝟐𝟏𝟐𝟑 effective voxels

slide-32
SLIDE 32

Input Weave Pattern: 18 18𝟏𝟏 × 𝟐𝟔𝟏𝟏 𝟕. 𝟔𝟑 × 𝟐𝟏𝟐𝟑 effective voxels

slide-33
SLIDE 33

Input Weave Pattern: 18 18𝟏𝟏 × 𝟐𝟔𝟏𝟏 𝟕. 𝟔𝟑 × 𝟐𝟏𝟐𝟑 effective voxels

slide-34
SLIDE 34

Input Weave Pattern: 18 18𝟏𝟏 × 𝟐𝟔𝟏𝟏 𝟕. 𝟔𝟑 × 𝟐𝟏𝟐𝟑 effective voxels

slide-35
SLIDE 35

Conclusion

slide-36
SLIDE 36

Limitation and Future Work

  • Limitations
  • Only modeled the front layer
  • Assume a grid-like structure
  • Future work
  • Extend our technique to support more structures
slide-37
SLIDE 37

Exemplar database + Input weave patterns Volumetric appearance models with complex designs

Summary

  • New level of quality for general woven fabrics
  • Useful for textile design and other textile applications
slide-38
SLIDE 38

Acknowledgements

  • Brooks Hagan (Rhode Island School of Design)
  • Jessie Maisano (The University of Texas at Austin)
  • Funding
  • Intel Science and Technology Center – Visual Computing
  • NSF grants CCF-0644175 and IIS-1011919
  • Amazon
slide-39
SLIDE 39

Thank you!

Physical material Weave pattern

+

Real fabric

Industrial loom

Scanned database Weave pattern

+

Volumetric model

Our system