Structure-aware Synthesis for Predictive Woven Fabric Appearance - PowerPoint PPT Presentation

Structure-aware Synthesis for Predictive Woven Fabric Appearance Shuang Zhao Wenzel Jakob Steve Marschner Kavita Bala Cornell University

Woven Fabric  Essential to our life  Challenging to model and render Denim fabric Silk brocade Polyester brocade

Fabric Appearance Models  Volumetric models [Kajiya and Kay 1989] [Jakob et al. 2010] [Xu et al. 2001] [Zhao et al. 2011]

Building Volumetric Models  Using micro computed tomography (CT) imaging [Zhao et al. 2011] Fabric samples Processed CT images Rendered images Velvet Silk satin  Assuming identical fibers, no large-scale designs

Our Goal  Creating volumetric models for woven fabrics ≈ User-specified designs Yarn-level geometries Predictive

Related Work  Cloth appearance models  General: [Wang et al. 2008], [Jakob et al. 2010], …  Specialized: [Wang et al. 2008] [Irawan and Marschner 2012] [Sadeghi et al. 2011], [Irawan and Marschner 2012 ], …  Cloth model construction  [Adabala et al. 2003], [Zhao et al. 2011 ], …  [Adabala et al. 2003] [Zhao et al. 2011] Example-based synthesis  Pixel-based: [Heeger and Bergen 1995], [Ashikhmin 2001], …  Patch-based: [Efros and Freeman 2001], [Cohen et al. 2003], … [Ashikhmin 2001] [Efros and Freeman 2001]

Weaving Woven fabric Industrial loom Real fabric Weave pattern

Our System + Industrial loom Physical material Weave pattern Real fabric + Our system Scanned database Weave pattern Volumetric model

Contribution + Our system Scanned database Weave pattern Volumetric model Database Construction Structure-aware Synthesis   End-to-end pipeline Highly efficient algorithm

Pipeline Fabric Structural samples information Exemplar database Volumetric model Micro CT Database Structure-aware imaging construction synthesis

Structure-aware Synthesis

Problem Specification Exemplar database … Weave patterns Volume … data Input weave pattern ? Output volume

Problem at the Yarn-level Exemplar database Block: a sub-volume corresponding to one yarn crossing Output volume 25 blocks … Reference a block Copy a voxel 1 million blocks 25 blocks

Principles for Example Block Selection Exemplars Output Volume  Correctness  Matching user-specified design Break ties  Consistency  Matching neighboring blocks Break ties  Continuity  Copying continuous content

Naïve Solution Input weave pattern Output volume (top view)

Consistency Maximized consistency or

Optimizing Consistency Without consistency With consistency

Continuity Output volume Exemplar volumes Output volume Exemplar volume

Continuity 2D continuity 1D continuity   Optimizing 2D continuity Optimizing 1D continuity  Generally NP-hard  Solvable in polynomial time  Approximation algorithms  Dynamic programming

Continuity In the Not in the database database Without continuity With continuity

Post-processing  Edge fixing With Without edge-fixing edge-fixing

Pipeline Fabric Structural samples information Exemplar database Volumetric model Micro CT Database Structure-aware imaging construction synthesis

Database Construction

Database Creation: Overview + Weave pattern Density, orientation Yarn ID information Weave pattern Yarn tracking CT image processing detection [Zhao et al. 2011]

Yarn Tracking  Tracking process  Correction  Voxel segmentation

Yarn Tracking Result

Experimental Results

Exemplar Database  8 Exemplars Twill patterns Satin patterns  Exemplar volume  Resolution: 575 × 350 × 300  25 Blocks

Validation Photographs Industrial of fabricated loom fabrics Our Rendered images system

Input Weave Pattern: 𝟘𝟏𝟏 × 𝟐𝟔𝟏𝟏 𝟒. 𝟑𝟕 × 𝟐𝟏 𝟐𝟑 effective voxels

Input Weave Pattern: 𝟐𝟗𝟏𝟏 × 𝟐𝟔𝟏𝟏 𝟕. 𝟔𝟑 × 𝟐𝟏 𝟐𝟑 effective voxels

Input Weave Pattern: 18 18 𝟏𝟏 × 𝟐𝟔𝟏𝟏 𝟕. 𝟔𝟑 × 𝟐𝟏 𝟐𝟑 effective voxels

Input Weave Pattern: 18 18 𝟏𝟏 × 𝟐𝟔𝟏𝟏 𝟕. 𝟔𝟑 × 𝟐𝟏 𝟐𝟑 effective voxels

Input Weave Pattern: 18 18 𝟏𝟏 × 𝟐𝟔𝟏𝟏 𝟕. 𝟔𝟑 × 𝟐𝟏 𝟐𝟑 effective voxels

Conclusion

Limitation and Future Work  Limitations  Only modeled the front layer  Assume a grid-like structure  Future work  Extend our technique to support more structures

Summary Exemplar database + Volumetric appearance models Input weave patterns with complex designs  New level of quality for general woven fabrics  Useful for textile design and other textile applications

Acknowledgements  Brooks Hagan (Rhode Island School of Design)  Jessie Maisano (The University of Texas at Austin)  Funding  Intel Science and Technology Center – Visual Computing  NSF grants CCF-0644175 and IIS-1011919  Amazon

Thank you! + Industrial loom Physical material Weave pattern Real fabric + Our system Scanned database Weave pattern Volumetric model