PT2PC: Learning to Generate 3D Point Cloud Shapes from Part Tree Conditions Kaichun Mo, He Wang, Xinchen Yan, Leonidas Guibas (Data and Code has been released) 1
PT2PC: Learning to Generate 3D Point Cloud Shapes from Part Tree Conditions Kaichun Mo, He Wang, Xinchen Yan, Leonidas Guibas (Data and Code has been released) 2
PT2PC: Learning to Generate 3D Point Cloud Shapes from Part Tree Conditions Kaichun Mo, He Wang, Xinchen Yan, Leonidas Guibas (Data and Code has been released) 3
Previous Works: 3D Shape Generation Wu et al., Learning a Probabilistic Latent Space of Object Shapes via 3D Generative-Adversarial Modeling, NeurIPS 2016 Achlioptas et al., Learning Representations and Generative Models for 3D Point Clouds, ICML 2018 Chen et al., Learning Implicit Fields for Generative Shape Modeling, CVPR 2019 4
Previous Works: Part-aware 3D Shape Generation Li et al., GRASS: Generative Recursive Autoencoders for Shape Structures, Siggraph 2017 Wang et al., Global-to-Local Generative Model for 3D Shapes, Siggraph Asia 2018 Mo et al., Structurenet: Hierarchical Graph Networks for 3D Shape Generation, Siggraph Asia 2019 5
Previous Works: Conditional Content Generation Johnson et al., Image Generation from Scene Graphs, CVPR 2018 Chen et al., Text2Shape: Generating Shapes from Natural Language by Learning Joint Embeddings, ACCV 2018 6
Representing Shape as a Hierarchy of Parts Sofa Arm Arm Back Single Back Support Surface Sofa Arm Chair Seat Support Arm Back Surface Back Seat Leg Base Frame Bar Regular Leg Base Seat Surface Leg Seat Frame Frame Bar Seat Single Leg Leg Surface Frame Bar Frame Bar Mo et al., PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understanding, CVPR 2019 7
Symbolic Part Tree: Describing a Shape Structure Sofa Arm Back Single Back Support Arm Surface Sofa Arm Back Surface Back Arm Chair Seat Support Seat Leg Base Frame Bar Regular Leg Base Leg Seat Surface Seat Frame Leg Frame Bar Leg Seat Single Frame Bar Surface Frame Bar 8
Generating 3D Shapes with Geometric Variations Sofa Arm Back Single Back Support Arm Surface Sofa Arm Arm Back Surface Back Seat Support Chair Seat Leg Base Frame Bar Regular Leg Base Leg Seat Surface Seat Frame Leg Frame Bar Leg Seat Single Frame Bar Surface Frame Bar 9
Network Architecture: conditional-GAN Part PC Part PC vertical Part Tree Encoding Part Tree Feature Decoding Tree Feature Encoding Decoding Encoding bar arm ... horizontal bar struct score chair leg1 leg2 base ... stretcher2 Part-tree Conditioned Generator Part-tree Conditioned Discriminator 10
Network Architecture: conditional-GAN vertical Part Tree Encoding bar arm ... horizontal bar chair leg1 leg2 base ... stretcher2 Part-tree Conditioned Generator 11
Network Architecture: conditional-GAN vertical Part Tree Encoding bar arm ... horizontal bar chair leg1 leg2 base ... stretcher2 Part-tree Conditioned Generator 12
Network Architecture: conditional-GAN vertical Part Tree Encoding bar arm ... horizontal bar chair leg1 leg2 base ... stretcher2 Part-tree Conditioned Generator 13
Network Architecture: conditional-GAN vertical Part Tree Encoding Part Tree Feature Decoding bar arm ... horizontal bar chair leg1 leg2 base ... stretcher2 Part-tree Conditioned Generator 14
Network Architecture: conditional-GAN vertical Part Tree Encoding Part Tree Feature Decoding bar arm ... horizontal bar chair leg1 leg2 base ... stretcher2 Part-tree Conditioned Generator 15
Network Architecture: conditional-GAN vertical Part Tree Encoding Part Tree Feature Decoding bar arm ... horizontal bar chair leg1 leg2 base ... stretcher2 Part-tree Conditioned Generator 16
Network Architecture: conditional-GAN Part PC vertical Part Tree Encoding Part Tree Feature Decoding Decoding bar arm ... horizontal bar chair leg1 leg2 base ... stretcher2 Part-tree Conditioned Generator 17
Network Architecture: conditional-GAN Part PC Encoding Part-tree Conditioned Discriminator 18
Network Architecture: conditional-GAN Part PC Tree Feature Encoding Encoding Part-tree Conditioned Discriminator 19
Network Architecture: conditional-GAN Part PC Tree Feature Encoding Encoding struct score Part-tree Conditioned Discriminator 20
Network Architecture: conditional-GAN Part PC Tree Feature Encoding Encoding whole struct score PointNet score Part-tree Conditioned Discriminator 21
Network Architecture: conditional-GAN Part PC Part PC vertical Part Tree Encoding Part Tree Feature Decoding Tree Feature Encoding Decoding Encoding bar arm ... horizontal bar struct score chair leg1 leg2 base ... stretcher2 Part-tree Conditioned Generator Part-tree Conditioned Discriminator Trained End-to-end with WGAN-GP 22
Results: Part-Tree To Point-Cloud Generation single bar x 4 surface surface frame vertical shelf seat drawer bar horizontal leg x 2 base bar x 4 arm x 2 base chair base support table back leg regular surface x 4 leg base surface tabletop single bar stretcher surface x 4 ceiling lamp lamp shelf x 2 chain x 3 pendant lamp lamp base cabinet lamp unit holistic base bottom panel top panel lamp cover lamp head frame base part side panel divider panel lamp shade light bulb x 2 x 4 23
Baseline Methods 24
Evaluation Metrics Achlioptas et al., Learning Representations and Generative Models for 3D Point Clouds, ICML 2018 Mo et al., Structurenet: Hierarchical Graph Networks for 3D Shape Generation, Siggraph Asia 2019 Shu et al., 3D Point Cloud Generative Adversarial Network based on Tree Structured Graph Convolutions, ICCV 2019 25
HierInsSeg: Measuring Structure Reconstruction Pre-define a Part Hierarchy Template Mo et al., PartNet: A Large-scale Benchmark for Fine-grained and Hierarchical Part-level 3D Object Understanding, CVPR 2019 26
HierInsSeg: Measuring Structure Reconstruction 27
Results: Numbers 28
Results: Chair and Table 29
Results: Cabinet and Lamp 30
Results: User Study 31
Results: Disentangling Structure and Geometry 32
Thank you! Project: https://cs.stanford.edu/~kaichun/pt2pc Github: https://github.com/daerduoCarey/pt2pc Looking forward to E-meeting you for questions! 33
Recommend
More recommend
