Learning 3D Part Assembly from A Single Image Yichen Li* 1 , - - PowerPoint PPT Presentation
Learning 3D Part Assembly from A Single Image Yichen Li* 1 , - - PowerPoint PPT Presentation
Learning 3D Part Assembly from A Single Image Yichen Li* 1 , Kaichun Mo* 1 , Lin Shao 1 , Minhyuk Sung 2 , Leonidas Guibas 1 1 2 Problem Definition Image-Guided Shape Structure Decoding Input Image Input Part Geometry
Learning 3D Part Assembly from A Single Image
Yichen Li*1, Kaichun Mo*1, Lin Shao1, Minhyuk Sung2, Leonidas Guibas1
1 2
Problem Definition
Input Image Input Part Geometry Structure Decoding Assembled Shape
Image-Guided Shape Structure Decoding
segmentation pose prediction
Geometry Conditioned Image Segmentation Graph Decoding of Part Geometry Conditioned Shape Structure
Approach
Instance Segmentation
Graph-Conv Pose Induction
Part Specific features Contextual Features Part Node Feature
L2 Translation loss L2 Rotation loss Chamfer distance Rotation loss Shape Holistic chamfer distance loss
Loss Functions
Evaluation Metric
Shape Chamfer Distance Part Accuracy
pointnet
GRU
resnet
Per part R/T
Baseline 1 - GRU
pointnet Instance one-hot
MLP
resnet
Per part R/T
Baseline 2 - InsOneHot
pointnet Instance one-hot 3D global feature
MLP
resnet 2.5D global feature
Per part R/T