Learning 3D Part Assembly from A Single Image Yichen Li* 1 , - - PowerPoint PPT Presentation

learning 3d part assembly from a single image
SMART_READER_LITE
LIVE PREVIEW

Learning 3D Part Assembly from A Single Image Yichen Li* 1 , - - PowerPoint PPT Presentation

Learning 3D Part Assembly from A Single Image Yichen Li* 1 , Kaichun Mo* 1 , Lin Shao 1 , Minhyuk Sung 2 , Leonidas Guibas 1 1 2 Problem Definition Image-Guided Shape Structure Decoding Input Image Input Part Geometry


slide-1
SLIDE 1
slide-2
SLIDE 2

Learning 3D Part Assembly from A Single Image

Yichen Li*1, Kaichun Mo*1, Lin Shao1, Minhyuk Sung2, Leonidas Guibas1

1 2

slide-3
SLIDE 3

Problem Definition

Input Image Input Part Geometry Structure Decoding Assembled Shape

Image-Guided Shape Structure Decoding

slide-4
SLIDE 4

segmentation pose prediction

Geometry Conditioned Image Segmentation Graph Decoding of Part Geometry Conditioned Shape Structure

Approach

slide-5
SLIDE 5

Instance Segmentation

slide-6
SLIDE 6

Graph-Conv Pose Induction

Part Specific features Contextual Features Part Node Feature

slide-7
SLIDE 7

L2 Translation loss L2 Rotation loss Chamfer distance Rotation loss Shape Holistic chamfer distance loss

Loss Functions

slide-8
SLIDE 8

Evaluation Metric

Shape Chamfer Distance Part Accuracy

slide-9
SLIDE 9

pointnet

GRU

resnet

Per part R/T

Baseline 1 - GRU

slide-10
SLIDE 10

pointnet Instance one-hot

MLP

resnet

Per part R/T

Baseline 2 - InsOneHot

slide-11
SLIDE 11

pointnet Instance one-hot 3D global feature

MLP

resnet 2.5D global feature

Per part R/T

Baseline 3 - GlobalFeat

slide-12
SLIDE 12

Quantitative Results

slide-13
SLIDE 13

Qualitative Results