Gradient-Induced Co-Saliency Detection Zhao Zhang, Wenda Jin, - - PowerPoint PPT Presentation

▶

Oct 23, 2022 348 likes •586 views

Gradient-Induced Co-Saliency Detection Zhao Zhang, Wenda Jin, Jun Xu, Ming-Ming Cheng Nankai University & Tianjin University What is co-saliency detection (Co-SOD) ? Input Images Salient Object Detection ! Co-Saliency Detection How

SLIDE 1

Gradient-Induced Co-Saliency Detection

Zhao Zhang, Wenda Jin, Jun Xu, Ming-Ming Cheng Nankai University & Tianjin University

SLIDE 2

Salient Object Detection ! Co-Saliency Detection Input Images

What is co-saliency detection (Co-SOD) ?

SLIDE 3

How do humans do it?

SLIDE 4

Gradient-Induced Co-Saliency Detection

SLIDE 5

How to get consensus representation?

VGG

Softmax

SLIDE 6

Gradient Inducing Module (GIM)

1.000 0.863 0.75

SLIDE 7

Gradient Inducing Module (GIM)

1.000 0.863 0.75

SLIDE 8

··· ···

Gradient

Derivation

GIM

ARM

Consensus Embedding

Grouped Inputs Single Input Single Output

ARM ARM ARM

Global Average Pooling

Gradient Inducing Module (GIM)

SLIDE 9

Gradient Inducing Module (GIM)

SLIDE 10

Attention Retaining Module (ARM)

SLIDE 11

Attention Retaining Module (ARM)

SLIDE 12

DUTS

2. Single Object
1. Category-Agnostic

How to get training data？

SOD Dataset

SLIDE 13

Convert any SOD dataset to Co-SOD dataset

∗

Classifier

Category Step-1

Jigsaw Training (JT) strategy

SLIDE 14

Step-2

Jigsaw Training (JT) strategy

jigsaw

SLIDE 15

Current Evaluation Datasets

SLIDE 16

Proposed CoCA Dataset

SLIDE 17

Proposed CoCA Dataset

SLIDE 18

Comparison with State-of-the-Arts

SLIDE 19

Comparison with State-of-the-Arts

SLIDE 20

Ablation Study

SLIDE 21

Our Contributions

Human-inspired Co-SOD model Jigsaw training strategy New challenging dataset

SLIDE 22

Thank you!

Codes and dataset can be obtained from the QR code ! Welcome to use our CoCA dataset for evaluation.

https://mmcheng.net/gicd/