binary foreground map evaluation
play

Binary Foreground Map Evaluation Deng-Ping Fan Nankai University of - PowerPoint PPT Presentation

May 26, 2023 •343 likes •1.01k views

Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan Nankai University of Media Computing Lab IJCAI2018 Oral Presentation http://dpfan.net/e-measure Outline Overview of Binary Foreground Maps Previous Work

  1. Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan Nankai University of Media Computing Lab IJCAI’2018 Oral Presentation http://dpfan.net/e-measure

  2. Outline  Overview of Binary Foreground Maps  Previous Work  Enhanced-alignment Measure  Experiments Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  3. Binary Foreground Map 0 (a) Image (b) Binary foreground map 1 Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  4. Binary Foreground Map  The binary foreground map consists of values of either 0 or 1.  1 denotes foreground, 0 for background. 0 (a) Image (b) Binary foreground map 1 Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  5. Application  Object Segmentation (a) Image (d) GT Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  6. Application  Object Segmentation (b) MDF (CVPR’15) (c) DISC (TNNLS’16) (a) Image (e) DCL (CVPR’16) (d) GT (f) Noise Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  7. Evaluation  Similarity evaluation is very important. Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  8. Evaluation  Similarity evaluation is very important. VS VS Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  9. Outline  Overview of Binary Foreground Maps  Previous Work  Enhanced-alignment Measure  Experiments Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  10. Previous Work  Intersection-over-Union ( IoU ) Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  11. Previous Work  Intersection-over-Union ( IoU ) A Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  12. Previous Work  Intersection-over-Union ( IoU ) B Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  13. Previous Work  Intersection-over-Union ( IoU ) A B Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  14. Previous Work  Intersection-over-Union ( IoU ) 𝐽𝑝𝑉 = 𝐵 ∩ 𝐶 𝐵 ∪ 𝐶 Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  15. Previous Work  Intersection-over-Union ( IoU ) A∩B 𝐽𝑝𝑉 = 𝐵 ∩ 𝐶 𝐵 ∪ 𝐶 Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  16. Previous Work  Intersection-over-Union ( IoU ) A∩B 𝐽𝑝𝑉 = 𝐵 ∩ 𝐶 𝐵 ∪ 𝐶 Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  17. Previous Work  Intersection-over-Union ( IoU ) A∩B 𝐽𝑝𝑉 = 𝐵 ∩ 𝐶 𝐵 ∪ 𝐶 A ∪ B Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  18. Previous Work  Contour Mapping ( CM ) [1] [1] Movahedi and Elder. Design and perceptual validation of performance measures for salient object segmentation. CVPRW, 2010. Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  19. Previous Work  Contour Mapping ( CM ) [1] [1] Movahedi and Elder. Design and perceptual validation of performance measures for salient object segmentation. CVPRW, 2010. Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  20. Previous Work  Contour Mapping ( CM ) [1]  Weighted 𝐺 𝛾 -measure ( Fbw ) [2] [1] Movahedi and Elder. Design and perceptual validation of performance measures for salient object segmentation. CVPRW, 2010. [2] Margolin et al. How to evaluate foreground maps? CVPR, 2014. [3] Shi et al. Visual quality evaluation of image object segmentation: Subjective assessment and objective measure. TIP, 2015. [4] Fan et al. Structure-measure: A New Way to Evaluate Foreground Maps. ICCV, 2017. Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  21. Previous Work  Contour Mapping ( CM ) [1]  Weighted 𝐺 𝛾 -measure ( Fbw ) [2] Introducing weight to the 𝐺 𝛾 -measure (related to IoU) framework. 𝐺1 𝐽𝑝𝑉 = 2 − 𝐺1 [1] Movahedi and Elder. Design and perceptual validation of performance measures for salient object segmentation. CVPRW, 2010. [2] Margolin et al. How to evaluate foreground maps? CVPR, 2014. [3] Shi et al. Visual quality evaluation of image object segmentation: Subjective assessment and objective measure. TIP, 2015. [4] Fan et al. Structure-measure: A New Way to Evaluate Foreground Maps. ICCV, 2017. Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  22. Previous Work  Contour Mapping ( CM ) [1]  Weighted 𝐺 𝛾 -measure ( Fbw ) [2] Introducing weight to the 𝐺 𝛾 -measure (related to IoU) framework.  Visual Quality ( VQ ) [3] [1] Movahedi and Elder. Design and perceptual validation of performance measures for salient object segmentation. CVPRW, 2010. [2] Margolin et al. How to evaluate foreground maps? CVPR, 2014. [3] Shi et al. Visual quality evaluation of image object segmentation: Subjective assessment and objective measure. TIP, 2015. [4] Fan et al. Structure-measure: A New Way to Evaluate Foreground Maps. ICCV, 2017. Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  23. Previous Work  Contour Mapping ( CM ) [1]  Weighted 𝐺 𝛾 -measure ( Fbw ) [2] Introducing weight to the 𝐺 𝛾 -measure (related to IoU) framework.  Visual Quality ( VQ ) [3] Considering psychological function based on the IoU. [1] Movahedi and Elder. Design and perceptual validation of performance measures for salient object segmentation. CVPRW, 2010. [2] Margolin et al. How to evaluate foreground maps? CVPR, 2014. [3] Shi et al. Visual quality evaluation of image object segmentation: Subjective assessment and objective measure. TIP, 2015. [4] Fan et al. Structure-measure: A New Way to Evaluate Foreground Maps. ICCV, 2017. Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  24. Previous Work  Contour Mapping ( CM ) [1]  Weighted 𝐺 𝛾 -measure ( Fbw ) [2] Introducing weight to the 𝐺 𝛾 -measure (related to IoU) framework.  Visual Quality ( VQ ) [3] Considering psychological function based on the IoU.  Structure measure ( S-measure ) [4] [1] Movahedi and Elder. Design and perceptual validation of performance measures for salient object segmentation. CVPRW, 2010. [2] Margolin et al. How to evaluate foreground maps? CVPR, 2014. [3] Shi et al. Visual quality evaluation of image object segmentation: Subjective assessment and objective measure. TIP, 2015. [4] Fan et al. Structure-measure: A New Way to Evaluate Foreground Maps. ICCV, 2017. Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  25. Previous Work  Contour Mapping ( CM ) [1]  Weighted 𝐺 𝛾 -measure ( Fbw ) [2] Introducing weight to the 𝐺 𝛾 -measure (related to IoU) framework.  Visual Quality ( VQ ) [3] Considering psychological function based on the IoU.  Structure measure ( S-measure ) [4] Mainly focus on the non-binary maps evaluation. [1] Movahedi and Elder. Design and perceptual validation of performance measures for salient object segmentation. CVPRW, 2010. [2] Margolin et al. How to evaluate foreground maps? CVPR, 2014. [3] Shi et al. Visual quality evaluation of image object segmentation: Subjective assessment and objective measure. TIP, 2015. [4] Fan et al. Structure-measure: A New Way to Evaluate Foreground Maps. ICCV, 2017. Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  26. Previous Work Table1. Current evaluation measure summary Measure Year Pros Cons IoU 190 easy to calculate losing image level statistics 1 CM [1] 2010 considering both region and noise sensitive contour assigning different weights error location sensitive, Fbw [2] 2014 for errors complicated VQ [3] 2015 weighting errors by subjective measure psychological function S-measure [4] 2017 considering structure focusing on non-binary map similarity properties [1] Movahedi and Elder. Design and perceptual validation of performance measures for salient object segmentation. CVPRW, 2010. [2] Margolin et al. How to evaluate foreground maps? CVPR, 2014. [3] Shi et al. Visual quality evaluation of image object segmentation: Subjective assessment and objective measure. TIP, 2015. [4] Fan et al. Structure-measure: A New Way to Evaluate Foreground Maps. ICCV, 2017. Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

  27. Problem (a) Image (b) GT (c) Foreground map (d) Noise Enhanced-alignment Measure for Binary Foreground Map Evaluation Deng-Ping Fan, http://dpfan.net/, 2018/7/7

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Binary images Constrained image capture setting Two pixel values Foreground and

Binary images Constrained image capture setting Two pixel values Foreground and

Sudheendras office hours Mon, Wed 1-2 pm Lecture 3: Binary image analysis ENS 31NR Forsyth and Ponce book Thursday, Sept 6 Binary images Constrained image capture setting Two pixel values Foreground and background

518 views • 13 slides
Interactive Foreground Segmentation in Images and Videos Suyog Jain 1 Foreground Segmentation

Interactive Foreground Segmentation in Images and Videos Suyog Jain 1 Foreground Segmentation

2/9/2017 Interactive Foreground Segmentation in Images and Videos Suyog Jain 1 Foreground Segmentation Generate pixel level foreground masks for objects in a given image or video 2 1 2/9/2017 Why is Foreground Segmentation useful?

416 views • 25 slides
A Comparative Evaluation of Foreground/Background Sketch-based Mesh Segmentation Algorithms Min

A Comparative Evaluation of Foreground/Background Sketch-based Mesh Segmentation Algorithms Min

A Comparative Evaluation of Foreground/Background Sketch-based Mesh Segmentation Algorithms Min Meng Lubin Fan Ligang Liu Zhejiang University, China Mesh Segmentation Modeling Deformation Morphing Texture Mapping Shape Retrieval Shape

449 views • 41 slides
Software and Foreground Subtraction Dave McGinnis 4/26/2010 Foreground Subtraction - McGinnis

Software and Foreground Subtraction Dave McGinnis 4/26/2010 Foreground Subtraction - McGinnis

21cm Instrument Simulation Software and Foreground Subtraction Dave McGinnis 4/26/2010 Foreground Subtraction - McGinnis 1 SKY SIMULATION SOFTWARE 4/26/2010 Foreground Subtraction - McGinnis 2 Code Suite 20 Java classes organized into

727 views • 34 slides
Lecture 3: Binary image analysis Thursday, Sept 6 Sudheendras office hours Mon, Wed

Lecture 3: Binary image analysis Thursday, Sept 6 Sudheendras office hours Mon, Wed

Lecture 3: Binary image analysis Thursday, Sept 6 Sudheendras office hours Mon, Wed 1-2 pm ENS 31NR Forsyth and Ponce book Binary images Two pixel values Foreground and background Regions of interest

1.13k views • 78 slides
Introduction to Machine Learning Evaluation: Measures for Binary Classification: ROC Measures

Introduction to Machine Learning Evaluation: Measures for Binary Classification: ROC Measures

Introduction to Machine Learning Evaluation: Measures for Binary Classification: ROC Measures compstat-lmu.github.io/lecture_i2ml IMBALANCED BINARY LABELS Classify all as no disease (green) high accuracy. Accuracy Paradox c

451 views • 10 slides
Binary Numbers Binary numbers look like this Binary Numbers or Binary Code Binary numbers or

Binary Numbers Binary numbers look like this Binary Numbers or Binary Code Binary numbers or

Binary Numbers Binary numbers look like this Binary Numbers or Binary Code Binary numbers or binary code are used by computers and digital devices to talk to each other. It is used to give commands to the computer or a way to enter data

165 views • 12 slides
How to Make a Game Like Flappy Bird in Swift Step 3: Moving the Background Moving Foreground

How to Make a Game Like Flappy Bird in Swift Step 3: Moving the Background Moving Foreground

How to Make a Game Like Flappy Bird in Swift Step 3: Moving the Background Moving Foreground Moving Foreground Demo: Moving Foreground Challenge Time!

462 views • 6 slides
Foreground detection and tracking in 2D/3D Jos Luis Landabaso Montse Pards Outline 2D

Foreground detection and tracking in 2D/3D Jos Luis Landabaso Montse Pards Outline 2D

Foreground detection and tracking in 2D/3D Jos Luis Landabaso Montse Pards Outline 2D Foreground Detection 2D Object Tracking 3D Foreground Detection 3D Object Tracking 2D Entity Detection: Stauffer &Grimson We model

562 views • 29 slides
Morphological Operators CS/BIOEN 4640: Image Processing Basics February 23, 2012 Common

Morphological Operators CS/BIOEN 4640: Image Processing Basics February 23, 2012 Common

Morphological Operators CS/BIOEN 4640: Image Processing Basics February 23, 2012 Common Morphological Operations Shrinking the foreground (erosion) Expanding the foreground (dilation) Removing holes in the foreground

635 views • 30 slides
CSE 421 Project Selection / Reductions Shayan Oveis Gharan 1 Image Segmentation Foreground /

CSE 421 Project Selection / Reductions Shayan Oveis Gharan 1 Image Segmentation Foreground /

CSE 421 Project Selection / Reductions Shayan Oveis Gharan 1 Image Segmentation Foreground / background segmentation Label each pixel as foreground/background. V = set of pixels, E = pairs of neighboring pixels. # 0 is

604 views • 21 slides
Introduction to Machine Learning Evaluation: Measures for Binary Classification: ROC

Introduction to Machine Learning Evaluation: Measures for Binary Classification: ROC

Introduction to Machine Learning Evaluation: Measures for Binary Classification: ROC visualization compstat-lmu.github.io/lecture_i2ml LABELS: ROC SPACE Plot True Positive Rate and False Positive Rate: 1.00 True Class y C2 +

596 views • 17 slides
The Power of Binary 0, 1, 10, 11, 100, 101, 110, 111... What is Binary? a binary number

The Power of Binary 0, 1, 10, 11, 100, 101, 110, 111... What is Binary? a binary number

The Power of Binary 0, 1, 10, 11, 100, 101, 110, 111... What is Binary? a binary number is a number expressed in the binary numeral system, or base-2 numeral system, which represents numeric values using two different symbols: typically

485 views • 19 slides
Evaluation of Program Success for Programs with Multiple Trials in Binary Outcomes Meihua Wang,

Evaluation of Program Success for Programs with Multiple Trials in Binary Outcomes Meihua Wang,

Evaluation of Program Success for Programs with Multiple Trials in Binary Outcomes Meihua Wang, G. Frank Liu, Jerald Schindler Merck Research Laboratory 12/15/2015 Outline Background Methods -- Probability of success (POS) --

270 views • 24 slides
Detecting Foreground Huynh The Thien thienht@oslab.khu.ac.kr Dept. of Computer Science &

Detecting Foreground Huynh The Thien thienht@oslab.khu.ac.kr Dept. of Computer Science &

KYUNG HEE UNIVERSITY Department of Computer Science & Engineering PhD Thesis Dissertation Presentation PhD Thesis Dissertation Presentation Ubiquitous Computing Lab NIC: A Novel Background Estimation Algorithm For Detecting Foreground

831 views • 48 slides
Binary Search Tree intro BST with order properties After today, you should be able to

Binary Search Tree intro BST with order properties After today, you should be able to

Binary Search Tree intro BST with order properties After today, you should be able to implement deletion from a BST Partner Evaluation done? Q/A and Work time today, 2 nd hour Binary Trees that store elements in increasing order

91 views • 8 slides
Aims of Session Understand the concept of constructive alignment Identify the benefits

Aims of Session Understand the concept of constructive alignment Identify the benefits

Aims of Session Understand the concept of constructive alignment Identify the benefits of constructive alignment Consider examples of how constructive alignment can enhance the learning and teaching environment Constructive

518 views • 14 slides
RTCP Extension For Time Alignment draft-taylor-avt-time-align-00.txt Tom Taylor et al IETF 66

RTCP Extension For Time Alignment draft-taylor-avt-time-align-00.txt Tom Taylor et al IETF 66

RTCP Extension For Time Alignment draft-taylor-avt-time-align-00.txt Tom Taylor et al IETF 66 Draft Contents Statement of problem and requirements Definition of a time alignment feedback message Time alignment procedures Sender

611 views • 6 slides
Algorithms in Bioinformatics: A Practical Introduction Multiple Sequence Alignment Multiple

Algorithms in Bioinformatics: A Practical Introduction Multiple Sequence Alignment Multiple

Algorithms in Bioinformatics: A Practical Introduction Multiple Sequence Alignment Multiple Sequence Alignment Given k sequences S = { S 1 , S 2 , , S k } . A multiple alignment of S is a set of k equal- length sequences { S 1 ,

652 views • 47 slides
Adversarial Robustness for Aligned AI Ian Goodfellow, Sta ff Research NIPS 2017 Workshop on

Adversarial Robustness for Aligned AI Ian Goodfellow, Sta ff Research NIPS 2017 Workshop on

Adversarial Robustness for Aligned AI Ian Goodfellow, Sta ff Research NIPS 2017 Workshop on Aligned Artificial Intelligence Many thanks to Catherine Olsson for feedback on drafts The Alignment Problem (This is now fixed. Dont try it!)

626 views • 30 slides
Sequence Alignment Mark Voorhies 5/20/2015 Mark Voorhies Sequence Alignment Exercise: Scoring

Sequence Alignment Mark Voorhies 5/20/2015 Mark Voorhies Sequence Alignment Exercise: Scoring

Sequence Alignment Mark Voorhies 5/20/2015 Mark Voorhies Sequence Alignment Exercise: Scoring an ungapped alignment Given two sequences and a scoring matrix, find the offset that yields the best scoring ungapped alignment. Mark Voorhies

406 views • 29 slides
Block Devices, Filesystems And Block Layer Alignment Christoph Anton Mitterer

Block Devices, Filesystems And Block Layer Alignment Christoph Anton Mitterer

. DCACHE WORKSHOP DEUTSCHES ELEKTRONEN-SYNCHROTRON DESY ZEUTHEN April 19, 2012 Block Devices, Filesystems And Block Layer Alignment Christoph Anton Mitterer christoph.anton.mitterer@lmu.de BLOCK DEVICES, FILESYSTEMS AND BLOCK LAYER

843 views • 45 slides
Fitting a transformation: feature-based alignment Tues Oct 13 Motivation: Recognition Figures

Fitting a transformation: feature-based alignment Tues Oct 13 Motivation: Recognition Figures

10/12/2015 Fitting a transformation: feature-based alignment Tues Oct 13 Motivation: Recognition Figures from David Low e 1 10/12/2015 Motivation: medical image registration Motivation: mosaics Image f rom

320 views • 31 slides
Uncertainty in compositional models of alignment Ieva Kazlauskaite, University of Bath Neill D.F.

Uncertainty in compositional models of alignment Ieva Kazlauskaite, University of Bath Neill D.F.

Uncertainty in compositional models of alignment Ieva Kazlauskaite, University of Bath Neill D.F. Campbell, University of Bath Carl Henrik Ek, University of Bristol Ivan Ustyuzhaninov, University of T ubingen Tom Waterson, Electronic Arts

875 views • 35 slides

More recommend