Shape Representation and Description Alexandre Falc ao Institute - - PowerPoint PPT Presentation

shape representation and description
SMART_READER_LITE
LIVE PREVIEW

Shape Representation and Description Alexandre Falc ao Institute - - PowerPoint PPT Presentation

Shape Representation and Description Alexandre Falc ao Institute of Computing - University of Campinas afalcao@ic.unicamp.br Alexandre Falc ao MC920/MO443 - Indrodu c ao ao Proc. de Imagens Introduction A segmented object may


slide-1
SLIDE 1

Shape Representation and Description

Alexandre Falc˜ ao

Institute of Computing - University of Campinas

afalcao@ic.unicamp.br

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-2
SLIDE 2

Introduction

A segmented object may contain multiple boundaries.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-3
SLIDE 3

Introduction

A segmented object may contain multiple boundaries. We will focus on 2D boundaries represented by closed, connected and oriented curves (contours).

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-4
SLIDE 4

Introduction

A segmented object may contain multiple boundaries. We will focus on 2D boundaries represented by closed, connected and oriented curves (contours). Each contour defines a shape whose properties are very important for image analysis.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-5
SLIDE 5

Introduction

Other shape representations can be derived from a contour and their properties are usually encoded in a more compact representation (i.e., feature vector).

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-6
SLIDE 6

Introduction

Other shape representations can be derived from a contour and their properties are usually encoded in a more compact representation (i.e., feature vector). Some feature vectors require specific distance functions to compute shape similarities independently of their orientation and size.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-7
SLIDE 7

Introduction

Other shape representations can be derived from a contour and their properties are usually encoded in a more compact representation (i.e., feature vector). Some feature vectors require specific distance functions to compute shape similarities independently of their orientation and size. The pair, feature extraction function and distance function, is called here a descriptor.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-8
SLIDE 8

Introduction

The Euclidean IFT from a contour S (lecture 2) creates in V multiscale contours (iso-contours) by subsequent exact dilations and erosions of S [1].

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-9
SLIDE 9

Introduction

Each contour is related to its internal and external skeletons (point sets with at least two equidistant pixels in the contour).

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-10
SLIDE 10

Introduction

Each contour is related to its internal and external skeletons (point sets with at least two equidistant pixels in the contour). The Euclidean IFT can output a labeled map L, which is used to create internal and external multiscale skeletons.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-11
SLIDE 11

Introduction

Each contour is related to its internal and external skeletons (point sets with at least two equidistant pixels in the contour). The Euclidean IFT can output a labeled map L, which is used to create internal and external multiscale skeletons. These skeletons present a highly desirable characteristic of being one-pixel-wide and connected in all scales.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-12
SLIDE 12

Introduction

Each contour is related to its internal and external skeletons (point sets with at least two equidistant pixels in the contour). The Euclidean IFT can output a labeled map L, which is used to create internal and external multiscale skeletons. These skeletons present a highly desirable characteristic of being one-pixel-wide and connected in all scales. In the presence of multiple contours, a simple variant computes the skeleton by influence zones (SKIZ — a point set with equidistant pixels in at least two contours).

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-13
SLIDE 13

Introduction

A given contour S.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-14
SLIDE 14

Introduction

A given contour S. Pixels along S receive a subsequent label from 1 to |S|.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-15
SLIDE 15

Introduction

A given contour S. Pixels along S receive a subsequent label from 1 to |S|. The labels are propagated to form a label map L (discrete Voronoi regions).

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-16
SLIDE 16

Introduction

A given contour S. Pixels along S receive a subsequent label from 1 to |S|. The labels are propagated to form a label map L (discrete Voronoi regions). A multiscale skeleton is created from local differences in L.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-17
SLIDE 17

Introduction

A given contour S. Pixels along S receive a subsequent label from 1 to |S|. The labels are propagated to form a label map L (discrete Voronoi regions). A multiscale skeleton is created from local differences in L. Skeletons are obtained by thresholding the multiscale skeleton at increasing scales.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-18
SLIDE 18

Introduction

A given contour S. Pixels along S receive a subsequent label from 1 to |S|. The labels are propagated to form a label map L (discrete Voronoi regions). A multiscale skeleton is created from local differences in L. Skeletons are obtained by thresholding the multiscale skeleton at increasing scales.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-19
SLIDE 19

Introduction

A given contour S. Pixels along S receive a subsequent label from 1 to |S|. The labels are propagated to form a label map L (discrete Voronoi regions). A multiscale skeleton is created from local differences in L. Skeletons are obtained by thresholding the multiscale skeleton at increasing scales.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-20
SLIDE 20

Introduction

The Euclidean IFT with a small dilation radius from an internal skeleton S creates a root map R,

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-21
SLIDE 21

Introduction

The Euclidean IFT with a small dilation radius from an internal skeleton S creates a root map R, the aperture angles of the discrete Voronoi regions in R are used to detect salience points of the skeleton,

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-22
SLIDE 22

Introduction

The Euclidean IFT with a small dilation radius from an internal skeleton S creates a root map R, the aperture angles of the discrete Voronoi regions in R are used to detect salience points of the skeleton, from salience points of the internal and external skeletons, we detect convex and concave salience points

  • f the contour.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-23
SLIDE 23

Introduction

The Euclidean IFT can also speed up the computation of the largest ellipse (tensor scale) centered at each pixel, creating a region-based shape representation. Orientation(s) = angle between t1(s) and the horizontal axis. Anisotropy(s) =

  • 1 − |t2(s)|2

|t1(s)|2 . Thickness(s) = |t2(s)|.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-24
SLIDE 24

Introduction

By using the HSI color space, the tensor orientation at each pixel is represented by a distinct color. The region-based representation stores orientation and anisotropy at each pixel.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-25
SLIDE 25

Organization of the lecture

Muliscale skeletonization and SKIZ [1].

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-26
SLIDE 26

Organization of the lecture

Muliscale skeletonization and SKIZ [1]. Contour and skeleton saliences [2].

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-27
SLIDE 27

Organization of the lecture

Muliscale skeletonization and SKIZ [1]. Contour and skeleton saliences [2]. Tensor scale computation [3].

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-28
SLIDE 28

Organization of the lecture

Muliscale skeletonization and SKIZ [1]. Contour and skeleton saliences [2]. Tensor scale computation [3]. Shape description from these representations [4].

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-29
SLIDE 29

Organization of the lecture

Muliscale skeletonization and SKIZ [1]. Contour and skeleton saliences [2]. Tensor scale computation [3]. Shape description from these representations [4]. Combining multiple descriptors [5].

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-30
SLIDE 30

Multiscale skeletonization and SKIZ

Consider a binary image ˆ I = (DI, I) with m disjoint contours Si ⊂ DI, i = 1, 2, . . . , m.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-31
SLIDE 31

Multiscale skeletonization and SKIZ

Consider a binary image ˆ I = (DI, I) with m disjoint contours Si ⊂ DI, i = 1, 2, . . . , m. By circumscribing each contour in a given orientation (clockwise), a function λp(t) assigns to each pixel t ∈ Si a subsequent integer number from 1 to |Si|.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-32
SLIDE 32

Multiscale skeletonization and SKIZ

Consider a binary image ˆ I = (DI, I) with m disjoint contours Si ⊂ DI, i = 1, 2, . . . , m. By circumscribing each contour in a given orientation (clockwise), a function λp(t) assigns to each pixel t ∈ Si a subsequent integer number from 1 to |Si|. Each contour pixel also receives a number i = 1, 2, . . . , m by a function λc(t) to identify its contour.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-33
SLIDE 33

Multiscale skeletonization and SKIZ

Let S = ∪c

i=1Si be the union set of all contour pixels.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-34
SLIDE 34

Multiscale skeletonization and SKIZ

Let S = ∪c

i=1Si be the union set of all contour pixels.

The Euclidean IFT propagates contour pixel labels in Lp and contour labels in Lc inside and outside the contours by using A√

2 (8-neighbors) and path function feuc,

feuc(t) = if t ∈ S, +∞

  • therwise,

feuc(πs · s, t) = t − R(πs)2.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-35
SLIDE 35

Multiscale skeletons and SKIZ

Algorithm

– Euclidean IFT with label propagation 1. For each t ∈ DI\S, set V (t) ← +∞ and R(πt) ← t. 2. For each t ∈ S, do 3. Set V (t) ← 0, Lp(t) ← λp(t), and Lc(t) ← λc(t). 4. Insert t in Q. 5. While Q is not empty, do 6. Remove from Q a pixel s such that V (s) is minimum. 7. For each t ∈ A√

2(s) such that V (t) > V (s), do

8. Compute tmp ← t − R(πs)2. 9. If tmp < V (t), then 10. If V (t) = +∞, remove t from Q. 11. Set V (t) ← tmp and R(πt) ← R(πs). 12. Set Lp(t) ← Lp(s) and Lc(t) ← Lc(s). 13. Insert t in Q.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-36
SLIDE 36

Multiscale skeletons and SKIZ

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-37
SLIDE 37

Multiscale skeletons and SKIZ

Multiscale skeletons and SKIZ are computed from Lp(s) and Lc(s), respectively, creating a difference map D(s).

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-38
SLIDE 38

Multiscale skeletons and SKIZ

Multiscale skeletons and SKIZ are computed from Lp(s) and Lc(s), respectively, creating a difference map D(s). SKIZ and one-pixel wide and connected skeletons are then

  • btained by thresholding D(s). Higher the threshold, more

simplified become the skeletons.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-39
SLIDE 39

Multiscale skeletons and SKIZ

Multiscale skeletons and SKIZ are computed from Lp(s) and Lc(s), respectively, creating a difference map D(s). SKIZ and one-pixel wide and connected skeletons are then

  • btained by thresholding D(s). Higher the threshold, more

simplified become the skeletons. Multiscale skeletons and SKIZ are computed as follows.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-40
SLIDE 40

Multiscale skeletons and SKIZ

Each pair of contour points in Si “equidistant” to a pixel s ∈ Si defines two segments between them. Among the shortest segments from each pair, the length of the longest one (blue line) is assigned to D(s).

R(π t) R(π s) t s

a = b c = d

This condition is relaxed by computing segment lengths between root points (a, b, c, and d) related to s and its 4-neighbors.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-41
SLIDE 41

Multiscale skeletons and SKIZ

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-42
SLIDE 42

Multiscale skeletons and SKIZ

If Lc(s) = Lc(t) = i for all t ∈ A1(s), then ∆(s, t) = Lp(t) − Lp(s) D(s) = max

∀(s,t)∈A1

{min{∆(s, t), |Si| − ∆(s, t)}}. Note that, for clockwise contour labeling, L(a) < L(b) < L(c) < L(d), and the FIFO tie-breaking policy will favor the root with lowest label.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-43
SLIDE 43

Multiscale skeletons and SKIZ

If Lc(s) = Lc(t) = i for all t ∈ A1(s), then ∆(s, t) = Lp(t) − Lp(s) D(s) = max

∀(s,t)∈A1

{min{∆(s, t), |Si| − ∆(s, t)}}. Note that, for clockwise contour labeling, L(a) < L(b) < L(c) < L(d), and the FIFO tie-breaking policy will favor the root with lowest label. When Lc(s) = Lc(t) for some t ∈ A1(s), then the SKIZ is in between pixels s and t. Since the SKIZ is never filtered by thresholding, for Lc(t) > Lc(s), D(t) = +∞ and D(s) = 0, and for Lc(t) < Lc(s), D(s) = +∞ and D(t) = 0. Show demo program.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-44
SLIDE 44

Skeleton saliences

How do we compute skeleton saliences?

θ r

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-45
SLIDE 45

Skeleton saliences

How do we compute skeleton saliences?

θ r

The IFT dilation of the skeletons up to a small radius r (e.g., 10) produces a small influence zone for each point.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-46
SLIDE 46

Skeleton saliences

How do we compute skeleton saliences?

θ r

The IFT dilation of the skeletons up to a small radius r (e.g., 10) produces a small influence zone for each point. The area A = θr2

2 of each influence zone is related to its

aperture angle θ at each point.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-47
SLIDE 47

Skeleton saliences

How do we compute skeleton saliences?

θ r

The IFT dilation of the skeletons up to a small radius r (e.g., 10) produces a small influence zone for each point. The area A = θr2

2 of each influence zone is related to its

aperture angle θ at each point. Salience points are then obtained by thresholding θ.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-48
SLIDE 48

How do we compute contour saliences?

For clockwise contour labeling, a contour salience a is detected from a skeleton salience c by skipping D(c)

2

pixels in either anti-clockwise or clockwise from the root R(πc).

πc

R( )

πc

R( )

−D(c)/2

c

=

a

D(c)/2

b c a

=

b

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-49
SLIDE 49

How do we compute contour saliences?

For clockwise contour labeling, a contour salience a is detected from a skeleton salience c by skipping D(c)

2

pixels in either anti-clockwise or clockwise from the root R(πc).

πc

R( )

πc

R( )

−D(c)/2

c

=

a

D(c)/2

b c a

=

b

However, how do we know which orientation to go?

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-50
SLIDE 50

Contour and skeleton saliences

Let ∆∗(s, t) = Lp(t) − Lp(s) be the one which satisfies D(s) = max

∀(s,t)∈A1

{min{∆(s, t), |Si| − ∆(s, t)}}. We go anti-clockwise, when ∆∗(s, t) > |Si| − ∆∗(s, t), and clockwise in the opposite case.

πc

R( )

πc

R( )

−D(c)/2

b a

= =

a

D(c)/2

d s=c s=c d t b t

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-51
SLIDE 51

Tensor scale computation

As proposed by Saha [6], the tensor scale at s may be computed by tracing sample lines, finding edge points in each line, and fitting the largest ellipse through these points.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-52
SLIDE 52

Tensor scale computation

As proposed by Saha [6], the tensor scale at s may be computed by tracing sample lines, finding edge points in each line, and fitting the largest ellipse through these points.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-53
SLIDE 53

Tensor scale computation

As proposed by Saha [6], the tensor scale at s may be computed by tracing sample lines, finding edge points in each line, and fitting the largest ellipse through these points.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-54
SLIDE 54

Tensor scale computation

As proposed by Saha [6], the tensor scale at s may be computed by tracing sample lines, finding edge points in each line, and fitting the largest ellipse through these points.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-55
SLIDE 55

Tensor scale computation

The Euclidean IFT speeds up the search for each pair of edge points by exploiting the values in V (s) [3].

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-56
SLIDE 56

Tensor scale computation

The Euclidean IFT speeds up the search for each pair of edge points by exploiting the values in V (s) [3].

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-57
SLIDE 57

Tensor scale computation

The Euclidean IFT speeds up the search for each pair of edge points by exploiting the values in V (s) [3].

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-58
SLIDE 58

Tensor scale computation

The ellipse orientation is obtained from the value of γ that minimizes function g below. g(γ) =

  • i=1,2,...,m

[x2

iγ − y2 iγ]

where

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-59
SLIDE 59

Tensor scale computation

The ellipse orientation is obtained from the value of γ that minimizes function g below. g(γ) =

  • i=1,2,...,m

[x2

iγ − y2 iγ]

where m is the number of sample lines,

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-60
SLIDE 60

Tensor scale computation

The ellipse orientation is obtained from the value of γ that minimizes function g below. g(γ) =

  • i=1,2,...,m

[x2

iγ − y2 iγ]

where m is the number of sample lines, (xiγ, yiγ) are obtained by rotation using angle γ on the relative coordinates (xi, yi) of the edge points with respect s = (xs, ys). xiγ = xi cos(γ) − yi sin(γ) yiγ = xi sin(γ) + yi cos(γ)

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-61
SLIDE 61

Organization of the lecture

Muliscale skeletonization and SKIZ. Contour and skeleton saliences. Tensor scale computation. Shape description from these representations. Combining multiple descriptors.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-62
SLIDE 62

Shape description

A descriptor is a pair (v, d), where v is a feature extraction function, which assigns a vector s to any sample s (shape, image, spel), and d is a distance function between samples s and t in the feature space (e.g., d(s, t) = t − s).

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-63
SLIDE 63

Shape description

r concave convex

Feature vectors may represent a multiscale fractal dimension [2] computed from the distance map V .

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-64
SLIDE 64

Shape description

r concave convex

Feature vectors may represent a multiscale fractal dimension [2] computed from the distance map V . area (salience value) of the largest influence zone [2] for each convex and concave point obtained from the label map Lp.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-65
SLIDE 65

Shape description

r concave convex

Feature vectors may represent a multiscale fractal dimension [2] computed from the distance map V . area (salience value) of the largest influence zone [2] for each convex and concave point obtained from the label map Lp. salience values [4] of contour segments obtained from the label map Lp.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-66
SLIDE 66

Shape description

r concave convex

Feature vectors may represent a multiscale fractal dimension [2] computed from the distance map V . area (salience value) of the largest influence zone [2] for each convex and concave point obtained from the label map Lp. salience values [4] of contour segments obtained from the label map Lp. In most cases, a specific distance function is required to take into account possible shape rotation and scaling.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-67
SLIDE 67

Shape descriptor based on tensor scale

For example, we have divided a contour into a fixed number of segments and assigned to each segment the weighted angular mean of the orientation θi at each pixel s in the influence zone of that segment [3]. The anisotropy αi of s is the weight. ¯ θ = arctan n

i=1 αi ∗ sin(2θi)

n

i=1 αi ∗ cos(2θi)

  • Alexandre Falc˜

ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-68
SLIDE 68

Shape Descriptor based on tensor scale

Feature vectors for a shape in different positions.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-69
SLIDE 69

Shape Descriptor based on tensor scale

Matching between the feature vectors for distance computation.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-70
SLIDE 70

Combining multiple descriptors

Let ∆ = {D1, D2, . . . , Dk} be a collection of descriptors Di = (vi, di), i = 1, 2, . . . , k, needed to handle different shape, color and texture properties.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-71
SLIDE 71

Combining multiple descriptors

Let ∆ = {D1, D2, . . . , Dk} be a collection of descriptors Di = (vi, di), i = 1, 2, . . . , k, needed to handle different shape, color and texture properties. The combination C of their distance functions is an application-dependent optimization problem which creates a composite descriptor D∗ = (∆, C).

D* Dk D2 D1 d1(s,t) d2(s,t) dk(s,t) *(s,t) d (b) ...... C t s vi t vi s vi(t) vi(s) di di(s,t) Di (a)

We have found C by genetic programming [5].

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-72
SLIDE 72

Conclusion

The Euclidean IFT was exploited to derive several shape representations.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-73
SLIDE 73

Conclusion

The Euclidean IFT was exploited to derive several shape representations. These representations involved multiscale skeletons, salience points, and tensor scale.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-74
SLIDE 74

Conclusion

The Euclidean IFT was exploited to derive several shape representations. These representations involved multiscale skeletons, salience points, and tensor scale. Given that contour saliences are estimated from skeleton saliences, the multiscale skeletons can also obtain contour saliences in different scales.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-75
SLIDE 75

Conclusion

The Euclidean IFT was exploited to derive several shape representations. These representations involved multiscale skeletons, salience points, and tensor scale. Given that contour saliences are estimated from skeleton saliences, the multiscale skeletons can also obtain contour saliences in different scales. There are many ways to create shape descriptors from those representations and combine their distance functions into a composite descriptor.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-76
SLIDE 76

[1] A.X. Falc˜ ao, L.F. Costa, and B.S. da Cunha. Multiscale skeletons by image foresting transform and its applications to neuromorphometry. Pattern Recognition, 35(7):1571–1582, Apr 2002. [2] R.S. Torres, A.X. Falc˜ ao, and L.F. Costa. A graph-based approach for multiscale shape analysis. Pattern Recognition, 37(6):1163–1174, 2004. [3] F.A. Andal´

  • , P.A.V. Miranda, R. da S. Torres, and A.X.Falc˜

ao. Shape feature extraction and description based on tensor scale. Pattern Recognition, 43(1):26–36, Jan 2010. [4] R.S. Torres and A.X. Falc˜ ao. Contour salience descriptors for effective image retrieval and analysis. Image and Vision Computing, 25(1):3–13, Jan 2007. [5] R.S. Torres, A.X. Falc˜ ao, M.A. Gon¸ calves, J.P. Papa,

  • B. Zhang, W. Fan, and E.A. Fox.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens

slide-77
SLIDE 77

A genetic programming framework for content-based image retrieval. Pattern Recognition, 42:217–312, Feb 2009. [6] P.K. Saha. Tensor Scale: A local morphometric parameter with applications to computer vision and image processing. Computer Vision and Image Understanding, 99:384–413, 2005.

Alexandre Falc˜ ao MC920/MO443 - Indrodu¸ c˜ ao ao Proc. de Imagens