Non-additive measures and integrals Vicen c Torra March, 2014 - - PowerPoint PPT Presentation

non additive measures and integrals vicen c torra march
SMART_READER_LITE
LIVE PREVIEW

Non-additive measures and integrals Vicen c Torra March, 2014 - - PowerPoint PPT Presentation

LiU 2014 Non-additive measures and integrals Vicen c Torra March, 2014 IIIA-CSIC (joint work with Yasuo Narukawa and Michio Sugeno) Motivation Outline A short motivation Topic. Non-additive measures A generalization of additive


slide-1
SLIDE 1

LiU 2014

Non-additive measures and integrals Vicen¸ c Torra March, 2014

∗ IIIA-CSIC (joint work with Yasuo Narukawa and Michio Sugeno)

slide-2
SLIDE 2

Motivation Outline

A short motivation

  • Topic. Non-additive measures
  • A generalization of additive measures (probabilities)
  • Non-additive measures also known as
  • fuzzy measures (Sugeno, 1974),
  • capacities (Choquet, 1954),
  • monotone games (Aumann and Shapley, 1974),
  • premeasures (ˇ

Sipoˇ s, 1979)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 1 / 70

slide-3
SLIDE 3

Motivation Outline

A short motivation

Why are these measures studied?

  • Mathematical interest
  • Properties

⋆ Equalities and inequalities (e.g. Cauchy-Schwarz type inequalities) ⋆ Measures and distances (e.g. entropy/Hellinger)

  • Constructions

⋆ Integrals with respect to these measures (e.g. Choquet integral)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 2 / 70

slide-4
SLIDE 4

Motivation Outline

A short motivation

Why are these measures studied?

  • Applications
  • Some problems that cannot be solved with additive measures can

be solved with non-additive measures ⋆ Decision making ⋆ Subjective evaluation ⋆ Data fusion (e.g. computer vision) → a common theme: to take into account interactions → a common advantage: more expressive power than with the additive models

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 3 / 70

slide-5
SLIDE 5

Outline

Outline

  • 1. Introduction
  • 2. Some definitions
  • 3. Distances (new definitions)
  • 4. Properties
  • 5. Applications
  • 6. Summary

LiU 2014 4 / 70

slide-6
SLIDE 6

Outline

Some definitions

LiU 2014 5 / 70

slide-7
SLIDE 7

Definitions Outline

Definitions: measures

Additive measures.

  • (X, A) a measurable space; then, a set function µ is an additive

measure if it satisfies (i) µ(A) ≥ 0 for all A ∈ A, (ii) µ(X) ≤ ∞ (iii) for every countable sequence Ai (i ≥ 1) of A that is pairwise disjoint (i.e,. Ai ∩ Aj = ∅ when i = j) µ(

  • i=1

Ai) =

  • i=1

µ(Ai)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 6 / 70

slide-8
SLIDE 8

Definitions Outline

Definitions: measures

Additive measures.

  • (X, A) a measurable space; then, a set function µ is an additive

measure if it satisfies (i) µ(A) ≥ 0 for all A ∈ A, (ii) µ(X) ≤ ∞ (iii) for every countable sequence Ai (i ≥ 1) of A that is pairwise disjoint (i.e,. Ai ∩ Aj = ∅ when i = j) µ(

  • i=1

Ai) =

  • i=1

µ(Ai) Finite case: µ(A ∪ B) = µ(A) + µ(B) for disjoint A, B

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 6 / 70

slide-9
SLIDE 9

Definitions Outline

Definitions: measures

Additive measures. Example:

  • Unique measure λ s.t.

λ([a, b]) = b − a for every finite interval [a, b] → the Lebesgue measure

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 7 / 70

slide-10
SLIDE 10

Definitions Outline

Definitions: measures

Additive measures. Example:

  • Unique measure λ s.t.

λ([a, b]) = b − a for every finite interval [a, b] → the Lebesgue measure

  • Probability, if µ(X) = 1.

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 7 / 70

slide-11
SLIDE 11

Definitions Outline

Definitions: measures

Non-additive measures.

  • (X, A) a measurable space, a non-additive (fuzzy) measure µ on

(X, A) is a set function µ : A → [0, 1] satisfying the following axioms: (i) µ(∅) = 0, µ(X) = 1 (boundary conditions) (ii) A ⊆ B implies µ(A) ≤ µ(B) (monotonicity)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 8 / 70

slide-12
SLIDE 12

Definitions Outline

Definitions: measures

Non-additive measures. Examples. Distorted Lebesgue

  • m : R+ → R+ a continuous and increasing function such that

m(0) = 0; λ be the Lebesgue measure. The following set function µm is a non-additive (fuzzy) measure: µm(A) = m(λ(A)) (1)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 9 / 70

slide-13
SLIDE 13

Definitions Outline

Definitions: measures

Non-additive measures. Examples. Distorted Lebesgue

  • m : R+ → R+ a continuous and increasing function such that

m(0) = 0; λ be the Lebesgue measure. The following set function µm is a non-additive (fuzzy) measure: µm(A) = m(λ(A)) (1)

  • If m(x) = x2, then µm(A) = (λ(A))2
  • If m(x) = xp, then µm(A) = (λ(A))p

(a) (b) (c) (d)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 9 / 70

slide-14
SLIDE 14

Definitions Outline

Definitions: measures

Non-additive measures. Examples. Distorted probabilities

  • m : R+ → R+ a continuous and increasing function such that

m(0) = 0; P be a probability. The following set function µm is a non-additive (fuzzy) measure: µm,P(A) = m(P(A)) (2)

DP Unconstrained fuzzy measures

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 10 / 70

slide-15
SLIDE 15

Definitions Outline

Definitions: integrals

Choquet integral (Choquet, 1954):

  • µ a non-additive measure, g a measurable function. The Choquet

integral of g w.r.t. µ, where µg(r) := µ({x|g(x) > r}): (C)

  • gdµ :=

∞ µg(r)dr. (3)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 11 / 70

slide-16
SLIDE 16

Definitions Outline

Definitions: integrals

Choquet integral (Choquet, 1954):

  • µ a non-additive measure, g a measurable function. The Choquet

integral of g w.r.t. µ, where µg(r) := µ({x|g(x) > r}): (C)

  • gdµ :=

∞ µg(r)dr. (3)

  • When the measure is additive, this is the Lebesgue integral

bi bi−1 ai ai−1 bi bi−1 x1 x1 x1 xN xN x {x|f(x) ≥ ai} {x|f(x) = bi} (a) (b) (c)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 11 / 70

slide-17
SLIDE 17

Definitions Outline

Definitions: integrals

Choquet integral. Discrete version

  • µ a non-additive measure, f a measurable function. The Choquet

integral of f w.r.t. µ, (C)

  • fdµ =

N

  • i=1

[f(xs(i)) − f(xs(i−1))]µ(As(i)), where f(xs(i)) indicates that the indices have been permuted so that 0 ≤ f(xs(1)) ≤ · · · ≤ f(xs(N)) ≤ 1, and where f(xs(0)) = 0 and As(i) = {xs(i), . . . , xs(N)}.

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 12 / 70

slide-18
SLIDE 18

Definitions Outline

Definitions: measures

Choquet integral: Example:

  • m : R+ → R+ a continuous and increasing function s.t.

m(0) = 0, m(1) = 1; P a probability distribution. µm, a non-additive (fuzzy) measure: µm(A) = m(P(A)) (4)

  • CIµm(f)

(a) → max, (b) → median, (c) → min, (d) → mean (expectation)

(a) (b) (c) (d)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 13 / 70

slide-19
SLIDE 19

Definitions Outline

Definitions: properties

Properties: (X be a reference set)

  • Comonotonicity. f and g are comonotonic if, for all xi, xj ∈ X,

f(xi) < f(xj) imply that g(xi) ≤ g(xj)

  • I is comonotonic monotone if and only if, for comonotonic f and

g, f ≤ g imply that I(f) ≤ I(g)

  • I is comonotonic additive if and only if, for comonotonic f and g,

I(f + g) = I(f) + I(g)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 14 / 70

slide-20
SLIDE 20

Definitions Outline

Definitions: properties

Choquet integral. Characterization

  • Theorem (Schmeidler, 1986; Narukawa and Murofushi, 2003). Let

I : [0, 1]n → R+ be a functional with the following properties

  • I is comonotonic monotone
  • I is comonotonic additive
  • I(1, . . . , 1) = 1

Then, there exists a non-additive measure µ such that I(f) is the Choquet integral of f with respect to µ. It is also true that a Choquet integral satisfies the conditions above.

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 15 / 70

slide-21
SLIDE 21

Definitions Outline

Definitions: properties

Choquet integral. Properties

  • Proposition 1. If µ is submodular, then

(C)

  • (f + g)dµ ≤ (C)
  • fdµ + (C)
  • gdµ.
  • Proposition 2. If µ is supermodular, then

(C)

  • (f + g)dµ ≥ (C)
  • fdµ + (C)
  • gdµ.

where

  • submodular µ(A) + µ(B) ≥ µ(A ∪ B) + µ(A ∩ B)

When adding an element, the smaller the set, the larger the increase

  • supermodular µ(A) + µ(B) ≤ µ(A ∪ B) + µ(A ∩ B)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 16 / 70

slide-22
SLIDE 22

Definitions Outline

Definitions: properties

Choquet integral. Properties

  • Cauchy-Schwarz inequality:

If µ is a submodular non-additive measure; then ((C)

  • fgdµ)2 ≤ (C)
  • f 2dµ(C)
  • g2dµ.
  • Another inequality: If µ is a submodular non-additive measure; then

((C)

  • (f + g)2dµ)

1 2 ≤ ((C)

  • f 2d)

1 2 + ((C)

  • g2dµ)

1 2

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 17 / 70

slide-23
SLIDE 23

Definitions Outline

Definitions: Radon-Nikodym derivative

Radon-Nikodym derivative: (additive measures)

  • Concept: ν absolutely continuous w.r.t. µ (if µ(A) = 0 then ν(A) = 0)
  • Theorem.

µ and ν two additive measures on (Ω, F) and µ be σ-finite. If ν << µ, then there exists a nonnegative measurable function f on Ω such that ν(A) =

  • A

fdµ

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 18 / 70

slide-24
SLIDE 24

Definitions Outline

Definitions: Radon-Nikodym derivative

Radon-Nikodym derivative: (additive measures)

  • Concept: ν absolutely continuous w.r.t. µ (if µ(A) = 0 then ν(A) = 0)
  • Theorem.

µ and ν two additive measures on (Ω, F) and µ be σ-finite. If ν << µ, then there exists a nonnegative measurable function f on Ω such that ν(A) =

  • A

fdµ → this permits to define the Radon-Nikodym derivative:

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 18 / 70

slide-25
SLIDE 25

Definitions Outline

Definitions: Radon-Nikodym derivative

Radon-Nikodym derivative: (additive measures)

  • Concept: ν absolutely continuous w.r.t. µ (if µ(A) = 0 then ν(A) = 0)
  • Theorem.

µ and ν two additive measures on (Ω, F) and µ be σ-finite. If ν << µ, then there exists a nonnegative measurable function f on Ω such that ν(A) =

  • A

fdµ → this permits to define the Radon-Nikodym derivative: → The function f is called the Radon-Nikodym derivative of ν w.r.t. µ, denoted f = dν dµ.

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 18 / 70

slide-26
SLIDE 26

Definitions Outline

Definitions: Radon-Nikodym derivative

Radon-Nikodym derivative: (additive measures)

  • Concept: ν absolutely continuous w.r.t. µ (if µ(A) = 0 then ν(A) = 0)
  • Theorem.

µ and ν two additive measures on (Ω, F) and µ be σ-finite. If ν << µ, then there exists a nonnegative measurable function f on Ω such that ν(A) =

  • A

fdµ → this permits to define the Radon-Nikodym derivative: → The function f is called the Radon-Nikodym derivative of ν w.r.t. µ, denoted f = dν dµ.

  • f may not be unique, but if f0 and f1 are both Radon-Nikodym

derivatives of ν, then f0 = f1 almost everywhere µ

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 18 / 70

slide-27
SLIDE 27

Definitions Outline

Derivatives w.r.t. non-additive measures

Derivative (Choquet integral): (non-additive measures)

  • (Ω, F) a measurable space, ν, µ : F → R+ non-additive measures.

→ ν is a Choquet integral of µ if there exists a measurable function g : Ω → R+ s.t. for all A ∈ F ν(A) = (C)

  • A

gdµ (5)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 19 / 70

slide-28
SLIDE 28

Definitions Outline

Derivatives w.r.t. non-additive measures

Derivative (Choquet integral): (non-additive measures)

  • (Ω, F) a measurable space, ν, µ : F → R+ non-additive measures.

→ ν is a Choquet integral of µ if there exists a measurable function g : Ω → R+ s.t. for all A ∈ F ν(A) = (C)

  • A

gdµ (5)

  • µ, ν two non-additive measures. If µ is a Choquet integral of ν, and

g is a function such that Equation 5 is satisfied, then dν/dµ = g, → g is a derivative of ν with respect to µ. → Graf and Sugeno studied conditions of when this derivative exists.

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 19 / 70

slide-29
SLIDE 29

Definitions Outline

Derivatives w.r.t. non-additive measures

Derivative (Choquet integral): (Proposition 4 in (Sugeno, 2013))

  • Let f(t) be a continuous and increasing function with f(0) = 0, let

µm be a distorted Lebesgue measure, then there exists an increasing (non-decreasing) function g so that f(t) = (C)

  • [0,t] g(τ)dµm and

the following holds: G(s) = F(s)/sM(s) (6) g(t) = L−1[F(s)/sM(s)]. (7) Here, F(s) is the Laplace transformation of f, M the Laplace transformation of m, and G the Laplace transformation of g.

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 20 / 70

slide-30
SLIDE 30

Definitions Outline

Derivatives w.r.t. non-additive measures

Computation:

  • It is possible to compute the Radon-Nikodym derivative

(for some examples)

  • Computations use the Laplace transformation

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 21 / 70

slide-31
SLIDE 31

Definitions Outline

Derivatives w.r.t. non-additive measures

Computation (Example): Applying Proposition 4 (Sugeno, 2013), we have L[ dνp dµm ] = N p(s) sM(s) = Γ(p + 1) 2sp−1 . Then using the inverse Laplace transform on this expression we obtain: dνp dµm = L−1[Γ(p + 1) 2sp−1 ] = Γ(p + 1) 2Γ(p − 1)tp−2 = p(p − 1) 2 tp−2.

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 22 / 70

slide-32
SLIDE 32

Outline

f-divergence for non-additive measures

LiU 2014 23 / 70

slide-33
SLIDE 33

f-divergence Outline

f-Divergence

Given: P, Q two probabilities a.c. w.r.t. a prob. ν.

  • f-divergence between P and Q w.r.t. ν

Df,ν(P, Q) = dQ dν f dP/dν dQ/dν

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 24 / 70

slide-34
SLIDE 34

f-divergence Outline

f-Divergence and distances

Examples of f-divergence between P and Q w.r.t. ν

Df,ν(P, Q) = dQ dν f dP/dν dQ/dν

Some particular distances

  • Hellinger distance when f(x) = (1 − √x)2,

H(P, Q) =

  • 1

2 dP dν −

  • dQ

dν 2 dν

Here dP/dν and dQ/dν are the Radon-Nikodym derivatives

  • Variation distance when f(x) = |x − 1|,

δ(P, Q) = 1 2

  • dP

dν − dP dν

  • Kullback-Leibler, R´

enyi distance, χ2-distance

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 25 / 70

slide-35
SLIDE 35

f-divergence Outline

f-Divergence: non-additive measures

Definition:

  • µ1, µ2 two non-additive measures that are Choquet integrals of ν.

The f-divergence between µ1 and µ2 with respect to ν is defined as Df,ν(µ1, µ2) = (C) dµ2 dν f dµ1/dν dµ2/dν

Here dµ1/dν and dµ2/dν are the derivatives of µ1 and µ2.

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 26 / 70

slide-36
SLIDE 36

f-divergence Outline

f-Divergence and Hellinger distance: non-additive measures

Definition:

  • µ1, µ2 two non-additive measures that are Choquet integrals of ν.

The Hellinger distance between µ1 and µ2 with respect to ν is defined as Hν(µ1, µ2) =

  • 1

2(C) dµ1 dν −

  • dµ2

dν 2 dν Here dµ1/dν and dµ2/dν are the derivatives of µ1 and µ2.

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 27 / 70

slide-37
SLIDE 37

f-divergence Outline

f-Divergence and variation distance: non-additive measures

Definition:

  • µ1, µ2 two non-additive measures that are Choquet integrals of ν.

The Variation distance between µ1 and µ2 with respect to ν is defined as δν(µ1, µ2) = 1 2(C)

  • dµ1

dν − dµ2 dν

Here dµ1/dν and dµ2/dν are the derivatives of µ1 and µ2.

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 28 / 70

slide-38
SLIDE 38

Outline

Properties

LiU 2014 29 / 70

slide-39
SLIDE 39

Distance Outline

Distances: properties

Properties:

  • Proper generalization?

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 30 / 70

slide-40
SLIDE 40

Distance Outline

Distances: properties

Properties:

  • Proper generalization?
  • Yes: Let ν, µ1, µ2 be three additive measures such that µ1 and µ2

are absolutely continuous with respect to ν. Then, Df,ν(µ1, µ2) is the standard f-divergence.

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 30 / 70

slide-41
SLIDE 41

Distance Outline

Distances: properties

Properties:

  • Proper generalization?
  • Yes: Let ν, µ1, µ2 be three additive measures such that µ1 and µ2

are absolutely continuous with respect to ν. Then, Df,ν(µ1, µ2) is the standard f-divergence.

  • Also, Hν(µ1, µ2) and δν(µ1, µ2) are the Hellinger distance and the

variation distance

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 30 / 70

slide-42
SLIDE 42

Distance Outline

Distances: properties

Properties:

  • Proper generalization?
  • Yes: Let ν, µ1, µ2 be three additive measures such that µ1 and µ2

are absolutely continuous with respect to ν. Then, Df,ν(µ1, µ2) is the standard f-divergence.

  • Also, Hν(µ1, µ2) and δν(µ1, µ2) are the Hellinger distance and the

variation distance

  • Df,ν(µ1, µ2) with appropriate f (i.e., f(x) = (1 − √x)2 and f(x) =

|x − 1|) correspond to Hellinger and variation distance. I.e.,

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 30 / 70

slide-43
SLIDE 43

Distance Outline

Distances: properties

Properties:

  • Proper generalization?
  • Yes: Let ν, µ1, µ2 be three additive measures such that µ1 and µ2

are absolutely continuous with respect to ν. Then, Df,ν(µ1, µ2) is the standard f-divergence.

  • Also, Hν(µ1, µ2) and δν(µ1, µ2) are the Hellinger distance and the

variation distance

  • Df,ν(µ1, µ2) with appropriate f (i.e., f(x) = (1 − √x)2 and f(x) =

|x − 1|) correspond to Hellinger and variation distance. I.e.,

  • 1

2Df,ν(µ1, µ2) = Hν(µ1, µ2). 1 2Df,ν(µ1, µ2) = δν(µ1, µ2).

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 30 / 70

slide-44
SLIDE 44

Distance Outline

Distances: properties

Properties:

  • Distance?

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 31 / 70

slide-45
SLIDE 45

Distance Outline

Distances: properties

Properties:

  • Distance?
  • f-divergence is not a distance for additive measures

(it is not symmetric, it does not no satisfy triangle inequality)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 31 / 70

slide-46
SLIDE 46

Distance Outline

Distances: properties

Properties:

  • Distance?
  • f-divergence is not a distance for additive measures

(it is not symmetric, it does not no satisfy triangle inequality)

  • Hellinger distance, variation distance are distances.

(satisfy positiveness, symmetry, and triangular inequality)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 31 / 70

slide-47
SLIDE 47

Distance Outline

Distances: properties

Properties:

  • Distance?
  • f-divergence is not a distance for additive measures

(it is not symmetric, it does not no satisfy triangle inequality)

  • Hellinger distance, variation distance are distances.

(satisfy positiveness, symmetry, and triangular inequality)

  • So, we only consider distance for Hellinger and variation distance

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 31 / 70

slide-48
SLIDE 48

Distance Outline

Distances: properties

Properties:

  • Distance?
  • Positiveness: Df,ν(µ1, µ2) = 0 if µ1 = µ2.

So, Hellinger and variation distance are positive

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 32 / 70

slide-49
SLIDE 49

Distance Outline

Distances: properties

Properties:

  • Distance?
  • Positiveness: Df,ν(µ1, µ2) = 0 if µ1 = µ2.

So, Hellinger and variation distance are positive

  • Symmetry: Hellinger and variation symmetric by definition

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 32 / 70

slide-50
SLIDE 50

Distance Outline

Distances: properties

Properties:

  • Distance?
  • Positiveness: Df,ν(µ1, µ2) = 0 if µ1 = µ2.

So, Hellinger and variation distance are positive

  • Symmetry: Hellinger and variation symmetric by definition
  • Triangular inequality:

⋆ If ν is submodular, then we have Hν(µ1, µ2) + Hν(µ2, µ3) ≥ Hν(µ1, µ3).

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 32 / 70

slide-51
SLIDE 51

Distance Outline

Distances: properties

Properties:

  • Distance?
  • Positiveness: Df,ν(µ1, µ2) = 0 if µ1 = µ2.

So, Hellinger and variation distance are positive

  • Symmetry: Hellinger and variation symmetric by definition
  • Triangular inequality:

⋆ If ν is submodular, then we have Hν(µ1, µ2) + Hν(µ2, µ3) ≥ Hν(µ1, µ3). ⋆ Also, if ν is submodular, then we have δν(µ1, µ2) + δν(µ2, µ3) ≥ δν(µ1, µ3).

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 32 / 70

slide-52
SLIDE 52

Distance Outline

Distances: properties

Properties:

  • Triangular inequality. Proof
  • Proof of triangular inequality for Hellinger distance comes from

(seen above) ((C)

  • (f + g)2dµ)

1 2 ≤ ((C)

  • f 2d)

1 2 + ((C)

  • g2dµ)

1 2

  • Proof of triangular inequality for variation distance comes from

(seen above) (C)

  • (f + g)dµ ≤ (C)
  • fdµ + (C)
  • gdµ.

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 33 / 70

slide-53
SLIDE 53

Distance Outline

Distances: properties

Properties:

  • Triangular inequality Hellinger distance. Proof

Hν(µ1, µ2) + Hν(µ2, µ3) = {1 2(C) dµ1 dν −

  • dµ2

dν 2 dν}1/2 + {1 2(C) dµ2 dν −

  • dµ3

dν 2 dν}1/ ≥ {1 2(C) dµ1 dν −

  • dµ2

dν 2 +

  • dµ2

dν −

  • dµ3

dν 2 dν}1/2 = {1 2(C) dµ1 dν −

  • dµ2

dν 2 +

  • dµ3

dν −

  • dµ2

dν 2 dν}1/2 ≥ {1 2(C) dµ1 dν −

  • dµ3

dν 2 dν}1/2 = Hν(µ1, µ3)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 34 / 70

slide-54
SLIDE 54

Distance Outline

Distances: properties

Properties:

  • Triangular inequality variation distance. Proof

δν(µ1, µ2) + δν(µ2, µ3) = 1 2(C)

  • dµ1

dν − dµ2 dν

  • dν + 1

2(C)

  • dµ2

dν − dµ3 dν

≥ 1 2(C)

  • dµ1

dν − dµ2 dν

  • +
  • dµ2

dν − dµ3 dν

≥ 1 2(C)

  • dµ1

dν − dµ3 dν

= δν(µ1, µ3)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 35 / 70

slide-55
SLIDE 55

Distance Outline

Distances: properties

Properties:

  • Distance?

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 36 / 70

slide-56
SLIDE 56

Distance Outline

Distances: properties

Properties:

  • Distance?
  • If ν is submodular, Hellinger distance is a distance.
  • If ν is submodular, Variation distance is a distance.

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 36 / 70

slide-57
SLIDE 57

Hellinger Distance Outline

Hellinger distance: properties

Example: Computation of a Hellinger distance between two distorted Lebesgue measures w.r.t. a third one

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 37 / 70

slide-58
SLIDE 58

Hellinger Distance Outline

Hellinger distance: properties

Example: Computation of a Hellinger distance between two distorted Lebesgue measures w.r.t. a third one

  • Measures:

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 37 / 70

slide-59
SLIDE 59

Hellinger Distance Outline

Hellinger distance: properties

Example: Computation of a Hellinger distance between two distorted Lebesgue measures w.r.t. a third one

  • Measures:
  • µm be the distorted Lebesgue measure with m(t) = t2,
  • νp be the distorted Lebesgue measure with np(t) = tp

(i.e., νp(A) = (λ(A))p for p ≥ 2, and νp([0, t]) = tp)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 37 / 70

slide-60
SLIDE 60

Hellinger Distance Outline

Hellinger distance: properties

Example: Computation of a Hellinger distance between two distorted Lebesgue measures w.r.t. a third one

  • Measures:
  • µm be the distorted Lebesgue measure with m(t) = t2,
  • νp be the distorted Lebesgue measure with np(t) = tp

(i.e., νp(A) = (λ(A))p for p ≥ 2, and νp([0, t]) = tp)

  • Computation: Hellinger distance between ν2 and νp w.r.t. µm.

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 37 / 70

slide-61
SLIDE 61

Hellinger Distance Outline

Hellinger distance: properties

Example: Computation of a Hellinger distance between two distorted Lebesgue measures w.r.t. a third one

  • Measures:
  • µm be the distorted Lebesgue measure with m(t) = t2,
  • νp be the distorted Lebesgue measure with np(t) = tp

(i.e., νp(A) = (λ(A))p for p ≥ 2, and νp([0, t]) = tp)

  • Computation: Hellinger distance between ν2 and νp w.r.t. µm.

Hµm(ν2, νp) =

  • 1

2(C) 1  

  • dν2

µm −

  • dνp

µm  

2

dµm (8)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 37 / 70

slide-62
SLIDE 62

Hellinger Distance Outline

Hellinger distance: properties

Example (II): Hellinger distance between ν2 and νp w.r.t. µm where distortions are np(t) = tp and m(t) = t2.

  • Recall (from a previous example) that

dνp dµm = p(p − 1) 2 tp−2

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 38 / 70

slide-63
SLIDE 63

Hellinger Distance Outline

Hellinger distance: properties

Example (II): Hellinger distance between ν2 and νp w.r.t. µm where distortions are np(t) = tp and m(t) = t2.

  • Recall (from a previous example) that

dνp dµm = p(p − 1) 2 tp−2

  • Computation (with more Choquet integral – and Laplace transforms):

Hµm(ν2, νp) =

  • 1

2(C) 1  

  • dν2

µm −

  • dνp

µm  

2

dµm =

  • 1

2(C) 1

  • 1 −
  • p(p − 1)

2 t(p−2)/2 2 dµm (9) =

  • 1 − 4
  • 2p(p − 1)

(p + 2)p (10)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 38 / 70

slide-64
SLIDE 64

Hellinger Distance Outline

Hellinger distance: properties

Example 2:

  • µm′ be the distorted Lebesgue measure with m′(t) = t.
  • νp be the distorted Lebesgue measure with n(t) = tp

(i.e., νp(A) = (λ(A))p for p ≥ 2, and νp([0, t]) = tp)

  • Compute the Hellinger distance between ν2 and νp w.r.t. µm′.

Only difference from Example 1 is µm′

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 39 / 70

slide-65
SLIDE 65

Hellinger Distance Outline

Hellinger distance: properties

Example 2: Hellinger distance between ν2 and νp w.r.t. µm where distortions are np(t) = tp and m(t) = t.

  • First,

dνp dµm′ = ptp−1

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 40 / 70

slide-66
SLIDE 66

Hellinger Distance Outline

Hellinger distance: properties

Example 2: Hellinger distance between ν2 and νp w.r.t. µm where distortions are np(t) = tp and m(t) = t.

  • First,

dνp dµm′ = ptp−1

  • Computation (with more Choquet integral – and Laplace transforms):

Hµm′(ν2, νp) =

  • 1

2(C) 1  

  • dν2

µm −

  • dνp

µm  

2

dµm =

  • 1

2(C) 1 √ 2t −

  • ptp−1

2 dµm (11) =

  • 1 − 2√2p

p + 2 (12)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 40 / 70

slide-67
SLIDE 67

Hellinger Distance Outline

Hellinger distance: properties

Properties:

  • Compare:

Hµm(ν2, νp) =

  • 1 − 4
  • 2p(p − 1)

(p + 2)p Hµm′(ν2, νp) =

  • 1 − 2√2p

p + 2 (13)

  • The Hellinger distance depends on µm

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 41 / 70

slide-68
SLIDE 68

Hellinger Distance Outline

Hellinger distance: properties

Properties:

  • Compare:

Hµm(ν2, νp) =

  • 1 − 4
  • 2p(p − 1)

(p + 2)p Hµm′(ν2, νp) =

  • 1 − 2√2p

p + 2 (13)

  • The Hellinger distance depends on µm

Different for additive measures: Hν(µ1, µ2) is independent of ν.

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 41 / 70

slide-69
SLIDE 69

Hellinger Distance Outline

Hellinger distance: properties

Properties related to the previous example: When p → ∞, Hµm(ν2, νp) = 1 and Hµm′(ν2, νp) = 1. Both Hµm(ν2, νp) and Hµm′(ν2, νp) are increasing w.r.t. p > 2, and the following holds

  • Hµm(ν2, νp) ∈ [0, 1] for all p ≥ 2,
  • Hµm′(ν2, νp) ∈ [0, 1] for all p ≥ 2.

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 42 / 70

slide-70
SLIDE 70

Hellinger Distance Outline

Hellinger distance: properties

Properties:

  • Conjugate of the measure, same distance ?

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 43 / 70

slide-71
SLIDE 71

Hellinger Distance Outline

Hellinger distance: properties

Properties:

  • Conjugate of the measure, same distance ?
  • Recall that conjugate of a measure: µc(A) = 1 − µm(X \ A)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 43 / 70

slide-72
SLIDE 72

Hellinger Distance Outline

Hellinger distance: properties

Properties:

  • Conjugate of the measure, same distance ?

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 44 / 70

slide-73
SLIDE 73

Hellinger Distance Outline

Hellinger distance: properties

Properties:

  • Conjugate of the measure, same distance ?
  • First question, which conjugate in Hν(µ1, µ2)?

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 44 / 70

slide-74
SLIDE 74

Hellinger Distance Outline

Hellinger distance: properties

Properties:

  • Conjugate of the measure, same distance ?
  • First question, which conjugate in Hν(µ1, µ2)?

⋆ Hν(µ1, µ2) = (?)Hν(µc

1, µc 2)

⋆ Hν(µ1, µ2) = (?)Hνc(µc

1, µc 2)

where µc(A) = 1 − µ(X \ A)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 44 / 70

slide-75
SLIDE 75

Hellinger Distance Outline

Hellinger distance: properties

Properties:

  • Conjugate of the measure, same distance ?
  • First question, which conjugate in Hν(µ1, µ2)?

⋆ Hν(µ1, µ2) = (?)Hν(µc

1, µc 2)

⋆ Hν(µ1, µ2) = (?)Hνc(µc

1, µc 2)

where µc(A) = 1 − µ(X \ A)

  • Partial answers:

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 44 / 70

slide-76
SLIDE 76

Hellinger Distance Outline

Hellinger distance: properties

Properties:

  • Conjugate of the measure, same distance ?
  • First question, which conjugate in Hν(µ1, µ2)?

⋆ Hν(µ1, µ2) = (?)Hν(µc

1, µc 2)

⋆ Hν(µ1, µ2) = (?)Hνc(µc

1, µc 2)

where µc(A) = 1 − µ(X \ A)

  • Partial answers:
  • Dual of Distorted Lebesgue is Distorted Lebesgue

µc(A) = 1 − µm(X \ A) = 1 − m(1 − x)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 44 / 70

slide-77
SLIDE 77

Hellinger Distance Outline

Hellinger distance: properties

Properties:

  • Conjugate of the measure, same distance ?
  • First question, which conjugate in Hν(µ1, µ2)?

⋆ Hν(µ1, µ2) = (?)Hν(µc

1, µc 2)

⋆ Hν(µ1, µ2) = (?)Hνc(µc

1, µc 2)

where µc(A) = 1 − µ(X \ A)

  • Partial answers:
  • Dual of Distorted Lebesgue is Distorted Lebesgue

µc(A) = 1 − µm(X \ A) = 1 − m(1 − x)

  • If ν is submodular, νc is supermodular

So, Hν(µ1, µ2) is a distance but Hνc(µc

1, µc 2) is not

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 44 / 70

slide-78
SLIDE 78

Hellinger Distance Outline

Hellinger distance: properties

Properties:

  • Conjugate of the measure, same distance ?
  • First question, which conjugate in Hν(µ1, µ2)?

⋆ Hν(µ1, µ2) = (?)Hν(µc

1, µc 2)

⋆ Hν(µ1, µ2) = (?)Hνc(µc

1, µc 2)

where µc(A) = 1 − µ(X \ A)

  • Partial answers:
  • Dual of Distorted Lebesgue is Distorted Lebesgue

µc(A) = 1 − µm(X \ A) = 1 − m(1 − x)

  • If ν is submodular, νc is supermodular

So, Hν(µ1, µ2) is a distance but Hνc(µc

1, µc 2) is not

Therefore, only Hν(µ1, µ2) = (?)Hν(µc

1, µc 2) makes sense

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 44 / 70

slide-79
SLIDE 79

Hellinger Distance Outline

Hellinger distance: properties

Properties:

  • Conjugate of the measure, same distance ?
  • First question, which conjugate in Hν(µ1, µ2)?

⋆ Hν(µ1, µ2) = (?)Hν(µc

1, µc 2)

⋆ Hν(µ1, µ2) = (?)Hνc(µc

1, µc 2)

where µc(A) = 1 − µ(X \ A)

  • Partial answers:
  • Dual of Distorted Lebesgue is Distorted Lebesgue

µc(A) = 1 − µm(X \ A) = 1 − m(1 − x)

  • If ν is submodular, νc is supermodular

So, Hν(µ1, µ2) is a distance but Hνc(µc

1, µc 2) is not

Therefore, only Hν(µ1, µ2) = (?)Hν(µc

1, µc 2) makes sense

  • This case, difficult (work in progress)

E.g., if m(x) = x2, then mc(x) = 2x − x2.

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 44 / 70

slide-80
SLIDE 80

Outline

Some definitions (II): The Sugeno integral

LiU 2014 45 / 70

slide-81
SLIDE 81

Definitions Outline

Definitions: integrals

Sugeno integral (Sugeno, 1974):

  • µ a non-additive measure, g a measurable function.

The Sugeno integral of g w.r.t. µ, where µg(r) := µ({x|g(x) > r}): (S)

  • gdµ := sup

r∈[0,1]

[r ∧ µg(r)]. (14)

f (x s(i) ) (A s(i) ) (S ) R f d (A s(i) ) f (x s(i) ) (A) f (x) f (x) (b) (a) ( )

LiU 2014 46 / 70

slide-82
SLIDE 82

Definitions Outline

Definitions: integrals

Sugeno integral. Discrete version

  • µ a non-additive measure, f a measurable function.

The Sugeno integral of f w.r.t. µ, (S)

  • fdµ = max

i=1,N min(f(xs(i)), µ(As(i))),

where f(xs(i)) indicates that the indices have been permuted so that 0 ≤ f(xs(1)) ≤ ... ≤ f(xs(N)) ≤ 1 and As(i) = {xs(i), ..., xs(N)}.

LiU 2014 47 / 70

slide-83
SLIDE 83

Definitions Outline

Definitions: properties

Properties: (X a reference set, a a value in [0, 1])

  • f, g functions f, g : X → [0, 1]. Then,
  • I is minimum homogeneous if and only if, for comonotonic f and

g, I(a ∧ f) = a ∧ I(f)

  • I is comonotonic maxitive if and only if, for comonotonic f and g,

I(f ∨ g) = I(f) ∨ I(g)

LiU 2014 48 / 70

slide-84
SLIDE 84

Definitions Outline

Definitions: properties

Characterization of the Sugeno integral

  • Theorem (Ralescu and Sugeno, 1996; Marichal, 2000; Benvenuti

and Mesiar, 2000). Let I : [0, 1]n → R+ be a functional with the following properties

  • I is comonotonic monotone
  • I is comonotonic maxitive
  • I is minimum homogeneous
  • I(1, . . . , 1) = 1

Then, there exists a fuzzy measure µ such that I(f) is the Sugeno integral of f with respect to µ.

LiU 2014 49 / 70

slide-85
SLIDE 85

Outline

Applications

LiU 2014 50 / 70

slide-86
SLIDE 86

Applications Outline

Aggregation operators

Independence.

  • Choquet integral and Mahalanobis distance
  • Mahalanobis: covariance matrix
  • Choquet integral: fuzzy measure
  • In a single framework: Mahalanobis and Choquet distance

Matrix Mahalanobis Distance Choquet Integral Weighted Mean Additive measure Diagonal Matrix Fuzzy measure Covariance LiU 2014 51 / 70

slide-87
SLIDE 87

Applications Outline

Aggregation operators

Independence.

  • Choquet integral and Mahalanobis distance
  • Mahalanobis: covariance matrix
  • Choquet integral: fuzzy measure
  • A generalization: Choquet-Mahalanobis distance/distribution

LiU 2014 52 / 70

slide-88
SLIDE 88

Applications Outline

Record Linkage

Record Linkage:

(protected / public) identifiers quasi- identifiers quasi- identifiers confidential r1 ra s1 sb a1 an a1 an i1, i2, ... B (intruder) A

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 53 / 70

slide-89
SLIDE 89

Applications Outline

Record Linkage

Record Linkage:

Minimize

N

  • i=1

Ki (15) Subject to : CIµ(d(V1(ai), V1(bj)), . . . , d(Vn(ai), Vn(bj)))− − CIµ(d(V1(ai), V1(bi)), . . . , d(Vn(ai), Vn(bi))) + CKi > 0 ∀i∀j (16) Ki ∈ {0, 1} (17) µ(A) ∈ [0, 1] (18) µ(A) ≤ µ(B) ∀A, B s.t. A ⊆ B ⊆ X (19)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 54 / 70

slide-90
SLIDE 90

Applications Outline

Decision

Decision:

  • Different alternatives
  • Users have preferences (an order on the alternatives ≺)
  • GOAL: We want to model these preferences (to model ≺)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 55 / 70

slide-91
SLIDE 91

Applications Outline

Decision under certainty

Decision under certainty. Multicriteria decision making

  • Alternatives expressed in terms of utility functions
  • Select best alternative by:

Step 1. Aggregate utilities: Choquet integral for non-independence Step 2. Rank according to aggregated utilities

Ranking alt alt Consensus alt Criteria Satisfaction on: Price Quality Comfort FordT 206 0.2 0.8 0.3 0.7 0.7 0.8 FordT 206 FordT 206 0.35 0.72 0.72 0.35 ... ... ... ... ... ... Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 56 / 70

slide-92
SLIDE 92

Applications Outline

Decision under uncertainty

Decision under uncertainty.

  • Decision theory based on probability and utility functions to model

lack of knowledge (Savage, 1954; Ramsey and von Neumann):

  • classical/subjective expected utility

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 57 / 70

slide-93
SLIDE 93

Applications Outline

Decision under uncertainty

Decision under uncertainty.

  • Decision theory based on probability and utility functions to model

lack of knowledge (Savage, 1954; Ramsey and von Neumann):

  • classical/subjective expected utility
  • Ellsberg paradox: people behave differently than the model!!
  • Ellsberg paradox violates the postulates of the theory
  • Alternative model based on non-additive (fuzzy) measures

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 57 / 70

slide-94
SLIDE 94

Applications Outline

Decision under uncertainty: Ellsberg paradox

Decision making: (Ellsberg, 1961) 90 balls in an urn

  • A player and different games, which prefer? (fR, fB, ...)

Color of balls Red Black Yellow Number of balls 30 60 fR $ 100 fB $ 0 $ 100 fRY $ 100 $ 100 fBY $ 0 $ 100 $ 100

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 58 / 70

slide-95
SLIDE 95

Applications Outline

Decision under uncertainty: Ellsberg paradox

  • How we model ≺ with classical expected utility ?
  • a (finite) state space S (options = the balls)
  • a (finite) set of outcomes X (benefits = the money)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 59 / 70

slide-96
SLIDE 96

Applications Outline

Decision under uncertainty: Ellsberg paradox

  • How we model ≺ with classical expected utility ?
  • a (finite) state space S (options = the balls)
  • a (finite) set of outcomes X (benefits = the money)
  • P be a probability measure on (X, A, P) (P on the balls)
  • u : X → R+ be a utility function (utility of the money)

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 59 / 70

slide-97
SLIDE 97

Applications Outline

Decision under uncertainty: Ellsberg paradox

  • How we model ≺ with classical expected utility ?
  • a (finite) state space S (options = the balls)
  • a (finite) set of outcomes X (benefits = the money)
  • P be a probability measure on (X, A, P) (P on the balls)
  • u : X → R+ be a utility function (utility of the money)
  • a function from S to X (an act), F the set of acts (the alternatives).
  • User preferences on F = {f|f : S → X} denoted by ≺

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 59 / 70

slide-98
SLIDE 98

Applications Outline

Decision under uncertainty: Ellsberg paradox

  • How we model ≺ with classical expected utility ?
  • a (finite) state space S (options = the balls)
  • a (finite) set of outcomes X (benefits = the money)
  • P be a probability measure on (X, A, P) (P on the balls)
  • u : X → R+ be a utility function (utility of the money)
  • a function from S to X (an act), F the set of acts (the alternatives).
  • User preferences on F = {f|f : S → X} denoted by ≺
  • ≺ is represented by P and u when (user preference model)

E(u(f)) < E(u(g)) if and only if f ≺ g

where

E(u(f)) =

  • s∈S

u(f(s))P({s}) =

  • x∈X

u(x)P(f −1(x)).

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 59 / 70

slide-99
SLIDE 99

Applications Outline

Decision under uncertainty: Ellsberg paradox

  • Computation of the expected utility for a particular act (alternative)
  • S = {Red, Black, Y ellow}
  • fRY = (0 for a Black, $ 100 for Red, and $ for Yellow)

E(u(fRY )) = u(0)P(f −1(0)) + u(100)P(f −1(100)) = u(0)P({B}) + u(100)P({Y, R}) = u(0)P({B}) + u(100)P({Y }) + u(100)P({R})

  • Problem. Given a player, and preferences ≺, determine P and u
  • E.g., P(x) = 1/3 and u(x) = x.

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 60 / 70

slide-100
SLIDE 100

Applications Outline

Decision under uncertainty: Ellsberg paradox

Decision making: (Ellsberg, 1961) 90 balls in an urn

  • A player and different games, which prefer? (fR, fB, ...)

Color of balls Red Black Yellow Number of balls 30 60 fR $ 100 fB $ 0 $ 100 fRY $ 100 $ 100 fBY $ 0 $ 100 $ 100

  • Most people prefer
  • fB ≺ fR

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 61 / 70

slide-101
SLIDE 101

Applications Outline

Decision under uncertainty: Ellsberg paradox

Decision making: (Ellsberg, 1961) 90 balls in an urn

  • A player and different games, which prefer? (fR, fB, ...)

Color of balls Red Black Yellow Number of balls 30 60 fR $ 100 fB $ 0 $ 100 fRY $ 100 $ 100 fBY $ 0 $ 100 $ 100

  • Most people prefer
  • fB ≺ fR
  • fRY ≺ fBY

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 61 / 70

slide-102
SLIDE 102

Applications Outline

Decision under uncertainty: Ellsberg paradox

Decision making: (Ellsberg, 1961) 90 balls in an urn

  • A player and different games, which prefer? (fR, fB, ...)

Color of balls Red Black Yellow Number of balls 30 60 fR $ 100 fB $ 0 $ 100 fRY $ 100 $ 100 fBY $ 0 $ 100 $ 100

  • Most people prefer
  • fB ≺ fR
  • fRY ≺ fBY
  • No solution exist with probabilities (additive measures),

but can be solved with non-additive (fuzzy) measures

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 61 / 70

slide-103
SLIDE 103

Applications Outline

Decision under uncertainty: Ellsberg paradox

  • Choquet expected utility model (Schmeidler, 1989)
  • Choquet integral (CI), utility u, non-additive (fuzzy) measure µ

E(u(fRY )) = u(0)µ({B}) + u(100)µ({Y, R}) = u(0)µ({B}) + u(100)µ({Y }) + u(100)µ({R})

  • User preferences on F denoted by ≺
  • ≺ is represented by P and u when (user preference model)

E(u(f)) = CIu,µ(f) < E(u(g)) = CIu,µ(g) if and only if f ≺ g where E(u(f)) = CIu,µ(f) =

  • xσ(i)∈X

(u(xσ(i)) − u(xσ(i−1)))µ(f −1(x)).

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 62 / 70

slide-104
SLIDE 104

Outline

Summary

LiU 2014 63 / 70

slide-105
SLIDE 105

Hellinger Distance Outline

Hellinger distance: properties

Summary:

  • Review of non-additive measures
  • Extension of the Hellinger distance to non-additive measures
  • Some properties
  • Some applications

Vicen¸ c Torra; Non-additive measures and integrals LiU 2014 64 / 70

slide-106
SLIDE 106

Outline

Thank you

LiU 2014 65 / 70

slide-107
SLIDE 107

References Outline

References

References.

  • Denneberg, D. (1994) Non Additive Measure and Integral, Kluwer Academic

Publishers.

  • Graf, S. (1980) A Radon-Nikodym theorem for capacities, Journal f¨

ur die reine und angewandte Mathematik, 1980 192-214.

  • Narukawa, Y., Murofushi, T. (2008) Choquet Stieltjes integral as a tool for decision

modeling, Int. J. of Intel. Syst. 23 115-127.

  • Nguyen, H. T. (2006) An Introduction to Random Sets, Chapman and Hall, CRC

Press.

  • Schmeidler, D. (1986) Integral representation without additivity, Proceedings of

the American Mathematical Society, 97 253-261.

  • Sugeno, M. (2013) A note on derivatives of functions with respect to fuzzy

measures, Fuzzy Sets and Systems 222 1-17.

  • Torra, V., Narukawa, Y. (2007) Modeling Decisions:

Information Fusion and Aggregation Operators, Springer.

  • Torra, V., Narukawa, Y., Sugeno, M., Carlson, M. (2014) On the f-divergence for

non-additive measures, submitted.

  • Torra, V., Narukawa, Y., Sugeno, M. (eds) (2014) Non-additive measures: Theory

and applications, Springer.

LiU 2014 66 / 70

slide-108
SLIDE 108

Introduction Outline

Choquet expected utility model

  • Why classical expected utility cannot represent Ellsberg paradox ?
  • to representation ≺ in terms of u and P, we need

E(u(f)) ≤ E(u(g)) for all f ≺ g.

LiU 2014 67 / 70

slide-109
SLIDE 109

Introduction Outline

Choquet expected utility model

  • Why classical expected utility cannot represent Ellsberg paradox ?
  • From fRY ≺ fBY ,

E(u(fRY )) = u(0)P(B) + u(100)P(Y ) + u(100)P(R) < u(100)P(B) + u(100)P(Y ) + u(0)P(R) = E(u(fBY ))

so, u(0)P(B) + u(100)P(R) < u(100)P(B) + u(0)P(R)

  • From fB ≺ fR,

E(u(fB)) = u(100)P(B) + u(0)P(Y ) + u(0)P(R) < u(0)P(B) + u(0)P(Y ) + u(100)P(R) = E(u(fR))

so, u(100)P(B) + u(0)P(R) < u(0)P(B) + u(100)P(R). Inequalities 1 and 2 are in contradiction: no u and P exist

LiU 2014 68 / 70

slide-110
SLIDE 110

Introduction Outline

Choquet expected utility model

  • How Choquet expected utility represents Ellsberg paradox ?

Using:

  • µ(∅) = 0
  • µ({R}) = 1/3, µ({B}) = µ({Y }) = 2/9
  • µ({R, Y }) = 5/9, µ({B, Y }) = µ({R, B}) = 2/3
  • µ({R, B, Y }) = 1

LiU 2014 69 / 70

slide-111
SLIDE 111

Introduction Outline

Choquet expected utility model

  • How Choquet expected utility represents Ellsberg paradox ?
  • From fRY ≺ fBY we have

CIµ(u(fRY )) = u(0)µ({B}) + u(100)µ({Y, R}) < u(100)µ({B, Y }) + u(0)µ({R}) = CIµ(u(fBY ))

so, 0 · 2/9 + 100 · 5/9 < 100 · 2/3 + 0 · 1/3.

  • From fB ≺ fR,

CIµ(u(fB)) = u(100)µ({B}) + u(0)µ({Y, R}) < CIµ(u(fR)) = u(0)µ({B, Y }) + u(100)µ({R})

so, 100 · 2/9 + 0 · 5/9 < 0 · 2/3 + 100 · 1/3.

LiU 2014 70 / 70