83rd EWG-MCDA 2016
Choquet integral: distributions and decisions Vicen¸ c Torra School of Informatics, University of Sk¨
- vde
Sk¨
- vde, Sweden
March 31-32 , 2016
Choquet integral: distributions and decisions Vicen c Torra School - - PowerPoint PPT Presentation
83rd EWG-MCDA 2016 Choquet integral: distributions and decisions Vicen c Torra School of Informatics, University of Sk ovde Sk ovde, Sweden March 31-32 , 2016 Overview > Example Outline Overview Basics and objectives:
83rd EWG-MCDA 2016
Choquet integral: distributions and decisions Vicen¸ c Torra School of Informatics, University of Sk¨
Sk¨
March 31-32 , 2016
Overview >Example Outline
Basics and objectives:
(for non-additive measures) Motivation:
statistical disclosure control (data privacy)
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 1 / 59
Outline
83rd EWG-MCDA 2016 2 / 59
Outline
83rd EWG-MCDA 2016 3 / 59
Outline
83rd EWG-MCDA 2016 4 / 59
Outline
83rd EWG-MCDA 2016 5 / 59
Outline
Alternatives = { Ford T, Seat 600, Simca 1000, VW, Citr.Acadiane }
83rd EWG-MCDA 2016 5 / 59
Outline
Alternatives = { Ford T, Seat 600, Simca 1000, VW, Citr.Acadiane } Criteria = { Seats, Security, Price, Comfort, trunk}
83rd EWG-MCDA 2016 5 / 59
Outline
Alternatives = { Ford T, Seat 600, Simca 1000, VW, Citr.Acadiane } Criteria = { Seats, Security, Price, Comfort, trunk} Decision making process:
83rd EWG-MCDA 2016 5 / 59
Outline
Alternatives = { Ford T, Seat 600, Simca 1000, VW, Citr.Acadiane } Criteria = { Seats, Security, Price, Comfort, trunk} Decision making process: Modelling=Criteria + Utilities, aggregation, selection
Number of Security Price Confort trunk seats Ford T 20 20 Seat 600 60 100 50 Simca 1000 100 30 100 50 70 VW Beetle 80 50 30 70 100 Citro¨ en Acadiane 20 40 60 40
83rd EWG-MCDA 2016 5 / 59
Outline
83rd EWG-MCDA 2016 6 / 59
Outline
Alternatives = { Ford T, Seat 600, Simca 1000, VW, Citr.Acadiane }
83rd EWG-MCDA 2016 6 / 59
Outline
Alternatives = { Ford T, Seat 600, Simca 1000, VW, Citr.Acadiane } Criteria = { Seats, Security, Price, Comfort, trunk}
83rd EWG-MCDA 2016 6 / 59
Outline
Alternatives = { Ford T, Seat 600, Simca 1000, VW, Citr.Acadiane } Criteria = { Seats, Security, Price, Comfort, trunk} Decision making process:
83rd EWG-MCDA 2016 6 / 59
Outline
Alternatives = { Ford T, Seat 600, Simca 1000, VW, Citr.Acadiane } Criteria = { Seats, Security, Price, Comfort, trunk} Decision making process: Modelling, aggregation = C, selection
Seats Security Price Comfort trunk C = AM Ford T 20 20 8 Seat 600 60 100 50 42 Simca 1000 100 30 100 50 70 70 VW 80 50 30 70 100 66
20 40 60 40 32
83rd EWG-MCDA 2016 6 / 59
Outline
83rd EWG-MCDA 2016 7 / 59
Outline
when ai ≤ bi it is clear that a ≤ b E.g., Seats Security Price Comfort trunk C = AM Seat 600 60 100 50 42 Simca 1000 100 30 100 50 70 70
83rd EWG-MCDA 2016 7 / 59
Outline
when ai ≤ bi it is clear that a ≤ b E.g., Seats Security Price Comfort trunk C = AM Seat 600 60 100 50 42 Simca 1000 100 30 100 50 70 70 Aggregation operators are appropriate because they satisfy monotonicity
83rd EWG-MCDA 2016 7 / 59
Outline
when ai ≤ bi it is clear that a ≤ b E.g., Seats Security Price Comfort trunk C = AM Seat 600 60 100 50 42 Simca 1000 100 30 100 50 70 70 Aggregation operators are appropriate because they satisfy monotonicity
Given two vectors a = (a1, . . . , an) and b = (b1, . . . , bn), we say that b dominates a when ai ≤ bi for all i and there is at least one k such that ak < bk.
83rd EWG-MCDA 2016 7 / 59
Outline
Seats Security Price Comfort trunk C = AM Simca 1000 100 30 100 50 70 70 VW 80 50 30 70 100 66
20 40 60 40 32
83rd EWG-MCDA 2016 8 / 59
Outline
Given a set of alternatives U represented by vectors u = (u1, . . . , un), the Pareto frontier is the set u ∈ U such that there is no other v ∈ U such that v dominates u. PF = {u|there is no v s.t. v dominates u}
x1 f1(x2) f1(x1) f1 f2 f2(x2) f2(x1) x2
83rd EWG-MCDA 2016 9 / 59
Outline
83rd EWG-MCDA 2016 10 / 59
Outline
Modelling, aggregation, selection=order,first
83rd EWG-MCDA 2016 10 / 59
Outline
Modelling, aggregation, selection=order,first
83rd EWG-MCDA 2016 10 / 59
Outline
Modelling, aggregation, selection=order,first
Ranking alt alt Consensus alt Criteria Satisfaction on: Price Quality Comfort FordT 206 0.2 0.8 0.3 0.7 0.7 0.8 FordT 206 FordT 206 0.35 0.72 0.72 0.35 ... ... ... ... ... ... x1 f1(x2) f1(x1) f1 f2 f2(x2) f2(x1) x2
83rd EWG-MCDA 2016 10 / 59
Outline
83rd EWG-MCDA 2016 11 / 59
Outline
∗ to represent interactions between criteria ∗ non-independent criteria allowed
83rd EWG-MCDA 2016 11 / 59
Outline
– Arithmetic mean: no parameters – Geometric mean, Harmonic mean, ...: : no parameters – Weighted mean: weighting vector – OWA, ...: weighting vector
83rd EWG-MCDA 2016 12 / 59
Outline
– Arithmetic mean: no parameters – Geometric mean, Harmonic mean, ...: : no parameters – Weighted mean: weighting vector – OWA, ...: weighting vector
83rd EWG-MCDA 2016 12 / 59
Outline
– Choquet integral (generalization of the AM, WM, OWA): a measure
83rd EWG-MCDA 2016 13 / 59
Outline
– Choquet integral (generalization of the AM, WM, OWA): a measure
83rd EWG-MCDA 2016 13 / 59
Outline
– Choquet integral (generalization of the AM, WM, OWA): a measure
– We can, of course, use w(security,price,confort)=w(security)+w(price)+w(confort)
83rd EWG-MCDA 2016 13 / 59
Outline
– Choquet integral (generalization of the AM, WM, OWA): a measure
– We can, of course, use w(security,price,confort)=w(security)+w(price)+w(confort) – but also
83rd EWG-MCDA 2016 13 / 59
Outline
– Choquet integral (generalization of the AM, WM, OWA): a measure ∗ And the level curves ? decision ?
x1 f1(x2) f1(x1) f1 f2 f2(x2) f2(x1) x2
83rd EWG-MCDA 2016 14 / 59
Outline
83rd EWG-MCDA 2016 15 / 59
Definitions Outline
Additive measures.
measure if it satisfies (i) µ(A) ≥ 0 for all A ∈ A, (ii) µ(X) ≤ ∞ (iii) Finite case: µ(A ∪ B) = µ(A) + µ(B) for disjoint A, B
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 16 / 59
Definitions Outline
Additive measures.
measure if it satisfies (i) µ(A) ≥ 0 for all A ∈ A, (ii) µ(X) ≤ ∞ (iii) Finite case: µ(A ∪ B) = µ(A) + µ(B) for disjoint A, B
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 16 / 59
Definitions Outline
Non-additive (or fuzzy) measures.
set function µ : A → [0, 1] satisfying the following axioms: (i) µ(∅) = 0 (ii) µ(X) ≤ ∞ (iii) A ⊆ B implies µ(A) ≤ µ(B) (monotonicity)
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 17 / 59
Definitions Outline
Non-additive measures. Examples. Distorted probabilities
m(0) = 0; P be a probability. The following set function µm is a non-additive measure: µm,P(A) = m(P(A)) (1)
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 18 / 59
Definitions Outline
Non-additive measures. Examples. Distorted probabilities
m(0) = 0; P be a probability. The following set function µm is a non-additive measure: µm,P(A) = m(P(A)) (1)
(a) (b) (c) (d)
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 18 / 59
Definitions Outline
Non-additive measures. Examples. Distorted probabilities
m(0) = 0; P be a probability. The following set function µm is a non-additive measure: µm,P(A) = m(P(A)) (2)
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 19 / 59
Definitions Outline
Non-additive measures. Examples. Distorted probabilities
m(0) = 0; P be a probability. The following set function µm is a non-additive measure: µm,P(A) = m(P(A)) (2) Applications.
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 19 / 59
Definitions Outline
Choquet integral (Choquet, 1954):
integral of g w.r.t. µ, where µg(r) := µ({x|g(x) > r}): (C)
∞ µg(r)dr. (3)
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 20 / 59
Definitions Outline
Choquet integral (Choquet, 1954):
integral of g w.r.t. µ, where µg(r) := µ({x|g(x) > r}): (C)
∞ µg(r)dr. (3)
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 20 / 59
Definitions Outline
Choquet integral (Choquet, 1954):
integral of g w.r.t. µ, where µg(r) := µ({x|g(x) > r}): (C)
∞ µg(r)dr. (3)
bi bi−1 ai ai−1 bi bi−1 x1 x1 x1 xN xN x {x|f(x) ≥ ai} {x|f(x) = bi} (a) (b) (c)
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 20 / 59
Definitions Outline
Choquet integral. Discrete version
integral of f w.r.t. µ, (C)
N
[f(xs(i)) − f(xs(i−1))]µ(As(i)), where f(xs(i)) indicates that the indices have been permuted so that 0 ≤ f(xs(1)) ≤ · · · ≤ f(xs(N)) ≤ 1, and where f(xs(0)) = 0 and As(i) = {xs(i), . . . , xs(N)}.
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 21 / 59
Definitions Outline
Choquet integral: Properties:
CIµm(f) (a) → max, (b) → median, (c) → min, (d) → mean
(a) (b) (c) (d)
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 22 / 59
Outline
83rd EWG-MCDA 2016 23 / 59
Classification Outline
Motivation: Another motivation: classification
real data or directly from the parameters of the distribution N(µ, Σ)).
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 24 / 59
Classification Outline
Motivation: Another motivation: classification
real data or directly from the parameters of the distribution N(µ, Σ)).
→ where to classify x?
−2 2 4 6 8 −2 2 4 6 8
Two classes
table[,1] table[,2]
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 24 / 59
Classification Outline
Classification problems: Classification of x into Ω
Formalization:
assigns x to the class ωi s.t. the probability P(ωi|x) is maximized. I.e., (Bayes condition):
P(ωi|x) = P(x|ωi)P(ωi) P(x)
di(x) = P(x|ωi)P(ωi) f ◦ d results into the same classification as for d (e.g. f = ln)
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 25 / 59
Classification Outline
Classification problems: Classes ωi generated from
xi → class-conditional probability-density function (Gaussian distribution) P(x|ωi) = 1 (2π)m/2|Σi|1/2e−1
2(x−¯
xi)T Σ−1
i
(x−¯ xi)
5 10 5 10
Two classes with different correlations
table[,1] table[,2]
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 26 / 59
Classification Outline
Proposition:
Σi = Σj, and P(ωi) = P(ωj), is (Mahalanobis distance) di(x) = −(x − ¯ xi)TΣ−1(x − ¯ xi)
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 27 / 59
Classification Outline
di(x) = −(x − ¯ xi)T(x − ¯ xi) = −||x − ¯ xi||2 → Euclidean distance
di(x) = −
m
(σ2
j)−1(xj − ¯
xij)2 → Weighted Euclidean distance
(with weights equal to the inverse of the variances: pj = (σ2
j)−1)
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 28 / 59
Shape of Distributions Outline
The class-conditional probability-density functions established above define level curves with the shape of an ellipse → circumference when variables are independent
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 29 / 59
Shape of Distributions Outline
The class-conditional probability-density functions established above define level curves with the shape of an ellipse → circumference when variables are independent
5 10 5 10
Two classes with different correlations
table[,1] table[,2]
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 29 / 59
Shape of Distributions Outline
The class-conditional probability-density functions established above define level curves with the shape of an ellipse → circumference when variables are independent
5 10 5 10
Two classes with different correlations
table[,1] table[,2]
What about another shape / another distance ?
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 29 / 59
Shape of Distributions Outline
The class-conditional probability-density functions established above define level curves with the shape of an ellipse → circumference when variables are independent
5 10 5 10
Two classes with different correlations
table[,1] table[,2]
What about another shape / another distance ? What about using the Choquet integral here ?
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 29 / 59
Shape of Distributions Outline
Why Choquet integral?:
between objects in X !! ... similar to covariances !!
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 30 / 59
Shape of Distributions Outline
Why Choquet integral?:
between objects in X !! ... similar to covariances !!
measure
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 30 / 59
Shape of Distributions Outline
Why Choquet integral?:
between objects in X !! ... similar to covariances !!
measure → can it be used to compute a distance / to define a distribution ?
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 30 / 59
Shape of Distributions Outline
Why Choquet integral?:
between objects in X !! ... similar to covariances !!
measure → can it be used to compute a distance / to define a distribution ? → if so, what is the shape of the distribution ?
Vicen¸ c Torra; Choquet integral: distributions and decisions 83rd EWG-MCDA 2016 30 / 59
Outline
83rd EWG-MCDA 2016 31 / 59
CI distribution Outline
Definition:
measure and m a vector in Rn.
probability-density functions is defined by: PCm,µ(x) = 1 Ke−1
2CIµ((x−m)◦(x−m))
where K is a constant that is defined so that the function is a probability, and where v ◦ w denotes the Hadamard or Schur (elementwise) product of vectors v and w (i.e., (v ◦ w) = (v1w1 . . . vnwn)). Notation:
83rd EWG-MCDA 2016 32 / 59
CI distribution Outline
(-15.0,-15.0) 15.0 15.0 qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq qq qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq qq qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q qq q qq qq qq qq qq qq qqq qqq qqq qqq qqqqqqq qqqqqqqqqqqqqqqqqq qqqqqqq qqq qqq qqq qqq qq qq qq qq qq qq q qq q qq q qqq qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq qqq q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q qqq qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq qq qq qq qqq qqq qqqq qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq qqqq qqq qqq qq qq qq qq (-15.0,-15.0) 15.0 15.0 q q qq q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qqqqqqqqqq qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq qqqqqqqqqq q q q q qq q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q q q q q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qqqq qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq qqq (-15.0,-15.0) 15.0 15.0 qqqqqqqqqqqqqqqqqqqqqqq qqqqqqqqqq qq qq q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q qq qq qqqqqqqqqq qqqqqqqqqqqqqqqqqqqqqq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qqqqqqqqqqqqqqqqqqq qqqqqqqqqqqqqqqqqqqqqqqqqq qqqqqqqqqqqqqqqqqqq qqqqqqqqqqqqqqqqqqqqqqqqqqqqq qqqqqqq qqq qq qq q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q qq qq qqq qqqqqqq qqqqqqqqqqqqqqqqqqqqqqqqqqqq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qqqqqqqqqqqqq qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq qqqqqqqqqqqq (-15.0,-15.0) 15.0 15.0 qqq qqqq qq qqqqqq qq qq qq qq q qq q qq q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q qq q qq q qq qq qq qq qqqqqq qq qqqq qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qqqqqqqqqq qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq qqqqqqqqqq qqqqqqqqqqqqqqqq qq qqqq qq qq qq qq q qq q q q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q q q qq q qq qq qq qq qqqq qq qqqqqqqqqqqqqqq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qqqq qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq qqq
(a) µA({x}) = 0.1 and µA({y}) = 0.1, (b) µB({x}) = 0.9 and µB({y}) = 0.9, (c) µC({x}) = 0.2 and µC({y}) = 0.8, and (d) µD({x}) = 0.4 and µD({y}) = 0.9.
83rd EWG-MCDA 2016 33 / 59
CI distribution Outline
−CIµ((x − ¯ xi) ⊗ (x − ¯ xi)) Proposition: Distribution/distance and level curves:
corresponds to an ellipse when µ({x}) = 1 − µ({y}). → A natural result: we have an ellipse when µ({x}) + µ({y}) = 1 → i.e., when µ is a probability. This follows from the fact that the Choquet integral with a measure that is a probability is equivalent to a weighted mean. Then, similar results are obtained for larger dimensions.
83rd EWG-MCDA 2016 34 / 59
CI distribution Outline
Property:
measure µ with all µ({xi}) = 0 are equivalent.
(µ(X) is not necessarily here 1)
83rd EWG-MCDA 2016 35 / 59
CI distribution Outline
Property:
measure µ with all µ({xi}) = 0 are equivalent.
(µ(X) is not necessarily here 1)
Corollary:
additive measure defined as µ1(A) = |A| for all A ⊆ X.
83rd EWG-MCDA 2016 35 / 59
CI distribution Outline
Properties:
are different.
(-15.0,-15.0) 15.0 15.0 qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq qq qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq qq qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q qq q qq qq qq qq qq qq qqq qqq qqq qqq qqqqqqq qqqqqqqqqqqqqqqqqq qqqqqqq qqq qqq qqq qqq qq qq qq qq qq qq q qq q qq q qqq qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq qqq q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q qqq qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq qq qq qq qqq qqq qqqq qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq qqqq qqq qqq qq qq qq qq
83rd EWG-MCDA 2016 36 / 59
CI distribution Outline
Properties:
are different.
(-15.0,-15.0) 15.0 15.0 qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq qq qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq qq qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q qq q qq qq qq qq qq qq qqq qqq qqq qqq qqqqqqq qqqqqqqqqqqqqqqqqq qqqqqqq qqq qqq qqq qqq qq qq qq qq qq qq q qq q qq q qqq qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq qqq q qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq q qqq qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq qq q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q q qq qq qq qq qqq qqq qqqq qqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqqq qqqq qqq qqq qq qq qq qq
– Mahalanobis: Σ represents some interactions – Choquet (measure): µ represents some interactions
83rd EWG-MCDA 2016 36 / 59
Outline
83rd EWG-MCDA 2016 37 / 59
CMI distribution Outline
Definition:
inverse.
CMIµ,Σ(x, ¯ x) = CIµ(v ⊗ w) (4) where v and w are the vectors defined by: v = (x − ¯ x)TL and w = L∗(x − ¯ x), where v ⊗ w denotes the elementwise product of vectors v and w (i.e., (v ⊗ w) = (v1w1 . . . vnwn)).
83rd EWG-MCDA 2016 38 / 59
CMI distribution Outline
On the definition:
When Σ−1 is a definite-positive matrix, the Cholesky descomposition is unique. This is the case when Σ is a covariance matrix valid for generating a probability- density function.
83rd EWG-MCDA 2016 39 / 59
CMI distribution Outline
On the definition:
When Σ−1 is a definite-positive matrix, the Cholesky descomposition is unique. This is the case when Σ is a covariance matrix valid for generating a probability- density function.
Proper generalization:
based distance.
– The definition with Σ equal to the identity results into the Choquet integral of (x − ¯ x) ⊗ (x − ¯ x) with respect to µ. – The definition with µ corresponding to an additive probability µ(A) = 1/|A| results into 1/n of the Mahalanobis distance with respect to Σ.
83rd EWG-MCDA 2016 39 / 59
CMI distribution Outline
Definition:
vector in Rn, and Q a positive-definite matrix.
conditional probability-density functions is defined by: PCMm,µ,Q(x) = 1 Ke−1
2CIµ(v◦w)
where K is a constant that is defined so that the function is a probability, where LLT = Q is the Cholesky decomposition of the matrix Q, v = (x − m)TL, w = LT(x − m), and where v ◦ w denotes the elementwise product of vectors v and w. Notation:
83rd EWG-MCDA 2016 40 / 59
CMI distribution Outline
Property:
distributions and the Choquet integral based distribution. In addition – A CMI(m, µ, Q) with µ = µ1 corresponds to multivariate normal distributions, – A CMI(m, µ, Q) with Q = I corresponds to a CI(m, µ).
83rd EWG-MCDA 2016 41 / 59
CMI distribution Outline
Graphically:
normal distribution), generalization (CMI distribution)
Mahalanobis Choquet−Mahalanobis Choquet WM
83rd EWG-MCDA 2016 42 / 59
CMI distribution Outline
1st Example: Interactions only expressed in terms of a measure.
83rd EWG-MCDA 2016 43 / 59
CMI distribution Outline
2nd Example: Interactions only in terms of a covariance matrix.
83rd EWG-MCDA 2016 44 / 59
CMI distribution Outline
3rd Example: Interactions both: covariance matrix and measure.
83rd EWG-MCDA 2016 45 / 59
CMI distribution Outline
More properties: Data not always acc. normality assumption
83rd EWG-MCDA 2016 46 / 59
CMI distribution Outline
More properties: Data not always acc. normality assumption
83rd EWG-MCDA 2016 46 / 59
CMI distribution Outline
More properties: Data not always acc. normality assumption
Example:
83rd EWG-MCDA 2016 46 / 59
CMI distribution Outline
More properties: Data not always acc. normality assumption
Example:
CMI for the following spherical distribution: Spherical distribution with density
f(r) = (1/K)e−
r−r0
σ
2
,
where r0 is a radius over which the density is maximum, σ is a variance, and K is the normalization constant.
83rd EWG-MCDA 2016 46 / 59
CMI distribution Outline
More properties: (symmetry)
µ. Then, for all x ∈ Rn and all i ∈ {1, . . . , n}
P(x1, . . . , xi−1, xi + mi, xi+1, . . . , xn) = P(x1, . . . , xi−1, −xi + mi, xi+1, . . . , xn).
positive-definite diagonal matrix Q, and a fuzzy measure µ. Then, for all x ∈ Rn and all i ∈ {1, . . . , n}
P(x1, . . . , xi−1, xi + mi, xi+1, . . . , xn) = P(x1, . . . , xi−1, −xi + mi, xi+1, . . . , xn).
83rd EWG-MCDA 2016 47 / 59
CMI distribution Outline
More properties:
fuzzy measure µ,
X = [E[X1], E[X2], . . . , E[Xn]] is m and
i = j and, thus, diagonal.
for any fuzzy measure µ and any diagonal matrix Q,
X = [E[X1], E[X2], . . . , E[Xn]] is m and
i = j and thus, diagonal.
83rd EWG-MCDA 2016 48 / 59
CMI distribution Outline
More properties:
Cov[Xi, Xj] = Q(Xi, Xj).
83rd EWG-MCDA 2016 49 / 59
CMI distribution Outline
More properties: If this type of data distinguishable from Normal ?
83rd EWG-MCDA 2016 50 / 59
CMI distribution Outline
More properties: If this type of data distinguishable from Normal ? Study:
83rd EWG-MCDA 2016 50 / 59
CMI distribution Outline
More properties: If this type of data distinguishable from Normal ? Study:
83rd EWG-MCDA 2016 50 / 59
CMI distribution Outline
More properties: Normality test for CI-based distribution
Marginal computed numerically integrate, uniroot function in R. Almost always the test is passed for samples of n = 100 data
83rd EWG-MCDA 2016 51 / 59
CMI distribution Outline
More properties: Normality test for CI-based distribution
Marginal computed numerically integrate, uniroot function in R. Almost always the test is passed for samples of n = 100 data
(right) with the same variance. µ({x1}) = 0.1 and µ({x2}) = 0.1
−20 −10 10 20 0.00 0.05 0.10 0.15 0.20 x marginalX2 −20 −10 10 20 0.00 0.05 0.10 0.15 x normalDistr
83rd EWG-MCDA 2016 51 / 59
CMI distribution Outline
More properties: Normality test for CI-based distribution
(i) µ({x1}) = 0.1 and µ({x2}) = 0.1; (ii) µ({x1}) = 0.1 and µ({x2}) = 0.2; (iii) µ({x1}) = 0.2 and µ({x2}) = 0.1; (iv) µ({x1}) = 0.9 and µ({x2}) = 0.9
−20 −10 10 20 0.00 0.05 0.10 0.15 0.20 x marginalX2 −20 −10 10 20 0.00 0.05 0.10 0.15 x normalDistr −20 −10 10 20 0.00 0.05 0.10 0.15 0.20 0.25 x marginalX2 −20 −10 10 20 0.00 0.05 0.10 0.15 0.20 x normalDistr −20 −10 10 20 0.00 0.05 0.10 0.15 0.20 x marginalX2 −20 −10 10 20 0.00 0.02 0.04 0.06 0.08 0.10 0.12 0.14 x normalDistr −20 −10 10 20 0.00 0.05 0.10 0.15 0.20 0.25 0.30 x marginalX2 −20 −10 10 20 0.00 0.05 0.10 0.15 0.20 0.25 0.30 x normalDistr83rd EWG-MCDA 2016 52 / 59
CMI distribution Outline
More properties: Normality test for CI-based distribution
Mardia’s test based on skewness and kurtosis – Skewness test is passed. – Almost all distributions (in R2) pass kurtosis test in experiments:
i = 1, 2, . . . , 9.
(i) µ({x}) = 0.1 and µ({y}) = 0.1, (ii) µ({x}) = 0.2 and µ({y}) = 0.1.
83rd EWG-MCDA 2016 53 / 59
Outline
83rd EWG-MCDA 2016 54 / 59
Summary Outline
Summary:
Integral for non-additive measures
83rd EWG-MCDA 2016 55 / 59
Summary Outline
Summary:
Integral for non-additive measures
Future work:
83rd EWG-MCDA 2016 55 / 59
Summary Outline
Defined by S. Greco, B. Matarazzo, S. Giove (FSS, 2011)
P(x) = 1
Ke −1
2CIG µG((x−¯
x)⊗(x−¯ x))
measures µ1 and µ2 with intervals (0, 3) for µ1, and (3, 100) for µ2. µ1({x}) = 0.05 and µ1({y}) = 0.95, and µ2({x}) = 0.95 and µ2({y}) = 0.05
83rd EWG-MCDA 2016 56 / 59
Outline
83rd EWG-MCDA 2016 57 / 59
References Outline
References:
distance and Choquet integral: the Choquet-Mahalanobis operator, Information Sciences 190 (2012) 56-63.
additive measures, RIMS Kokyuroku 1906 (2014) 136-143.
functions, Acta et Commentationes Universitatis Tartuensis de Mathematica 19:1 (2015) 35-47. http://dx.doi.org/10.12697/ACUTM.2015.19.04
83rd EWG-MCDA 2016 58 / 59
Outline
Slides at: http://www.mdai.cat/ifao/ http://www.mdai.cat/ifao/slides.php
83rd EWG-MCDA 2016 59 / 59