An algebraic structure for Dominance-based Rough Set Approach to ordinal classification
Salvatore Greco
University of Catania, Italy
Benedetto Matarazzo
University of Catania, Italy
Roman Słowiński
Poznań University of Technology, Poland
An algebraic structure for Dominance-based Rough Set Approach to - - PowerPoint PPT Presentation
An algebraic structure for Dominance-based Rough Set Approach to ordinal classification Salvatore Greco University of Catania, Italy Benedetto Matarazzo University of Catania, Italy Roman Sowiski Pozna University of Technology, Poland
University of Catania, Italy
University of Catania, Italy
Poznań University of Technology, Poland
University of Catania, Italy
University of Catania, Italy
Poznań University of Technology, Poland
3
bad medium bad bad S8 bad bad bad bad S7 good good good good S6 good good medium good S5 good medium medium medium S4 medium medium medium medium S3 medium bad medium medium S2 bad bad medium good S1 Overall class Literature (L) Physics (Ph) Mathematics (M) Student
4
Greco, S., Matarazzo, B., Słowiński, R.: Rough sets theory for multicriteria decision analysis. European J. of Operational Research, 129 (2001) no.1, 1-47
5
S.Greco, B.Matarazzo, R.Słowiński: Rough sets theory for multicriteria decision analysis. European J. of Operational Research, 129 (2001) no.1, 1-47
6
The faster the car, the more expensive it is
The higher the inflation, the higher the interest rate
The larger the mass and the smaller the distance, the larger the gravity
The colder the weather, the greater the energy consumption
7
8
9
y x λ
1 1
10
Greco, S., Matarazzo, B., Słowiński, R.: Axiomatic characterization of a general utility function and its particular cases in terms of conjoint measurement and rough-set decision rules. European J. of Operational Research, 158 (2004) no. 2, 271-292
11
Many algebraic models have been proposed for rough set theory:
Nelson algebra (Pagliani 1998),
Heyting algebra (Pagliani 1998),
Wajsberg algebra (Polkowski 2002),
Stone algebra (Pomykała & Pomykała 1988) ,
Łukasiewicz algebra (Pagliani 1998),
Brouwer-Zadeh algebra (Cattaneo & Nisticò 1989),
...
These algebra models give elegant representations of basic properties
12
13
In Classical Rough Set Theory we approximate subsets of the universe, e.g.
bad students,
medium students,
good students.
In Dominance based Rough Set Theory we approximate downward cumulations
at most bad students (i.e., bad or worse students)
at most medium students (i.e., medium or worse students)
at least medium students (i.e. medium or better students)
at least good students (i.e. good or better students)
14
Critical remarks
Lower and upper approximations for downward cumulations are different
The complement of a downward cumulation is an upward cumulation:
The complement of an upward cumulation is a downward cumulation:
15
A typical algebra for Classical Rough Set Theory:
A system <,,,’,,0,1> is a Brouwer-Zadeh distributive
A typical algebra for Dominance-based Rough Set Theory:
A system <,+,-,,,’+, ’-,+,-,0,1> is a bipolar Brouwer-
16
Negations in a typical algebra for Classical Rough Set Theory:
’ : is a Kleene complementation,…
: is a Brouwer complementation, …
Negations in a typical algebra for Dominance-based Rough Set
’+ : +- and ’- : -+ are Kleene complementations,…
+ : +- and - : -+ are Brouwer complementations, …
17
We can generalize to Dominance-based Rough Set Approach all algebra models proposed for Classical Rough Set Theory:
Nelson algebra Bipolar Nelson algebra ,
Heyting algebra Bipolar Heyting algebra,
Wajsberg algebra Bipolar Wajsberg algebra,
Stone algebra Bipolar Stone algebra,
Łukasiewicz algebra Bipolar Łukasiewicz algebra ,
Brouwer-Zadeh algebra Bipolar Brouwer-Zadeh algebra,
...
These algebra models give elegant representations of basic properties of Dominance–based Rough Set Theory. (Greco, S., Matarazzo, B., Słowiński, R.: Algebra and Topology for Dominance-based Rough Set Approach, in Z.W. Raś, W. Ribarsky (editors), Studies in Computational Intelligence, Springer, 2009, to appear)
18
19
In Classical Rough Set Theory we approximate subsets of the universe which can be considered as disjoint concepts, e.g.:
the subset of Bad Students, corresponding to the of Bad Student,
the subset of Medium Students, corresponding to the of Medium Student,
the subset of Good Students , corresponding to the of Good Student.
In Dominance based Rough Set Theory we approximate gradual concepts, e.g., taking into account the concept of Good Student
Bad Students is the set of elements belonging with the lowest level to the the concept of Good Student,
Medium Students is the set of elements belonging with an intermediate level to the the concept of Good Student,
Good Students is the set of elements belonging with the highest level to the the concept of Good Student.
20
Critical remarks
At least Good Students At least Medium Students At least Bad Students Lower Approximation (and Upper Approximation) of at least Good Students Lower Approximation (and Upper Approximation) of at least Medium Students Lower Approximation (and Upper Approximation) of at most Bad Students
At most Good Students At least Medium Students At most Bad Students Lower Approximation (and Upper Approximation) of at most Good Students Lower Approximation (and Upper Approximation) of at most Medium Students Lower (and Upper Approximation) Approximation of at most Bad Students
21
A typical algebra for Classical Rough Set Theory:
A system <,,,’,,0,1> is a Brouwer-Zadeh distributive lattice if the following properties hold … = A(U)=(I(X),E(X)), XU, I(X)=R(X), E(X)=U-
A typical algebra for Dominance-based Rough Set Theory:
A system <,+,-,,,’+, ’-,+,-,0,1> is a bipolar Brouwer-Zadeh distributive lattice if the following properties hold…
nU= (X1,…,Xn): X1,…,Xn U, , XiXj =, i,j=1,…,n
= (I1,…,In-1;E1,…,En-1): Ii,Ei U, Ii Ei =, i=1,…,n-1
, (X1,…,Xn) nU
, (X1,…,Xn) nU
X R
n 1 i i
n 2 n 2
X R U ,..., X R U ; X R ,..., X R
1 n 1 1 n 1
X R U ,..., X R U ; X R ,..., X R
22
nU= (X1,…,Xn): X1,…,Xn U, , XiXj =, i,j=1,…,n nU= (Bad Students,Medium Students, Good Students) +=
+= R+(at least Medium Students), R+(at least Good Students);
-= R-(at most Bad Students), R-(at most Medium Students);
n 1 i i
n 2 n 2
23
We can generalize to Dominance-based Rough Set Approach all algebra models proposed for Classical Rough Set Theory:
Nelson algebra of rough sets Bipolar Nelson algebra of rough ord. class.,
Heyting algebra of rough sets Bipolar Heyting algebra of rough ord. class.,
Wajsberg algebra of rough sets Bipolar Wajsberg algebra of rough ord. class.,
Stone algebra of rough sets Bipolar Stone algebra of rough ord. class.,
Łukasiewicz algebra of rough sets Bipolar Łukasiewicz algebra of rough ord. class.,
Brouwer-Zadeh algebra of rough sets Bipolar Brouwer-Zadeh algebra
...
24
The reasons of Dominance-based Rough Set Approach (DRSA)
De Morgan Brouwer-Zadeh lattice
De Morgan Brouwer-Zadeh lattice as a model for Indiscernibility-based Rough Set Approach (IRSA)
Bipolar De Morgan Brouwer-Zadeh lattice
Bipolar de Morgan Brouwer-Zadeh lattice as a model for DRSA
Ordinal classification
Bipolar de Morgan Brouwer-Zadeh lattice as a model for DRSA approximation of ordinal classification
Another algebraic model: Nelson algebra and bipolar Nelson algebra
Conclusions
25
26
Greco, S., Matarazzo, B., Słowiński, R.: Rough sets theory for multicriteria decision analysis. European J. of Operational Research, 129 (2001) no.1, 1-47
27
bad medium bad bad S8 bad medium bad bad S7 good good good good S6 good good medium good S5 good medium medium medium S4 medium medium medium medium S3 medium bad medium medium S2 bad bad medium good S1 Overall class Literature (L) Physics (Ph) Mathematics (M) Student
28
bad medium bad bad S8 bad medium bad bad S7 good good good good S6 good good medium good S5 good medium medium medium S4 medium medium medium medium S3 medium bad medium medium S2 bad bad medium good S1 Overall class Literature (L) Physics (Ph) Mathematics (M) Student Lower Approximation
29
bad medium bad bad S8 bad medium bad bad S7 good good good good S6 good good medium good S5 good medium medium medium S4 medium medium medium medium S3 medium bad medium medium S2 bad bad medium good S1 Overall class Literature (L) Physics (Ph) Mathematics (M) Student Lower Approximation Upper Approximation
30
31
32
33
34
35
bad medium bad bad S8 bad bad bad bad S7 good good good good S6 good good medium good S5 good medium medium medium S4 medium medium medium medium S3 medium bad medium medium S2 bad bad medium good S1 Overall class Literature (L) Physics (Ph) Mathematics (M) Student
36
37
bad medium bad bad S8 bad bad bad bad S7 good good good good S6 good good medium good S5 good medium medium medium S4 medium medium medium medium S3 medium bad medium medium S2 bad bad medium good S1 Overall class Literature (L) Physics (Ph) Mathematics (M) Student
38
39
S.Greco, B.Matarazzo, R.Słowiński: Rough sets theory for multicriteria decision analysis. European J. of Operational Research, 129 (2001) no.1, 1-47
40
Greco, S., Matarazzo, B., Słowiński, R.: Axiomatic characterization of a general utility function and its particular cases in terms of conjoint measurement and rough-set decision rules. European J. of Operational Research, 158 (2004) no. 2, 271-292
41
Example Objects = firms
Investments Sales Value 40 17,8 High 35 30 High 32.5 39 High 31 35 High 27.5 17.5 High 24 17.5 High 22.5 20 High 30.8 19 Medium 27 25 Medium 21 9.5 Medium 18 12.5 Medium 10.5 25.5 Medium 9.75 17 Medium 17.5 5 Low 11 2 Low 10 9 Low 5 13 Low
42
Objects in condition attribute space
attribute 1 (Investment) attribute 2 (Sales) 40 40 20 20
43
a1 a2 40 40 20 20
Indiscernibility sets Quantitative attributes are discretized according to perception of the user
44
a1 40 40 20 20
Granules of knowlegde are sets IP(x)
a2
45
a1 40 40 20 20
Lower approximation of class High
a2
46
a1 40 40 20 20
Upper approximation of class High
a2
47
a1 a2 40 40 20 20
Lower approximation of class Medium
48
a1 a2 40 40 20 20
Upper approximation of class Medium
49
a1 40 40 20 20
Boundary set of classes High and Medium
a2
50
a1 40 40 20 20
Lower = Upper approximation of class Low
a2
51
Investements Sales Value 40 17,8 High 35 30 High 32.5 39 High 31 35 High 27.5 17.5 High 24 17.5 High 22.5 20 High 30.8 19 Medium 27 25 Medium 21 9.5 Medium 18 12.5 Medium 10.5 25.5 Medium 9.75 17 Medium 17.5 5 Low 11 2 Low 10 9 Low 5 13 Low
Value:
52
Sales Investments 40 40 20 20
Objects in condition criteria space
53
Sales 40 40 20 20
Granular computing with dominance cones
Investments
P P
P P
54
Sales 40 40 20 20
Granular computing with dominance cones
Investments
P P
P P
55
Sales 40 40 20 20
Lower approximation of upward union of class High
Investments
t P t
56
Sales 40 40 20 20
Upper approximation and the boundary of upward union of class High
Investments
t
Cl x P t
t
t t t P
57
Sales 40 40 20 20
Lower = Upper approximation of upward union of class Medium
Investments
t P t
t
Cl x P t
t
58
Sales 40 40 20 20
Lower = upper approximation of downward union of class Low
Investements
t
Cl x P t P t
t P t
59
Sales 40 40 20 20
Lower approximation of downward union of class Medium
Investments
t P t
60
Sales 40 40 20 20
Upper approximation and the boundary of downward union of class Medium
Investements
t
Cl x P t P t
t t t P
61
Sales Investments 40 40 20 20
Comparison of CRSA and DRSA
a1 a2 40 40 20 20
62
utility function (e.g. additive, multiplicative, associative, Choquet
binary relation (e.g. outranking relation, fuzzy relation)
Greco, S., Matarazzo, B., Słowiński, R.: Axiomatic characterization of a general utility function and its particular cases in terms of conjoint measurement and rough-set decision rules. European J. of Operational Research, 158 (2004) no. 2, 271-292
63
64
A system <,,,’,,0,1> is quasi Brouwer-Zadeh distributive
<,,,0,1> is a distributive lattice ’ : is a Kleene complementation, that is for all a,b
(K1) a’’=a (K2) (a b)’=a’ b’ (k3) a a’ b b’
65
: is a Brouwer complementation, that is for all a,b
(B1) a a =a (B2) (a b) =a b (B3) a a =0
(win) for all a, a a’ A quasi Brouwer-Zadeh lattice is Brouwer-Zadeh lattice if
(in) for all a, a = a ’
66
A Brouwer-Zadeh lattice is a de Morgan Brouwer-Zadeh lattice if
(B2a) for all a,b, (a b) =a b
67
68
U, universe R, equivalence relation on U For any yU, [y]R is the equivalence class of y For any XU,
Lower approximation: R(X)= y U: [y]RX Upper approximation: = y U: [y]RX
69
For any XU,
interior of X: I(X)=R(X),
exterior of X: E(X)=U
For any X,Y U,
union: (I(X),E(X))(I(Y),E(Y))=(I(X)I(Y), E(X)E(Y))
intersection: (I(X),E(X))(I(Y),E(Y))=(I(X)I(Y), E(X)E(Y))
Minimal element: (,U), Maximal element: (U,)
X R
70
A(U)=(I(X),E(X)), XU The system
71
72
(K1b) a’+’- =a, c’-’+ =c, (K2b) (a b)’+ =a’+ b’+, (c d)’- =c’- d’-, (k3b) a a’+ b b’+, c c’- d d’-.
73
(B1b) a a+- =a, c c-+ =c, (B2b) (a b)+=a+ b+ , (c d)+ =c+ d+ , (B3b) a a+=0, c c-=0,
74
A bipolar Brouwer-Zadeh lattice is a bipolar de Morgan Brouwer-
(B2a-b) for all a,b+ and c,d- , (ab)+=a+b+, (cd)-=c-d- .
75
76
Upward lower approximation: R+(X) = yU:R+(y)X, Upward upper approximation: = y U: R-(y)X, Downward lower approximation: R-(X) = yU:R-(y)X, Downward upper approximation: = y U: R+(y)X.
77
(W+,W-) 2U2U is a bipolarization of universe U if,
(1) for any X1,X2W+, X1X2 W+ and X1X2 W+,
(2) for any Y1,Y2W-, Y1Y2 W- and Y1Y2 W-,
(3) for any X W+, U-X W-,
(4) for any Y W-, U-YW+,
(5) ,UW+.
(3) and (4) are equivalent to: W-=Y2U:XW+ such that Y=U-X or, equivalently, W+=X2U:YW- such that X=U-Y.
For (3) and (4), (5) implies ,UW- .
(1), (3) and (4) imply (2); (2), (3) and (4) imply (1).
78
79
interior of X and Y: I(X)=R+(X), I(Y)=R-(Y), exterior of X and Y: E(X)=U-
union: (I(X),E(X))(I(Y),E(Y))=(I(X)I(Y), E(X)E(Y)) intersection: (I(X),E(X))(I(Y),E(Y))=(I(X)I(Y), E(X)E(Y))
80
81
B=(I,E): I,EU and IE=, B+=(I,E): XW+ such that I=I(X),E=E(X), B-=(I,E): YW- such that I=I(Y),E=E(Y),
82
83
n 1 i i
i 1 j j i n i j j i
n 2 n 2
1 n 1 1 n 1
84
union:
intersection:
85
86
87
88
89
For any XU,
interior of X: I(X)=R(X),
exterior of X: E(X)=U
For any X,Y U,
union: (I(X),E(X))(I(Y),E(Y))=(I(X)I(Y), E(X)E(Y))
intersection: (I(X),E(X))(I(Y),E(Y))=(I(X)I(Y), E(X)E(Y))
(I(X),E(X))(I(Y),E(Y))=((U-I(X))I(Y), I(X)E(Y))
X R
90
+,- ’-: - +, -: - +, ’+: + -, +: + -, +-: +- -, -+: -+ +,
91
a a’+ b b’+ for all a,b+, c c’- d d’- for all c,d-, a c (a’+ b) iff c a +- b for all a+,b-,c, a c (a’- b) iff c a -+ b for all a-,b+,c, a +-(b +- c)=(a b) +-c for all a,b+, c-, a -+(b -+c)=(a b) -+c for all a,b-, c+, +a=a +-a’+=a +-0, -a=a -+a’-=a -+0.
92
Given a bipolarization (W+,W-) of universe U, for any XW+ and
93
For any (I,E)B+ and (I’,E)B-
94
For any (I1,…,In-1;E1,…,En-1)B+ and (I’1,…,I’n-1;E’1,…,E’n-1)B-
95
For any (I1,…,In-1;E1,…,En-1)B+ and (I’1,…,I’n-1;E’1,…,E’n-1)B-
96
We considered the problem of giving an algebraic model to DRSA.
We observed that these algebraic models should represent two basic features of DRSA: bipolarity and graduality.
We introduced the bipolar de Morgan Brouwer-Zadeh lattice.
We showed how the bipolar de Morgan Brouwer-Zadeh lattice can model DRSA approximation of ordinal classifications
Other algebraic models can be generalized to model DRSA approximation of
Topological approach to DRSA is another interesting subject involving interesting concepts such as bitopological space and Priestely space
(see Greco, S., Matarazzo, B., Słowiński, R.: Algebra and Topology for Dominance-based Rough Set Approach, in Z.W. Raś, W. Ribarsky (editors), Studies in Computational Intelligence, Springer, 2009, to appear)