Decision Tree Prof. Seungchul Lee Industrial AI Lab. Feature Test - - PowerPoint PPT Presentation

▶
decision tree
SMART_READER_LITE
LIVE PREVIEW

Decision Tree Prof. Seungchul Lee Industrial AI Lab. Feature Test - - PowerPoint PPT Presentation

Nov 24, 2023 337 likes •580 views

Decision Tree Prof. Seungchul Lee Industrial AI Lab. Feature Test Feature 1 Feature 2 Feature 3 Feature 4 output ? Yes Low Medium Bad Feature test in the first level Yes Yes High Medium Bad ? No High Medium Good No No

slide-1
SLIDE 1

Decision Tree

  • Prof. Seungchul Lee

Industrial AI Lab.

slide-2
SLIDE 2

Feature Test

  • Feature test in the first level

2

Feature 1 Feature 2 Feature 3 Feature 4

  • utput

? Yes Low Medium Bad Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Yes No Low High Bad Yes No Medium High Bad ? Yes High Low Bad Feature 1

Good: 2 Bad: 2 Good: 0 Bad: 3 Good: 1 Bad: 0

? Yes No

4

slide-3
SLIDE 3
  • Homogeneous set in the first level

Feature Test

3

Feature 1 Feature 2 Feature 3 Feature 4

  • utput

? Yes Low Medium Bad Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Yes No Low High Bad Yes No Medium High Bad ? Yes High Low Bad Feature 1

Good: 2 Bad: 2 Good: 0 Bad: 3 Good: 1 Bad: 0

? Yes No Feature 2

Good: 0 Bad: 3 Good: 3 Bad: 2

Yes No

4 3

slide-4
SLIDE 4
  • Homogeneous set in the first level

Feature Test

4

Feature 1 Feature 2 Feature 3 Feature 4

  • utput

? Yes Low Medium Bad Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Yes No Low High Bad Yes No Medium High Bad ? Yes High Low Bad Feature 1

Good: 2 Bad: 2 Good: 0 Bad: 3 Good: 1 Bad: 0

? Yes No Feature 2

Good: 0 Bad: 3 Good: 3 Bad: 2

Yes No Feature 3

Good: 2 Bad: 1 Good: 0 Bad: 2 Good: 1 Bad: 2 Medium Low High

4 3 2

slide-5
SLIDE 5
  • Homogeneous set in the first level

Feature Test

5

Feature 1 Feature 2 Feature 3 Feature 4

  • utput

? Yes Low Medium Bad Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Yes No Low High Bad Yes No Medium High Bad ? Yes High Low Bad Feature 1

Good: 2 Bad: 2 Good: 0 Bad: 3 Good: 1 Bad: 0

? Yes No Feature 2

Good: 0 Bad: 3 Good: 3 Bad: 2

Yes No Feature 3

Good: 2 Bad: 1 Good: 0 Bad: 2 Good: 1 Bad: 2 Medium Low High

Feature 4

Good: 1 Bad: 2 Good: 1 Bad: 1 Good: 1 Bad: 2 Medium Low High

4 3 2

slide-6
SLIDE 6
  • Homogeneous set in the first level

Feature Test

6

Feature 1 Feature 2 Feature 3 Feature 4

  • utput

? Yes Low Medium Bad Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Yes No Low High Bad Yes No Medium High Bad ? Yes High Low Bad Feature 1

Good: 2 Bad: 2 Good: 0 Bad: 3 Good: 1 Bad: 0

? Yes No

4

slide-7
SLIDE 7
  • Homogeneous set in the second level

Feature Test

7

Feature 1 Feature 2 Feature 3 Feature 4

  • utput

? Yes Low Medium Bad Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Yes No Low High Bad Yes No Medium High Bad ? Yes High Low Bad Feature 1

Good: 2 Bad: 2 Good: 0 Bad: 3 Good: 1 Bad: 0

? Yes No

4

slide-8
SLIDE 8
  • Homogeneous set in the second level

Feature Test

8

Feature 1 Feature 2 Feature 3 Feature 4

  • utput

? Yes Low Medium Bad Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Yes No Low High Bad Yes No Medium High Bad ? Yes High Low Bad Feature 1

Good: 2 Bad: 2 Good: 0 Bad: 3 Good: 1 Bad: 0

? Yes No

4

Feature 2

Good: 0 Bad: 2 Good: 2 Bad: 0

Yes No

4

slide-9
SLIDE 9
  • Homogeneous set in the second level

Feature Test

9

Feature 1 Feature 2 Feature 3 Feature 4

  • utput

? Yes Low Medium Bad Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Yes No Low High Bad Yes No Medium High Bad ? Yes High Low Bad Feature 1

Good: 2 Bad: 2 Good: 0 Bad: 3 Good: 1 Bad: 0

? Yes No

4

Feature 2

Good: 0 Bad: 2 Good: 2 Bad: 0

Yes No Feature 3

Good: 1 Bad: 0 Good: 0 Bad: 1 Good: 1 Bad: 1 Medium Low High

4 2

slide-10
SLIDE 10
  • Homogeneous set in the second level

Feature Test

10

Feature 1 Feature 2 Feature 3 Feature 4

  • utput

? Yes Low Medium Bad Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Yes No Low High Bad Yes No Medium High Bad ? Yes High Low Bad Feature 1

Good: 2 Bad: 2 Good: 0 Bad: 3 Good: 1 Bad: 0

? Yes No

4

Feature 2

Good: 0 Bad: 2 Good: 2 Bad: 0

Yes No Feature 3

Good: 1 Bad: 0 Good: 0 Bad: 1 Good: 1 Bad: 1 Medium Low High

Feature 4

Good: 1 Bad: 1 Good: 1 Bad: 1 Good: 0 Bad: 0 Medium Low High

4 2

slide-11
SLIDE 11
  • Homogeneous set in the second level

Feature Test

11

Feature 1 Feature 2 Feature 3 Feature 4

  • utput

? Yes Low Medium Bad Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Yes No Low High Bad Yes No Medium High Bad ? Yes High Low Bad Feature 1

Good: 2 Bad: 2 Good: 0 Bad: 3 Good: 1 Bad: 0

? Yes No

4

Feature 2

Good: 0 Bad: 2 Good: 2 Bad: 0

Yes No

4

slide-12
SLIDE 12
  • Decision tree
  • Issue: a large data set will be most likely to produce zero homogeneous set

Feature Test

12

Feature 1 Feature 2 Feature 3 Feature 4

  • utput

? Yes Low Medium Bad Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Yes No Low High Bad Yes No Medium High Bad ? Yes High Low Bad Feature 1

Good: 0 Bad: 3 Good: 1 Bad: 0

? Yes No Feature 2

Good: 0 Bad: 2 Good: 2 Bad: 0

Yes No

slide-13
SLIDE 13

Disorder

  • Disorder of single set

13

slide-14
SLIDE 14

Quality of Test

  • Disorder of single set
  • Quality of test

14

Feature 1

Good: 2 Bad: 2 D = 1 Good: 0 Bad: 3 D = 0 Good: 1 Bad: 0 D = 0

? Yes No

Q = 0.5

3 8 1 8 4 8

slide-15
SLIDE 15
  • Quality of test in the first level

Quality

15

Feature 1 Feature 2 Feature 3 Feature 4

  • utput

? Yes Low Medium Bad Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Yes No Low High Bad Yes No Medium High Bad ? Yes High Low Bad Feature 1

Good: 2 Bad: 2 D = 1 Good: 0 Bad: 3 D = 0 Good: 1 Bad: 0 D = 0

? Yes No Feature 2

Good: 0 Bad: 3 D = 0 Good: 3 Bad: 2 D = 0.97

Yes No

Q = 0.5 Q = 0.6

3 8 3 8 1 8 5 8 4 8

slide-16
SLIDE 16
  • Quality of test in the first level

Quality

16

Feature 1 Feature 2 Feature 3 Feature 4

  • utput

? Yes Low Medium Bad Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Yes No Low High Bad Yes No Medium High Bad ? Yes High Low Bad Feature 1

Good: 2 Bad: 2 D = 1 Good: 0 Bad: 3 D = 0 Good: 1 Bad: 0 D = 0

? Yes No Feature 2

Good: 0 Bad: 3 D = 0 Good: 3 Bad: 2 D = 0.97

Yes No Feature 3

Good: 2 Bad: 1 D = 0.92 Good: 0 Bad: 2 D = 0 Good: 1 Bad: 2 D = 0.92 Medium Low High

Q = 0.5 Q = 0.6 Q = 0.69

3 8 3 8 1 8 5 8 3 8 3 8 2 8 4 8

slide-17
SLIDE 17
  • Quality of test in the first level

Quality

17

Feature 1 Feature 2 Feature 3 Feature 4

  • utput

? Yes Low Medium Bad Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Yes No Low High Bad Yes No Medium High Bad ? Yes High Low Bad Feature 1

Good: 2 Bad: 2 D = 1 Good: 0 Bad: 3 D = 0 Good: 1 Bad: 0 D = 0

? Yes No Feature 2

Good: 0 Bad: 3 D = 0 Good: 3 Bad: 2 D = 0.97

Yes No Feature 3

Good: 2 Bad: 1 D = 0.92 Good: 0 Bad: 2 D = 0 Good: 1 Bad: 2 D = 0.92 Medium Low High

Feature 4

Good: 1 Bad: 2 D = 0.92 Good: 1 Bad: 1 D = 1 Good: 1 Bad: 2 D = 0.92 Medium Low High

Q = 0.5 Q = 0.6 Q = 0.69 Q = 0.94

3 8 3 8 1 8 5 8 3 8 3 8 2 8 2 8 3 8 3 8 4 8

slide-18
SLIDE 18
  • Quality of test in the first level

Quality

18

Feature 1 Feature 2 Feature 3 Feature 4

  • utput

? Yes Low Medium Bad Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Yes No Low High Bad Yes No Medium High Bad ? Yes High Low Bad Feature 1

Good: 2 Bad: 2 D = 1 Good: 0 Bad: 3 D = 0 Good: 1 Bad: 0 D = 0

? Yes No

Q = 0.5

3 8 1 8 4 8

slide-19
SLIDE 19
  • Quality of test in the second level

Quality

19

Feature 1 Feature 2 Feature 3 Feature 4

  • utput

? Yes Low Medium Bad Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Yes No Low High Bad Yes No Medium High Bad ? Yes High Low Bad Feature 1

Good: 2 Bad: 2 D = 1 Good: 0 Bad: 3 D = 0 Good: 1 Bad: 0 D = 0

? Yes No

Q = 0.5

slide-20
SLIDE 20
  • Quality of test in the second level

Quality

20

Feature 1 Feature 2 Feature 3 Feature 4

  • utput

? Yes Low Medium Bad Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Yes No Low High Bad Yes No Medium High Bad ? Yes High Low Bad Feature 1

Good: 2 Bad: 2 D = 1 Good: 0 Bad: 3 D = 0 Good: 1 Bad: 0 D = 0

? Yes No Feature 2

Good: 0 Bad: 2 D = 0 Good: 2 Bad: 0 D = 0

Yes No

Q = 0.5 Q = 0

2 4 2 4

slide-21
SLIDE 21
  • Quality of test in the second level

Quality

21

Feature 1 Feature 2 Feature 3 Feature 4

  • utput

? Yes Low Medium Bad Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Yes No Low High Bad Yes No Medium High Bad ? Yes High Low Bad Feature 1

Good: 2 Bad: 2 D = 1 Good: 0 Bad: 3 D = 0 Good: 1 Bad: 0 D = 0

? Yes No Feature 2

Good: 0 Bad: 2 D = 0 Good: 2 Bad: 0 D = 0

Yes No Feature 3

Good: 1 Bad: 0 D = 0 Good: 0 Bad: 1 D = 0 Good: 1 Bad: 1 D = 1 Medium Low High

Q = 0.5 Q = 0 Q = 0.5

2 4 2 4 1 4 2 4 1 4

slide-22
SLIDE 22
  • Quality of test in the second level

Quality

22

Feature 1 Feature 2 Feature 3 Feature 4

  • utput

? Yes Low Medium Bad Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Yes No Low High Bad Yes No Medium High Bad ? Yes High Low Bad Feature 1

Good: 2 Bad: 2 D = 1 Good: 0 Bad: 3 D = 0 Good: 1 Bad: 0 D = 0

? Yes No Feature 2

Good: 0 Bad: 2 D = 0 Good: 2 Bad: 0 D = 0

Yes No Feature 3

Good: 1 Bad: 0 D = 0 Good: 0 Bad: 1 D = 0 Good: 1 Bad: 1 D = 1 Medium Low High

Feature 4

Good: 1 Bad: 1 D = 1 Good: 1 Bad: 1 D = 1 Good: 0 Bad: 0 D = Medium Low High

Q = 0.5 Q = 0 Q = 0.5 Q = 1

2 4 2 4 1 4 2 4 1 4 2 4 8 2 4

slide-23
SLIDE 23
  • Quality of test in the second level

Quality

23

Feature 1 Feature 2 Feature 3 Feature 4

  • utput

? Yes Low Medium Bad Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Yes No Low High Bad Yes No Medium High Bad ? Yes High Low Bad Feature 1

Good: 0 Bad: 3 D = 0 Good: 1 Bad: 0 D = 0

? Yes No Feature 2

Good: 0 Bad: 2 D = 0 Good: 2 Bad: 0 D = 0

Yes No