decision tree
play

Decision Tree Prof. Seungchul Lee Industrial AI Lab. Feature Test - PowerPoint PPT Presentation

Nov 24, 2023 •337 likes •579 views

Decision Tree Prof. Seungchul Lee Industrial AI Lab. Feature Test Feature 1 Feature 2 Feature 3 Feature 4 output ? Yes Low Medium Bad Feature test in the first level Yes Yes High Medium Bad ? No High Medium Good No No

  1. Decision Tree Prof. Seungchul Lee Industrial AI Lab.

  2. Feature Test Feature 1 Feature 2 Feature 3 Feature 4 output ? Yes Low Medium Bad • Feature test in the first level Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good 4 Feature 1 Yes No Low High Bad Yes No Medium High Bad ? Yes No ? Yes High Low Bad Good: 2 Good: 0 Good: 1 Bad: 2 Bad: 3 Bad: 0 2

  3. Feature Test Feature 1 Feature 2 Feature 3 Feature 4 output ? Yes Low Medium Bad • Homogeneous set in the first level Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good 4 Feature 1 Yes No Low High Bad Yes No Medium High Bad ? Yes No ? Yes High Low Bad Good: 2 Good: 0 Good: 1 Bad: 2 Bad: 3 Bad: 0 3 Feature 2 Yes No Good: 0 Good: 3 Bad: 3 Bad: 2 3

  4. Feature Test Feature 1 Feature 2 Feature 3 Feature 4 output ? Yes Low Medium Bad • Homogeneous set in the first level Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good 4 Feature 1 Yes No Low High Bad Yes No Medium High Bad ? Yes No ? Yes High Low Bad Good: 2 Good: 0 Good: 1 Bad: 2 Bad: 3 Bad: 0 3 2 Feature 2 Feature 3 Medium Low High Yes No Good: 0 Good: 3 Good: 2 Good: 0 Good: 1 Bad: 3 Bad: 2 Bad: 1 Bad: 2 Bad: 2 4

  5. Feature Test Feature 1 Feature 2 Feature 3 Feature 4 output ? Yes Low Medium Bad • Homogeneous set in the first level Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good 4 Feature 1 Yes No Low High Bad Yes No Medium High Bad ? Yes No ? Yes High Low Bad Good: 2 Good: 0 Good: 1 Bad: 2 Bad: 3 Bad: 0 3 2 0 Feature 2 Feature 3 Feature 4 Medium Low High Medium Low High Yes No Good: 0 Good: 3 Good: 2 Good: 0 Good: 1 Good: 1 Good: 1 Good: 1 Bad: 3 Bad: 2 Bad: 1 Bad: 2 Bad: 2 Bad: 2 Bad: 1 Bad: 2 5

  6. Feature Test Feature 1 Feature 2 Feature 3 Feature 4 output ? Yes Low Medium Bad • Homogeneous set in the first level Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good 4 Feature 1 Yes No Low High Bad Yes No Medium High Bad ? Yes No ? Yes High Low Bad Good: 2 Good: 0 Good: 1 Bad: 2 Bad: 3 Bad: 0 6

  7. Feature Test Feature 1 Feature 2 Feature 3 Feature 4 output ? Yes Low Medium Bad • Homogeneous set in the second level Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good 4 Feature 1 Yes No Low High Bad Yes No Medium High Bad ? Yes No ? Yes High Low Bad Good: 2 Good: 0 Good: 1 Bad: 2 Bad: 3 Bad: 0 7

  8. Feature Test Feature 1 Feature 2 Feature 3 Feature 4 output ? Yes Low Medium Bad • Homogeneous set in the second level Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good 4 Feature 1 Yes No Low High Bad Yes No Medium High Bad ? Yes No ? Yes High Low Bad Good: 2 Good: 0 Good: 1 Bad: 2 Bad: 3 Bad: 0 4 Feature 2 Yes No Good: 0 Good: 2 Bad: 2 Bad: 0 8

  9. Feature Test Feature 1 Feature 2 Feature 3 Feature 4 output ? Yes Low Medium Bad • Homogeneous set in the second level Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good 4 Feature 1 Yes No Low High Bad Yes No Medium High Bad ? Yes No ? Yes High Low Bad Good: 2 Good: 0 Good: 1 Bad: 2 Bad: 3 Bad: 0 4 2 Feature 2 Feature 3 Medium Low High Yes No Good: 0 Good: 2 Good: 1 Good: 0 Good: 1 Bad: 2 Bad: 0 Bad: 0 Bad: 1 Bad: 1 9

  10. Feature Test Feature 1 Feature 2 Feature 3 Feature 4 output ? Yes Low Medium Bad • Homogeneous set in the second level Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good 4 Feature 1 Yes No Low High Bad Yes No Medium High Bad ? Yes No ? Yes High Low Bad Good: 2 Good: 0 Good: 1 Bad: 2 Bad: 3 Bad: 0 4 2 0 Feature 2 Feature 3 Feature 4 Medium Low High Medium Low High Yes No Good: 0 Good: 2 Good: 1 Good: 0 Good: 1 Good: 1 Good: 1 Good: 0 Bad: 2 Bad: 0 Bad: 0 Bad: 1 Bad: 1 Bad: 1 Bad: 1 Bad: 0 10

  11. Feature Test Feature 1 Feature 2 Feature 3 Feature 4 output ? Yes Low Medium Bad • Homogeneous set in the second level Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good 4 Feature 1 Yes No Low High Bad Yes No Medium High Bad ? Yes No ? Yes High Low Bad Good: 2 Good: 0 Good: 1 Bad: 2 Bad: 3 Bad: 0 4 Feature 2 Yes No Good: 0 Good: 2 Bad: 2 Bad: 0 11

  12. Feature Test Feature 1 Feature 2 Feature 3 Feature 4 output ? Yes Low Medium Bad • Decision tree Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Feature 1 Yes No Low High Bad Yes No Medium High Bad ? Yes No ? Yes High Low Bad Good: 0 Good: 1 Feature 2 Bad: 3 Bad: 0 Yes No Good: 0 Good: 2 Bad: 2 Bad: 0 • Issue: a large data set will be most likely to produce zero homogeneous set 12

  13. Disorder • Disorder of single set 13

  14. Quality of Test • Disorder of single set • Quality of test Q = 0.5 Feature 1 4 3 1 8 ? Yes 8 No 8 Good: 2 Good: 0 Good: 1 Bad: 2 Bad: 3 Bad: 0 D = 1 D = 0 D = 0 14

  15. Quality Feature 1 Feature 2 Feature 3 Feature 4 output ? Yes Low Medium Bad • Quality of test in the first level Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Q = 0.5 Feature 1 Yes No Low High Bad 4 3 1 Yes No Medium High Bad 8 ? Yes 8 No 8 ? Yes High Low Bad Good: 2 Good: 0 Good: 1 Bad: 2 Bad: 3 Bad: 0 D = 1 D = 0 D = 0 Q = 0.6 Feature 2 3 5 Yes No 8 8 Good: 0 Good: 3 Bad: 3 Bad: 2 D = 0 D = 0.97 15

  16. Quality Feature 1 Feature 2 Feature 3 Feature 4 output ? Yes Low Medium Bad • Quality of test in the first level Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Q = 0.5 Feature 1 Yes No Low High Bad 4 3 1 Yes No Medium High Bad 8 ? Yes 8 No 8 ? Yes High Low Bad Good: 2 Good: 0 Good: 1 Bad: 2 Bad: 3 Bad: 0 D = 1 D = 0 D = 0 Q = 0.6 Q = 0.69 Feature 2 Feature 3 3 3 2 3 5 Medium Low High Yes No 8 8 8 8 8 Good: 0 Good: 3 Good: 2 Good: 0 Good: 1 Bad: 3 Bad: 2 Bad: 1 Bad: 2 Bad: 2 D = 0 D = 0.97 D = 0.92 D = 0 D = 0.92 16

  17. Quality Feature 1 Feature 2 Feature 3 Feature 4 output ? Yes Low Medium Bad • Quality of test in the first level Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Q = 0.5 Feature 1 Yes No Low High Bad 4 3 1 Yes No Medium High Bad 8 ? Yes 8 No 8 ? Yes High Low Bad Good: 2 Good: 0 Good: 1 Bad: 2 Bad: 3 Bad: 0 D = 1 D = 0 D = 0 Q = 0.6 Q = 0.69 Q = 0.94 Feature 2 Feature 3 Feature 4 3 3 2 3 3 2 3 5 Medium Low High Medium Low High Yes No 8 8 8 8 8 8 8 8 Good: 0 Good: 3 Good: 2 Good: 0 Good: 1 Good: 1 Good: 1 Good: 1 Bad: 3 Bad: 2 Bad: 1 Bad: 2 Bad: 2 Bad: 2 Bad: 1 Bad: 2 D = 0 D = 0.97 D = 0.92 D = 0 D = 0.92 D = 0.92 D = 1 D = 0.92 17

  18. Quality Feature 1 Feature 2 Feature 3 Feature 4 output ? Yes Low Medium Bad • Quality of test in the first level Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Q = 0.5 Feature 1 Yes No Low High Bad 4 3 1 Yes No Medium High Bad 8 ? Yes 8 No 8 ? Yes High Low Bad Good: 2 Good: 0 Good: 1 Bad: 2 Bad: 3 Bad: 0 D = 1 D = 0 D = 0 18

  19. Quality Feature 1 Feature 2 Feature 3 Feature 4 output ? Yes Low Medium Bad • Quality of test in the second level Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Q = 0.5 Feature 1 Yes No Low High Bad Yes No Medium High Bad ? Yes No ? Yes High Low Bad Good: 2 Good: 0 Good: 1 Bad: 2 Bad: 3 Bad: 0 D = 1 D = 0 D = 0 19

  20. Quality Feature 1 Feature 2 Feature 3 Feature 4 output ? Yes Low Medium Bad • Quality of test in the second level Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Q = 0.5 Feature 1 Yes No Low High Bad Yes No Medium High Bad ? Yes No ? Yes High Low Bad Good: 2 Good: 0 Good: 1 Bad: 2 Bad: 3 Bad: 0 D = 1 D = 0 D = 0 Q = 0 Feature 2 2 2 Yes No 4 4 Good: 0 Good: 2 Bad: 2 Bad: 0 D = 0 D = 0 20

  21. Quality Feature 1 Feature 2 Feature 3 Feature 4 output ? Yes Low Medium Bad • Quality of test in the second level Yes Yes High Medium Bad ? No High Medium Good No No Medium High Good ? No Medium Low Good Q = 0.5 Feature 1 Yes No Low High Bad Yes No Medium High Bad ? Yes No ? Yes High Low Bad Good: 2 Good: 0 Good: 1 Bad: 2 Bad: 3 Bad: 0 D = 1 D = 0 D = 0 Q = 0 Q = 0.5 Feature 2 Feature 3 2 2 1 1 2 Medium Low High Yes No 4 4 4 4 4 Good: 0 Good: 2 Good: 1 Good: 0 Good: 1 Bad: 2 Bad: 0 Bad: 0 Bad: 1 Bad: 1 D = 0 D = 0 D = 0 D = 0 D = 1 21

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Decision Tree Decision Trees A decision tree is a decision support tool that uses a tree-like

Decision Tree Decision Trees A decision tree is a decision support tool that uses a tree-like

Decision Tree Decision Trees A decision tree is a decision support tool that uses a tree-like graph or model of decisions and their possible MSE 2400 EaLiCaRA consequences, including chance event Dr. Tom Way outcomes, resource costs, and

568 views • 8 slides
1 Optimization in decision graphs Unfolding to decision tree Only option until Shachter

1 Optimization in decision graphs Unfolding to decision tree Only option until Shachter

Decision graphs II Influence Diagrams Advanced Herd Management Anders Ringgaard Kristensen Slide 1 Outline Optimization methods Decision tree Strong junction tree Single Policy Updating Decision node ordering Advantages and

467 views • 10 slides
1 Optimization in decision graphs The repeated milk test problem Unfolding to decision tree The

1 Optimization in decision graphs The repeated milk test problem Unfolding to decision tree The

Outline Decision trees Optimization methods Decision tree Decision graphs II Strong junction tree (Limited Memory) Influence Diagrams Single Policy Updating Markov property versus no forgetting Advanced Herd Management

512 views • 4 slides
A Brief History of Decision Tree Implementation MAX AUSTIN Overview Famous Decision Tree

A Brief History of Decision Tree Implementation MAX AUSTIN Overview Famous Decision Tree

A Brief History of Decision Tree Implementation MAX AUSTIN Overview Famous Decision Tree Algorithms Chi-squared Automatic Interaction Detector (CHAID) Classification and Regression Tree (CART) Iterative Dichotomiser 3 (ID3)

114 views • 9 slides
Decision Tree and Automata Learning Stefan Edelkamp 1 Overview - Decision tree representation

Decision Tree and Automata Learning Stefan Edelkamp 1 Overview - Decision tree representation

Decision Tree and Automata Learning Stefan Edelkamp 1 Overview - Decision tree representation - Top Down Induction, Attribute Selection - Entropy, Information gain - ID3 learning algorithm - Overfitting - Continous, multi-valued, costly and

718 views • 33 slides
Decision tree learning Aim: find a small tree consistent with the training examples Idea:

Decision tree learning Aim: find a small tree consistent with the training examples Idea:

Decision tree learning Aim: find a small tree consistent with the training examples Idea: (recursively) choose most significant attribute as root of (sub)tree function DTL ( examples, attributes, default ) returns a decision tree if examples

261 views • 13 slides
Decision Tree Learning: Part 2 CS 760@UW-Madison Goals for the last lecture you should

Decision Tree Learning: Part 2 CS 760@UW-Madison Goals for the last lecture you should

Decision Tree Learning: Part 2 CS 760@UW-Madison Goals for the last lecture you should understand the following concepts the decision tree representation the standard top-down approach to learning a tree Occams razor

505 views • 38 slides
Decision-Tree for Classication MACH IN E LEARN IN G W ITH TREE-BAS ED MODELS IN P YTH ON

Decision-Tree for Classication MACH IN E LEARN IN G W ITH TREE-BAS ED MODELS IN P YTH ON

Decision-Tree for Classication MACH IN E LEARN IN G W ITH TREE-BAS ED MODELS IN P YTH ON Elie Kawerk Data Scientist Course Overview Chap 1 : Classication And Regression Tree (CART) Chap 2 : The Bias-Variance Tradeoff Chap 3 : Bagging

320 views • 29 slides
Assessing The Necessity Survey and Decision Tree Activities Conducted Decision tree created

Assessing The Necessity Survey and Decision Tree Activities Conducted Decision tree created

Assessing The Necessity Survey and Decision Tree Activities Conducted Decision tree created December 2013. Survey closed March 5, 2014. 132 survey responses. 72 public health and 60 non-public health (NF, ALF, HCBS, other).

280 views • 17 slides
Learning Decision Trees Representation is a decision tree. Bias is towards simple decision

Learning Decision Trees Representation is a decision tree. Bias is towards simple decision

Learning Decision Trees Representation is a decision tree. Bias is towards simple decision trees. Search through the space of decision trees, from simple decision trees to more complex ones. Decision trees A decision tree is

484 views • 10 slides
Decision Tree R Greiner Cmput 466 / 551 Learning Decision Trees Def'n: Decision Trees

Decision Tree R Greiner Cmput 466 / 551 Learning Decision Trees Def'n: Decision Trees

HTF: 9.2 B: 14.4 R N , C h a p t e r 1 8 1 8 . 3 Decision Tree R Greiner Cmput 466 / 551 Learning Decision Trees Def'n: Decision Trees Algorithm for Learning Decision Trees Entropy, Inductive Bias (Occam's

1.43k views • 87 slides
Decision Tree Algorithm Decision Tree Algorithm Week 4 1 Team Homework Assignment #5 Team

Decision Tree Algorithm Decision Tree Algorithm Week 4 1 Team Homework Assignment #5 Team

Decision Tree Algorithm Decision Tree Algorithm Week 4 1 Team Homework Assignment #5 Team Homework Assignment #5 Read pp. 105 117 of the text book. R d 105 117 f h b k Do Examples 3.1, 3.2, 3.3 and Exercise 3.4 (a). Prepare

385 views • 21 slides
Chapter 18 Learning from Observations Decision tree examples Additional source used in preparing

Chapter 18 Learning from Observations Decision tree examples Additional source used in preparing

Chapter 18 Learning from Observations Decision tree examples Additional source used in preparing the slides: Jean-Claude Latombes CS121 slides: robotics.stanford.edu/~latombe/cs121 1 Decision Trees A decision tree allows a

608 views • 33 slides
Decision Tree Mahdi Roozbahani Lecturer, Computational Science and Engineering, Georgia Tech

Decision Tree Mahdi Roozbahani Lecturer, Computational Science and Engineering, Georgia Tech

Class Website CX4242: Decision Tree Mahdi Roozbahani Lecturer, Computational Science and Engineering, Georgia Tech These slides are adopted from Polo, Andrew w. Moore, and Vivek Srikumar 2 1 Visual Introduction to Decision Tree

652 views • 47 slides
Keep the Decision Tree and Estimate the Class Probabilities Using its Decision Boundary Isabelle

Keep the Decision Tree and Estimate the Class Probabilities Using its Decision Boundary Isabelle

Keep the Decision Tree and Estimate the Class Probabilities Using its Decision Boundary Isabelle Alvarez (1 , 2) Stephan Bernard (2) Guillaume Deffuant (2) (1) LIP6, Paris VI University (2) Cemagref, LISC (2) Cemagref, LISC 4 place Jussieu

310 views • 6 slides
Decision Tree CE-717 : Machine Learning Sharif University of Technology M. Soleymani Fall 2019

Decision Tree CE-717 : Machine Learning Sharif University of Technology M. Soleymani Fall 2019

Decision Tree CE-717 : Machine Learning Sharif University of Technology M. Soleymani Fall 2019 Decision tree } One of the most intuitive classifiers that is easy to understand and construct } However, it also works very (very) well }

453 views • 41 slides
Today CS 188: Artificial Intelligence Neural Nets (wrap-up) and Decision Trees Neural Nets --

Today CS 188: Artificial Intelligence Neural Nets (wrap-up) and Decision Trees Neural Nets --

Today CS 188: Artificial Intelligence Neural Nets (wrap-up) and Decision Trees Neural Nets -- wrap Formalizing Learning Consistency Simplicity Decision Trees Expressiveness Information Gain Overfitting Instructors: Pieter

451 views • 13 slides
FacultyAdministrator Collaboration Team(FACT) FDP Meeting Sept 2018 Agenda for FACT

FacultyAdministrator Collaboration Team(FACT) FDP Meeting Sept 2018 Agenda for FACT

FacultyAdministrator Collaboration Team(FACT) FDP Meeting Sept 2018 Agenda for FACT Session Introductions 5 min Review Purpose, Goals, Timeline & Progress 10 min Has anyone done something like this before? 5

416 views • 27 slides
SEARCHES FOR ANNIHILATING DARK MATTER IN THE MILKY WAY HALO WITH ICECUBE Samuel Flis* , Morten

SEARCHES FOR ANNIHILATING DARK MATTER IN THE MILKY WAY HALO WITH ICECUBE Samuel Flis* , Morten

SEARCHES FOR ANNIHILATING DARK MATTER IN THE MILKY WAY HALO WITH ICECUBE Samuel Flis* , Morten Medici, Martin Wolf for the IceCube Collaboration ICRC 2017, 12-20 July, Busan, South Korea 2 SAMUEL FLIS Searching for DM in the Milky Way Halo

663 views • 16 slides
Named Entity WordNet *Istituto di Linguistica Computazionale (Pisa, Italy) ^University of

Named Entity WordNet *Istituto di Linguistica Computazionale (Pisa, Italy) ^University of

*Antonio Toral ^Rafael Muoz *Monica Monachini Named Entity WordNet *Istituto di Linguistica Computazionale (Pisa, Italy) ^University of Alicante (Spain) LREC 2008 O12 - Named Entity Recognition Marrakech, 2008-05-28 Outline Intro Named

655 views • 23 slides
No CDN On-net Off-net Deep off-net User Experience Low Medium High Very High

No CDN On-net Off-net Deep off-net User Experience Low Medium High Very High

No CDN On-net Off-net Deep off-net User Experience Low Medium High Very High Interconnection High High Low Low Backbone High Medium Low Very Low Colo High High Nil Nil Trending to Trending to Machines Medium Medium High

285 views • 11 slides
Filtering random medium effects for imaging Liliana Borcea Computational and Applied Mathematics

Filtering random medium effects for imaging Liliana Borcea Computational and Applied Mathematics

Filtering random medium effects for imaging Liliana Borcea Computational and Applied Mathematics Rice University borcea@caam.rice.edu Collaborators: alez del Cueto , CAAM, Rice University Fernando Gonz George Papanicolaou , Mathematics,

621 views • 28 slides
IB 1A5 (=E1R86), 1L1 (=E1R05) , IIB E2R40 , 2011 L2 URL

IB 1A5 (=E1R86), 1L1 (=E1R05) , IIB E2R40 , 2011 L2 URL

IB 1A5 (=E1R86), 1L1 (=E1R05) , IIB E2R40 , 2011 L2 URL : http://clsl.hi.h.kyoto-u.ac.jp/~kkuroda/lectures/11B-KU/KU-2011B-L01- slides.pdf ( ) substituting

387 views • 37 slides
L2 for English Acquisition I B k and II B i , 2011 URL

L2 for English Acquisition I B k and II B i , 2011 URL

L2 for English Acquisition I B k and II B i , 2011 URL : http://clsl.hi.h.kyoto-u.ac.jp/~kkuroda/lectures/11B-KIT/KIT-2011B-L02- slides.pdf ( ) 2011-10-18 ( ) Tuesday,

721 views • 36 slides

More recommend