Introduction to Machine Learning Classification and Regression Trees - PowerPoint PPT Presentation

Oct 12, 2023 •338 likes •415 views

Introduction to Machine Learning Classification and Regression Trees (CART): Basics compstat-lmu.github.io/lecture_i2ml TREE MODEL AND PREDICTION Classification and Regression Trees, introduced by Breiman Binary splits are constructed top-down

Introduction to Machine Learning Classification and Regression Trees (CART): Basics compstat-lmu.github.io/lecture_i2ml
TREE MODEL AND PREDICTION Classification and Regression Trees, introduced by Breiman Binary splits are constructed top-down Constant prediction in each terminal node (leaf): either a numerical value, a class label or a probability vector over class labels. � c Introduction to Machine Learning – 1 / 5
TREE MODEL AND PREDICTION For predictions, observations are passed down the tree, according to the splitting rules in each node An observation will end up in exactly one leaf node All observations in a leaf node are assigned the same prediction for the target � c Introduction to Machine Learning – 2 / 5
TREE MODEL AND PREDICTION For predictions, observations are passed down the tree, according to the splitting rules in each node An observation will end up in exactly one leaf node All observations in a leaf node are assigned the same prediction for the target -1.20 -0.42 0.98 -0.20 -0.01 � c Introduction to Machine Learning – 3 / 5
TREES AS AN ADDITIVE MODEL Each point in X is assigned to exactly one leaf, and each leaf has a set of input points leading to it, through axis-parallel splits. Hence, trees divide the feature space X into rectangular regions : M � f ( x ) = c m I ( x ∈ Q m ) , m = 1 where a tree with M leaf nodes defines M “rectangles” Q m . c m is the predicted numerical response, class label or class distribution in the respective leaf node. Iris Data 2.5 Species 2.0 Petal.Width ● setosa 1.5 versicolor 1.0 virginica ● 0.5 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 0.0 2 4 6 Petal.Length � c Introduction to Machine Learning – 4 / 5
TREES The hypothesis space of a CART is the set of all step functions over rectangular partitions of X : M � f ( x ) = c m I ( x ∈ Q m ) , m = 1 Classification: Regression: Iris Data 2.5 -1.20 -0.42 0.98 -0.20 -0.01 2.0 Species Petal.Width 1.5 ● setosa versicolor 1.0 virginica ● 0.5 ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● ● 0.0 2 4 6 Petal.Length � c Introduction to Machine Learning – 5 / 5

Download Presentation

Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Introduction to Machine Learning Classification: Tasks Sonar Learning goals 0.20 Understand

Introduction to Machine Learning Classification: Tasks Sonar Learning goals 0.20 Understand the main difference between regression and 0.15 classification Response V2 M R 0.10 Know that classification can be binary or multiclass 0.05

510 views • 8 slides

Introduction to Machine Learning: Classification and The Noisy Channel Model CMSC 473/673 UMBC

Introduction to Machine Learning: Classification and The Noisy Channel Model CMSC 473/673 UMBC Some slides adapted from 3SLP Outline Classification Why incorporate uncertainty Classification with Bayes Rule Example: Email Classifier

1.68k views • 89 slides

1 Why Study Machine Learning? Why Study Machine Learning? Cognitive Science The Time is Ripe

What is Learning? Herbert Simon: Learning is any process by which a system improves performance from CS 391L: Machine Learning experience. Introduction What is the task? Classification Problem solving / planning /

603 views • 6 slides

Classification and Machine Learning techniques for CBIR: introduction to the RETIN system

Classification and Machine Learning techniques for CBIR: introduction to the RETIN system Matthieu Cord ETIS CNRS UMR 8051 Classification and Machine Learning techniques for CBIR: introduction to the RETIN system p.1/81 Content-Based Image

1.37k views • 81 slides

Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine

Introduction to Machine Learning COMPSCI 371D Machine Learning COMPSCI 371D Machine Learning Introduction to Machine Learning 1 / 18 Outline 1 Classification, Regression, Unsupervised Learning 2 About Dimensionality 3 Drawings and

701 views • 18 slides

Introduction to machine learning COMS 4721 Learning from data Machine learning : the study

Introduction to machine learning COMS 4721 Learning from data Machine learning : the study of computational mechanisms that learn from data in order to make predictions and decisions. Example 1: image classification A birdwatcher

932 views • 14 slides

Classifiers: Support Vector Machine 1 MACHINE LEARNING What is Classification? Female Adult

MACHINE LEARNING MACHINE LEARNING Classifiers: Support Vector Machine 1 MACHINE LEARNING What is Classification? Female Adult Children Detecting facial attributes He & Zhang, Pattern Recognition, 2011 Sony (Make Believe) Training set

914 views • 80 slides

Introduction to Machine Learning Session 2a: Introduction to Classification and Regression Trees

Introduction to Machine Learning Session 2a: Introduction to Classification and Regression Trees Reto West Department of Political Science and International Relations University of Geneva Outline 1 The Basics of Decision Trees 2 Regression

754 views • 29 slides

Introduction to Machine Learning Evaluation: Simple Measures for Classification Learning goals

Introduction to Machine Learning Evaluation: Simple Measures for Classification Learning goals Know the definitions of misclassification error rate (MCE) and accuracy (ACC) Understand the entries of a confusion matrix Understand the idea of

704 views • 10 slides

Introduction to Machine Learning Classification: Logistic Regression

Introduction to Machine Learning Classification: Logistic Regression compstat-lmu.github.io/lecture_i2ml MOTIVATION A discriminant approach for directly modeling the posterior probabilities ( x | ) of the labels is logistic regression . For

484 views • 9 slides

Machine Learning Classification: Introduction Hamid R. Rabiee Jafar Muhammadi, Nima Pourdamghani

Machine Learning Classification: Introduction Hamid R. Rabiee Jafar Muhammadi, Nima Pourdamghani Spring 2015 http://ce.sharif.edu/courses/93-94/2/ce717-1/ Agenda Agenda Introduction Classification: A Two-Step Process Evaluating

1k views • 76 slides

Decision tree learning Introduction to Machine Learning Task of classification Automatically

INTRODUCTION TO MACHINE LEARNING Decision tree learning Introduction to Machine Learning Task of classification Automatically assign class to observations with features Observation: vector of features , with a class Automatically

1.08k views • 80 slides

Learning Objectives SIRE503:Intro Med Bioinformatics What & Why? Classification

10/30/18 30 Oct 2018 Learning Objectives SIRE503:Intro Med Bioinformatics What & Why? Classification problems Introduction to Examples from Netflix Machine Learning 3 common types of Machine Learning Related

195 views • 16 slides

Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning

GCT634/AI613: Musical Applications of Machine Learning (Fall 2020) Traditional Machine Learning: Unsupervised Learning Juhan Nam Traditional Machine Learning Pipeline in Classification Tasks A set of hand-designed audio features are selected

398 views • 26 slides

Introduction to Machine Learning CMU-10701 2. MLE, MAP, Bayes classification Barnabs Pczos

Introduction to Machine Learning CMU-10701 2. MLE, MAP, Bayes classification Barnabs Pczos & Aarti Singh 2014 Spring Administration http://www.cs.cmu.edu/~aarti/Class/10701_Spring14/index.html Blackboard manager & Peer grading:

1.08k views • 41 slides

Linear classification Course of Machine Learning Master Degree in Computer Science University of

Linear classification Course of Machine Learning Master Degree in Computer Science University of Rome Tor Vergata Giorgio Gambosi a.a. 2018-2019 1 Introduction 2 Classification most common case: disjoint classes, each input has

742 views • 59 slides

A concrete memory model for CompCert Frdric Besson Sandrine Blazy Pierre Wilke Rennes,

A concrete memory model for CompCert Frdric Besson Sandrine Blazy Pierre Wilke Rennes, France P . Wilke A concrete memory model for CompCert 1 / 28 CompCert real-world C to ASM compiler used in industry (commercialised by AbsInt)

563 views • 40 slides

Generic absoluteness and universally Baire sets of reals Trevor Wilson Miami University, Ohio

One-step generic absoluteness Two-step generic absoluteness Generic absoluteness and universally Baire sets of reals Trevor Wilson Miami University, Ohio July 18, 2016 Trevor Wilson Generic absoluteness and universally Baire sets of reals

464 views • 24 slides

Opportunities for Mathematicians in the Real World Rajeeva L. Karandikar Director , Chennai

Opportunities for Mathematicians in the Real World Rajeeva L. Karandikar Director , Chennai Mathematical Institute rlk@cmi.ac.in , rkarandikar@gmail.com Rajeeva L. Karandikar Chennai Mathematical Institute Opportunities for Mathematicians in the

510 views • 13 slides

Optimally L Leveraging D Densi sity a and L Locality for E Exploratory B Browsi sing a

Optimally L Leveraging D Densi sity a and L Locality for E Exploratory B Browsi sing a and S Sampling Albert Kim 1* , Liqi Xu 2* , Tarique Siddiqui 1 , Silu Huang 2 , Samuel Madden 1 , Aditya Parameswaran 2 1 MIT 2 University of Illinois

347 views • 12 slides

Pulsed Dipole Design and Tests D. Summers, L. Perera, T. Hart, L. Cremaldi University of

Pulsed Dipole Design and Tests D. Summers, L. Perera, T. Hart, L. Cremaldi University of Mississippi-Oxford S. Hansen, M. L. Lopes, Fermilab 27-31 May 2014, MAP Collaboration Meeting Fermilab, Batavia, IL c c A e l e n r o a u t o

348 views • 8 slides

Heat Equation Fan Cheng John Hopcroft Center Computer Science and Engineering Shanghai Jiao

[Pop-up Salon, Maths, SJTU, 2019/01/10] On the Complete Monotonicity of Heat Equation Fan Cheng John Hopcroft Center Computer Science and Engineering Shanghai Jiao Tong University chengfan@sjtu.edu.cn Overview 2 2 2 ,

628 views • 25 slides

Bosons in optical lattices Subroto Mukerjee Department of Physics Indian Institute of Science

Bosons in optical lattices Subroto Mukerjee Department of Physics Indian Institute of Science Bangalore Current trends in frustrated magnetism, JNU 2015 Collaborators Arya Dhar Maheswar Maji Sayonee Ray Tapan Mishra Ramesh

588 views • 31 slides

SKT: A Computationaly Efficient SUPANOVA: Spline Kernel Based Machine Learning Tool Boleslaw

SKT: A Computationaly Efficient SUPANOVA: Spline Kernel Based Machine Learning Tool Boleslaw Szymanski, Lijuan Zhu, Long Han and Mark Embrechts Rensselaer Polytechnic Institute, Troy, NY 12180, USA and Alexander Ross and Karsten Sternickel

306 views • 15 slides