Week 2 RA : Aysun Koak Instructor : Dr. Aykut Erdem Department of - PowerPoint PPT Presentation

Week 2 RA : Aysun Koçak Instructor : Dr. Aykut Erdem Department of Computer Engineering Hacettepe University

Outline Week 2 Aysun Koçak k Nearest Neighbor(k-NN) Linear Regression Note for Assignment k Nearest Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University 22

k-Nearest Neighbor(k-NN) Week 2 ◮ Nonparametric algorithm Aysun Koçak ◮ To classify a new point, find its K nearest neighbors from the k Nearest 2 Neighbor(k-NN) training data. Linear Regression Note for Assignment credit - Siddharth Deokar slides Dept. of Computer Engineering Hacettepe University 22

Code Week 2 Aysun Koçak k Nearest 3 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering http://scikit-learn.org/stable/auto_examples/neighbors/plot_classification.html Hacettepe University 22

k-NN Results Week 2 Aysun Koçak k Nearest 4 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Engineering Hacettepe University 22

Drawbacks Week 2 Aysun Koçak k Nearest 5 Neighbor(k-NN) Linear Regression Note for Assignment ◮ Keep all data to classify a new input ◮ All neighbors have same importance ◮ Determining hyper-parameters ◮ What is the best distance to use? ◮ What is the best value of k to use? ◮ Distance usually relates to all the attributes and assumes all of them have the same effects on distance(curse of dimensionality) Dept. of Computer Engineering Hacettepe University 22

Determining Parameters Week 2 Aysun Koçak k Nearest 6 Neighbor(k-NN) Linear Regression Note for Assignment Dept. of Computer Credit - Fei-Fei Li & Andrej Karpathy slides Engineering Hacettepe University 22

Determining Parameters Week 2 Aysun Koçak k Nearest 7 Neighbor(k-NN) Linear Regression Note for Assignment Accuracy = (# of correctly classified examples / # of examples) X 100 Dept. of Computer Credit - Fei-Fei Li & Andrej Karpathy slides Engineering Hacettepe University 22

Linear Regression Week 2 Aysun Koçak k Nearest Neighbor(k-NN) Linear Regression 8 Note for Assignment Credit - Andrew Ng slides Dept. of Computer Engineering Hacettepe University 22

Linear Regression Week 2 Aysun Koçak k Nearest Neighbor(k-NN) Linear Regression 9 Note for Assignment Credit - Andrew Ng slides Dept. of Computer Engineering Hacettepe University 22

Linear Regression Week 2 Aysun Koçak k Nearest Neighbor(k-NN) Linear Regression 10 Note for Assignment Credit - Andrew Ng slides Dept. of Computer Engineering Hacettepe University 22

Linear Regression Week 2 Aysun Koçak k Nearest Neighbor(k-NN) Linear Regression 11 Note for Assignment Credit - Andrew Ng slides Dept. of Computer Engineering Hacettepe University 22

Linear Regression Week 2 Aysun Koçak k Nearest Neighbor(k-NN) Linear Regression 12 Note for Assignment Credit - Andrew Ng slides Dept. of Computer Engineering Hacettepe University 22

Linear Regression Week 2 Aysun Koçak k Nearest Neighbor(k-NN) Linear Regression 13 Note for Assignment Credit - Andrew Ng slides Dept. of Computer Engineering Hacettepe University 22

Linear Regression Week 2 Aysun Koçak k Nearest Neighbor(k-NN) Linear Regression 14 Note for Assignment Credit - Andrew Ng slides Dept. of Computer Engineering Hacettepe University 22

Linear Regression Week 2 Aysun Koçak k Nearest Neighbor(k-NN) Linear Regression 15 Note for Assignment Credit - Andrew Ng slides Dept. of Computer Engineering Hacettepe University 22

Linear Regression Week 2 Aysun Koçak k Nearest Neighbor(k-NN) Linear Regression 16 Note for Assignment Credit - Andrew Ng slides Dept. of Computer Engineering Hacettepe University 22

Linear Regression Week 2 Aysun Koçak k Nearest Neighbor(k-NN) Linear Regression 17 Note for Assignment Credit - Andrew Ng slides Dept. of Computer Engineering Hacettepe University 22

Linear Regression Week 2 Aysun Koçak k Nearest Neighbor(k-NN) Linear Regression 18 Note for Assignment Credit - Andrew Ng slides Dept. of Computer Engineering Hacettepe University 22

Linear Regression Week 2 Aysun Koçak k Nearest Neighbor(k-NN) Linear Regression 19 Note for Assignment OR Credit - Andrew Ng slides Dept. of Computer Engineering Hacettepe University 22

Linear Regression Week 2 Aysun Koçak k Nearest Neighbor(k-NN) Linear Regression 20 Note for Assignment Dept. of Computer Engineering Hacettepe University 22

Linear Regression Week 2 Aysun Koçak k Nearest Neighbor(k-NN) Linear Regression 21 Note for Assignment Dept. of Computer Engineering Hacettepe University 22

PCA Week 2 Aysun Koçak k Nearest Neighbor(k-NN) Linear Regression Note for Assignment 22 Dept. of Computer Engineering Hacettepe University 22