Week 2 RA : Aysun Koak Instructor : Dr. Aykut Erdem Department of - - PowerPoint PPT Presentation

▶
week 2
SMART_READER_LITE
LIVE PREVIEW

Week 2 RA : Aysun Koak Instructor : Dr. Aykut Erdem Department of - - PowerPoint PPT Presentation

Oct 16, 2023 162 likes •394 views

Week 2 RA : Aysun Koak Instructor : Dr. Aykut Erdem Department of Computer Engineering Hacettepe University Outline Week 2 Aysun Koak k Nearest Neighbor(k-NN) Linear Regression Note for Assignment k Nearest Neighbor(k-NN) Linear

slide-1
SLIDE 1

Week 2

RA : Aysun Koçak Instructor : Dr. Aykut Erdem

Department of Computer Engineering Hacettepe University

slide-2
SLIDE 2

22

Week 2 Aysun Koçak k Nearest Neighbor(k-NN) Linear Regression Note for Assignment

  • Dept. of Computer

Engineering Hacettepe University

Outline

k Nearest Neighbor(k-NN) Linear Regression Note for Assignment

slide-3
SLIDE 3

22

Week 2 Aysun Koçak

2

k Nearest Neighbor(k-NN) Linear Regression Note for Assignment

  • Dept. of Computer

Engineering Hacettepe University

k-Nearest Neighbor(k-NN)

◮ Nonparametric algorithm ◮ To classify a new point, find its K nearest neighbors from the

training data.

credit - Siddharth Deokar slides

slide-4
SLIDE 4

22

Week 2 Aysun Koçak

3

k Nearest Neighbor(k-NN) Linear Regression Note for Assignment

  • Dept. of Computer

Engineering Hacettepe University

Code

http://scikit-learn.org/stable/auto_examples/neighbors/plot_classification.html

slide-5
SLIDE 5

22

Week 2 Aysun Koçak

4

k Nearest Neighbor(k-NN) Linear Regression Note for Assignment

  • Dept. of Computer

Engineering Hacettepe University

k-NN Results

slide-6
SLIDE 6

22

Week 2 Aysun Koçak

5

k Nearest Neighbor(k-NN) Linear Regression Note for Assignment

  • Dept. of Computer

Engineering Hacettepe University

Drawbacks

◮ Keep all data to classify a new input ◮ All neighbors have same importance ◮ Determining hyper-parameters

◮ What is the best distance to use? ◮ What is the best value of k to use?

◮ Distance usually relates to all the attributes and assumes all of

them have the same effects on distance(curse of dimensionality)

slide-7
SLIDE 7

22

Week 2 Aysun Koçak

6

k Nearest Neighbor(k-NN) Linear Regression Note for Assignment

  • Dept. of Computer

Engineering Hacettepe University

Determining Parameters

Credit - Fei-Fei Li & Andrej Karpathy slides

slide-8
SLIDE 8

22

Week 2 Aysun Koçak

7

k Nearest Neighbor(k-NN) Linear Regression Note for Assignment

  • Dept. of Computer

Engineering Hacettepe University

Determining Parameters

Accuracy = (# of correctly classified examples / # of examples) X 100

Credit - Fei-Fei Li & Andrej Karpathy slides

slide-9
SLIDE 9

22

Week 2 Aysun Koçak k Nearest Neighbor(k-NN)

8

Linear Regression Note for Assignment

  • Dept. of Computer

Engineering Hacettepe University

Linear Regression

Credit - Andrew Ng slides

slide-10
SLIDE 10

22

Week 2 Aysun Koçak k Nearest Neighbor(k-NN)

9

Linear Regression Note for Assignment

  • Dept. of Computer

Engineering Hacettepe University

Linear Regression

Credit - Andrew Ng slides

slide-11
SLIDE 11

22

Week 2 Aysun Koçak k Nearest Neighbor(k-NN)

10

Linear Regression Note for Assignment

  • Dept. of Computer

Engineering Hacettepe University

Linear Regression

Credit - Andrew Ng slides

slide-12
SLIDE 12

22

Week 2 Aysun Koçak k Nearest Neighbor(k-NN)

11

Linear Regression Note for Assignment

  • Dept. of Computer

Engineering Hacettepe University

Linear Regression

Credit - Andrew Ng slides

slide-13
SLIDE 13

22

Week 2 Aysun Koçak k Nearest Neighbor(k-NN)

12

Linear Regression Note for Assignment

  • Dept. of Computer

Engineering Hacettepe University

Linear Regression

Credit - Andrew Ng slides

slide-14
SLIDE 14

22

Week 2 Aysun Koçak k Nearest Neighbor(k-NN)

13

Linear Regression Note for Assignment

  • Dept. of Computer

Engineering Hacettepe University

Linear Regression

Credit - Andrew Ng slides

slide-15
SLIDE 15

22

Week 2 Aysun Koçak k Nearest Neighbor(k-NN)

14

Linear Regression Note for Assignment

  • Dept. of Computer

Engineering Hacettepe University

Linear Regression

Credit - Andrew Ng slides

slide-16
SLIDE 16

22

Week 2 Aysun Koçak k Nearest Neighbor(k-NN)

15

Linear Regression Note for Assignment

  • Dept. of Computer

Engineering Hacettepe University

Linear Regression

Credit - Andrew Ng slides

slide-17
SLIDE 17

22

Week 2 Aysun Koçak k Nearest Neighbor(k-NN)

16

Linear Regression Note for Assignment

  • Dept. of Computer

Engineering Hacettepe University

Linear Regression

Credit - Andrew Ng slides

slide-18
SLIDE 18

22

Week 2 Aysun Koçak k Nearest Neighbor(k-NN)

17

Linear Regression Note for Assignment

  • Dept. of Computer

Engineering Hacettepe University

Linear Regression

Credit - Andrew Ng slides

slide-19
SLIDE 19

22

Week 2 Aysun Koçak k Nearest Neighbor(k-NN)

18

Linear Regression Note for Assignment

  • Dept. of Computer

Engineering Hacettepe University

Linear Regression

Credit - Andrew Ng slides

slide-20
SLIDE 20

22

Week 2 Aysun Koçak k Nearest Neighbor(k-NN)

19

Linear Regression Note for Assignment

  • Dept. of Computer

Engineering Hacettepe University

Linear Regression

OR

Credit - Andrew Ng slides

slide-21
SLIDE 21

22

Week 2 Aysun Koçak k Nearest Neighbor(k-NN)

20

Linear Regression Note for Assignment

  • Dept. of Computer

Engineering Hacettepe University

Linear Regression

slide-22
SLIDE 22

22

Week 2 Aysun Koçak k Nearest Neighbor(k-NN)

21

Linear Regression Note for Assignment

  • Dept. of Computer

Engineering Hacettepe University

Linear Regression

slide-23
SLIDE 23

22

Week 2 Aysun Koçak k Nearest Neighbor(k-NN) Linear Regression

22

Note for Assignment

  • Dept. of Computer

Engineering Hacettepe University

PCA