introduction to k means
play

Introduction to K- means Dmitriy (Dima) Gorenshteyn Sr. Data - PowerPoint PPT Presentation

Mar 13, 2024 •381 likes •878 views

DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Introduction to K- means Dmitriy (Dima) Gorenshteyn Sr. Data Scientist, Memorial Sloan Kettering Cancer Center DataCamp Cluster Analysis in R DataCamp Cluster Analysis in R DataCamp

  1. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Introduction to K- means Dmitriy (Dima) Gorenshteyn Sr. Data Scientist, Memorial Sloan Kettering Cancer Center

  2. DataCamp Cluster Analysis in R

  3. DataCamp Cluster Analysis in R

  4. DataCamp Cluster Analysis in R

  5. DataCamp Cluster Analysis in R

  6. DataCamp Cluster Analysis in R

  7. DataCamp Cluster Analysis in R

  8. DataCamp Cluster Analysis in R

  9. DataCamp Cluster Analysis in R

  10. DataCamp Cluster Analysis in R

  11. DataCamp Cluster Analysis in R

  12. DataCamp Cluster Analysis in R kmeans() print(lineup) x y 1 -1 1 2 -2 -3 3 8 6 4 7 -8 ... ... ... model <- kmeans(lineup, centers = 2)

  13. DataCamp Cluster Analysis in R Assigning Clusters print(model$cluster) [1] 1 1 2 2 1 1 1 2 2 2 1 2 lineup_clustered <- mutate(lineup, cluster = model$cluster) print(lineup_clustered) x y cluster <dbl> <dbl> <int> 1 -1 1 1 2 -2 -3 1 3 8 6 2 4 7 -8 2 ... ... ... ...

  14. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Let's practice!

  15. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Evaluating Different Values of K by Eye Dmitriy (Dima) Gorenshteyn Sr. Data Scientist, Memorial Sloan Kettering Cancer Center

  16. DataCamp Cluster Analysis in R T otal Within-Cluster Sum of Squares: k = 1

  17. DataCamp Cluster Analysis in R T otal Within-Cluster Sum of Squares: k = 2

  18. DataCamp Cluster Analysis in R T otal Within-Cluster Sum of Squares: k = 3

  19. DataCamp Cluster Analysis in R T otal Within-Cluster Sum of Squares: k = 4

  20. DataCamp Cluster Analysis in R Elbow Plot

  21. DataCamp Cluster Analysis in R Elbow Plot

  22. DataCamp Cluster Analysis in R Generating the Elbow Plot model <- kmeans(x = lineup, centers = 2) model$tot.withinss [1] 1434.5

  23. DataCamp Cluster Analysis in R Generating the Elbow Plot library(purrr) tot_withinss <- map_dbl(1:10, function(k){ model <- kmeans(x = lineup, centers = k) model$tot.withinss }) elbow_df <- data.frame( k = 1:10, tot_withinss = tot_withinss ) print(elbow_df) k tot_withinss 1 1 3489.9167 2 2 1434.5000 3 3 881.2500 4 4 637.2500 ... ... ...

  24. DataCamp Cluster Analysis in R Generating the Elbow Plot ggplot(elbow_df, aes(x = k, y = tot_withinss)) + geom_line() + scale_x_continuous(breaks = 1:10)

  25. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Let's practice!

  26. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Silhouette Analysis Dmitriy (Dima) Gorenshteyn Sr. Data Scientist, Memorial Sloan Kettering Cancer Center

  27. DataCamp Cluster Analysis in R Soccer Lineup with K = 3

  28. DataCamp Cluster Analysis in R Silhouette Width Within Cluster Distance: C(i) Closest Neighbor Distance: N(i)

  29. DataCamp Cluster Analysis in R Silhouette Width Within Cluster Distance: C(i) Closest Neighbor Distance: N(i)

  30. DataCamp Cluster Analysis in R Silhouette Width Within Cluster Distance: C(i) Closest Neighbor Distance: N(i)

  31. DataCamp Cluster Analysis in R Silhouette Width Within Cluster Distance: C(i) Closest Neighbor Distance: N(i)

  32. DataCamp Cluster Analysis in R Silhouette Width Within Cluster Distance: C(i) Closest Neighbor Distance: N(i)

  33. DataCamp Cluster Analysis in R Silhouette Width: S(i)

  34. DataCamp Cluster Analysis in R Silhouette Width: S(i) 1: Well matched to cluster 0: On border between two clusters -1: Better fit in neighboring cluster

  35. DataCamp Cluster Analysis in R Calculating S(i) library(cluster) pam_k3 <- pam(lineup, k = 3) pam_k3$silinfo$widths cluster neighbor sil_width 4 1 2 0.465320054 2 1 3 0.321729341 10 1 2 0.311385893 1 1 3 0.271890169 9 2 1 0.443606497 ... ... ... ...

  36. DataCamp Cluster Analysis in R Silhouette Plot sil_plot <- silhouette(pam_k3) plot(sil_plot)

  37. DataCamp Cluster Analysis in R Silhouette Plot sil_plot <- silhouette(pam_k3) plot(sil_plot)

  38. DataCamp Cluster Analysis in R Average Silhouette Width pam_k3$silinfo$avg.width [1] 0.353414 1: Well matched to each cluster 0: On border between clusters -1: Poorly matched to each cluster

  39. DataCamp Cluster Analysis in R Highest Average Silhouette Width library(purrr) sil_width <- map_dbl(2:10, function(k){ model <- pam(x = lineup, k = k) model$silinfo$avg.width }) sil_df <- data.frame( k = 2:10, sil_width = sil_width ) print(sil_df) k sil_width 1 2 0.4164141 2 3 0.3534140 3 4 0.3535534 4 5 0.3724115 ... ... ...

  40. DataCamp Cluster Analysis in R Choosing K Using Average Silhouette Width ggplot(sil_df, aes(x = k, y = sil_width)) + geom_line() + scale_x_continuous(breaks = 2:10)

  41. DataCamp Cluster Analysis in R Choosing K Using Average Silhouette Width ggplot(sil_df, aes(x = k, y = sil_width)) + geom_line() + scale_x_continuous(breaks = 2:10)

  42. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Let's practice!

  43. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Making Sense of the K- Means Clusters Dmitriy (Dima) Gorenshteyn Sr. Data Scientist, Memorial Sloan Kettering Cancer Center

  44. DataCamp Cluster Analysis in R Wholesale Dataset 45 observations print(customers_spend) Milk Grocery Frozen 1 11103 12469 902 3 features: 2 2013 6550 909 3 1897 5234 417 Milk Spending 4 1304 3643 3045 5 3199 6986 1455 ... ... ... ... Grocery Spending Frozen Food Spending

  45. DataCamp Cluster Analysis in R Segmenting with Hierarchical Clustering

  46. DataCamp Cluster Analysis in R Segmenting with Hierarchical Clustering cluster Milk Grocery Frozen cluster size 1 16950 12891 991 5 2 2512 5228 1795 29 3 10452 22550 1354 5 4 1249 3916 10888 6

  47. DataCamp Cluster Analysis in R Segmenting with K-means Estimate the "best" k using average silhouette width Run k-means with the suggested k Characterize the spending habits of these clusters of customers

  48. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Let's cluster!

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

K -means Clustering Ke Chen Reading: [7.3, EA], [9.1, CMB] COMP24111 Machine Learning Outline

K -means Clustering Ke Chen Reading: [7.3, EA], [9.1, CMB] COMP24111 Machine Learning Outline

K -means Clustering Ke Chen Reading: [7.3, EA], [9.1, CMB] COMP24111 Machine Learning Outline Introduction K -means Algorithm Example How K -means partitions? K -means Demo Relevant Issues Application:

416 views • 22 slides
Unsupervised learning D. Dubhashi D. Dubhashi Introduction Introduction Everything weve

Unsupervised learning D. Dubhashi D. Dubhashi Introduction Introduction Everything weve

Introduction Introduction Unsupervised learning D. Dubhashi D. Dubhashi Introduction Introduction Everything weve seen so far has been supervised K-means K-means TDA231 Kernel K-means Kernel K-means We were given a set of x n

550 views • 13 slides
Course 02402 Overview, Hypotheses Concerning Means Introduction to Statistics Motivating Example

Course 02402 Overview, Hypotheses Concerning Means Introduction to Statistics Motivating Example

Course 02402 Overview, Hypotheses Concerning Means Introduction to Statistics Motivating Example 1 Hypotheses and tests of these 2 Lecture 6: Chapter 7: Hypothesis Test for means One- or Two-Sided Alternative (one-sample setup), 7.4-7.6

567 views • 7 slides
Image Denoising Using Two-stage Non-local Means Enming Luo advisor: Truong Nguyen March 15,

Image Denoising Using Two-stage Non-local Means Enming Luo advisor: Truong Nguyen March 15,

Image Denoising Using Two-stage Non-local Means Enming Luo advisor: Truong Nguyen March 15, 2012 Outline 2 Introduction 1 Non-local Means 2 Two-stage Non-local Means 3 Simulation Results 4 Conclusion and Future Work 5 Introduction

354 views • 31 slides
1 K-means clustering The K-means clustering algorithm can be seen as applying the EM algorithm to

1 K-means clustering The K-means clustering algorithm can be seen as applying the EM algorithm to

Statistical Modeling and Analysis of Neural Data (NEU 560) Princeton University, Spring 2018 Jonathan Pillow Lecture 18 notes: K-means and Factor Analysis Tues, 4.17 1 K-means clustering The K-means clustering algorithm can be seen as

547 views • 3 slides
CLUSTER ANALYSIS WITH K-MEANS What about the details ? Maurice ROUX Ex-Professor Paul Cezanne

CLUSTER ANALYSIS WITH K-MEANS What about the details ? Maurice ROUX Ex-Professor Paul Cezanne

CLUSTER ANALYSIS WITH K-MEANS What about the details ? Maurice ROUX Ex-Professor Paul Cezanne University Marseille, France mrhroux@yahoo.fr K-means: what about the details ? Introduction k-means type algorithms are very popular

1.11k views • 55 slides
Contents Clustering K-means Mixture of Gaussians Expectation Maximization

Contents Clustering K-means Mixture of Gaussians Expectation Maximization

Contents Clustering K-means Mixture of Gaussians Expectation Maximization Variational Methods 1 Introduction to Machine Learning CMU-10701 Clustering and EM Barnabs Pczos &amp; Aarti Singh Clustering 3 K- means

1.04k views • 67 slides
K-means:

K-means:

K-means: Means Business Jus/n Talbot,Lei Hu K-means

322 views • 15 slides
Lecture 23/Chapter 19 Diversity of Sample Means Means versus Proportions Behavior of

Lecture 23/Chapter 19 Diversity of Sample Means Means versus Proportions Behavior of

Lecture 23/Chapter 19 Diversity of Sample Means Means versus Proportions Behavior of Sample Means: Example Behavior of Sample Means: Conditions Behavior of Sample Means: Rules Approach to Inference Step 1 (Chapter 19): Work

357 views • 22 slides
Review of Last Time |= means logically follows |- i means can be derived from

Review of Last Time |= means logically follows |- i means can be derived from

Review of Last Time |= means logically follows |- i means can be derived from CS 331: Artificial Intelligence If your inference algorithm derives only Propositional Logic 2 things that follow logically from the KB, the

89 views • 5 slides
Data Clustering: Data Clustering: 50 Years Beyond K means 50 Years Beyond K means 50 Years

Data Clustering: Data Clustering: 50 Years Beyond K means 50 Years Beyond K means 50 Years

Data Clustering: Data Clustering: 50 Years Beyond K means 50 Years Beyond K means 50 Years Beyond K-means 50 Years Beyond K-means Anil K. Jain Department of Computer Science Michigan State University King-Sun Fu King-Sun Fu King-Sun

1.03k views • 39 slides
O. Kosmachev INTRODUCTION Necessity of conversion to axiomatics. What means axiomatic-like

O. Kosmachev INTRODUCTION Necessity of conversion to axiomatics. What means axiomatic-like

THE LEPTON SECTOR AS AN AXIOMATIC-LIKE CONSTRUCTION O. Kosmachev INTRODUCTION Necessity of conversion to axiomatics. What means axiomatic-like construction? Unique approach and unification of mathematical formalism. STABLE LEPTONS

164 views • 15 slides
A What is |A|? B Solution: 0 3x+4 1000 iff -4/3 x 996/3 a 1 injection

A What is |A|? B Solution: 0 3x+4 1000 iff -4/3 x 996/3 a 1 injection

Section 2.4: Countability a 1 We can compare the cardinality of two sets. |A| = |B| means there is a bijection b bijection 2 between A and B. c 3 |A| |B| means there is an injection from A to B. d 4 |A| &lt; |B| means |A| |B|

547 views • 15 slides
Sustainable Ocean. Innovation means to come up with new ideas. Sustainable means to keep

Sustainable Ocean. Innovation means to come up with new ideas. Sustainable means to keep

World Oceans Day is held on 8 th June each year. This years theme is Innovation for a Sustainable Ocean. Innovation means to come up with new ideas. Sustainable means to keep something going. Did You Know? 70% of the Earths surface is

295 views • 10 slides
1 Introduction Introduction Communication System Baseband an adjective that describes

1 Introduction Introduction Communication System Baseband an adjective that describes

Introduction Introduction Physical Layer Mobile network Global ISP Provides the means to transmit bits Basic Concepts of from sender to receiver, Data Transmission Defines the mechanical, electrical, and Home network timing

463 views • 7 slides
11/11/2014 Chapter 22 INFERENCES ABOUT MEANS 1 SAMPLING DISTRIBUTION FOR MEANS Recall, the

11/11/2014 Chapter 22 INFERENCES ABOUT MEANS 1 SAMPLING DISTRIBUTION FOR MEANS Recall, the

11/11/2014 Chapter 22 INFERENCES ABOUT MEANS 1 SAMPLING DISTRIBUTION FOR MEANS Recall, the Central Limit Theorem told us the sampling distribution for means , N n What if we dont know ? 2

428 views • 4 slides
Administrative notes October 26, 2017 Well do some In the News Groupwork today

Administrative notes October 26, 2017 Well do some In the News Groupwork today

Administrative notes October 26, 2017 Well do some In the News Groupwork today Reminder: my office hours for this Friday are cancelled Reminder: optional project proposal resubmission deadline extension now due tomorrow

813 views • 36 slides
Anonymization Algorithms - Microaggregation and Clustering Li Xiong CS573 Data Privacy and

Anonymization Algorithms - Microaggregation and Clustering Li Xiong CS573 Data Privacy and

Anonymization Algorithms - Microaggregation and Clustering Li Xiong CS573 Data Privacy and Anonymity Anonymization using Microaggregation or Clustering Practical Data-Oriented Microaggregation for Statistical Disclosure Control,

902 views • 55 slides
Abstracting and Coding Boot Camp: Webinar Series Cancer Case Scenarios NAACCR 20152016

Abstracting and Coding Boot Camp: Webinar Series Cancer Case Scenarios NAACCR 20152016

2/23/2017 NAACC R 2015- 2016 Abstracting and Coding Boot Camp: Webinar Series Cancer Case Scenarios NAACCR 20152016 Webinar Series Presented by: Angela Martin amartin@naaccr.org Jim Hofferkamp jhofferkamp@naaccr.org Q&amp;A Please

679 views • 18 slides
Convex Biclustering Eric Chi Rice University joint work with Genevera Allen and Rich Baraniuk

Convex Biclustering Eric Chi Rice University joint work with Genevera Allen and Rich Baraniuk

Convex Biclustering Eric Chi Rice University joint work with Genevera Allen and Rich Baraniuk E. Chi Convex Biclustering 1 The Biclustering Problem Task Given a data matrix X R p n , find subgroups of rows &amp; columns that go

888 views • 54 slides
LIFE SCIENCES IN PARIS REGION PARIS AREA : FIRST EUROPEAN REGION IN THE FIELD OF LIFE SCIENCE AND

LIFE SCIENCES IN PARIS REGION PARIS AREA : FIRST EUROPEAN REGION IN THE FIELD OF LIFE SCIENCE AND

LIFE SCIENCES IN PARIS REGION PARIS AREA : FIRST EUROPEAN REGION IN THE FIELD OF LIFE SCIENCE AND HEALTH % of GDP allocated to R&amp;D 3.1% Total private R&amp;D investment Bn 11.3 Total public R&amp;D investment Bn

422 views • 18 slides
Clustering and information visualization Samuel Kaski University of Helsinki Department of

Clustering and information visualization Samuel Kaski University of Helsinki Department of

Data analysis for gene expression, Fall 2004 Clustering and information visualization Samuel Kaski University of Helsinki Department of Computer Science http://www.cs.helsinki.fi/ S. Kaski Material A.K. Jain, M.N. Murty and P.J. Flynn. Data

901 views • 40 slides
Data Mining in Bioinformatics Day 7: Clustering in Bioinformatics Karsten Borgwardt February 21

Data Mining in Bioinformatics Day 7: Clustering in Bioinformatics Karsten Borgwardt February 21

Data Mining in Bioinformatics Day 7: Clustering in Bioinformatics Karsten Borgwardt February 21 to March 4, 2011 Machine Learning &amp; Computational Biology Research Group MPIs Tbingen Karsten Borgwardt: Data Mining in Bioinformatics, Page

618 views • 24 slides
Co-manifold learning with missing data Gal Mishne, Eric C. Chi and Ronald R. Coifman Department

Co-manifold learning with missing data Gal Mishne, Eric C. Chi and Ronald R. Coifman Department

Co-manifold learning with missing data Gal Mishne, Eric C. Chi and Ronald R. Coifman Department of Mathematics, Yale University Department of Statistics, North Carolina State University June 12, 2019 Gal Mishne (Yale) Co-Manifold Learning

556 views • 17 slides

More recommend