what is cluster analysis
play

What is Cluster Analysis? Dmitriy (Dima) Gorenshteyn Sr. Data - PowerPoint PPT Presentation

Sep 08, 2023 •1.65k likes •2.23k views

DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R What is Cluster Analysis? Dmitriy (Dima) Gorenshteyn Sr. Data Scientist, Memorial Sloan Kettering Cancer Center DataCamp Cluster Analysis in R What is Clustering? DataCamp Cluster

  1. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R What is Cluster Analysis? Dmitriy (Dima) Gorenshteyn Sr. Data Scientist, Memorial Sloan Kettering Cancer Center

  2. DataCamp Cluster Analysis in R What is Clustering?

  3. DataCamp Cluster Analysis in R What is Clustering?

  4. DataCamp Cluster Analysis in R What is Clustering?

  5. DataCamp Cluster Analysis in R What is Clustering?

  6. DataCamp Cluster Analysis in R What is Clustering?

  7. DataCamp Cluster Analysis in R What is Clustering?

  8. DataCamp Cluster Analysis in R What is Clustering?

  9. DataCamp Cluster Analysis in R What is Clustering?

  10. DataCamp Cluster Analysis in R What is Clustering? A form of exploratory data analysis ( EDA ) where observations are divided into meaningful groups that share common characteristics ( features ).

  11. DataCamp Cluster Analysis in R The Flow of Cluster Analysis

  12. DataCamp Cluster Analysis in R The Flow of Cluster Analysis

  13. DataCamp Cluster Analysis in R The Flow of Cluster Analysis

  14. DataCamp Cluster Analysis in R The Flow of Cluster Analysis

  15. DataCamp Cluster Analysis in R The Flow of Cluster Analysis

  16. DataCamp Cluster Analysis in R Structure of This Course

  17. DataCamp Cluster Analysis in R Structure of This Course

  18. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Let's Learn!

  19. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Distance Between Two Observations Dmitriy (Dima) Gorenshteyn Sr. Data Scientist, Memorial Sloan Kettering Cancer Center

  20. DataCamp Cluster Analysis in R Distance vs Similarity

  21. DataCamp Cluster Analysis in R Distance vs Similarity DISTANCE = 1 − SIMILARITY

  22. DataCamp Cluster Analysis in R Distance Between T wo Players

  23. DataCamp Cluster Analysis in R Distance Between T wo Players

  24. DataCamp Cluster Analysis in R Distance Between T wo Players

  25. DataCamp Cluster Analysis in R Distance Between T wo Players

  26. DataCamp Cluster Analysis in R Distance Between T wo Players

  27. DataCamp Cluster Analysis in R Distance Between T wo Players

  28. DataCamp Cluster Analysis in R Distance Between T wo Players

  29. DataCamp Cluster Analysis in R Distance Between T wo Players

  30. DataCamp Cluster Analysis in R Distance Between T wo Players

  31. DataCamp Cluster Analysis in R dist() Function print(two_players) X Y BLUE 0 0 RED 9 12 dist(two_players, method = 'euclidean') BLUE RED 15

  32. DataCamp Cluster Analysis in R More than 2 Observations print(three_players) X Y BLUE 0 0 RED 9 12 GREEN -2 19 dist(three_players) BLUE RED RED 15.00000 GREEN 19.10497 13.03840

  33. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Let's practice!

  34. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R The Scales of Your Features Dmitriy (Dima) Gorenshteyn Sr. Data Scientist, Memorial Sloan Kettering Cancer Center

  35. DataCamp Cluster Analysis in R Distance Between Individuals Observation Height (feet) Weight (lbs) 1 6.0 200 2 6.0 202 3 8.0 200 ... ... ... ... ... ...

  36. DataCamp Cluster Analysis in R

  37. DataCamp Cluster Analysis in R

  38. DataCamp Cluster Analysis in R

  39. DataCamp Cluster Analysis in R

  40. DataCamp Cluster Analysis in R

  41. DataCamp Cluster Analysis in R Scaling our Features height − mean ( height ) = height scaled sd ( height )

  42. DataCamp Cluster Analysis in R

  43. DataCamp Cluster Analysis in R

  44. DataCamp Cluster Analysis in R scale() function print(height_weight) Height Weight 1 6 200 2 6 202 3 8 200 ... ... ... scale(height_weight) Height Weight 1 0.60 0.67 2 0.60 0.73 3 11.3 0.67 ... ... ...

  45. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Let's practice!

  46. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Measuring Distance For Categorical Data Dmitriy (Dima) Gorenshteyn Sr. Data Scientist, Memorial Sloan Kettering Cancer Center

  47. DataCamp Cluster Analysis in R Binary Data wine beer whiskey vodka 1 TRUE TRUE FALSE FALSE 2 FALSE TRUE TRUE TRUE ... ... ... ... ...

  48. DataCamp Cluster Analysis in R Jaccard Index A ∩ B J ( A , B ) = A ∪ B

  49. DataCamp Cluster Analysis in R Calculating Jaccard Distance wine beer whiskey vodka 1 TRUE TRUE FALSE FALSE 2 FALSE TRUE TRUE TRUE 1 ∩ 2 1 J (1, 2) = = = 0.25 1 ∪ 2 4 Distance (1, 2) = 1 − J (1, 2) = 0.75

  50. DataCamp Cluster Analysis in R Calculating Jaccard Distance in R print(survey_a) wine beer whiskey vodka <lgl> <lgl> <lgl> <lgl> 1 TRUE TRUE FALSE FALSE 2 FALSE TRUE TRUE TRUE 3 TRUE FALSE TRUE FALSE dist(survey_a, method = "binary") 1 2 2 0.7500000 3 0.6666667 0.7500000

  51. DataCamp Cluster Analysis in R More Than T wo Categories color sport colorblue colorgreen colorred sporthockey sportsoccer 1 red soccer 1 0 0 1 0 1 2 green hockey 2 0 1 0 1 0 3 blue hockey 3 1 0 0 1 0 4 blue soccer 4 1 0 0 0 1 ... ... ... ... ... ... ... ... ...

  52. DataCamp Cluster Analysis in R Dummification in R print(survey_b) color sport 1 red soccer 2 green hockey 3 blue hockey 4 blue soccer library(dummies) dummy.data.frame(survey_b) colorblue colorgreen colorred sporthockey sportsoccer 1 0 0 1 0 1 2 0 1 0 1 0 3 1 0 0 1 0 4 1 0 0 0 1

  53. DataCamp Cluster Analysis in R Generalizing Categorical Distance in R print(survey_b) color sport 1 red soccer 2 green hockey 3 blue hockey 4 blue soccer dummy_survey_b <- dummy.data.frame(survey_b) dist(dummy_survey_b, method = 'binary') 1 2 3 2 1.0000000 3 1.0000000 0.6666667 4 0.6666667 1.0000000 0.6666667

  54. DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Let's practice!

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Kmean Cluster Analysis 1 Learning Objectives Understanding the kmean cluster analysis

Kmean Cluster Analysis 1 Learning Objectives Understanding the kmean cluster analysis

Kmean Cluster Analysis 1 Learning Objectives Understanding the kmean cluster analysis procedure. Understanding the methods used to determine the optimal number of clusters. Managing data for the sake of conducting cluster analysis.

1.1k views • 80 slides
Introduction to Graph Cluster Analysis Outline Introduction to Cluster Analysis Types of

Introduction to Graph Cluster Analysis Outline Introduction to Cluster Analysis Types of

Introduction to Graph Cluster Analysis Outline Introduction to Cluster Analysis Types of Graph Cluster Analysis Algorithms for Graph Clustering k-Spanning Tree Shared Nearest Neighbor Betweenness Centrality Based Highly

836 views • 48 slides
CLUSTER ANALYSIS Agenda Introduction to cluster analysis and application Feature

CLUSTER ANALYSIS Agenda Introduction to cluster analysis and application Feature

CLUSTER ANALYSIS Agenda Introduction to cluster analysis and application Feature Selection for Clustering Clustering Algorithm DBScan Cluster Validation Introduction Clustering is the partitioning of large

593 views • 21 slides
What is Cluster Analysis? Cluster: a collection of data objects Similar to one another

What is Cluster Analysis? Cluster: a collection of data objects Similar to one another

What is Cluster Analysis? Cluster: a collection of data objects Similar to one another within the same cluster Dissimilar to the objects in other clusters Cluster analysis Grouping a set of data objects into clusters

1.16k views • 77 slides
Stability of Cluster Analysis 2. Preparation of the data 3. Distance measure used S T A T I S

Stability of Cluster Analysis 2. Preparation of the data 3. Distance measure used S T A T I S

Stability of Cluster Analysis For real data sets without obvious grouping structure the stability of clusters depends on: 1. Input data - the selection of variables Stability of Cluster Analysis 2. Preparation of the data 3. Distance measure

384 views • 4 slides
Data Mining Techniques: Cluster Analysis Mirek Riedewald Many slides based on presentations by

Data Mining Techniques: Cluster Analysis Mirek Riedewald Many slides based on presentations by

Data Mining Techniques: Cluster Analysis Mirek Riedewald Many slides based on presentations by Han/Kamber, Tan/Steinbach/Kumar, and Andrew Moore Cluster Analysis Overview Introduction Foundations: Measuring Distance (Similarity)

903 views • 55 slides
Data Mining Techniques: Partitioning Methods: K-Means Cluster Analysis Hierarchical

Data Mining Techniques: Partitioning Methods: K-Means Cluster Analysis Hierarchical

Cluster Analysis Overview Introduction Foundations: Measuring Distance (Similarity) Data Mining Techniques: Partitioning Methods: K-Means Cluster Analysis Hierarchical Methods Mirek Riedewald Density-Based Methods Many slides

487 views • 19 slides
Clustering Data Mining: Concepts and October 18, 2019 Techniques 1 Chapter 8. Cluster Analysis

Clustering Data Mining: Concepts and October 18, 2019 Techniques 1 Chapter 8. Cluster Analysis

Clustering Data Mining: Concepts and October 18, 2019 Techniques 1 Chapter 8. Cluster Analysis What is Cluster Analysis? Types of Data in Cluster Analysis A Categorization of Major Clustering Methods Partitioning Methods

893 views • 32 slides
Evaluating clustering Introduction to cluster analysis and classifjcation: publics ou privs.

Evaluating clustering Introduction to cluster analysis and classifjcation: publics ou privs.

HAL Id: hal-01810377 scientifjques de niveau recherche, publis ou non, mer School on Clustering, Data Analysis and Visualization of Complex Data, May 2018, Catania, Christophe Biernacki. Introduction to cluster analysis and classifjcation:

985 views • 67 slides
Bi-clustering and co-clustering Going further in cluster analysis and classifjcation: publics ou

Bi-clustering and co-clustering Going further in cluster analysis and classifjcation: publics ou

HAL Id: hal-01810380 manant des tablissements denseignement et de Summer School on Clustering, Data Analysis and Visualization of Complex Data, May 2018, Catania, Going further in cluster analysis and classifjcation: Bi-clustering and

1.23k views • 67 slides
Introduction to K- means Dmitriy (Dima) Gorenshteyn Sr. Data Scientist, Memorial Sloan

Introduction to K- means Dmitriy (Dima) Gorenshteyn Sr. Data Scientist, Memorial Sloan

DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Introduction to K- means Dmitriy (Dima) Gorenshteyn Sr. Data Scientist, Memorial Sloan Kettering Cancer Center DataCamp Cluster Analysis in R DataCamp Cluster Analysis in R DataCamp

878 views • 48 slides
CS6220: DATA MINING TECHNIQUES Chapter 10: Cluster Analysis: Basic Concepts and Methods

CS6220: DATA MINING TECHNIQUES Chapter 10: Cluster Analysis: Basic Concepts and Methods

CS6220: DATA MINING TECHNIQUES Chapter 10: Cluster Analysis: Basic Concepts and Methods Instructor: Yizhou Sun yzsun@ccs.neu.edu April 2, 2013 Chapter 10. Cluster Analysis: Basic Concepts and Methods Cluster Analysis: Basic Concepts

1.08k views • 86 slides
Network Traffic Analysis &amp; Cluster Analysis Exploring Hadoop Clusters using Free Tools

Network Traffic Analysis &amp; Cluster Analysis Exploring Hadoop Clusters using Free Tools

Network Traffic Analysis &amp; Cluster Analysis Exploring Hadoop Clusters using Free Tools Background and Goals: Apache Spot was started recently DNS, Netflow, PCAP data is analyzed The goal is to identify: suspicous

644 views • 19 slides
Comparing More than Two Observations Dmitriy Gorenshteyn Sr. Data Scientist, Memorial Sloan

Comparing More than Two Observations Dmitriy Gorenshteyn Sr. Data Scientist, Memorial Sloan

DataCamp Cluster Analysis in R CLUSTER ANALYSIS IN R Comparing More than Two Observations Dmitriy Gorenshteyn Sr. Data Scientist, Memorial Sloan Kettering Cancer Center DataCamp Cluster Analysis in R The Closest Observation to a Pair Is 2

764 views • 59 slides
Classification method in single particle analysis Cluster Analysis Pawel A. Penczek

Classification method in single particle analysis Cluster Analysis Pawel A. Penczek

Classification method in single particle analysis Cluster Analysis Pawel A. Penczek Pawel.A.Penczek@uth.tmc.edu The University of Texas Houston Medical School Overview Background Hierarchical Methods K -Means Clustering in

780 views • 62 slides
Cluster Analysis This lab will demonstrate how to perform the following in Python:

Cluster Analysis This lab will demonstrate how to perform the following in Python:

Cluster Analysis This lab will demonstrate how to perform the following in Python: Hierarchical clustering K-means clustering Internal validation methods Elbow plots Silhouette analysis External validation

1.42k views • 8 slides
The Statistical Machine Translation System of the University of Edinburgh Philipp Koehn

The Statistical Machine Translation System of the University of Edinburgh Philipp Koehn

The Statistical Machine Translation System of the University of Edinburgh Philipp Koehn pkoehn@inf.ed.ac.uk School of Informatics University of Edinburgh p.1 The Statistical Machine Translation System of the

760 views • 19 slides
MariaDB MySQL Corrected Michael Monty Widenius About Monty Original author of MySQL

MariaDB MySQL Corrected Michael Monty Widenius About Monty Original author of MySQL

MariaDB MySQL Corrected Michael Monty Widenius About Monty Original author of MySQL Co-Founder of MySQL Ab (with David Axmark and Allan Larsson) Founder of Monty Program Ab Swedish-Finn Purveyor of salmiakkikossu and

707 views • 32 slides
Fast gradient descent for drifting least squares regression: Non-asymptotic bounds and application

Fast gradient descent for drifting least squares regression: Non-asymptotic bounds and application

Fast gradient descent for drifting least squares regression: Non-asymptotic bounds and application to bandits Prashanth L A Joint work with Nathaniel Korda and R emi Munos INRIA Lille - Team SequeL MLRG - Oxford University

1.42k views • 73 slides
Research In Context Adriana Kovashka Assistant Professor, Dept of Computer Science University of

Research In Context Adriana Kovashka Assistant Professor, Dept of Computer Science University of

Research In Context Adriana Kovashka Assistant Professor, Dept of Computer Science University of Pittsburgh Good Citizen of CVPR Workshop 2018 What context? Fact: We do research to understand images automatically. Context: Where does

260 views • 12 slides
Title: Historical notes AIMA: Chapter 1 1 Introduction to Artificial Intelligence

Title: Historical notes AIMA: Chapter 1 1 Introduction to Artificial Intelligence

B.Y. Choueiry Title: Historical notes AIMA: Chapter 1 1 Introduction to Artificial Intelligence CSCE 476-876, Fall 2020 URL: www.cse.unl.edu/~choueiry/F20-476-876 Instructors notes #2 Berthe Y. Choueiry (Shu-we-ri) August 19,

705 views • 5 slides
Introduction + Information Theory LING 572 January 7, 2020 Shane Steinert-Threlkeld Adapted

Introduction + Information Theory LING 572 January 7, 2020 Shane Steinert-Threlkeld Adapted

Introduction + Information Theory LING 572 January 7, 2020 Shane Steinert-Threlkeld Adapted from F. Xia, 17 1 Outline Background General course information Course contents Information Theory 2 Early NLP Early

1.21k views • 77 slides
CSE 473 Artificial Intelligence (AI) Rajesh Rao (Instructor) Yi-Shu Wei (TA) Hunter Whalen (TA)

CSE 473 Artificial Intelligence (AI) Rajesh Rao (Instructor) Yi-Shu Wei (TA) Hunter Whalen (TA)

CSE 473 Artificial Intelligence (AI) Rajesh Rao (Instructor) Yi-Shu Wei (TA) Hunter Whalen (TA) http://www.cs.washington.edu/473 Based on slides by UW CSE AI faculty, Dan Klein, Stuart Russell, Andrew Moore Outline Goals of this course

1.13k views • 31 slides
Session 5 Programming Paradigms Sbastien Combfis Fall 2019 This work is licensed under a

Session 5 Programming Paradigms Sbastien Combfis Fall 2019 This work is licensed under a

I402A Software Architecture and Quality Assessment Session 5 Programming Paradigms Sbastien Combfis Fall 2019 This work is licensed under a Creative Commons Attribution NonCommercial NoDerivatives 4.0 International License.

1.15k views • 48 slides

More recommend