Interactive Clustering Barna Saha Clustering Learning over Noisy - PowerPoint PPT Presentation

Jun 23, 2023 •183 likes •322 views

Interactive Clustering Barna Saha Clustering Learning over Noisy Data Learn a classifier or find clusters over noisy/uncertain data Noise comes from using similarity func5onsadd an edge between two images if they represent the same

Interactive Clustering Barna Saha
Clustering
Learning over Noisy Data Learn a classifier or find clusters over noisy/uncertain data Noise comes from using similarity func5ons—add an edge between two images if they represent the same monument—clusters could be erroneous
Learning over Noisy Data Learn a classifier or find clusters over noisy/uncertain data Noise comes from inherent data errors/missing a?ributes—clustering collabora5on network • Learn a classifier or do clustering over noisy/uncertain data obtained from DBLP could be erroneous.
Further Applications • Linking Census Records • Public Health • Web search • Comparison shopping • Spam Detec5on • Machine Reading • IP Aliasing • ……..
Query complexity of optimal strategy?
Query complexity of optimal strategy? Davidson, Khanna, Milo, Roy, 2014
Faulty Oracle
Faulty Oracle Repeat the same ques5on. Assuming p=q, repeat each ques5on (say) 24log n/(1-2p) 2 5mes
Faulty Oracle
Faulty Oracle: No Resampling • Find seed nodes for each cluster • If we can find 24 log n/(1-2p) 2 seed nodes from each cluster then we are done! [Why?] ……………….. …..
Faulty Oracle: How to Cind seed nodes? • Let N=O(k 2 log n/(1-2p) 4 ) • Select N nodes and ask all possible pairwise queries among these nodes. • Run correla5on clustering algorithm in this small set of nodes • Each cluster returned by the correla5on clustering that has size at least 24 log n/(1-2p) 2 act as a seed
Faulty Oracle: How to Cind seed nodes? • Let N=O(k 2 log n/(1-2p) 4 ) • Select N nodes and ask all possible pairwise queries among these nodes. • Run correla5on clustering algorithm in this small set of nodes • Each cluster returned by the correla5on clustering that has size at least 24 log n/(1-2p) 2 act as a seed Some intui5on on the analysis: If we know all the query results, correla5on clustering gives the maximum likelihood es5mator. Moreover, it is an instance of correla5on clustering where errors are random— we know how to solve it!

Download Presentation

Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Lecture 23: Spectral clustering Hierarchical clustering What is a good clustering?

Lecture 23: Spectral clustering Hierarchical clustering What is a good clustering? Aykut Erdem May 2016 Hacettepe University Last time K-Means An iterative clustering algorithm - Initialize: Pick K random points as cluster

932 views • 64 slides

Clustering Hierarchical clustering, k-mean clustering Genome 559: Introduction to Statistical and

Clustering Hierarchical clustering, k-mean clustering Genome 559: Introduction to Statistical and Computational Genomics Elhanan Borenstein A quick review The clustering problem: partition genes into distinct sets with high homogeneity

772 views • 40 slides

Graph Clustering Graph Clustering What is clustering? What is clustering? Finding patterns

Graph Clustering Graph Clustering What is clustering? What is clustering? Finding patterns in data, or grouping similar groups of data-points together into clusters . Clustering algorithms for numeric data: Lloyds K-means, EM

688 views • 19 slides

Clustering Hierarchical clustering and k-mean clustering Genome 373 Genomic Informatics

Clustering Hierarchical clustering and k-mean clustering Genome 373 Genomic Informatics Elhanan Borenstein A quick review The clustering problem: partition genes into distinct sets with high homogeneity and high separation Many

768 views • 43 slides

Clustering methods R.W. Oldford Interactive data visualization An important advantage of data

Clustering methods R.W. Oldford Interactive data visualization An important advantage of data visualization is that much structure (e.g. density, groupings, regular patterns, relationships, outliers, connections across dimensions, etc.) can be

933 views • 49 slides

Clustering methods R.W. Oldford Interactive data visualization An important advantage of data

851 views • 53 slides

Clustering DSE 210 Clustering in R d Two common uses of clustering: Vector quantization Find

Clustering DSE 210 Clustering in R d Two common uses of clustering: Vector quantization Find a finite set of representatives that provides good coverage of a complex, possibly infinite, high-dimensional space. Finding meaningful

396 views • 36 slides

Clustering: Hierarchical Clustering and K- Means Clustering Machine

Clustering: Hierarchical Clustering and K- Means Clustering Machine Learning 10-601B Seyoung Kim Many of these slides are derived from William Cohen,

660 views • 46 slides

Clustering and Dimensionality Reduction Preview Clustering K -means clustering

Clustering and Dimensionality Reduction Preview Clustering K -means clustering Mixture models Hierarchical clustering Dimensionality reduction Principal component analysis Multidimensional scaling Isomap

1.61k views • 17 slides

Clustering A Categorization of Major Clustering Methods Partitioning Methods

Clustering What is Clustering? Types of Data in Cluster Analysis Clustering A Categorization of Major Clustering Methods Partitioning Methods Hierarchical Methods 1 2 What is Clustering? What is Clustering? Typical

647 views • 18 slides

Subspace Clustering Ensemble Clustering Subspace Clustering, Ensemble Clustering, Alternative

LUDWIG- MAXIMILIANS- INSTITUTE DATABASE UNIVERSITT FOR SYSTEMS MNCHEN MNCHEN INFORMATICS INFORMATICS GROUP GROUP Subspace Clustering Ensemble Clustering Subspace Clustering, Ensemble Clustering, Alternative Clustering, Multiview

513 views • 9 slides

Finding Clusters Types of Clustering Approaches: Linkage Based, e.g. Hierarchical Clustering

Finding Clusters Types of Clustering Approaches: Linkage Based, e.g. Hierarchical Clustering Clustering by Partitioning, e.g. k-Means Density Based Clustering, e.g. DBScan Grid Based Clustering Compendium slides for Guide to Intelligent

1.32k views • 82 slides

Introduction to Machine Learning, Clustering and EM Barnab s P czos Contents Clustering

Introduction to Machine Learning, Clustering and EM Barnab s P czos Contents Clustering K-means Mixture of Gaussians Expectation Maximization Variational Methods 2 Clustering 3 K- means clustering What is clustering?

1.32k views • 66 slides

PAC-Bayesian Analysis of Co-clustering, Graph Clustering and Pairwise Clustering Yevgeny Seldin

PAC-Bayesian Analysis of Co-clustering, Graph Clustering and Pairwise Clustering Yevgeny Seldin Motivation Example Clustering cannot be analyzed without specifying what it will be used for! be used for! Example Cluster then pack

293 views • 28 slides

Clustering kMeans, Expectation Maximization, Self-Organizing Maps Outline K-means

Clustering kMeans, Expectation Maximization, Self-Organizing Maps Outline K-means clustering Hierarchical clustering Incremental clustering Probability-based clustering Self-Organising Maps Classification vs. Clustering

1k views • 67 slides

Chapter 7: Clustering (Unsupervised Data Organization) 7.1 Hierarchical Clustering 7.2 Flat

Chapter 7: Clustering (Unsupervised Data Organization) 7.1 Hierarchical Clustering 7.2 Flat Clustering 7.3 Embedding into Vector Space for Visualization 7.4 Applications Clustering: unsupervised grouping (partitioning) of objects into

763 views • 49 slides

Staffing, Scheduling, and Acuity: A New Decision Tree for Nursing Mary Jo Assi, DNP, RN, NEA-BC,

Staffing, Scheduling, and Acuity: A New Decision Tree for Nursing Mary Jo Assi, DNP, RN, NEA-BC, FNP-BC American Nurses Association Deborah Crist-Grundman, BSN, RN Catalyst Systems Danielle K. Miller, PhD(c), MSN, RNC-OB, C-EFM Infor

625 views • 24 slides

Setting the Scene The year is AD 60. The Romans have occupied Britain for 17 years. Many Celtic

Setting the Scene The year is AD 60. The Romans have occupied Britain for 17 years. Many Celtic tribes have managed to continue to live in much the same way they always did, making deals with the Romans to leave them in peace. However, a

382 views • 17 slides

Peer-to-Peer Data Integration with Active XML Tova Milo Tel-Aviv University Tova Milo Tel

/56 Peer-to-Peer Data Integration with Active XML Tova Milo Tel-Aviv University Tova Milo Tel Aviv University /56 Active XML - Outline Introduction Active XML Active XML documents Active XML services Novel issues

712 views • 39 slides

WELCOME TO ARLINGTON, TEXAS The Am he Amer erican D Drea eam Ci City A LEADER IN

WELCOME TO ARLINGTON, TEXAS The Am he Amer erican D Drea eam Ci City A LEADER IN INNOVATION ARLINGTONS APPROACH TO IMPLEMENTING TECHNOLOGY IS FORWARD-THINKING, INNOVATIVE, AND AGILE. - Marble Robotics 2 City of Arlington,

654 views • 16 slides

Optimizing for developer happiness Chad Dickerson CTO, Etsy chad@etsy.com @chaddickerson We

Optimizing for developer happiness Chad Dickerson CTO, Etsy chad@etsy.com @chaddickerson We deploy code to production about 25x per day Across a team of 70 engineers We have a lot of people depending on us. 400,000+ active sellers 9+

967 views • 85 slides

CANADIAN DAM ASSOCIATION ASSOCIATION CANADIENNE DES BARRAGES Barrage St-Alban, QC Eastend, SK

Stanrock TMA,ON Elko, BC Ghost Dam, AB 1 CANADIAN DAM ASSOCIATION ASSOCIATION CANADIENNE DES BARRAGES Barrage St-Alban, QC Eastend, SK Lake Milo, NS 2016 2 Canadian Dam Association The CDA is a group of dam owners, operators, regulators,

345 views • 16 slides

W W W . O D O T . O R G / M E E T I N G S / O T H E R . P H P ODOT PUBLIC MEETING FOR S.H. 53 IN

W W W . O D O T . O R G / M E E T I N G S / O T H E R . P H P ODOT PUBLIC MEETING FOR S.H. 53 IN MILO, OK 01/ 31/ 2012 6:00pm DIVISION 7 INFORMATION Division Engineer: Bob Rose Counties Serviced: 9 Total Road Miles: 1,420.20

605 views • 22 slides

Shared Autonomous Vehicles Today and Tomorrow PRESENTER Paul Buharin, Region Vice President @

Minnesota Transportation Conference Shared Autonomous Vehicles Today and Tomorrow PRESENTER Paul Buharin, Region Vice President @ First Transit. Paul began his career in student transportation in 1983, advancing to a school bus location

182 views • 17 slides