Introduction to Data Stream Mining Albert Bifet March 2012 - PowerPoint PPT Presentation

Jul 03, 2023 •195 likes •390 views

Introduction to Data Stream Mining Albert Bifet March 2012 Motivation Source: IDCs Digital Universe Study (EMC), June 2011 Data is growing Motivation Memory unit Size Binary size 10 3 2 10 kilobyte (kB/KB) 10 6 2 20 megabyte (MB) 10 9

Introduction to Data Stream Mining Albert Bifet March 2012
Motivation Source: IDC’s Digital Universe Study (EMC), June 2011 Data is growing
Motivation Memory unit Size Binary size 10 3 2 10 kilobyte (kB/KB) 10 6 2 20 megabyte (MB) 10 9 2 30 gigabyte (GB) 10 12 2 40 terabyte (TB) 10 15 2 50 petabyte (PB) 10 18 2 60 exabyte (EB) 10 21 2 70 zettabyte (ZB) 10 24 2 80 yottabyte (YB) Data is growing
Motivation Source: IDC’s Digital Universe Study (EMC), June 2011 Data is growing
Motivation Source: IDC’s Digital Universe Study (EMC), June 2011 Data is growing
Motivation Source: IDC’s Digital Universe Study (EMC), June 2011 Data is growing
Streaming Data Big Data & Real Time
Big Data McKinsey Global Institute (MGI) Report on Big Data, 2011. Big data refers to datasets whose size is beyond the ability of typical database software tools to capture, store, manage, and analyze.
Big Data McKinsey Global Institute (MGI) Report on Big Data, 2011. Big data refers to datasets whose size is beyond the ability of typical database software tools to capture, store, manage, and analyze.
Methodology Sampling and distributed systems
Methodology Paolo Boldi Big Data does not need big machines, it needs big intelligence
Real time analytics We want to analyze what is happening now .
Real time analytics We want to analyze what is happening now .
Time and Memory Number 8 Wire Mentality Time and memory are the resource dimensions of the process.
Time and Memory Time and memory are the resource dimensions of the process.
Algorithms Classification, Regression, Clustering, Frequent Pattern Mining.
Applications ◮ sensor data: industry, cities ◮ telecomm data ◮ social networks: twitter, facebook, yahoo ◮ marketing: sales business Data may come from: humans, sensors, or machines.
Data Streams Big Data & Real Time

Download Presentation

Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Frequent Pattern Mining Albert Bifet May 2012 COMP423A/COMP523A Data Stream Mining Outline 1.

Frequent Pattern Mining Albert Bifet May 2012 COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics 3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9.

585 views • 44 slides

Clustering Albert Bifet May 2012 COMP423A/COMP523A Data Stream Mining Outline 1. Introduction

Clustering Albert Bifet May 2012 COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics 3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern

260 views • 22 slides

Regression Albert Bifet May 2012 COMP423A/COMP523A Data Stream Mining Outline 1. Introduction

Regression Albert Bifet May 2012 COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics 3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern

862 views • 16 slides

Introduction to data stream querying and mining Georges HEBRAIL Workshop Franco-Brasileiro sobre

Introduction to data stream querying and mining Georges HEBRAIL Workshop Franco-Brasileiro sobre Minerao de Dados Recife, May 5-7, 2009 Preliminaries Now at Google Page 2 G.HEBRAIL May 5th, 2009 Introduction to data stream querying

1.19k views • 86 slides

Distributed Streaming Albert Bifet May 2012 COMP423A/COMP523A Data Stream Mining Outline 1.

Distributed Streaming Albert Bifet May 2012 COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics 3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent

529 views • 13 slides

DATA MINING LECTURE 1 Introduction What is data mining? After years of data mining there is

DATA MINING LECTURE 1 Introduction What is data mining? After years of data mining there is still no unique answer to this question. A tentative definition: Data mining is the use of efficient techniques for the analysis of very large

1.28k views • 62 slides

Evaluation Albert Bifet April 2012 COMP423A/COMP523A Data Stream Mining Outline 1.

Evaluation Albert Bifet April 2012 COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics 3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent Pattern

394 views • 18 slides

Classification Albert Bifet April 2012 COMP423A/COMP523A Data Stream Mining Outline 1.

Classification Albert Bifet April 2012 COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics 3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent

1.12k views • 34 slides

Ensemble Methods Albert Bifet May 2012 COMP423A/COMP523A Data Stream Mining Outline 1.

Ensemble Methods Albert Bifet May 2012 COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics 3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent

696 views • 23 slides

Mining Data Streams (Part 2) Determine which elements of stream have keys in S Obvious

2/19/2010 Each element of data stream is a tuple Given a list of keys S Mining Data Streams (Part 2) Determine which elements of stream have keys in S Obvious solution: hash table But suppose we dont have enough memory to

284 views • 6 slides

Concept Drift Albert Bifet March 2012 COMP423A/COMP523A Data Stream Mining Outline 1.

Concept Drift Albert Bifet March 2012 COMP423A/COMP523A Data Stream Mining Outline 1. Introduction 2. Stream Algorithmics 3. Concept drift 4. Evaluation 5. Classification 6. Ensemble Methods 7. Regression 8. Clustering 9. Frequent

633 views • 26 slides

Introduction What is data mining? to Data Mining: On what kind of data? Data Mining

Introduction Motivation: Why data mining? Introduction What is data mining? to Data Mining: On what kind of data? Data Mining Data mining functionalities Major issues in data mining 2 Motivation: Necessity is

438 views • 14 slides

LECTURE 1: INTRODUCTION TO DATA MINING Dr. Dhaval Patel CSE, IIT-Roorkee What is data mining?

LECTURE 1: INTRODUCTION TO DATA MINING Dr. Dhaval Patel CSE, IIT-Roorkee What is data mining? Data mining is also called knowledge discovery and data mining (KDD) Data mining is extraction of useful patterns from data sources , e.g.,

1.29k views • 50 slides

Data Mining and Exploration Data Mining and Exploration: Introduction Course Introduction Amos

Data Mining and Exploration Data Mining and Exploration: Introduction Course Introduction Amos Storkey, School of Informatics Welcome Administration January 10, 2006 Books (Hand Monilla and Smyth) Mini Project Paper

87 views • 5 slides

Introduction to Web Mining What is Web Mining? Discovering useful information from the

CS 345A Data Mining Lecture 1 Introduction to Web Mining What is Web Mining? Discovering useful information from the World-Wide Web and its usage patterns Web Mining v. Data Mining Structure (or lack of it) Textual information and

744 views • 31 slides

Introduction to Data Mining Methods and Tools by Michael Hahsler Agenda What is Data Mining?

Introduction to Data Mining Methods and Tools by Michael Hahsler Agenda What is Data Mining? Data Mining T asks Relationship to Statistics, Optimization, Machine Learning and AI T ools Data Legal, Privacy and Security

1.02k views • 69 slides

Serverless in Action CodeStock April 13, 2019 Who is Chad Green Director of Software

Chad Green Serverless in Action CodeStock April 13, 2019 Who is Chad Green Director of Software Development at ScholarRx Community Involvement Code PaLOUsa Conference Chair Louisville .NET Meetup Organizer Louisville Tech

939 views • 59 slides

Administrivia CSCE150A CSCE150A Computer Science & Engineering 150A Administrivia Problem

Administrivia CSCE150A CSCE150A Computer Science & Engineering 150A Administrivia Problem Solving Using Computers Administrivia Roll Overview Overview Syllabus Hardware Hardware Lecture 01 - Course Introduction Course Webpage:

594 views • 8 slides

Overviews and practical reports Justin Clarke, Cecilia Ferrando, William Rebelsky Trends

Overviews and practical reports Justin Clarke, Cecilia Ferrando, William Rebelsky Trends The growing amount of data and need for Machine Learning data processing challenges us to advance systems One trillion IoT devices expected by

545 views • 50 slides

Flexible Grid Label Format in Wavelength Switched Op:cal

Flexible Grid Label Format in Wavelength Switched Op:cal Network draft-li-ccamp-flexible-grid-label-00 Yao Li (li.yao3@zte.com.cn) Fei Zhang (zhang.fei3@zte.com.cn) Ramon Casellas (ramon.casellas@cttc.es )

768 views • 7 slides

BasicComputerConcepts Chapter4 Objec;ves15 ReviewQues;ons

8/29/08 BasicComputerConcepts Chapter4 Objec;ves15 ReviewQues;ons InplainEnglish,whatisAFS? WherewasAFScreated/developed?

489 views • 10 slides

Bhyve guests with hardware accelerated graphics Michael Chiu EuroBSDCon 2019 Who am I?

Bhyve guests with hardware accelerated graphics Michael Chiu EuroBSDCon 2019 Who am I? Studying Pure Mathematics in San Jose, California FreeBSD user since 4 years ago Accidentally started programming Reason for GPU accelerated Guests?

304 views • 18 slides

Regularization Methods for Large Scale Machine Learning Alessandro Rudi University of Genova -

Regularization Methods for Large Scale Machine Learning Alessandro Rudi University of Genova - Istituto Italiano di Tecnologia Massachusetts Institute of Technology lcsl.mit.edu In collaboration with: Raffaello Camoriano, Lorenzo Rosasco May

702 views • 46 slides

DAFT -- Results From NASA High End Computing (HEC) WAN File Transfer

DAFT -- Results From NASA High End Computing (HEC) WAN File Transfer Experiments/Demonstrations Super Computing 2016 (SC16) Bill Fink Computational And Information Science and Technology Office (CISTO) High End Computer

635 views • 10 slides