EM Algorithm 11-09-2019 For Mixture Gaussian Models Instructor - - - PowerPoint PPT Presentation

▶
em algorithm
SMART_READER_LITE
LIVE PREVIEW

EM Algorithm 11-09-2019 For Mixture Gaussian Models Instructor - - - PowerPoint PPT Presentation

Mar 11, 2023 173 likes •368 views

E9 205 Machine Learning for Signal Processing EM Algorithm 11-09-2019 For Mixture Gaussian Models Instructor - Sriram Ganapathy (sriramg@iisc.ac.in) Teaching Assistant - Prachi Singh (prachisingh@iisc.ac.in). EM Algorithm For GMMs EM

slide-1
SLIDE 1

E9 205 Machine Learning for Signal Processing

11-09-2019

EM Algorithm

For Mixture Gaussian Models

Instructor - Sriram Ganapathy (sriramg@iisc.ac.in) Teaching Assistant - Prachi Singh (prachisingh@iisc.ac.in).

slide-2
SLIDE 2

EM Algorithm For GMMs

slide-3
SLIDE 3

EM Algorithm for GMM

E-step M-step

slide-4
SLIDE 4

EM Algorithm for GMM

3.3 3.4 3.5 3.6 3.7 3.8 3.9 4 3.7 3.8 3.9 4 4.1 4.2 4.3 4.4 ANEMIA PATIENTS AND CONTROLS Red Blood Cell Volume Red Blood Cell Hemoglobin Concentration

Cadez, Igor V., et al. "Hierarchical models for screening of iron deficiency anemia." ICML. 1999.

slide-5
SLIDE 5

EM Algorithm for GMM

3.3 3.4 3.5 3.6 3.7 3.8 3.9 4 3.7 3.8 3.9 4 4.1 4.2 4.3 4.4

Red Blood Cell Volume Red Blood Cell Hemoglobin Concentration

EM ITERATION 1

Cadez, Igor V., et al. "Hierarchical models for screening of iron deficiency anemia." ICML. 1999.

slide-6
SLIDE 6

EM Algorithm for GMM

3.3 3.4 3.5 3.6 3.7 3.8 3.9 4 3.7 3.8 3.9 4 4.1 4.2 4.3 4.4

Red Blood Cell Volume Red Blood Cell Hemoglobin Concentration

EM ITERATION 3

Cadez, Igor V., et al. "Hierarchical models for screening of iron deficiency anemia." ICML. 1999.

slide-7
SLIDE 7

EM Algorithm for GMM

3.3 3.4 3.5 3.6 3.7 3.8 3.9 4 3.7 3.8 3.9 4 4.1 4.2 4.3 4.4

Red Blood Cell Volume Red Blood Cell Hemoglobin Concentration

EM ITERATION 5

Cadez, Igor V., et al. "Hierarchical models for screening of iron deficiency anemia." ICML. 1999.

slide-8
SLIDE 8

EM Algorithm for GMM

3.3 3.4 3.5 3.6 3.7 3.8 3.9 4 3.7 3.8 3.9 4 4.1 4.2 4.3 4.4

Red Blood Cell Volume Red Blood Cell Hemoglobin Concentration

EM ITERATION 10

Cadez, Igor V., et al. "Hierarchical models for screening of iron deficiency anemia." ICML. 1999.

slide-9
SLIDE 9

EM Algorithm for GMM

3.3 3.4 3.5 3.6 3.7 3.8 3.9 4 3.7 3.8 3.9 4 4.1 4.2 4.3 4.4

Red Blood Cell Volume Red Blood Cell Hemoglobin Concentration

EM ITERATION 15

Cadez, Igor V., et al. "Hierarchical models for screening of iron deficiency anemia." ICML. 1999.

slide-10
SLIDE 10

EM Algorithm for GMM

3.3 3.4 3.5 3.6 3.7 3.8 3.9 4 3.7 3.8 3.9 4 4.1 4.2 4.3 4.4

Red Blood Cell Volume Red Blood Cell Hemoglobin Concentration

EM ITERATION 25

Cadez, Igor V., et al. "Hierarchical models for screening of iron deficiency anemia." ICML. 1999.

slide-11
SLIDE 11

EM Algorithm for GMM

3.3 3.4 3.5 3.6 3.7 3.8 3.9 4 3.7 3.8 3.9 4 4.1 4.2 4.3 4.4

Red Blood Cell Volume Red Blood Cell Hemoglobin Concentration

ANEMIA DATA WITH LABELS

Cadez, Igor V., et al. "Hierarchical models for screening of iron deficiency anemia." ICML. 1999.

slide-12
SLIDE 12

K-means Algorithm for Initialization

slide-13
SLIDE 13

Other Considerations

  • Initialization - random or k-means
  • Number of Gaussians
  • Type of Covariance matrix
  • Spherical covariance
slide-14
SLIDE 14

Other Considerations

  • Initialization - random or k-means
  • Number of Gaussians
  • Type of Covariance matrix
  • Diagonal covariance
slide-15
SLIDE 15

Other Considerations

  • Initialization - random or k-means
  • Number of Gaussians
  • Type of Covariance matrix
  • Full covariance
slide-16
SLIDE 16

Probablistic PCA

slide-17
SLIDE 17

1-D PPCA Example

slide-18
SLIDE 18

HouseKeeping

  • Assignment 2
  • Mid Term Exam
  • Project Topic Selection.
  • Notes on Assignment 1