Multivariate COM-Poisson: A Flexible Count Distribution that - - PowerPoint PPT Presentation

β–Ά
multivariate com poisson
SMART_READER_LITE
LIVE PREVIEW

Multivariate COM-Poisson: A Flexible Count Distribution that - - PowerPoint PPT Presentation

Multivariate COM-Poisson: A Flexible Count Distribution that Accommodates Data Dispersion Yixuan (Sherry) Wu Georgetown University Mentor: Prof. Kimberly Sellers COM-Poisson Multivariate (CMP): Discussion CMP Introduction Background


slide-1
SLIDE 1

Multivariate COM-Poisson: A Flexible Count Distribution that Accommodates Data Dispersion

Yixuan (Sherry) Wu Georgetown University Mentor: Prof. Kimberly Sellers

slide-2
SLIDE 2

Background Analysis R Shiny

COM-Poisson (CMP): Introduction Multivariate CMP Discussion

slide-3
SLIDE 3

Background Analysis R Shiny

Available Count Models:

  • Poisson Distribution
  • PMF for random variable Y:

P(Y = y) = πœ‡π‘§π‘“βˆ’πœ‡

𝑧!

, 𝑧 = 0, 1, 2, β‹―

  • Assumption:
  • Ξ» = mean = variance β†’ equi-dispersion
  • Multivariate analog of this distribution exists

https://en.wikipedia.org/wiki/Poisson_d istribution#/media/File:Poisson_pmf.svg

Background & Motivation

y

slide-4
SLIDE 4

Background Analysis R Shiny

Background & Motivation

Available Count Models:

  • Negative Binomial Distribution
  • Accounts for over-dispersion, but not under-dispersion
  • Generalized Poisson Distribution
  • Not good when huge amount of under-dispersion
slide-5
SLIDE 5

Background Analysis R Shiny

Background & Motivation

Available Count Models:

  • Negative Binomial Distribution
  • Accounts for over-dispersion, but not under-dispersion
  • Generalized Poisson Distribution
  • Not good when huge amount of under-dispersion

Challenges:

  • 1. Accounting for under-dispersion
  • 2. Uncertain Dispersion
slide-6
SLIDE 6

Background Analysis R Shiny

COM-Poisson Distribution

(Conway & Maxwell, 1962; Shmueli et al., 2005) COM-Poisson distribution PMF for random variable Y:

𝑄 𝑍 = 𝑧 =

πœ‡π‘§ 𝑧! πœ‰π‘Ž(πœ‡,πœ‰) , 𝑧 = 0, 1, 2, β‹―

where π‘Ž πœ‡, πœ‰ = ෍

π‘˜=0 ∞ πœ‡π‘˜ (π‘˜!)πœ‰ ; πœ‰ β‰₯ 0; πœ‡ = 𝐹(π‘πœ‰)

Captures both over-dispersion and under-dispersion

slide-7
SLIDE 7

Background Analysis R Shiny

COM-Poisson Distribution

(Conway & Maxwell, 1962; Shmueli et al., 2005) COM-Poisson distribution PMF for random variable Y:

𝑄 𝑍 = 𝑧 =

πœ‡π‘§ 𝑧! πœ‰π‘Ž(πœ‡,πœ‰) , 𝑧 = 0, 1, 2, β‹―

where π‘Ž πœ‡, πœ‰ = ෍

π‘˜=0 ∞ πœ‡π‘˜ (π‘˜!)πœ‰ ; πœ‰ β‰₯ 0; πœ‡ = 𝐹(π‘πœ‰)

Special Cases: πœ‰ = 1 βž” π‘Ž πœ‡, πœ‰ = π‘“πœ‡ βž” 𝑄 𝑍 = 𝑧 =

πœ‡π‘§ π‘“βˆ’πœ‡ 𝑧!

∼ π‘„π‘π‘—π‘‘π‘‘π‘π‘œ πœ‡ πœ‰ = 0, πœ‡ < 1 βž” π‘Ž πœ‡, πœ‰ =

1 1βˆ’πœ‡

βž” 𝑄 𝑍 = 𝑧 = πœ‡π‘§(1 βˆ’ πœ‡) ∼ 𝐻𝑓𝑝𝑛𝑓𝑒𝑠𝑗𝑑 (π‘ž = 1 βˆ’ πœ‡) πœ‰ β†’ ∞ βž” π‘Ž πœ‡, πœ‰ = 1 + πœ‡ βž” 𝑄 𝑍 = 𝑧 =

πœ‡ 1+πœ‡ ∼ πΆπ‘“π‘ π‘œπ‘π‘£π‘šπ‘šπ‘— (π‘ž = πœ‡ 1+πœ‡)

slide-8
SLIDE 8

Background Analysis R Shiny

COM-Poisson Distribution Properties

Probability Generating Function (PGF):

Ξ  π‘’βˆ— = 𝐹 𝑒𝑍 =

π‘Ž πœ‡π‘’, πœ‰ π‘Ž πœ‡, πœ‰

Moment Generating Function (MGF):

𝑁𝑍 π‘’βˆ— = 𝐹 etY =

π‘Ž πœ‡π‘“π‘’, πœ‰ π‘Ž(πœ‡, πœ‰)

Expected Value:

E 𝑍 = πœ‡

πœ– log π‘Ž(πœ‡,πœ‰) πœ–πœ‡

Variance: Var 𝑍 =

πœ–πΉ(𝑍) πœ– log πœ‡

slide-9
SLIDE 9

Background Analysis R Shiny

Let π‘œ ∼ CMP(πœ‡, πœ‰) and (π‘Œ1, β‹― , π‘Œπ‘™|π‘œ) have conditional PGF

Multivariate COM-Poisson Distribution

slide-10
SLIDE 10

Background Analysis R Shiny

Let π‘œ ∼ CMP(πœ‡, πœ‰) and (π‘Œ1, β‹― , π‘Œπ‘™|π‘œ) have conditional PGF Using compounding technique, unconditional PGF:

Multivariate COM-Poisson Distribution

slide-11
SLIDE 11

Background Analysis R Shiny

Tri-variate Case

  • Probability Generating Function:
slide-12
SLIDE 12

Background Analysis R Shiny

  • The current challenge with computing PMF:
  • Tri-variate PMF

β†’Computational Challenge to estimate parameters β†’Questions?

Next Step & Challenges

slide-13
SLIDE 13

Background Analysis R Shiny

Trivariate Case - PGF

d_1 d_3 d_2

slide-14
SLIDE 14

Background Analysis R Shiny

Compounding Method:

For Derivation of Multivariate Poisson Distribution

Let π‘œ ∼ Poisson(πœ‡) and (π‘Œ1, β‹― , π‘Œπ‘™|π‘œ) have conditional PGF

slide-15
SLIDE 15

Background Analysis R Shiny

Compounding Method:

For Derivation of Multivariate Poisson Distribution

Let π‘œ ∼ Poisson(πœ‡) and (π‘Œ1, β‹― , π‘Œπ‘™|π‘œ) have conditional PGF

slide-16
SLIDE 16

Background Analysis R Shiny

Compounding Method:

For Derivation of Multivariate Poisson Distribution

Let π‘œ ∼ Poisson(πœ‡) and (π‘Œ1, β‹― , π‘Œπ‘™|π‘œ) have conditional PGF Using compounding technique, unconditional PGF: