konstantin tretjakov kt ut ee
play

Konstantin Tretjakov (kt@ut.ee) 22. november 2005 RVM & Eponine - PowerPoint PPT Presentation

Konstantin Tretjakov (kt@ut.ee) 22. november 2005 RVM & Eponine p.1/ ??


  1. � ✁ ✡ ✝ ☛ ✠ ✞ � ☎ ☛ ☎ ✞ ✌ �☞ ☎ ☛ ✡ � ✂ ✄ ☎ ✆ � � ✆ ✠ ✄ ✆ ✝✟✞ ✁✎✍ Konstantin Tretjakov (kt@ut.ee) 22. november 2005

  2. RVM & Eponine – p.1/ ?? ✎ ✌ ✍ ✎ ✔ ✟ ✍ ✞ ☎ ✟ ✆ ✞ ☛ ✑ ✏ ✘ ✗ ✏ ✡ ✍ ✖ ✡ ✢ ✔ ✞ ✔ ☎ ✟ ☎ ✆ ✄ ✟ ✡ ✥ ✤ ✡ ✔ ✆ ✞ ☎ ✞ ✏ ✝ ✌ ✟ ☞ ☎ ✡ ☛ ✡ ☎✆ ✕ ✄ ✂ �✁ ☞ ✝ ☎ � ✝ ☎ ☛ ✌✍ ✞ ✡ ✓ ✍ ✄ ✡ ☞ ✟ ✟ ✍ ✄ ✝ ✎ ✞ ☛✧✦ ✗✙✢ ✚✜✛ ✗✙✘ ✞✠✟ ☛✒✔ ✞✠✟ ✖✣✑ ✏✒✑

  3. RVM & Eponine – p.2/ ?? ☎ ✞ ✎ ✎ ✍ ✔ ✡ ✤ ✥ ✡ ✟ ✆ ✡ ☎ ✟ ✔ ☛ ✞ ✔ ✍ ✎ ✏ ✔✕ ✖✗ ✘ ✒ ✙ ✗ ✗ ✚ ✗ ✦ ✑ ✥✦ ✍ ✡ ✞ ✎ ☎ ✑ ✑ ☛ ✞ ✆ ☎ ☎ ☛ ✡ ✎ ✔ ✑ ✡ ✤ ✥ ✡ ✟ ✆ ✡ ☎ ✟ ☎ ✔ ✞ ✔ ✖ ✗ ✒ ☎ ✓ ☛ ☛ ✪ ✥ ✔ ✎ ✍ ☎ ✔ ✡ ☞ ✟ ✡ ✘ ✞ ✝ ✔ ✆ ✥ ✔ ✔ ☎ ✟ ✓ ☛ ✡ ☎ ☞ ✟ ✢ ☎ ✔ ✖ ✡ ✔ ✚ ✧ ✖ ★ ✩ ✥ ☎ ☛ ✞ ✔ ✝ ✎ ✝ ☞ ✡ ✟ ☞ ✡ ✝ ✡ ✝ ✓ ✖ ✡ ✢ ✔ ✎ ☛ ✥ ✔ ✄ ✡ ✂ ☎ ✎ ✝ ✡ ✓ ✍ ✟ ✞ ✎ ☞ ✟ ✍ ✝ ✝ ✝ ✎ ☎ ✞ ☎ ✡ ✆ ✢ ✌ ✎ ✝ ✎ ✎ ✞ ✝ ✍ ✓ ✍ ✥ ✘ ✍ ✥ ✝ ✂ ✄ ✝ ✡ ✑ ☞ ✍ ☎ ☛ ✡ ✄ ☎ ✔ ✔ ✖ ✌✍ ✡☛ ✔ ✞ ✝ ✎ ✎ ✡ ✥ ✡ ✝ ✆ ✕ ☛ ☎ ✕ ☞ ✝ ✄ ✎ ☛ ✍ ✍ ☞ ✔ ✆ ✍ ✍ ☛ ✢ ✢ ✢ ✌ ✝ ✎ ✡ ✥ ✔ ✥ ☎ ☛ ✔ ✍ ☛ ✥ ✎ ✞ ✍ ✟ ☎ ✝ ✓ ✞ ☎ ✟ ✡ ✎ ✝ ✞ ✔ ✟ ✞ ✆ ✡ ✄ ☎✆ ✍ ✝ ✟ ✄ ☛ ✝ ✡ ☎ ✎ ☞ ✟ ✡ ✡ ✌ ☛✧✦ ✞✠✟ ☛✧✦ ✞✠✟ ✑✢✤✣ ✚✜✛ ✡ ✁� ✑✓✒ ☛✒✔

  4. RVM & Eponine – p.3/ ?? ☛ ✔ ✡ ☞ ✌ ✡ ☞ ☞ ✍ � ✡ ✞ ✓ ✍ ✄ ☞ ☎ ✡ ☞ ✓ ✡ ✔ ✍ ✞ ✔ ✕ ✟ ✍ ✞ ✎ ☎ ✆ ✂ ✞ ✔ ✟ ☎ ☛ ✆ ☞ ✍ ✢ ✢ ✢ ✕ ✁ ✩ ☛ ✑ ✍ ☎ ✆ ☎ ✔ ☎ ✌ ✟ ✞ ✑ ✡ ✞ ✄ ✦ ☎ ✓ ✡ ✔ ✍ ✑ ✍ ✄✑ ☛ ✎ ✖ ☞ ✡ ✟ ✡ ✌ � ✍ ✓ ✟ ✞ ☞ ✞ ✢ ✁ ✗ ✍ ✎ ✂ ☞ ✍ ✎ � w m φ m ( x ) + w 0 + ǫ w m φ m ( x ) + w 0 �� m � m ✞✠✟ y ( x ) = σ y ( x ) =

  5. ✖ ✥ ✍ ✟ ☎ ✍ ✄ ✕ ✡ ☛ ☞ ✓ ✞ ✔ ✡ ✦ ☎ ✔ ✡ ✝ ✞ ✍ ✡ ✂ ☞ ✍ � ✝ ✂ ✁✂ ✡ ✟ ✡ ✟ ✓ ✌ ✟ ✞ ✎ ✎ ✂ ☞ ✡ ✎ � ✔ ✝ ✥ ✔ ✥ ☎ ✌ ✝ ✎ ✞ ☛ ☎ ✡ ✓ ✍ ✄ ☎ ✡ ✄ ✥ ✔ ✞ ✔ ✟ ✟ ✝ ✍ ✟ ✟ ☎ ✆ ✡ ✡ ✔ ✍ ✞ � � 1 − 1 2 σ 2 � t − Φw � 2 P ( t | w ) = (2 πσ 2 ) n/ 2 exp P ( w | t ) = P ( t | w ) P ( w ) P ( t ) P ( w ) ✄✆☎ � N ( w i | 0 , α − 1 P ( w | α ) = i ) i RVM & Eponine – p.4/ ??

  6. 2( w − µ ) T Σ − 1 ( w − µ RVM & Eponine – p.5/ ?? ✡ ✎ ✝ ✞ ✟ ✌ ☛ ✞ ☞ ✡ ✕ ✝ ✍ ✝ ✡ ☞ ✡ ✘ ✘ ✘ ✢ ☛ ✍ ✝ ✄ ✔ ✟ ✆ ✔ ✍ ✝ ✡ ✥ ✌ ☛ ✦ ✆ ☎ ☛ ✥ ✎ ☛ ☎ ✎ ✞ ✍ ✟ ✔ ✎ ✍ ✌ ✡ ✞ ✎ ✟ � ✞ ☛ ☎ ☞ ☛ ✦ ✥ ✌ ☛ ✦ ✡ ✑ ✞ ☞ ✡ ✔ ✔ ✞ ✍ ✟ � ✍ ☞ ✢ ✄ ✔ ✡ ✡ ✌ ☞ ☎ ✎ ✡ ☎ ✝ ☎ ✦ ✎ ✝ ✝ ☎ ✡ ✞ ✌ ✝ ✎ ✔ ✎ ✍ ✌ ✡ ✎ ✓ ✄ ☎ ☛ ☞ ✞ ☎ ✥ ✎ ✞ ✍ ✟ ✍ � ✢ ✍ ✔ ✝ ✝ ✡ ✄ ✥ ✔ ✎ ☎ ✍ ✡ ✔ ✎ ✎ ✞ ✄ ✑ ✡ ✑ ☎ ☞ ☎ ✄ ✡ ✎ ✡ ☞ ✔ ✔ ✡ ✓ ✆ ✞ � ✦ ✎ ✝ ✡ ✑ ☞ ✞ ✍ ☞ ✟ ✞ ✄ ✘ ✔ ✡ ✔ ✍ ✄ ✡ � ☎ ✦ ✡ ✔ ✞ ✔ ☎ ✍ ✄ ✡ ✞ ✟ ✎ ✡ ✌ ☞ ☎ ✎ ✞ ✍ ✥ ✘ ✟ ✄ ✡ ✍ ✞ ✝ ✎ ✡ ✎ ✄ ✡ ✝ ✍ ✝ ✢ ✖ ✌ ☎ ✔ w i − 1 µ = ΣΦ T Bt � (2 π ) ( N +1) / 2 | Σ | − 1 / 2 exp B = σ − 2 I n Σ = ( Φ T BΦ + A ) − 1 P ( t | α ) A = diag( α 1 , . . . , α n ) 1 α i ☛✒✔ P ( w | t , α ) =

  7. RVM & Eponine – p.6/ ?? ✞ ✎ ✓ ✟ ✡ ✎ ☛ ☛ ✝ ✘ ✔ ✛ ✦ ✟ ☎ ✄ ✔ ✍ ✔ ✎ ✎ ✝ ✎ ✡ ✟ ✥ ☞ ✑ ✔ ✍ ✥ ✪ ✟ ☎ ✆ ✡ ✝ ✡ ☎ ✆ ✡ ✡ ✎ ✞ ✓ ✟ ☎ ✔ ✎ ☎ ☎ ✓ ✥✑ ✎ ☎ ✝ ✎ ☞ ✎ ✓ ✞ ✑ ✥ ✡ ✝ ✎ ✌ ✟ ☞ ✞ ✥ ✡ ✢ ✦ ☛ ✡ ✟ ✡ ✍ ✝ ✞ ✔ ✟ ✥ ☞ ✄ ✝ ✎ ☞ ☞ ✌✍ ☛ ☎ ✡ ✝ ✎ ✘ ✑ ✍ ✡ ✦ ✢ ☞ ✡ ✎ ✔ ☎ � ☛ ✌ ✡ ✟ ✞ ✔ ✔ ✡ ☞ ✓ ✟ ☞ ✟ ✎ ✝ ✌ ✞ ✡ ✝ ✌ ✞ ✢ ✓ ✟ ✍ ✑ ✔ ✡ ☞ ✔ ✖ ✥ ✝ ☞ ✑ ✎ ✡ ✌ ✔ ✎ ✌ ✔ ✞ ✡ ✝ ✡ ☞ ✍ ✄ ✆ ✡ ✎ ✡ ✍ ☎ ✓ ☛ ✥ ✍ ✆ ✢ ✥ ✎ ✟ ✡ ✆ ✔ ✡ ✓ ✪ ✔ ✟ ✂ ✎ ✞ ☞ ✍ ✌ ☛ ☎ ✏ ✎ ✡ ✝ ✎ ✓ ✡ ✔ ✥ ✎ ✡ ✄ ✎ ✞ � ☎ ✄ ✦ ☎ ✡ ☎ ✞ ✄ ✞ ✎ ✔ ✡ ✟ ☎ ✄ ✁ ✞ ✔ ✓ ☎ ☞ ✌ ✘ ✦ ☎ ✘ ✌ ✌ ✟ ✞ ✔ ✥ ✦ ☎ ✞ ✝ ✎ ☞ ✎ ✍ ☎ ✟ � ✢ ✔ ✡ ✆ ✎ ✡ ✄ ☎ ☞ ☎ ✍ ✝ ☎ ✡ ✍ ☞ ✍ ✌ ☛ ☎ ✡ ✄ ✔ ✔ ✎ ✡ ✌ ✡ ✝ ✔ ✡ ✟ ✑ ✓ ✞ ☞ ✂ ✡ ✝ ✎ ✟ ✡ ✔ ✁ ✞ ✄ ✞ � ☎ ✄ ✓ ✄ ✎ ✥ ✞ ✝ ✔ ☎ ✌ ✟ ✞ ✔ ✘ ✡ ☎✆ ☛ ✑ w ∞ P ( t | α ) α ✞✠✟ α α ☛✒✔ P ( w | t , α ) α

  8. RVM & Eponine – p.7/ ?? ✡ ☎ ✞ ✔ ✎ ✝ ✡ ✟ ✕ ✄ ✝ ✞ ✔ � ☎ ✑ ☞ ✡ ✔ ✔ ✞ ✍ ✟ ✞ ✔ ✝ ✍ ☞ ✎ ✓ ✡ ✑ ☎ ☎ ✞ ✞ ☛ ✞ ✎ ✦ ✕ ✄ ✝ ✡ ☞ ✡ ✍ ☎ ☎ ☎ ✞ ☛ ✞ ✎ ✦ ✍ � ✎ ✝ ✔ ✎ ☞ ☎ ✎ ✝ ✡ ✝ ✡ ✞ ✌ ✝ ✎ ✔ ☎ ✝ ✦ ✎ ✞ ✟ ✆ ☛ ✍ ✔ ✡ ✓ � ✍ ☞ ✄ ✢ ✡ ☎ ✝ ☎ ☎ ✟ ✎ ✝ ✡ ✑ ☞ ✡ ✟ ✞ ✍ ✥ ✔ ✟ ☞ ✓ ✝ ✡ ✆ ☎ ✟ ✞ ✎ ✞ ✟ ✎ ✡ ✌ ✍ � ✑ ✆ ✑ ☛ ✦ ✎ ✝ ✡ ☛ ✍ ✌ ✞ ✔ ✎ ✞ � ☎ ✥ ✟ ✆ ✎ ✞ ✍ ✟ ✍ ✟ ✎ ✝ ✡ ☞ ✑ ✡ ☎ ✂ ✠ ✁ ✄ ☞ ☞ ☛ ✁ ✆ ✄ ✝ ☛ ✞ ☎ ✍ ✝ ☞ ✆ ☛ ☎ ✔ ✔ ✞ ✂ ✆ ☎ ✎ ✞ ✍ ✟ ✡ ✔ ✥ ☛ ☛ ✎ ✡ ☞ ✑ ☞ ✡ ✎ ✎ ✝ ✡ ✟ ☎ ✥ ✍ ✡ ✍ � ✎ ✝ ✡ ✄ ✍ ✓ ✡ ☛ ☎ ✔ ✞ ✟ ✎ ✢ ✎ ✍ � ☛ ✞ ✟ ✡ ☎ ✔ �✁ ✂ ☞ ✄ ✝ ✥ ✔ ✎ ✡ ☛ ✔ ✞ ☎ y ( x ) t i (1 − y ( x )) 1 − t i � w m φ m ( x ) + w 0 �� m � i P ( t | w ) = y ( x ) = σ 1+ e x 1 σ ( x ) =

  9. RVM & Eponine – p.8/ ?? ✥ ☎ ✎ ☞ ✞ � ✍ � ✎ ✝ ✞ ✔ ✌ ☎ ✔ ✡ ✔ ✞ ☎ ✟ ✕ ✔ ✍ ✄ ✡ ✓ ✡ ✆ ✡ ✄ ✆ ✎ ✎ ✆ ✡ ✟ ✎ ✡ ☞ ✡ ✓ ☎ ✎ ✢ ✏ ✔ ✞ ✟ ✄ ☎ ✎ ✡ ✎ ✝ ✡ ✆ ✍ ✟ ☎ ☞ ✞ ☎ ✟ ☛ ☎ ✄ ✑ ✑ ☞ ✍ � ✞ ✄ ☎ ✎ ✞ ✍ ✟ ✢ ✝ ✔ ✡ ✦ ✔ ☎ ✦ ✞ ✎ ✝ ✍ ☞ ☞ ✔ ✢ ☎ ✞ ✦ ✞ ✔ ✞ ✄ ✑ ☛ ✡ ✡ � ✑ ☞ ✡ ✔ ✔ ✍ ✝ ✟ ✢ ✁ ✑ ✓ ☎ ✎ ✡ ✥ ✔ ✞ ✟ ✌ ✎ ✞ � ✞ ✢ ✂ ☎✆ � ☎ ✦ ✕ ✂ ✞ � ✔ ✍ ✄ ✡ ✂ ☎ ✓ ✎ ✝ ✡ ✄ ☎ � ✞ ✄ ✥ ✄ ☛ ✞ ✦ ✄ ✡ � ✠ ✁ ✄ ☞ ☞ ☛ ✁ ✆ ✄ ✝ ☛ ✞ ☎ ✎ ✝ ✡ ☞ ☎ ✎ ✞ ✟ ✡ ☎ ☛ ✌ ✍ ☞ ✞ ✎ ✔ ☞ ☛ ☎ ✎ ✝ ☎ ✎ ✎ ✝ ✡ ✓ ✞ ✔ ✎ ☞ ✞ ✥ ✞ ✎ ✞ ✍ ✟ ✍ � ✞ ✔ ☎ ✌ ☎ ✥ ✔ ✡ ✄ ✥ � ✝ ✍ ✍ ✓ ✡ ✔ ✎ ✞ ✄ ☎ ✎ ✡ ✔ ✟ ✍ ✌ ✢ ✔ ✎ ✝ ✡ ✞ ✝ ☞ w P ( w , t | α ) w ML ∇ 2 log P ( w , t | α ) = w ML ✞✠✟ α α ✖✧✔

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend


More recommend