The Evolution of Expert Guided Sentiment Analysis William D. - - PowerPoint PPT Presentation

the evolution of expert guided sentiment analysis
SMART_READER_LITE
LIVE PREVIEW

The Evolution of Expert Guided Sentiment Analysis William D. - - PowerPoint PPT Presentation

The Evolution of Expert Guided Sentiment Analysis William D. MacMillan, Ph.D. Evan A. Schnidman, Ph.D. QWAFAFEW, Feb. 16, 2016 Built for Amazon Reviews Sentiment Analysis Download Word Dictionaries Good - Bad Buzz ????


slide-1
SLIDE 1

The Evolution of Expert Guided Sentiment Analysis

William D. MacMillan, Ph.D. Evan A. Schnidman, Ph.D. QWAFAFEW, Feb. 16, 2016

slide-2
SLIDE 2

Built for Amazon Reviews

  • Sentiment Analysis

○ Download Word Dictionaries ○ Good - Bad Buzz ○ ???? ○ Profit

slide-3
SLIDE 3

Built for Amazon Reviews

  • Sentiment Analysis

○ Download Word Dictionaries ○ Good - Bad Buzz ○ ???? ○ Profit Inaccurate in more nuanced communications

slide-4
SLIDE 4

Built for Amazon Reviews

  • ML Classifiers

○ Train Classifier ○ Project onto new documents ○ Deep requirements to generate findings.

slide-5
SLIDE 5

Built for Amazon Reviews

  • ML Classifiers

○ Train Classifier ○ Project onto new documents ○ Deep requirements to generate findings. Need many, many training documents, and authoritative scoring.

slide-6
SLIDE 6

Detailed, Nuanced Communications

  • Not many solutions

○ Not enough documents (ML) ○ Dictionaries need rebuilding (SA) How do you quantitatively analyze high value documents?

slide-7
SLIDE 7

Including Expertise in Practice

  • Expert Guided Sentiment Analysis
  • Quantitative Central Banking Watching
  • Earnings Call Analysis
slide-8
SLIDE 8

How we do what we do

  • Expert Guided Sentiment

Analysis ○ Define relevant dimension ○ Documents are scored from effects ○ Effects of language vary

  • ver time
slide-9
SLIDE 9

How we do what we do

Word usage determines location

slide-10
SLIDE 10

Traditional Fed Watching

The Briefcase Watch Not Much Changed

slide-11
SLIDE 11

Experts in Fed Speak

  • Experts are biased and

fail to be comprehensive

  • Simple text analysis

dictionaries don’t work for Fed Speak and other complex language

  • Modest v. Moderate
slide-12
SLIDE 12

Experts in Fed Speak

  • Expertise and impartial

metrics allow scaling based on whole documents

  • Scores Reflect

Qualitative Understanding

slide-13
SLIDE 13

Experts in Fed Speak

  • Resulting Data:

○ Fast ○ Unbiased ○ Quantitative

  • Uses:

○ Eliminate post-hoc hedging

  • n CB policy

○ Forecast based on established correlations ○ Add as a signal in multifactor model

slide-14
SLIDE 14

Equity Markets

slide-15
SLIDE 15

Equity Market Simulated Portfolio

slide-16
SLIDE 16

Leading Indicator

slide-17
SLIDE 17

Earnings Call Analysis

  • Human systems burdensome
  • Relevant markets easy to define
  • Can scale to stock price changes
slide-18
SLIDE 18

Automatic Document Scaling

  • Stock Price Relevant

○ Dimension is % Change ○ Reference docs selected by impact ○ Intra/interday change in price

slide-19
SLIDE 19

Automatic Document Scaling

slide-20
SLIDE 20

Takeaways

  • Stock NLP/text analysis deficient
  • Create models to fit the application
  • Improved models increases applicability
slide-21
SLIDE 21

Evan A. Schnidman, Ph.D. evan@prattle.co William D. MacMillan, Ph.D. bill@prattle.co web: prattle.co twitter: @prattledata