Linguistic Harbingers of Betrayal me, Vlad Niculae , Cornell - PowerPoint PPT Presentation


 Linguistic 
 Harbingers 
 of Betrayal me, 
 Vlad Niculae , Cornell University with 
 Srijan Kumar , University of Maryland College Park Jordan Boyd-Graber , University of Colorado Boulder and Cristian Danescu-Niculescu-Mizil Cornell University

Linguistic 
 Harbingers 
 of Betrayal is everywhere.

Are there any 
 linguistic cues that foretell betrayal?

What is betrayal? (And how does it 
 differ from just lying?)

Can this be 
 a betrayal?

Can this be 
 a betrayal? Deceptive review spam 
 (Li, Huang, Yang & Zhu, 2011) 
 (Ott, Choi, Cardie & Hancock, 2011) 
 (Feng, Banerjee & Choi, 2012) 
 …

Can this be 
 a betrayal? Deceptive review spam 
 Deception in court cases 
 (Li, Huang, Yang & Zhu, 2011) 
 (Bachenko, Fitzpatrick 
 (Ott, Choi, Cardie & Hancock, 2011) 
 & Schonwetter, 2008) 
 (Feng, Banerjee & Choi, 2012) 
 (Fornaciari & Poesio, 2013) 
 … …

Can this be 
 a betrayal? Elicited deception in essays 
 Deceptive review spam 
 Deception in court cases 
 (Newman, Pennebaker, Berry 
 (Li, Huang, Yang & Zhu, 2011) 
 (Bachenko, Fitzpatrick 
 & Richards, 2003) 
 (Ott, Choi, Cardie & Hancock, 2011) 
 & Schonwetter, 2008) 
 (Mihalcea & Strapparava, 2009) 
 (Feng, Banerjee & Choi, 2012) 
 (Fornaciari & Poesio, 2013) 
 (Pérez-Rosas & Mihalcea, 2014) 
 … … …

Okay, how about this, can this be a betrayal? (Feldman and Happ, 2002) 
 (Hancock, Curry, Goorha & Woodworth, 2011) 
 …

? t

“ T h e g a m 
 e t h a t r u i n s f r i e n d s h i p s ”

X “ T h e g a m 
 e t h a t r u i n s f r i e n d s h i p s ”

“ T h e g a m 
 e t h a t r u i n s f r i e n d s h i p s ”

“ T h e g a m 
 e t h a t r u i n s f r i e n d s h i p s ” o n l i n e !

“ T h e g a m 
 e t h a t r u i n s f r i e n d s h i p s ” o n l i n e ! 2 4 9 g a m e s ~ 6 m o n t h s / 
 g a m e 1 4 5 k m e s s a g e s d i p l o m . o r g ; u s a k . a s c i i k i n g . c o m

help?


 F What I would like you to do is keep Turkey busy and somehow get Russia and Turkey to engage. Meanwhile we need to take VIE, suggest you support me in there. help?


 
 F What I would like you to do is keep Turkey busy and somehow get Russia and Turkey to engage. Meanwhile we need to take VIE, suggest you support me in there. OK It's a sensible plan. I'll support you as requested. Please be sure to simultaneously attack SWE.


 
 F What I would like you to do is keep Turkey busy and somehow get Russia and Turkey to engage. Meanwhile we need to take VIE, suggest you support me in there. It's a sensible plan. I'll support you as requested. Please be sure to simultaneously attack SWE. F


 
 F What I would like you to do is keep Turkey busy and somehow get Russia and Turkey to engage. Meanwhile we need to take VIE, suggest you support me in there. It's a sensible plan. I'll support you as requested. Please be sure to simultaneously attack SWE. F


 
 
 
 F What I would like you to do is keep Turkey busy and somehow get Russia and Turkey to engage. Meanwhile we need to take VIE, suggest you support me in there. It's a sensible plan. I'll support you as requested. Please be sure to simultaneously attack SWE. F … 
 E stabs ! 


NOW STAND BACK, I GOTTA PRACTICE MY STABBIN'


 
 
 
 F What I would like you to do is keep Turkey busy and somehow get Russia and Turkey to engage. Meanwhile we need to take VIE, suggest you support me in there. It's a sensible plan. I'll support you as requested. Please be sure to simultaneously attack SWE. F … 
 E stabs ! 



 
 
 
 F What I would like you to do is keep Turkey busy and somehow get Russia and Turkey to engage. Meanwhile we need to take VIE, suggest you support me in there. It's a sensible plan. I'll support you as requested. Please be sure to simultaneously attack SWE. F … 
 E stabs ! 



 
 
 
 F What I would like you to do is keep Turkey busy and somehow get Russia and Turkey to engage. Meanwhile we need to take VIE, suggest you support me in there. It's a sensible plan. I'll support you as requested. Please be sure to simultaneously attack SWE. F … 
 E stabs ! 
 Not really sure what to say, except 
 that I regret you did what you did.

Curse your sudden 
 but inevitable 
 betrayal!


 
 
 
 F What I would like you to do is keep Turkey busy and somehow get Russia and Turkey to engage. Meanwhile we need to take VIE, suggest you support me in there It's a sensible plan. I'll support you as requested. Please be sure to simultaneously attack SWE. 
 F E stabs ! 
 Not really sure what to say, except 
 that I regret you did what you did. E

Identifying Betrayals (So That We Can Analyze Their Language)

Identifying Betrayals E } F Solid friendships: F established ( ≥ two supports), 
 mutual ( ≥ one from each). E } F E E Betrayal: friendship followed by 
 ≥ two attacks.

Identifying Betrayals 250 such betrayals in our Diplomacy dataset. E } F Solid friendships: F established ( ≥ two supports), 
 mutual ( ≥ one from each). E } F E E Betrayal: friendship followed by 
 ≥ two attacks.

Matching Friendship 250 such betrayals in our Diplomacy dataset. 
 We find 250 matching friendships. { } F E } (9660 msgs., 59 words/msg.) Matched for: F F F Solid friendships: length, 
 F established ( ≥ two supports), 
 F game year. mutual ( ≥ one from each). } F F F E E E Betrayal.

Matching Friendship 250 such betrayals in our Diplomacy dataset. 
 We find 250 matching friendships. { F } E } (9660 msgs., 59 words/msg.) Matched for: F F F Solid friendships: length, 
 F established ( ≥ two supports), 
 F game year. mutual ( ≥ one from each). } } F F F Matched 
 E E friendship: E Betrayal. no attacks 
 (ever).

Matching Friendship 250 such betrayals in our Diplomacy dataset. 
 We find 250 matching friendships. F (9660 msgs., 59 words/msg.) F F F F F F F F E E E E

Matching Friendship 250 such betrayals in our Diplomacy dataset. 
 We find 250 matching friendships. F (9660 msgs., 59 words/msg.) F F F Linguistic signs of betrayal 
 while they act as friends? F F F F F E E E E

Matching Friendship 250 such betrayals in our Diplomacy dataset. 
 We find 250 matching friendships. F (9660 msgs., 59 words/msg.) F F F Linguistic signs of betrayal 
 while they act as friends? F F The betrayers actively hide it. 
 The victims didn’t see it coming. F F F E E E E

Insight: 
 Conversational Balance

Insight: 
 Conversational Balance

Insight: 
 Conversational Balance • Stable marriages are balanced (Gottman, 1993). • So are effective pair programming teams 
 (Jung, Chong & Leifer, 2012).

Insight: 
 Conversational Balance • Stable marriages are balanced (Gottman, 1993). • So are effective pair programming teams 
 (Jung, Chong & Leifer, 2012). • Can we apply this to linguistic conversational features?

(Im)balance: Sentiment Imbalance: f( betrayer ) - f( victim ) 0.03 | imbalance | 0.02 0.01 0.00 betrayal (Proportion of sentences showing positive sentiment.) 
 (Error bars show standard error.)

(Im)balance: Sentiment Imbalance: f( betrayer ) - f( victim ) 0.03 | imbalance | 0.02 0.01 0.00 matched betrayal friendship (Proportion of sentences showing positive sentiment.) 
 (Error bars show standard error.)

(Im)balance: Sentiment Imbalance: f( betrayer ) - f( victim ) 0.20 0.03 0.15 | imbalance | 0.02 amount 0.10 0.01 0.05 0.00 0.00 matched betrayal matched betrayer victim friendship friendship (Proportion of sentences showing positive sentiment.) 
 (Error bars show standard error.)

(Im)balance: Politeness Imbalance: f( betrayer ) - f( victim ) 0.70 0.03 0.65 | imbalance | 0.02 amount 0.60 0.01 0.55 0.00 0.50 matched betrayal matched betrayer victim friendship friendship (Average 0-1 politeness score of requests: http://politeness.mpi-sws.org) 
 (Error bars show standard error.)

(Im)balance: Future Planning Imbalance: f( betrayer ) - f( victim ) 0.12 0.03 0.10 | imbalance | 0.08 0.02 amount 0.06 0.01 0.04 0.00 0.02 0.00 matched betrayal matched betrayer victim friendship friendship (Average number of planning connectors per message, e.g. “next”, “after”) 
 (Error bars show standard error.)