Towards automatic estimation of conversation floors within - - PowerPoint PPT Presentation

Towards automatic estimation of conversation floors within F-formations

Chirag Raman, Hayley Hung Socially Perceptive Computing Lab Delft University of Technology, The Netherlands

Motivation Methodology Summary Research Questions Experiments

MatchNMingle Dataset

Motivation Methodology Summary Research Questions Experiments

RQ 1 Can we use observed speaker turns to infer the conversation floors within an F-formation? RQ 2 How does the cardinality of an F-formation affect the conversation floors developed within it?

Motivation Methodology Summary Research Questions Experiments

“The floor is defined as the acknowledged what’s going-on within a psychological time/space. What’s going on can be the development of a topic or a function (teasing, soliciting a response, etc.) or an interaction of the two. It can be developed or controlled by one person at a time or by several simultaneously or in quick succession.”

• C. Edelsky, “Who’s got the floor?” p. 405

Motivation Methodology Summary Research Questions Experiments

An encounter between two participants exhausts a situation, forming a fully-focused gathering. With more than two participants, there may be bystanders who are not themselves so engaged, changing the gathering into a partly-focused one. If more than three persons are present, there may be more than one encounter carried on in the same situation, resulting in a multi-focused gathering.

• E. Goffman, “Behavior in public places: Notes on

the social organization of gatherings” p. 91

Motivation Methodology Summary Research Questions Experiments

The co-existence of two turn-taking systems is the most decisive characteristic of schisming.

• H. Sacks, E. A. Schegloff, and G. Jefferson, “A simplest systematics for the
• rganization of turn-taking for conversation”
• C. Goodwin, “Forgetfulness as an interactive resource”

There is an interface between the two simultaneous conversations during schisming. Systemic differences exist between overlapping speech, and schisming.

• M. M. Egbert, “Schisming: The collaborative transformation from a single

conversation to multiple conversations”

Motivation Methodology Summary Research Questions Experiments

• 1. We can infer schisms without audio data!
• 2. Simultaneous speech provides a link

between the temporal and spatial notions

• f a conversing group!

Inferences!

Given a sliding window w of speaking duration d, consider a speaker to be a participant who speaks for the entire duration d The number of simultaneous speakers corresponds to the number of distinct conversation floors at that position of w

Motivation Methodology Summary Research Questions Experiments

Motivation Methodology Summary Research Questions Experiments

Choice of speaking window duration d

Speech Speech Speech Speech Within-overlap Gap Between-overlap S1 S2 Time

Scheme originally proposed by Heldner and Edlund and adopted by Levinson and Torreira

Motivation Methodology Summary Research Questions Experiments

RQ1 - Distinct floors within an F-formation

Examine the maximum number of simultaneous speakers over all positions of w.

Motivation Methodology Summary Research Questions Experiments

RQ2 - Effect of cardinality on turn duration

Train a Generalized Linear Model (GLM) on the data with an interaction factor between cardinality and speaking duration Assume Yi ~ P(𝜈i), and model 𝜈i as follows: di - speaking duration, ci- cardinality

Motivation Methodology Summary Research Questions Experiments

RQ2 - Effect of cardinality on turn duration

Coef (𝛄)

• Std. Err.

z P > |z| Intercept 0.0626 0.339 0.184 0.854 Turn-duration 0.0057 0.002 2.296 0.022** Cardinality 0.1869 0.072 2.603 0.009* Turn-duration : cardinality

• 0.0025

0.001

• 4.543

0.000006* * : significant at a level of 0.01 ** : significant at a level of 0.05

Motivation Methodology Summary Research Questions Experiments

RQ2 - Effect of cardinality on turn duration Post-hoc comparisons to ascertain differences between cardinalities Fit multiple GLMs to subset of data with each possible cardinality pair, and correct the p-values with six-way Bonferroni correction

Motivation Methodology Summary Research Questions Experiments

RQ2 - Effect of cardinality on turn duration

Cardinality Pairs Intercept (𝛄0) d (𝛄1) c (𝛄2) d:c (𝛄3) 4-5 0.196 0.855 0.794 0.403 4-6 0.364 0.0007 0.010 0.00002* 4-7 0.697 0.428 0.030 0.009 5-6 0.079 0.0008 0.016 0.00016* 5-7 0.434 0.413 0.043 0.052 6-7 0.275 0.006 0.657 0.024 d : duration, c: cardinality, * : significant at a level of 0.001

Motivation Methodology Summary Research Questions Experiments

Simultaneous speaker turns can be used as effective indicators of distinct conversations within a single F-formation An increase in cardinality of an F-formation correlates with a decrease in turn duration of simultaneous speakers

Motivation Methodology Summary Research Questions Experiments

Thanks! Questions?