+ Argumentation-based Discussion for User Forum: A Research - - PowerPoint PPT Presentation

+

Argumentation-based Discussion for User Forum: A Research Preview

Itzel Morales Ramírez and Anna Perini

REFSQ 2014 Essen, Germany, April 2014

+ Outline

n Context + Motivation n Problem + Research questions n Ideas + Research plan n Conclusion

Argumentation-based Discussion for User Forum: A Research Preview Itzel Morales Ramírez

1

Thursday, April 17, 2014

+ Context + Motivation

n User forums provide a virtual space in which participants

exchange views on issues about a software application.

n Open source software (OSS) projects exploit this idea. n Users and volunteer developers of OSS communities engage

in discussions derived from initial requests.

n Data from: Apache OpenOffice (AOOo) bugzilla

Argumentation-based Discussion for User Forum: A Research Preview Itzel Morales Ramírez

2 +

Thursday, April 17, 2014

+ Problem

n Tedious discussions to be completely read n Sequential comments that hide an explicit recognition of

participants’ attitude (i.e. “in favor” or “against”) wrt. the initial request.

n Unclear identification of worth comments to be further analyzed

3 3

Thursday, April 17, 2014 Argumentation-based Discussion for User Forum: A Research Preview Itzel Morales Ramírez

+ Research questions

n RQ1. How can the attitude of the participants in user forums be

made explicit and recorded within the structure of a discussion?

n RQ2. How can a structured discussion support decisions on

what comments should be further analyzed?

4

✓ ✓

explicitly represented?

Thursday, April 17, 2014 Argumentation-based Discussion for User Forum: A Research Preview Itzel Morales Ramírez

+ Principal Ideas

n Argumentation is a natural way humans engage in a

discussion, based on arguments, in order to clarify or defend their opinions.

n Represent an online discussion as a structured set of

arguments according to the Argumentation Framework (AF).

n Dung’s framework:

n An argumentation framework (AF) is a pair: n AF= <A, Def> n A is a set of arguments. A={y1,…,yn}

(an argument is an abstract entity)

n Def is a binary relation of defeat between arguments. n Def (yi,yj) means that yi represents an attack against yj. n Ex1. A={y1,y2,y3} Def={(y1,y3), (y3,y1), (y2,y3)}

5 y1 y2 y3

Thursday, April 17, 2014 Argumentation-based Discussion for User Forum: A Research Preview Itzel Morales Ramírez

attacks attacks attacks

+ Recalling RQ1: Explicit participant’s attitude

n Computational construction of the argumentation-based

discussion forum (ADF) as a directed acyclic graph G=(V,E)

n (V)ertex n (E)dges

6 supports rejects neutral ID Participant Description Comment knowc Real number representing participant’s perception on their own expertise level.

Thursday, April 17, 2014 Argumentation-based Discussion for User Forum: A Research Preview Itzel Morales Ramírez

Participant’s attitude

+ Example

7

Excerpt of the discussion #112163 in AOOo bugzilla

c0 c1 c2 c3 c8 c11

0 Dotan Cohen Calc lets users have multiple… 1 2 eric.savary closed 0.5 neutral 3 Dotan Cohen Thanks, ES, but this is not… 1 rejects michael.r... 8 Reassigned to requirements. 0.75 supports 11 timdeaton Dotan’s… explain usefulness of this 0.5 supports duplicate 1 eric.savary rejects 0.5 Thursday, April 17, 2014 Argumentation-based Discussion for User Forum: A Research Preview Itzel Morales Ramírez

ADF graph

+ Recalling RQ2: Computing Relevant Comments

8

0 Dotan Cohen Calc lets users have multiple… 1 2 eric.savary closed 0.5 neutral 3 Dotan Cohen Thanks, ES, but this is not… 1 rejects michael.r... 8 Reassigned to requirements. 0.75 supports 11 timdeaton Dotan’s… explain usefulness of this 0.5 supports duplicate 1 eric.savary rejects 0.5 Thursday, April 17, 2014 Argumentation-based Discussion for User Forum: A Research Preview Itzel Morales Ramírez

n Algorithm for a quantitative evaluation based on graph search algorithms, it

evaluates the entire discussion.

4 5 6 7 9 10 s s s r r n

Discussion #112163 Total comments 12

+ Research plan

n Experiments using a graph library to manipulate graphs (with

extensions)

n Investigating Neo4j (for manipulating and storing huge data)

9 hasCustomers Input (txt files) Discussions #9437 (47 comments) *4 more to be analysed y0 y2 y1

rejects supports

ADF Graph Output

Thursday, April 17, 2014 Argumentation-based Discussion for User Forum: A Research Preview Itzel Morales Ramírez

+ Conclusion

n Present the Argumentation-based Discussion Forum

(ADF)

n Make an explicit representation of participants’ attitude (“in

favour” or “against”)

n Algorithm that will allow participants to get an overview of the

discussion and point out relevant comments

n Research plan

10

Thursday, April 17, 2014 Argumentation-based Discussion for User Forum: A Research Preview Itzel Morales Ramírez

+ Thank you very much for your attention!

Any questions?

11

Thursday, April 17, 2014 Argumentation-based Discussion for User Forum: A Research Preview Itzel Morales Ramírez

+ Recalling RQ2: Computing Relevant Comments

n Algorithm for a quantitative evaluation based on graph search

algorithms, it evaluates the entire discussion.

n Definition 5. Support relation strength. A given comment yj has

associated a support strength that is calculated based on the number of incoming support relations and the parameter knowc.

n Definition 6. Rejection relation strength. Idem n Definition 7. Relevant comments (RelC). A set of comments

where given a comment y belonging to the set there are no comments, included in the set, that reject y.

12 y0 y2 y1

rejects

y3

knowc

supports supports

y0 y2 y3

supports supports

Thursday, April 17, 2014 Argumentation-based Discussion for User Forum: A Research Preview Itzel Morales Ramírez

+ Overall approach

Thursday, April 17, 2014

13

Argumentation-based Discussion for User Forum: A Research Preview Itzel Morales Ramírez

Systematic approach for acquiring end-user feedback and deriving requirements knowledge from it.

+ Parallel ongoing work

n In parallel with this work, we are performing research on how to

use NLP to identify the attitude in unstructured text.

n Attitude that is derived from patterns in a conversation or that

can be derived from the intention of rejecting or supporting statements in a conversation.

Thursday, April 17, 2014

14

Argumentation-based Discussion for User Forum: A Research Preview Itzel Morales Ramírez

Perception Message Receiver Sender Agent Communicative Act 1..* *triggered by > 1 * * * 1 < propositional content of Proposition Action Contribution Intention (internal commitment) Speech act * < performance of 1 * < performance of 1 1 propositional content of > involves > Intentional Moment Belief Desire inheres in > Reflexive Intention 1 3 < performance

• f

Communicative Intention Topic < inheres in

+ Extension to the Communication ontology (CONTO)

Thursday, April 17, 2014

15

Argumentation-based Discussion for User Forum: A Research Preview Itzel Morales Ramírez Expressives Constantives Drawing Directives Assertives Informatives Confirmatives Concessives Descriptives Suggestives Suppositives Responsives Requestives Questions Requirements Thank Accept Reject Negative

• pinion

Positive

• pinion

Speech act Non linguistic act 1 < is interpreted in terms of

1

Gesture {disjoint} Attached information

+ What is explicit user feedback?

Explicit Implicit

Argumentation-based Discussion for User Forum: A Research Preview Itzel Morales Ramírez

16

I’m very happy today From your smile I guess you are happy

User feedback Meaningful information given by users of software applications with the purpose of suggesting new needs or improvements to them.

Thursday, April 17, 2014

+ Implementation (mock-up) (1)

Argumentation-based Discussion for User Forum: A Research Preview Itzel Morales Ramírez

17

Thursday, April 17, 2014

+ Implementation (mock-up) (2)

Argumentation-based Discussion for User Forum: A Research Preview Itzel Morales Ramírez

18

Thursday, April 17, 2014

+ Implementation

n Coordination with a colleague in Mexico: Eloy Fragoso

(flea07mx@gmail.com)

Thursday, April 17, 2014

19

Argumentation-based Discussion for User Forum: A Research Preview Itzel Morales Ramírez

+ Knowledge level classification [Ericsson2006]

n A novice is a person who will be considerably overloaded in

seeking to gather information, understand what it means.

n An initiate is a person who has at least an introductory

knowledge of the domain.

n An apprentice is a person who is learning beyond the

introductory knowledge of the domain.

n An advanced is a person who has acquired certain knowledge

that let her to perform activities unsupervised.

n An expert is someone who exhibits a high degree of

competence.

Argumentation-based Discussion for User Forum: A Research Preview Itzel Morales Ramírez

20

Thursday, April 17, 2014

+ Time complexity

n DFS has a time complexity (tc) , as every vertex must be

visited once. And the recursive part has tc . In total is .

n Investigate the complexity of our algorithms

Argumentation-based Discussion for User Forum: A Research Preview Itzel Morales Ramírez

21

Θ(m + n)

Θ(n)

Θ(m)

Thursday, April 17, 2014