Empirical Study: Expert Finding Matthieu Vergne vergne@fbk.eu - - PowerPoint PPT Presentation

▶

Sep 11, 2023 240 likes •487 views

Presentation Experiment Conclusion Empirical Study: Expert Finding Matthieu Vergne vergne@fbk.eu Fondazione Bruno Kessler Information and Communication Technology University of Trento February 19th, 2014 Empirical Study: Expert Finding 1/

SLIDE 1

Presentation Experiment Conclusion

Empirical Study: Expert Finding

Matthieu Vergne

vergne@fbk.eu

Fondazione Bruno Kessler Information and Communication Technology University of Trento

February 19th, 2014

Empirical Study: Expert Finding 1/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 2

Presentation Experiment Conclusion

Outline

1 Presentation 2 Experiment 3 Conclusion

Empirical Study: Expert Finding 2/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 3

Presentation Experiment Conclusion

Your Role

Context: Your position: requirement analyst in a small IT company

Check the needs of your customers are met and the necessary constraints are considered.

Empirical Study: Expert Finding 3/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 4

Presentation Experiment Conclusion

Your Role

Context: Your position: requirement analyst in a small IT company

Check the needs of your customers are met and the necessary constraints are considered.

Your job: refine a set of requirements on some topics

Empirical Study: Expert Finding 3/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 5

Presentation Experiment Conclusion

Your Role

Context: Your position: requirement analyst in a small IT company

Check the needs of your customers are met and the necessary constraints are considered.

Your job: refine a set of requirements on some topics Problem: no time to browse the web and read hundreds of documents

Empirical Study: Expert Finding 3/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 6

Presentation Experiment Conclusion

Your Role

Context: Your position: requirement analyst in a small IT company

Check the needs of your customers are met and the necessary constraints are considered.

Your job: refine a set of requirements on some topics Problem: no time to browse the web and read hundreds of documents Solution: find people to help you refining these requirements

Empirical Study: Expert Finding 3/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 7

Presentation Experiment Conclusion

Your Role

Context: Your position: requirement analyst in a small IT company

Check the needs of your customers are met and the necessary constraints are considered.

Your job: refine a set of requirements on some topics Problem: no time to browse the web and read hundreds of documents Solution: find people to help you refining these requirements Suggestion: look in broad Open Source communities

Empirical Study: Expert Finding 3/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 8

Presentation Experiment Conclusion

Your Role

Context: Your position: requirement analyst in a small IT company

Check the needs of your customers are met and the necessary constraints are considered.

Your job: refine a set of requirements on some topics Problem: no time to browse the web and read hundreds of documents Solution: find people to help you refining these requirements Suggestion: look in broad Open Source communities Candidate: XWiki, Open Source tool to build collaborative content managers (Wikis)

Empirical Study: Expert Finding 3/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 9

Presentation Experiment Conclusion

Your Role

Context: Your position: requirement analyst in a small IT company

Check the needs of your customers are met and the necessary constraints are considered.

Your job: refine a set of requirements on some topics Problem: no time to browse the web and read hundreds of documents Solution: find people to help you refining these requirements Suggestion: look in broad Open Source communities Candidate: XWiki, Open Source tool to build collaborative content managers (Wikis) Final goal: evaluate people’s expertises in the XWiki mailing lists.

Empirical Study: Expert Finding 3/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 10

Presentation Experiment Conclusion

Dataset: XWiki mailing list

URL:

http://selab.fbk.eu/vergne/Experiment-2014-02-19/dataset

Empirical Study: Expert Finding 4/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 11

Presentation Experiment Conclusion

Dataset: XWiki mailing list

URL:

http://selab.fbk.eu/vergne/Experiment-2014-02-19/dataset

ZIP: (also available on USB key)

http://selab.fbk.eu/vergne/Experiment-2014-02-19/dataset.zip

Empirical Study: Expert Finding 4/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 12

Presentation Experiment Conclusion

Dataset: XWiki mailing list

URL:

http://selab.fbk.eu/vergne/Experiment-2014-02-19/dataset

ZIP: (also available on USB key)

http://selab.fbk.eu/vergne/Experiment-2014-02-19/dataset.zip

Quick presentation

Empirical Study: Expert Finding 4/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 13

Presentation Experiment Conclusion

Dataset: XWiki mailing list

URL:

http://selab.fbk.eu/vergne/Experiment-2014-02-19/dataset

ZIP: (also available on USB key)

http://selab.fbk.eu/vergne/Experiment-2014-02-19/dataset.zip

Quick presentation For fairness, use only the search feature of your browser!

Empirical Study: Expert Finding 4/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 14

Presentation Experiment Conclusion

Questionnaires

Resources: Guidelines

Empirical Study: Expert Finding 5/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 15

Presentation Experiment Conclusion

Questionnaires

Resources: Guidelines Pre-questionnaire

Empirical Study: Expert Finding 5/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 16

Presentation Experiment Conclusion

Questionnaires

Resources: Guidelines Pre-questionnaire 2 Questionnaires (one after the other)

Empirical Study: Expert Finding 5/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 17

Presentation Experiment Conclusion

Questionnaires

Resources: Guidelines Pre-questionnaire 2 Questionnaires (one after the other) Post-questionnaire

Empirical Study: Expert Finding 5/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 18

Presentation Experiment Conclusion

Questionnaires

Resources: Guidelines Pre-questionnaire 2 Questionnaires (one after the other) Post-questionnaire You keep the guidelines, but the questionnaires are taken back when filled.

Empirical Study: Expert Finding 5/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 19

Presentation Experiment Conclusion

Experiment

If you have questions, put a hand up. I will come to you. Following the guidelines:

1 ID assigned to you with your guidelines

Empirical Study: Expert Finding 6/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 20

Presentation Experiment Conclusion

Experiment

If you have questions, put a hand up. I will come to you. Following the guidelines:

1 ID assigned to you with your guidelines 2 Pre-questionnaire

Empirical Study: Expert Finding 6/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 21

Presentation Experiment Conclusion

Experiment

If you have questions, put a hand up. I will come to you. Following the guidelines:

1 ID assigned to you with your guidelines 2 Pre-questionnaire 3 Questionnaire A

Specific topic Requirement analyst searching for support to refine a set of requirements Duration: around 20 minutes (notification 11:46, end 11:51).

Empirical Study: Expert Finding 6/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 22

Presentation Experiment Conclusion

Experiment

If you have questions, put a hand up. I will come to you. Following the guidelines:

1 ID assigned to you with your guidelines 2 Pre-questionnaire 3 Questionnaire A

Specific topic Requirement analyst searching for support to refine a set of requirements Duration: around 20 minutes (notification 11:46, end 11:51).

4 Questionnaire B

Different topic, but same task Duration: around 20 minutes (notification 12:09, end 12:14).

Empirical Study: Expert Finding 6/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 23

Presentation Experiment Conclusion

Experiment

If you have questions, put a hand up. I will come to you. Following the guidelines:

1 ID assigned to you with your guidelines 2 Pre-questionnaire 3 Questionnaire A

Specific topic Requirement analyst searching for support to refine a set of requirements Duration: around 20 minutes (notification 11:46, end 11:51).

4 Questionnaire B

Different topic, but same task Duration: around 20 minutes (notification 12:09, end 12:14).

5 Post-questionnaire

Privacy statement + contact information

Empirical Study: Expert Finding 6/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School

SLIDE 24

Presentation Experiment Conclusion

That’s it!

The experiment is finished. Thanks for your participation. Questions?

Empirical Study: Expert Finding 7/ 7 Matthieu Vergne (vergne@fbk.eu) FBK - ICT Doctoral School