WP5: Wikipedia Use Case Angelika Mhlbauer (Wikimedia), Kai Nissen - - PowerPoint PPT Presentation

▶
wp5 wikipedia use case angelika m hlbauer wikimedia kai
SMART_READER_LITE
LIVE PREVIEW

WP5: Wikipedia Use Case Angelika Mhlbauer (Wikimedia), Kai Nissen - - PowerPoint PPT Presentation

Feb 14, 2023 172 likes •379 views

WP5: Wikipedia Use Case Angelika Mhlbauer (Wikimedia), Kai Nissen (Wikimedia) 3 nd year review 21 November 2013 Karlsruhe Institute of Technology, Karlsruhe - Germany Main contributions in Y3 o Evaluation and improvement of the supporting tools

slide-1
SLIDE 1

WP5: Wikipedia Use Case

Angelika Mühlbauer (Wikimedia), Kai Nissen (Wikimedia)

3nd year review 21 November 2013 Karlsruhe Institute of Technology, Karlsruhe - Germany

slide-2
SLIDE 2

Main contributions in Y3

  • Evaluation and improvement of the supporting tools
  • 2 evaluation phases
  • Improvement of the software components according to

evaluation results and feedback comments

  • Documentation in D5.1.4

21/11/2013 www.render-project.eu 2

slide-3
SLIDE 3

Main contributions in Y3 – Article Monitor

21/11/2013 www.render-project.eu 3

slide-4
SLIDE 4

Main contributions in Y3 – Article List Generator

21/11/2013 www.render-project.eu 4

slide-5
SLIDE 5

Main contributions in Y3

  • Analysis of the influences on Wikipedia
  • Documented in D5.1.3
  • Implementation of the Interactive Limes Map
  • result of a cooperation the German Archaeological

Institute, WikiData and the Wikipedia project “Römischer Limes”

21/11/2013 www.render-project.eu 5

slide-6
SLIDE 6

Evaluation of the tools D5.1.4

  • Evaluation: In two phases
  • First phase Feb/Mar 2013
  • Final phase Jul/Aug 2013
  • First Phase:
  • 9 participants: 5 Article Monitor, 4 Article List Generator
  • Thinking Aloud Tests – 3 Tasks
  • Questionnaires – Assess understandability, benefit,

performance, efficiency and further needs → Improvement according to results and feedback

21/11/2013 www.render-project.eu 6

slide-7
SLIDE 7

Results of First Evaluation – Article Monitor

Component Requirements Priority * Realisation * Article Monitor Renaming of ASQM to Article Monitor high yes Restructuring the result box and renaming sections high yes Parameters are visible if results are available medium yes Statistics Visualisation of editor numbers: Author (+ IP) and linking to user page medium yes Visitors today → Visitors yesterday Visitors last 30 days → Visitors last month low yes Number of authors within a time period low no Analysis Approaches Improvement of description texts for Link Extractor, Change Detector and WikiGini high yes Improve the Link Extractor page: Optical separation of the example section and form section high yes General Performance problems → Moving to Wikimedia Labs high yes

* For the final release 21/11/2013 www.render-project.eu 7

slide-8
SLIDE 8

Results of First Evaluation – Article List Generator

Component Requirements Priority * Realisation * ALG Renaming TLG (Task List Generator) → ALG (Article List Generator) low yes Optimisation for the progress bar medium no Further language versions medium yes No underlines in result list visualisation in WikiSyntax low yes Presentation of number of results high yes Search terms Simpler search term insertions function high yes Auto completion high yes Allow the individual watch list as search terms medium yes Email function Fixing of bugs: no error message/ results if no email address was inserted high yes Filters More precise description texts (tool tips) high yes Additional Filters No links to an article medium yes Pending article (more than 12 hours) medium yes Missing sources medium no Abnormalities in article structure, style of speech and further formal parameters medium no General Performance problems → Moving to Wikimedia Labs high yes

* For the final release 21/11/2013 www.render-project.eu 8

slide-9
SLIDE 9

Supporting tools

  • Final versions of tools released at the end of June 2013
  • Available at: http://tools.wmflabs.org/render/stools/
  • Demo of the Article Monitor and the Article List Generator

21/11/2013 www.render-project.eu 9

slide-10
SLIDE 10

Results of Final Evaluation

  • Final Phase - Jul/ Aug 2013:
  • Online Questionnaires
  • Assess understandability, benefit, performance, efficiency,

hints to contribute and how, further needs

  • 25 participants:
  • 16 Article Monitor
  • 9 Article List Generator

21/11/2013 www.render-project.eu 10

slide-11
SLIDE 11

Results of Final Evaluation

  • Article Monitor:
  • 64 installations between 21.6. and 26.8.2013
  • 675 articles requested
  • Article List Generator:
  • 447 requests
  • 380 DE, 67 EN

21/11/2013 www.render-project.eu 11

20 40 60 80 100 120 140 160

Number requests per filter

slide-12
SLIDE 12

Evaluation Results – Article Monitor

21/11/2013 www.render-project.eu 12

  • Better assessment for understandability and benefit in EP2
  • Performance problems were caused by initial difficulties of

Wiki Labs

1 1,5 2 2,5 3 3,5 4 Understand Benefit Performance Efficiency ratings

Article Monitor: User Ratings (EP1 - EP2)

EP1 EP2

slide-13
SLIDE 13

Evaluation Results – Article List Generator

21/11/2013 www.render-project.eu 13

1 1,5 2 2,5 3 3,5 4 Understand Benefit Performance Efficiency ratings

ALG: User Ratings (EP1 - EP2)

EP1 EP2

  • Better assessment for performance and understandability
  • Assessment of benefit is slightly worse but still positive
  • Similar assessment results for efficiency in both phases
slide-14
SLIDE 14

Evaluation Results - Summary

  • The supporting tools
  • provide valuable information for the users for improving

the articles

  • have the potential to become highly productive

instruments to support Wikipedia users

  • Some adaptions could increase the number of users

extremely

  • We identified several points and requirements for the future

→ Next steps will go close together with community

21/11/2013 www.render-project.eu 14

slide-15
SLIDE 15

Influence on Wikipedia D5.1.3

  • Methodology of analysis
  • Logging of requests between 21.06. – 26.08.
  • Reproduction of requests
  • Questionnaires: additional questions concerning the

rating of the outcomes and their usefulness to contribute In all cases we had to respect privacy aspects!

21/11/2013 www.render-project.eu 15

slide-16
SLIDE 16

Influence on Wikipedia

  • We found first results that the RENDER supporting tools

influence the diversity indirectly

  • Many-Eyes-Principle:

By increasing the visibility of articles we increase the quality and diversity

21/11/2013 www.render-project.eu 16

slide-17
SLIDE 17

Contribution to the project

  • Bring diverse information throughout different language

versions of Wikipedia articles closer together

  • Summarizing different metrics about an article or providing

suggestions about what may be missing → Attract people to edit in Wikipedia → Keep raising the number of active authors → Wider diversity of authors

21/11/2013 www.render-project.eu 17

slide-18
SLIDE 18

Future Steps

  • Further maintaining and expansion together with community
  • Integrated versions of the tools
  • Expansion for further language versions
  • First discussions for pilot project together for Wikimedia

India

  • WikiCon2013 - 22.- 24.11. in Karlsruhe (Workshop)
  • Research partners to re-use and individualize tools for

further analysis; inclusion of further analysis approaches

  • All component are open source available on Wikimedia

Labs and Github

21/11/2013 www.render-project.eu 18

slide-19
SLIDE 19

The Limes Map

  • Collaboration of RENDER with the German Archaeological

Institute, WikiData and the Wikipedia Project “Römischer Limes”

  • Symposium “Wikidata trifft Archäologie“, 16 March 2013, Berlin

21/11/2013 www.render-project.eu 19 http://tools.wmflabs.org/render-tests/limes/web/

slide-20
SLIDE 20

Thank you