Making Peripheral Participation Legitimate Aaron Halfaker - - PowerPoint PPT Presentation

▶
making peripheral participation legitimate
SMART_READER_LITE
LIVE PREVIEW

Making Peripheral Participation Legitimate Aaron Halfaker - - PowerPoint PPT Presentation

Jan 25, 2023 5 likes •457 views

Making Peripheral Participation Legitimate Aaron Halfaker halfaker@cs.umn.edu Oliver Keyes okeyes@wikimedia.org Dario Taraborelli dtaraborelli@wikimedia.org Wikipedia's scale Wikipedia's scale Planet Earth (6.97 billion) Data from March

slide-1
SLIDE 1

Making Peripheral Participation Legitimate

Aaron Halfaker

halfaker@cs.umn.edu

Oliver Keyes

  • keyes@wikimedia.org

Dario Taraborelli

dtaraborelli@wikimedia.org

slide-2
SLIDE 2

Wikipedia's scale

slide-3
SLIDE 3

Planet Earth

(6.97 billion)

Wikipedia's scale

Data from March 2012

slide-4
SLIDE 4

Monthly Wikipedia Readers (1.47 billion) Data from March 2012

Planet Earth

(6.97 billion)

Wikipedia's scale

slide-5
SLIDE 5

Monthly Wikipedia Readers (1.47 billion) Monthly Wikipedia editors (113,304) Data from March 2012

Planet Earth

(6.97 billion)

Wikipedia's scale

slide-6
SLIDE 6

The Powerlaw of Participation

Wilkinson, D. Strong regularities in online peer production. In Ecommerce ’ 08, ACM (2008), 302–309

slide-7
SLIDE 7

Wikipedia as a system

Wikipedia Users' time & energy

slide-8
SLIDE 8

Wikipedia as a system

Wikipedia Users' time & energy

Monthly Wikipedia Readers (1.47 billion)

slide-9
SLIDE 9

Legitimate Peripheral Participation

Lave & Wenger

Situated learning: Legitimate peripheral participation. Cambridge University Press, 1991.

How do newcomers enter communities of practice? "Community of Practice"?

slide-10
SLIDE 10

Legitimate Peripheral Participation

  • A group of people

with a specific skill.

  • Newcomers seek to

gain skills and enter community

slide-11
SLIDE 11

Legitimate Peripheral Participation

Newcomer Community of people doing a thing

slide-12
SLIDE 12

Legitimate Peripheral Participation

Newcomer Community of people doing a thing

slide-13
SLIDE 13

Legitimate Peripheral Participation

Newcomer Community of people doing a thing

slide-14
SLIDE 14

Legitimate Peripheral Participation

Newcomer Community of people doing a thing

Newcomer evaluates community. Community evaluates newcomer.

slide-15
SLIDE 15

Legitimate Peripheral Participation

  • 1. Simple
  • 2. Low risk
  • 3. Productive
slide-16
SLIDE 16

Legitimate Peripheral Participation

  • 1. Simple
  • 2. Low risk
  • 3. Productive

Becoming Wikipedian - Bryant, Forte & Bruckman, GROUP'05

At the periphery of Wikipedia, novice users contribute by reading articles out of interest, noting mistakes or

  • missions, and correcting them.
slide-17
SLIDE 17

Wikipedia's changed since 2005

Newcomers' first edits

  • More complex
  • Higher risk of failure
slide-18
SLIDE 18

Difficulty of first edit increasing.

Halfaker, A., Gieger, R. S., Morgan, J., & Riedl, J. (in-press). The Rise and Decline of an Open Collaboration System: How Wikipedia's reaction to sudden popularity is causing its decline. American Behavioral Scientist

slide-19
SLIDE 19

8

slide-20
SLIDE 20

12

slide-21
SLIDE 21

8

slide-22
SLIDE 22

11

slide-23
SLIDE 23

13

slide-24
SLIDE 24

Wikipedia's policy on verifiability. 1366 x 5878 px

slide-25
SLIDE 25

What do?

Extend the periphery with:

  • Simple
  • Low risk
  • Productive
slide-26
SLIDE 26
slide-27
SLIDE 27
  • Simple
  • Low risk
  • Productive?
slide-28
SLIDE 28

The Article Feedback Tool

slide-29
SLIDE 29

The Article Feedback Tool

3 experiments

  • 1% sample of articles
  • Forms #1, #2 and #3

○

Dec 27th 2011 - Jan 24th 2012

■

Sampled 4353 submissions

slide-30
SLIDE 30

The Article Feedback Tool

3 experiments

  • 1% sample of articles
  • Forms #1, #2 and #3

○

Dec 27th 2011 - Jan 24th 2012

■

Sampled 4353 submissions

  • Prominent links A and E

○

Apr 5th - 19th 2012

■

Sampled 3710 submissions

slide-31
SLIDE 31

The Article Feedback Tool

3 experiments

  • 1% sample of articles
  • Forms #1, #2 and #3

○

Dec 27th 2011 - Jan 24th 2012

■

Sampled 4353 submissions

  • Prominent links A and E

○

Apr 5th - 19th 2012

■

Sampled 3710 submissions

  • Call to action form #4

○

Apr 27th - May 7th 2012

■

Sampled all new editors

slide-32
SLIDE 32

The Article Feedback Tool

3 experiments

  • 1% sample of articles
  • Forms #1, #2 and #3

○

Dec 27th 2011 - Jan 24th 2012

■

Sampled 4353 submissions

  • Prominent links A and E

○

Apr 5th - 19th 2012

■

Sampled 3710 submissions

  • Call to action form #4

○

Apr 27th - May 7th 2012

■

Sampled all new editors Feedback quality: Hand-coders: 20 Wikipedians

  • Categorized feedback
  • Rated for usefulness

New editor productivity:

  • Inferred from reverts
slide-33
SLIDE 33

Overview of Results

Quantity Quality Editors' concerns Readers' concerns

RQ1: How does the request affect the quantity and quality of feedback?

slide-34
SLIDE 34

Overview of Results

  • 1. "Did you find what you were looking for?"

○ Boost contribution rate by 45% over asking for rating ○ No loss in usefulness

condition submissions

slide-35
SLIDE 35

Overview of Results

RQ2: How does prominence affect the quality and quantity of feedback?

Quantity Quality Bottom of article Prominent

slide-36
SLIDE 36

Overview of Results

  • 2. Prominent button asking for feedback

○ Boost contribution rate by 108% ○ No loss in usefulness A E

improve this article

submissions condition

slide-37
SLIDE 37

Overview of Results

RQ3: How does the presence of the feedback form effect new editor conversion?

  • could cannibalize primary contributions (edits)
  • could be a stepping stone
slide-38
SLIDE 38

Overview of Results

  • 3. Invitation to edit after feedback submission

○ Boost new editor conversions by 151% ○ 20% drop in productivity*

slide-39
SLIDE 39

Conclusions

  • No tradeoff between quantity and quality of

participation

○

Rick Wash and Cliff Lampe. “The Power of the Ask in Social Media” Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW). Seattle, WA. February 2012.

slide-40
SLIDE 40

Conclusions

  • No tradeoff between quantity and quality of

participation

○

Rick Wash and Cliff Lampe. “The Power of the Ask in Social Media” Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW). Seattle, WA. February 2012.

  • Inviting readers to covert

○ Increases the rate of new editors ○ But at a lower success rate ○ Anti-vandalism tools negated cost to community

slide-41
SLIDE 41

Conclusions

  • No tradeoff between quantity and quality of

participation

○

Rick Wash and Cliff Lampe. “The Power of the Ask in Social Media” Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW). Seattle, WA. February 2012.

  • Inviting readers to covert

○ Increases the rate of new editors ○ But at a lower success rate ○ Anti-vandalism tools negated cost to community

  • Balance: contribution vs. cost of moderation
slide-42
SLIDE 42

Conclusions

Value of Contribution Cost of Moderation Value to Community

  • =
slide-43
SLIDE 43

Conclusions

Value of Contribution Cost of Moderation Value to Community

  • =

If you get this wrong, it's not going to work. E.g. this

slide-44
SLIDE 44

Thank you!

Aaron Halfaker http://halfaker.info Funded by NSF IIS 09-68483 and IIS 11-11201 Thanks to our Wikipedian volunteers:

Salim Fadhley, Fluffernutter, GorillaWarfare, Adam Hyland, Jamietw, John Minthorne, Tom Morris, Osarius, Rohit Patnaik, Utar and Whiteguru.

slide-45
SLIDE 45

Now everyone look at Dario

WE WANT YOU... FOR SCIENCE

  • Machine learning --> feedback moderation
  • Predictive models --> new editors
  • Cultural and language barriers to

participation

  • etc.