The Power of Bots: Understanding Bots in OSS Projects Mairieli - - PowerPoint PPT Presentation

▶
the power of bots understanding bots in oss projects
SMART_READER_LITE
LIVE PREVIEW

The Power of Bots: Understanding Bots in OSS Projects Mairieli - - PowerPoint PPT Presentation

Mar 11, 2024 285 likes •514 views

The Power of Bots: Understanding Bots in OSS Projects Mairieli Wessel Bruno Mendes Igor Steinmacher Igor Wiese Ivanilton Polato Ana Paula Chaves Marco Aurlio Gerosa Research funded by CNPq, FAPESP and NAU Open Source Software (OSS)

slide-1
SLIDE 1

The Power of Bots: Understanding Bots in OSS Projects

Mairieli Wessel Bruno Mendes Igor Steinmacher Igor Wiese Ivanilton Polato Ana Paula Chaves Marco Aurélio Gerosa

Research funded by CNPq, FAPESP and NAU

slide-2
SLIDE 2

Open Source Software (OSS) Social-coding platforms Pull-based model

1

slide-3
SLIDE 3

Software agents that integrate their work with human tasks.

Bots

2

slide-4
SLIDE 4

How bots support software development productivity?

3

slide-5
SLIDE 5

Examine the current state of bots and identify directions for future work...

4

slide-6
SLIDE 6

How much impact do bots have in OSS? What challenges will bots bring to contributors and integrators of OSS?

… little is known about bots in OSS and their challenges

5

slide-7
SLIDE 7

6

slide-8
SLIDE 8

6

slide-9
SLIDE 9

6

slide-10
SLIDE 10

Research questions

  • RQ1. How common are bots in GitHub projects?
  • RQ2. How do the characteristics of pull requests

compare before and after the bot adoption?

  • RQ3. How do contributors and integrators

perceive bots’ support during the pull request submission process?

7

slide-11
SLIDE 11

Research questions

  • RQ1. How common are bots in GitHub projects?
  • RQ2. How do the characteristics of pull requests

compare before and after the bot adoption?

  • RQ3. How do contributors and integrators

perceive bots’ support during the pull request submission process? Survey with 3,371 contributors and 368 integrators Manual analysis of 351 projects (CL=95%, CI=5%) Quantitative analysis of time series

slide-12
SLIDE 12

Research questions

  • RQ1. How common are bots in GitHub projects?
  • RQ2. How do the characteristics of pull requests

compare before and after the bot adoption?

  • RQ3. How do contributors and integrators

perceive bots’ support during the pull request submission process? Survey with 3,371 contributors and 368 integrators Quantitative analysis of time series Manual analysis of 351 projects (CL=95%, CI=5%)

slide-13
SLIDE 13

Research questions

  • RQ1. How common are bots in GitHub projects?
  • RQ2. How do the characteristics of pull requests

compare before and after the bot adoption?

  • RQ3. How do contributors and integrators

perceive bots’ support during the pull request submission process? Survey with 3,371 contributors and 368 integrators Quantitative analysis of time series Manual analysis of 351 projects (CL=95%, CI=5%)

slide-14
SLIDE 14
  • RQ1. How common are bots in GitHub projects?

48

differents bots in 93 projects

We identified that ... … almost one-third of the projects adopted at least one bot.

8

slide-15
SLIDE 15

Ensure license agreement signing Review code Review pull requests Assign reviewers Welcome newcomers

9 7 7 4 10 7

slide-16
SLIDE 16
  • RQ2. How do the characteristics of pull requests compare before and

after the bot adoption?

The differences related to number of commits, number of changed files, and closed time before and after bot adoption were not consistent.

10

slide-17
SLIDE 17
  • RQ3. How do contributors and integrators perceive the relevance of bot

support during the pull request process?

Assisted by #of answers (%)

Bots only 7 (3.4%) Project members only 9 (4.4%) Bots and project members 189 (92.2%)

Based on your experience, it was easier to contribute to the project when assisted by…

11

slide-18
SLIDE 18
  • RQ3. How do contributors and integrators perceive the relevance of bot

support during the pull request process?

The most recurrent challenge is that bots have poor decision support mechanisms (39 mentions).

We are not smart enough yet. 12

slide-19
SLIDE 19
  • RQ3. How do contributors and integrators perceive the relevance of bot

support during the pull request process?

Make the bots smarter Improve code review Improve notification/awareness Enhance user interaction Improvements proposed by contributors and integrators. 13

slide-20
SLIDE 20

What we found...

14

  • RQ1. Almost one-third of the projects adopted at least one bot.
  • RQ2. The most noticeable difference regarded the number of

comments per pull request.

  • RQ3. Contributors want smart bots and integrators want bots that

satisfy their needs.

slide-21
SLIDE 21

Thank you!

You can find me at: mairieli.com mairieli@ime.usp.br @mairieliw

Credits to Freepik for the images used in this presentation!

slide-22
SLIDE 22

The Power of Bots: Understanding Bots in OSS Projects

Mairieli Wessel Bruno Mendes Igor Steinmacher Igor Wiese Ivanilton Polato Ana Paula Chaves Marco Aurélio Gerosa

Research funded by CNPq, FAPESP and NAU