A Gamified Requirements Inspection Process for Goal Models Joo - - PowerPoint PPT Presentation

▶
a gamified requirements inspection process for goal models
SMART_READER_LITE
LIVE PREVIEW

A Gamified Requirements Inspection Process for Goal Models Joo - - PowerPoint PPT Presentation

May 05, 2023 131 likes •593 views

[ACM SAC 2018 RE Track] A Gamified Requirements Inspection Process for Goal Models Joo Pimentel Emanuel Santos Tarcisio Pereira thats me Daniel Ferreira Jaelson Castro UFRPE 1 [agenda] 1) Context and Motivation 2) Proposal

slide-1
SLIDE 1

A Gamified Requirements Inspection Process for Goal Models

João Pimentel Emanuel Santos Tarcisio Pereira Daniel Ferreira Jaelson Castro that’s me

UFRPE [ACM SAC 2018 – RE Track]

1

slide-2
SLIDE 2

2

1) Context and Motivation 2) Proposal (gamified process) 3) Evaluation

[agenda]

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

slide-3
SLIDE 3

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

Inspection is an effective verification approach

3

Bosu, A., Greiler, M., & Bird, C. (2015, May). Characteristics of useful code reviews: An empirical study at microsoft. In Mining Software Repositories (MSR), 2015 IEEE/ACM 12th Working Conference on (pp. 146-156).

slide-4
SLIDE 4

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

4

Bell, T. E., & Thayer, T. A. (1976, October). Software requirements: Are they really a problem?. In Proceedings of the 2nd international conference on Software engineering (pp. 61-68). IEEE Computer Society Press.

slide-5
SLIDE 5

2015 Survey with 247 practitioners 55% of participants declared to perform some form of requirements review

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

5

Kassab, M. (2015, August). The changing landscape of requirements engineering practices over the past decade. In Empirical Requirements Engineering (EmpiRE), 2015 IEEE Fifth International Workshop on.

slide-6
SLIDE 6

Online Store

Shopping Cart Security Internet Orders Handled Pay Add Item

Goal Task Actor Softgoal Legend Means- end link Decomposition link

i*

iStar

6

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

slide-7
SLIDE 7

Is there an inspection process for i* goal models?

7

slide-8
SLIDE 8

Is there a inspection process for goal models?

8

NO

*

*to the best of our knowledge

slide-9
SLIDE 9

Ring-i

Requirements Inspection Gamified process for i* Models

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

9

slide-10
SLIDE 10

10

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

slide-11
SLIDE 11

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

11

Online Store

Shopping Cart Security Internet Orders Handled Pay Add Item

Goal Task Actor Softgoal Legend Means- end link Decomposition link

slide-12
SLIDE 12

Online Store

Shopping Cart Security Internet Orders Handled Pay Add Item

Goal Task Actor Softgoal Legend Means- end link Decomposition link 1 3 2 4 5 6

FINISH

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

12

slide-13
SLIDE 13

Online Store

Shopping Cart Security Internet Orders Handled Pay Add Item

Goal Task Actor Softgoal Legend Means- end link Decomposition link 1 3 2 4 5 6

FINISH

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

13

slide-14
SLIDE 14

Online Store

Shopping Cart Security Internet Orders Handled Pay Add Item

Goal Task Actor Softgoal Legend Means- end link Decomposition link 1 3 2 4 5 6

FINISH

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

14

slide-15
SLIDE 15

ty

nd Means- end link Decomposition link 3 2 6

FINISH

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

15

GOAL TASK ACTOR SOFTGOAL

slide-16
SLIDE 16

Online Store

Shopping Cart Security Internet Orders Handled Pay Add Item

Goal Task Actor Softgoal Legend Means- end link Decomposition link 1 3 2 4 5 6

FINISH

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

16

slide-17
SLIDE 17

Online Store

Shopping Cart Security Internet Orders Handled Pay Add Item

Goal Task Actor Softgoal Legend Means- end link Decomposition link 1 3 2 4 5 6

FINISH

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

17

slide-18
SLIDE 18

Online Store

Shopping Cart Security Internet Orders Handled Pay Add Item

Goal Task Actor Softgoal Legend Means- end link Decomposition link 1 3 2 4 5 6

FINISH

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

18

slide-19
SLIDE 19

Online Store

Shopping Cart Security Internet Orders Handled Pay Add Item

Goal Task Actor Softgoal Legend Means- end link Decomposition link 1 3 2 4 5 6

FINISH

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

19

slide-20
SLIDE 20

Online Store

Shopping Cart Security Internet Orders Handled Pay Add Item

Goal Task Actor Softgoal Legend Means- end link Decomposition link 1 3 2 4 5 6

FINISH

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

20

slide-21
SLIDE 21

Online Store

Shopping Cart Security Internet Orders Handled Pay Add Item

Goal Task Actor Softgoal Legend Means- end link Decomposition link 1 3 2 4 5 6

FINISH

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

21

slide-22
SLIDE 22

123 different cards Based on Literature Interviews Protocol analysis

22

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

slide-23
SLIDE 23

23

Some cards are not actual ‘inspection’

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

slide-24
SLIDE 24

24

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

slide-25
SLIDE 25
  • Incomplete coverage
  • Not every element is inspected
  • Not every inspection heuristic is applied
  • Does it make sense to continue after a big

change?

25

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

[agenda]

slide-26
SLIDE 26

Empirical Evaluation

26

slide-27
SLIDE 27

18 students 5 groups

i* training i* project Ring-i session

Questionaire

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

27

slide-28
SLIDE 28

Able to execute the process without training Perceived as useful Perceived as fun Perceived as easy to use Would recommend Would use it again?

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

28

EASE OF USE FUN ACCEPTANCE USEFULNESS

slide-29
SLIDE 29

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

29

slide-30
SLIDE 30

Limitations of this evaluation

  • Students as subjects
  • Small sample size
  • Lack of control group for comparison

30

slide-31
SLIDE 31

Future work & conclusion

31

slide-32
SLIDE 32

Future work

  • Expand and update the inspection cards
  • Test different game mechanics (e.g. RPG)
  • Validate with industry and i* experts
  • Create a non-gamified version

32

slide-33
SLIDE 33

33

RE goal models inspection Ring-i Artefacts: www.cin.ufpe.br/~ler/istargame

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

Requirements inspection

[context] [evaluation] [proposal]

slide-34
SLIDE 34

Thank you!

34

slide-35
SLIDE 35

Analyze the Ring-i process; for the purpose of evaluation and improvement; with respect to its use by non-experts on i*; from the point of view of software engineers; in the context of students applying the process on their

  • wn projects.

REQUIREMENTS ENGINEERING TRACK - A Gamified Requirements Inspection Process for Goal Models

35

slide-36
SLIDE 36

Distribution of changes resulting from the Ring-i process

36

slide-37
SLIDE 37

Questionnaire answers regarding error discovery

37

slide-38
SLIDE 38

Questionnaire answers regarding improvements to the model

38

slide-39
SLIDE 39

Questionnaire answers on whether respondents learned more about i* with the process

39

slide-40
SLIDE 40

Questionnaire answers regarding usefulness, directly

40

slide-41
SLIDE 41

Questionnaire answers regarding process enjoyment

41

slide-42
SLIDE 42

Questionnaire answers regarding ease of use, directly

42

slide-43
SLIDE 43

Questionnaire answers regarding ease of use, indirectly

43

slide-44
SLIDE 44

Questionnaire answers regarding acceptance of the proposal

44