Keeping Evolving Requirements and Acceptance Tests Aligned with Automatically Generated Guidance
Eya Ben Charrada Sofija Hotomski Martin Glinz
Keeping Evolving Requirements and Acceptance Tests Aligned with - - PowerPoint PPT Presentation
Keeping Evolving Requirements and Acceptance Tests Aligned with Automatically Generated Guidance Sofija Hotomski Eya Ben Charrada Martin Glinz Agenda 1. Context, background and motivation 2. Our approach and tool 3. Evaluation 4. Summary
Eya Ben Charrada Sofija Hotomski Martin Glinz
2
motivation
Requirement id: REQ1 Title: Group chat management – adding users to a group Text: A user can add new users to the group. The addition of a new user must be first approved by the admin. The admin can modify personal data and the status of a user. Test id: AT1 Title: Test for REQ1 (Group chat management – adding users to a group) Prerequisites: Internet connection is needed. Steps: Expected results:
Login is successful
The page is opened and the list with users’ groups
"Manage group” next and there is a button “Add users” to the Group 1. in the upper, right corner. … …
3
4
4
4
TESTERS ARE NOT AWARE
4
TESTERS ARE NOT AWARE
4
TESTERS ARE NOT AWARE BUGS FOR FEATURES
5
Non-aligned documents
5
Poor communication Non-aligned documents
5
Poor communication Non-aligned documents
5
False expectations
Poor communication Non-aligned documents
5
False expectations
Poor communication Non-aligned documents
5
False expectations
Poor communication Non-aligned documents
5
False expectations
Poor communication Non-aligned documents
5
False expectations
6
7
8
8
Generate guidance
8
Generate guidance Notification system
9
A user can add new users to the group. The addition of a new user must be first approved by the admin. The admin and the user can modify personal data and the status of that a
its status. The admin must be logged-in in order to modify personal data of a user.
10
addition of a new user must be first approved by the admin. A user can add new users to the group. The addition of a new user must be first approved by the admin. The admin and the user can modify personal data and the status of that a
its status. The admin must be logged-in in order to modify personal data of a user.
10
addition of a new user must be first approved by the admin. A user can add new users to the group. The addition of a new user must be first approved by the admin. The admin and the user can modify personal data and the status of that a
its status. The admin must be logged-in in order to modify personal data of a user.
10
data of that user. Add the steps or modify the expected results which verify this activity.
addition of a new user must be first approved by the admin. A user can add new users to the group. The addition of a new user must be first approved by the admin. The admin and the user can modify personal data and the status of that a
its status. The admin must be logged-in in order to modify personal data of a user.
10
admin can modify the status of a user.
data of that user. Add the steps or modify the expected results which verify this activity.
addition of a new user must be first approved by the admin. A user can add new users to the group. The addition of a new user must be first approved by the admin. The admin and the user can modify personal data and the status of that a
its status. The admin must be logged-in in order to modify personal data of a user.
10
admin can modify the status of a user.
data of that user. Add the steps or modify the expected results which verify this activity.
addition of a new user must be first approved by the admin. A user can add new users to the group. The addition of a new user must be first approved by the admin. The admin and the user can modify personal data and the status of that a
its status. The admin must be logged-in in order to modify personal data of a user.
10
admin can modify the status of a user.
the admin must be logged-in in order to modify personal data of a user.
data of that user. Add the steps or modify the expected results which verify this activity.
to the group.
to the group. The sentences in oldReq: The sentences in newReq:
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
logged-in in order to modify personal data of a user.
to the group.
to the group. The sentences in oldReq: The sentences in newReq: Similarity Score (S):
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
logged-in in order to modify personal data of a user.
to the group.
to the group. The sentences in oldReq: The sentences in newReq: Similarity Score (S):
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
logged-in in order to modify personal data of a user.
to the group.
to the group. The sentences in oldReq: The sentences in newReq: Similarity Score (S):
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
S = 1
logged-in in order to modify personal data of a user.
to the group.
to the group. The sentences in oldReq: The sentences in newReq: Similarity Score (S):
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
S = 1 Unchanged sentences
logged-in in order to modify personal data of a user.
to the group.
to the group. The sentences in oldReq: The sentences in newReq: Similarity Score (S):
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
S = 1 Unchanged sentences
logged-in in order to modify personal data of a user.
to the group.
to the group. The sentences in oldReq: The sentences in newReq: Similarity Score (S):
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
S = 1 Unchanged sentences
logged-in in order to modify personal data of a user.
to the group.
to the group. The sentences in oldReq: The sentences in newReq: Similarity Score (S):
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
S = 1 S = 0.36 Unchanged sentences
logged-in in order to modify personal data of a user.
to the group.
to the group. The sentences in oldReq: The sentences in newReq: Similarity Score (S):
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
S = 1 S = 0.36 Unchanged sentences
logged-in in order to modify personal data of a user.
to the group.
to the group. The sentences in oldReq: The sentences in newReq: Similarity Score (S):
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
S = 1 S = 0.36 Unchanged sentences
logged-in in order to modify personal data of a user.
to the group.
to the group. The sentences in oldReq: The sentences in newReq: Similarity Score (S):
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
S = 1 S = 0.36 Unchanged sentences
logged-in in order to modify personal data of a user. Similarity threshold = 0.6
to the group.
to the group. The sentences in oldReq: The sentences in newReq: Similarity Score (S):
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
S = 1 S = 0.36 Unchanged sentences
logged-in in order to modify personal data of a user. Similarity threshold = 0.6
to the group.
to the group. The sentences in oldReq: The sentences in newReq: Similarity Score (S):
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
S = 1 S = 0.36 Unchanged sentences
logged-in in order to modify personal data of a user. Similarity threshold = 0.6
to the group.
to the group. The sentences in oldReq: The sentences in newReq: Similarity Score (S):
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
S = 1 S = 0.36 Unchanged sentences
logged-in in order to modify personal data of a user. Similarity threshold = 0.6
to the group.
to the group. The sentences in oldReq: The sentences in newReq: Similarity Score (S):
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
S = 1 S = 0.36 Unchanged sentences
logged-in in order to modify personal data of a user. Similarity threshold = 0.6
to the group.
to the group. The sentences in oldReq: The sentences in newReq: Similarity Score (S):
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
S = 1 S = 0.36 Unchanged sentences
logged-in in order to modify personal data of a user. Similarity threshold = 0.6
to the group.
to the group. The sentences in oldReq: The sentences in newReq: Similarity Score (S):
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
S = 1 S = 0.36 S = 0.47 Unchanged sentences
logged-in in order to modify personal data of a user. Similarity threshold = 0.6
to the group.
to the group. The sentences in oldReq: The sentences in newReq: Similarity Score (S):
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
S = 1 S = 0.36 S = 0.47 Unchanged sentences
logged-in in order to modify personal data of a user. Similarity threshold = 0.6
to the group.
to the group. The sentences in oldReq: The sentences in newReq: Similarity Score (S):
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
S = 1 S = 0.36 S = 0.47 Unchanged sentences
logged-in in order to modify personal data of a user. Similarity threshold = 0.6
to the group.
to the group. The sentences in oldReq: The sentences in newReq: Similarity Score (S):
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
S = 1 S = 0.36 S = 0.47 Unchanged sentences
logged-in in order to modify personal data of a user. Similarity threshold = 0.6
to the group.
to the group. The sentences in oldReq: The sentences in newReq: Similarity Score (S):
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
S = 1 S = 0.36 S = 0.47 Unchanged sentences
logged-in in order to modify personal data of a user. Similarity threshold = 0.6
to the group.
to the group. The sentences in oldReq: The sentences in newReq: Similarity Score (S):
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
S = 1 S = 0.36 S = 0.47 Unchanged sentences
logged-in in order to modify personal data of a user. Similarity threshold = 0.6
to the group.
to the group. The sentences in oldReq: The sentences in newReq: Similarity Score (S):
user must be first approved by the admin.
personal data and the status of a user.
can modify personal data of that user.
its status.
S = 1 S = 0.36 S = 0.47 Unchanged sentences
logged-in in order to modify personal data of a user. Similarity threshold = 0.6
1
3
4
5
6
7
8
9
10
11
12
13
CLASS
12
1.3 Identify change types using an adapted TextDiff algorithm The admin <add>and</add> <add>the</add> <add>user</add> can modify personal data <del>and</del> <del>the</del> <del>status</del>
<del>a</del> user.
13
14
14
14
14
1
3
4
5
6
7
8
9
10
11
12
13
CLASS
14
1
3
4
5
6
7
8
9
10
11
12
13
CLASS
14
1
3
4
5
6
7
8
9
10
11
12
13
CLASS
15
16
17
18
19
20
21
22
23
23
24
25
DS1/C1 User story 28 2 DS2/C2 User story 37 2 DS3/C3 Unstructured text 197 3
26
26
26
26
26
26
26
26
26
26
26
26
26
26
26
27
27
27
27
27
27
27