Requirements Validation Lectures 6, DAT230, Requirements - - PowerPoint PPT Presentation

requirements validation
SMART_READER_LITE
LIVE PREVIEW

Requirements Validation Lectures 6, DAT230, Requirements - - PowerPoint PPT Presentation

Requirements Validation Lectures 6, DAT230, Requirements Engineering Robert Feldt, 2012-09-18 tisdag 18 september 12 Recap from last lecture tisdag 18 september 12 Recap Specification to refine/specify reqs and reduce risks SRS is


slide-1
SLIDE 1

Requirements Validation

Lectures 6, DAT230, Requirements Engineering Robert Feldt, 2012-09-18

tisdag 18 september 12

slide-2
SLIDE 2

Recap from last lecture

tisdag 18 september 12

slide-3
SLIDE 3
  • Specification to refine/specify reqs and reduce risks
  • SRS is primarily a communication device
  • Also drives development and is baseline for releases
  • Modeling for specific situations and reqs
  • Many different specification techniques
  • Text, Sequence- and state-based models are key
  • Use cases, scenarios also quite common
  • Formal approaches less used; user communication harder
  • IEEE 830 gives basic and common structure

Recap

tisdag 18 september 12

slide-4
SLIDE 4

Specification Techniques

Word doc Excel doc

Text

DB / Req tool

Interaction- / Sequence-based

Scenario Storyboard Use case Stimulus-response sequence

State-based

State transition diagram UML state diagram

Decision-based

Decision tables Decision trees

Quality Requirements

PLanguage Volere Probabilistic Quality Patterns

User Interfaces

UI standards Text Prototype Sketches Look’n’feel samples

Formal

Z Property-based CSP VDM

tisdag 18 september 12

slide-5
SLIDE 5

Why validation?

“If temperature is higher than 70 and less than 100, then output should be 3000 watts”

tisdag 18 september 12

slide-6
SLIDE 6

Why validation?

“If temperature is higher than 70 and less than 100, then output should be 3000 watts”

  • What if <70?

tisdag 18 september 12

slide-7
SLIDE 7

Why validation?

“If temperature is higher than 70 and less than 100, then output should be 3000 watts”

  • What if <70?
  • What if >100

tisdag 18 september 12

slide-8
SLIDE 8

Why validation?

“If temperature is higher than 70 and less than 100, then output should be 3000 watts”

  • What if <70?
  • What if >100
  • 70 and 100 are in C or F?

tisdag 18 september 12

slide-9
SLIDE 9

Why validation?

“If temperature is higher than 70 and less than 100, then output should be 3000 watts”

  • What if <70?
  • What if >100
  • 70 and 100 are in C or F?
  • How does this fit with rest? Conflicts?

tisdag 18 september 12

slide-10
SLIDE 10

Why validation?

“If temperature is higher than 70 and less than 100, then output should be 3000 watts”

  • What if <70?
  • What if >100
  • 70 and 100 are in C or F?
  • How does this fit with rest? Conflicts?
  • What is missing?

tisdag 18 september 12

slide-11
SLIDE 11

Validation Techniques

tisdag 18 september 12

slide-12
SLIDE 12

Req Review

tisdag 18 september 12

slide-13
SLIDE 13

The Review Formality Spectrum

Formal

Ad Hoc Review Formal / Fagan Inspection Peer Desk Check Pair Programming Team Review

No rules!

tisdag 18 september 12

slide-14
SLIDE 14

The Review Formality Spectrum

Formal

Ad Hoc Review Formal / Fagan Inspection Peer Desk Check Pair Programming Team Review

No rules!

7 Stages Roles Preparation Recorder Approval/Not

tisdag 18 september 12

slide-15
SLIDE 15

[Wikipedia2011]

Fagan Inspection Process

IBM: 80-90% of defects found & 25% resource savings

tisdag 18 september 12

slide-16
SLIDE 16
  • Test-Case Driven Review
  • Tester does review to find reqs that are not testable
  • Reading techniques
  • Ad hoc (most common, focused on experience)
  • Check-list based
  • Perspective-based (different stakeholders or user types)

Review/Reading Styles

tisdag 18 september 12

slide-17
SLIDE 17

Checklist example

tisdag 18 september 12

slide-18
SLIDE 18

Selective Homeworkless Review

  • Challenges when re-introducing Fagan inspections at IBM:
  • Managers: High up-front cost (20-30% of dev time), since

everything reviewed => Selective reviewing

  • Individuals: Preparations seldom happen, since tight

schedules => Homeworkless reviews

  • Team meets once a week, fixed day&time, 1-1.5 hours
  • Artifact selected just before or at meeting
  • Roles: Moderator, Reader, Scribe/Recorder
  • Hybrid: No preparation => informal, Roles => formal
  • Moderator selects specific review technique

[Farchi2008]

tisdag 18 september 12

slide-19
SLIDE 19

Selective Homeworkless Review

tisdag 18 september 12

slide-20
SLIDE 20

Selective Homeworkless Review

  • Moderator monitors metrics:
  • Issues found per reviewer per hour
  • If below 2, then stop meeting or use other technique
  • Does it work?
  • 2.17 +/- 0.34 issues/hour/reviewer (90% confidence level)
  • “When compared to other review methodologies that in- clude

preparation, our method finds fewer issues overall but more major issues per hour. Our opinion is that people working on their own are more effective in finding low-level syntactic problems, as more eyes are watching more places, but less effective in finding real bugs as the understanding is shallower.” [Farchi2008]

tisdag 18 september 12

slide-21
SLIDE 21

Prototyping

tisdag 18 september 12

slide-22
SLIDE 22

Prototyping

tisdag 18 september 12

slide-23
SLIDE 23

What do industry use?

4 companies used checklist-based and 2 ad hoc review reading 6 used throwaway prototypes, 2 also evolutionary

tisdag 18 september 12

slide-24
SLIDE 24

Who do industry involve in reviews?

tisdag 18 september 12

slide-25
SLIDE 25

Pros/Cons of Reviews?

tisdag 18 september 12

slide-26
SLIDE 26

Improvements to Reviews?

tisdag 18 september 12

slide-27
SLIDE 27

Satisfaction with Prototyping?

tisdag 18 september 12

slide-28
SLIDE 28

Comparison of Techniques

tisdag 18 september 12

slide-29
SLIDE 29

Standards & Process Reqs

tisdag 18 september 12

slide-30
SLIDE 30

Standards & Process Reqs

tisdag 18 september 12