Software Process Recovery Abram Hindle Software Architecture Group - - PowerPoint PPT Presentation

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Software Process Recovery

Abram Hindle

Software Architecture Group David R. Cheriton School of Computer Science University of Waterloo Canada http://swag.uwaterloo.ca/˜ahindle/

ahindle@cs.uwaterloo.ca

Abram Hindle 1

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Software Development Processes

• Repeatable development
• Predictable
• Ensure Quality
• Project management
• Attempt to succeed at building software

Abram Hindle 2

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Prescribed Processes

• The processes chosen for a project
• The processes that developers are expected to follow

– Do developers actually follow these?

∗ How would we know?

Abram Hindle 3

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Observed Processes

• Based on observation
• What is observable
• What kind of behaviour is observable
• What kind of intent is observable

Abram Hindle 4

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Process Recovery

• Recover information about:

– behaviour – topics / focus – requirements – Software Development Life Cycle – repeating behaviours

• from...

Abram Hindle 5

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Development Artifacts

• Wand of dispel demo demons
• Blessed wand of developer motivation (4:3)
• Rusty cursed plate mail named “contract deadline”
• Blessed dagger named “debug”
• Potion of Bad Smell Detection

Abram Hindle 6

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Actual Dev. Artifacts

• Mailing lists
• Bug tracker events
• Source Control Repositories
• Source Code
• Documentation
• Test
• Build system

Abram Hindle 7

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Mailing lists

• Often used in projects to:

– Allow users to interact with developers – Provide tech support – Report bugs – Post Patches – Discuss Development

Abram Hindle 9

Software Process Recovery CS445 / CS645 / ECE451 / SE463

User Mailing lists

• Support
• General discussion
• Artifacts

– Bug reports – Messages

Abram Hindle 10

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Development Lists

• New features, maintenance, development discussion
• Bug fixing
• Artifacts

– Patches – Bug reports – Requirements – Design

Abram Hindle 11

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Data inside of an email

• People: to, from, cc, replies, etc.
• Fields: headers, subjects
• Body: text data, bug fields

Abram Hindle 12

Software Process Recovery CS445 / CS645 / ECE451 / SE463

How can we analyze mailing lists?

• Social Network Analysis
• Natural Language Processing
• Bug extractor
• Time-series analysis

Abram Hindle 13

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Version Control

• Used to store changes to source code
• Contains diffs of source code
• Track changes
• Common products: CVS, GIT, SVN, Darcs, Perforce,

etc.

Abram Hindle 14

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Version Control Entities

• Author/Committer - who committed the change
• Changelog comment - description of change
• Revision - change to a file
• Commit - collection of revision (one logical change)
• Diff/patch - the change per line per file
• File - source code, tests, documentation, build files,

etc.

Abram Hindle 15

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Version Control Analysis

• Time-series - when changes occur
• Partitioning - by file-type
• NLP - word occurrence

– Word-bags – Machine learning

Abram Hindle 16

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Source Code

• Author
• Module and File-name
• Comments
• Entities - identifiers, structures, classes, architecture

Abram Hindle 17

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Bug Reports

• Repositories of bug descriptions

– And feature requests

• Made by users, developers, testers
• Document the instance and solution to bug

Abram Hindle 18

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Bug report data

• Participants: author, stakeholders, testers, developers
• Bug fields: meta-data such as version or platform
• Bug description: often contains logs or error codes

Abram Hindle 19

Software Process Recovery CS445 / CS645 / ECE451 / SE463

How can we analyze Bug reports?

• Social Network Analysis
• Natural Language Processing
• Bug extractor
• Time-series analysis

Abram Hindle 20

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Process

• What if our data doesn’t look like boxes and arrows?

– Maybe it isn’t.

∗ Maybe the process we can observe is mixture of

efforts over time.

Abram Hindle 21

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Rational Unified Process

• Phases and Disciplines

– Phase - stage in a life-cycle – Discipline - types of tasks

Abram Hindle 22

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Phases

• Inception - investigate or plan it
• Elaboration - design it
• Construction - build it
• Transition - ship it, finish it

Abram Hindle 23

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Engineering Disciplines

• Business Modelling - domain clarification
• Requirements - collect and record
• Analysis/Design - uses cases
• Implementation - build it
• Test - unit/regression tests, quality
• Deployment - package and platforms

Abram Hindle 24

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Support Disciplines

• Environment - processes and tools
• Configuration Management - version control and

metrics

• Project Management - managing and planning

Abram Hindle 25

Software Process Recovery CS445 / CS645 / ECE451 / SE463

View of Process

• What parts of RUP are observable?
• What parts of RUP could we extract?
• What wouldn’t we see during certain phases or

iterations?

Abram Hindle 26

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Mapping to Process

• How do we map events or artifacts to process?
• What does a change mean?

Abram Hindle 27

Software Process Recovery CS445 / CS645 / ECE451 / SE463

Limitations of Process Recovery

• What isn’t observed is hard to reason about

– Proxy measures?

• OSS versus Commercial

– Requirements are different!

Abram Hindle 8