SLIDE 1
A Generic Approach to Run Mutation Analysis
Siamak Haschemi and Stephan Weißleder Humboldt-Universität zu Berlin METRIK Research Training Group TAIC-PART 2010
Sonntag, 5. September 2010Mutation Analysis
2
Sonntag, 5. September 2010A Generic Approach to Run Mutation Analysis Siamak Haschemi and - - PowerPoint PPT Presentation
A Generic Approach to Run Mutation Analysis Siamak Haschemi and - - PowerPoint PPT Presentation
A Generic Approach to Run Mutation Analysis Siamak Haschemi and Stephan Weileder Humboldt-Universitt zu Berlin METRIK Research Training Group TAIC-PART 2010 Sonntag, 5. September 2010 Mutation Analysis 2 Sonntag, 5. September 2010
SLIDE 2
SLIDE 3
Mutation Analysis
SUT
2
Sonntag, 5. September 2010 SLIDE 4
Mutation Analysis
SUT
2
Sonntag, 5. September 2010 SLIDE 5
Mutation Analysis
SUT
2
Sonntag, 5. September 2010 SLIDE 6
Mutation Analysis
SUT
2
Sonntag, 5. September 2010 SLIDE 7
Mutation Analysis
SUT
2
Sonntag, 5. September 2010 SLIDE 8
Mutation Analysis
SUT
2
Sonntag, 5. September 2010 SLIDE 9
Mutation Analysis
SUT
2
Sonntag, 5. September 2010 SLIDE 10
Mutation Analysis
SUT
2
SUT
Mutation Operator
Sonntag, 5. September 2010 SLIDE 11
Mutation Analysis
SUT
2
SUT
Mutation Operator
Sonntag, 5. September 2010 SLIDE 12
Mutation Analysis
SUT
2
SUT
Sonntag, 5. September 2010 SLIDE 13
Mutation Analysis
SUT
2
SUT
Sonntag, 5. September 2010 SLIDE 14
Mutation Analysis
SUT
2
SUT
Sonntag, 5. September 2010 SLIDE 15
Mutation Analysis
2
Mutation Score =
Sonntag, 5. September 2010 SLIDE 16
Mutation Analysis
2
http://www.dcs.kcl.ac.uk/pg/jiayue/repository
Sonntag, 5. September 2010 SLIDE 17
3
SUT
Sonntag, 5. September 2010 SLIDE 18
SUT
3
Sonntag, 5. September 2010 SLIDE 19
SUT
3
Sonntag, 5. September 2010 SLIDE 20
SUT
3
Sonntag, 5. September 2010 SLIDE 21
SUT
3
Sonntag, 5. September 2010 SLIDE 22
SUT
3
Sonntag, 5. September 2010 SLIDE 23
SUT
3
OSGi (modularization for Java)
Sonntag, 5. September 2010 SLIDE 24
SUT
3
OSGi (modularization for Java) MTF
Sonntag, 5. September 2010 SLIDE 25
SUT
3
OSGi (modularization for Java) MTF
Sonntag, 5. September 2010 SLIDE 26
SUT
3
OSGi (modularization for Java) MTF
Sonntag, 5. September 2010 SLIDE 27
SUT
3
OSGi (modularization for Java) Jumble Javalanche MTF
Sonntag, 5. September 2010 SLIDE 28
SUT
3
OSGi (modularization for Java) Jumble Javalanche
?
MTF
Sonntag, 5. September 2010 SLIDE 29
Problem
4
SUT
conf
Mutation Analysis Tool
Sonntag, 5. September 2010 SLIDE 30
Problem
4
SUT
conf
Mutation Analysis Tool
Sonntag, 5. September 2010 SLIDE 31
Problem
4
SUT
conf
Mutation Analysis Tool
Sonntag, 5. September 2010 SLIDE 32
Problem
4
SUT
conf
Mutation Score Documen- tation Visualization Mutation Analysis Tool
Sonntag, 5. September 2010 SLIDE 33
Problem
4
SUT
conf
Mutation Score Documen- tation Visualization Mutation Analysis Tool
Sonntag, 5. September 2010 SLIDE 34
Approach
Mutation Metamodel Mutation Analysis Tool API Mutation Analysis Tool B Mutation Analysis Tool A Execution Environment X Execution Environment Y Mutation Integration Framework Code Generator for Execution Environment X Code Generator for Execution Environment Y
5
Sonntag, 5. September 2010 SLIDE 35
Approach
SUT
conf
6
Sonntag, 5. September 2010 SLIDE 36
Approach
SUT
conf
Jumble
6
Sonntag, 5. September 2010 SLIDE 37
Approach
SUT
conf
Jumble
6
Sonntag, 5. September 2010 SLIDE 38
Approach
SUT
conf
Jumble
6
Sonntag, 5. September 2010 SLIDE 39
Approach
SUT
conf
Jumble
6
Sonntag, 5. September 2010 SLIDE 40
Approach
SUT
conf
Jumble
6
Environment- specific Code
Sonntag, 5. September 2010 SLIDE 41
Approach
SUT
conf
Jumble
6
Environment- specific Code
Sonntag, 5. September 2010 SLIDE 42
Approach
SUT
conf
Jumble
6
Environment- specific Code
Sonntag, 5. September 2010 SLIDE 43
Approach
7
Jumble
Sonntag, 5. September 2010 SLIDE 44
Approach
7
Jumble
Sonntag, 5. September 2010 SLIDE 45
Approach
7
Jumble
Sonntag, 5. September 2010 SLIDE 46
Approach
7
Jumble
Sonntag, 5. September 2010 SLIDE 47
Approach
7
Jumble
Sonntag, 5. September 2010 SLIDE 48
Approach
7
Jumble
Sonntag, 5. September 2010 SLIDE 49
Approach
7
Jumble
Sonntag, 5. September 2010 SLIDE 50
Demo
8
Sonntag, 5. September 2010 SLIDE 51
Conclusion
- Mutation Analysis to measure the fault
detection ability of a test suite
- Mutation Analysis Tools have hard
requirements on the execution environments
- We separate the calculation and creation of
mutants to support any execution environment (by generating code)
9
Sonntag, 5. September 2010