Welcome to Centre for Research in Evolution, Search & Testing - - PowerPoint PPT Presentation

welcome to
SMART_READER_LITE
LIVE PREVIEW

Welcome to Centre for Research in Evolution, Search & Testing - - PowerPoint PPT Presentation

Welcome to Centre for Research in Evolution, Search & Testing CREST COW/SEBASE workshop Mark Harman Centre for Research in Evolution, Search & Testing Thursday, 10 December 2009 CREST is home to Centre for Research in Evolution,


slide-1
SLIDE 1

Centre for Research in Evolution, Search & Testing

Welcome to CREST

COW/SEBASE workshop

Mark Harman

Centre for Research in Evolution, Search & Testing

Thursday, 10 December 2009

slide-2
SLIDE 2

Centre for Research in Evolution, Search & Testing

http://crest.dcs.kcl.ac.uk/

CREST is home to 4 faculty 1 administrative offjcer 8 post docs 12 PhD students 1 to 4 long term visitors

Thursday, 10 December 2009

slide-3
SLIDE 3

Centre for Research in Evolution, Search & Testing

http://crest.dcs.kcl.ac.uk/

Testing

All kinds of testing:- – Mutation testing – Model based testing – Automated test data generation – Web application testing – Service oriented testing – Fuzz testing – Security testing – Regression testing

Thursday, 10 December 2009

slide-4
SLIDE 4

Centre for Research in Evolution, Search & Testing

http://crest.dcs.kcl.ac.uk/

Dependence Analysis

dependence clusters impact analysis program and model based slicing assessing third party code

Thursday, 10 December 2009

slide-5
SLIDE 5

Centre for Research in Evolution, Search & Testing

http://crest.dcs.kcl.ac.uk/

Quantitative Information Flow

calculate amount of information flowing find security leaks use information theory to compute fitness

Thursday, 10 December 2009

slide-6
SLIDE 6

Centre for Research in Evolution, Search & Testing

http://crest.dcs.kcl.ac.uk/

Service Oriented Computing

Testing services with services Optimizing performance Finding dependence

Thursday, 10 December 2009

slide-7
SLIDE 7

Centre for Research in Evolution, Search & Testing

http://crest.dcs.kcl.ac.uk/

Clone detection

using static analysis applied to code provenance applied to graphical languages

Thursday, 10 December 2009

slide-8
SLIDE 8

Centre for Research in Evolution, Search & Testing

http://crest.dcs.kcl.ac.uk/

Clone detection

using static analysis applied to code provenance applied to graphical languages

Thursday, 10 December 2009

slide-9
SLIDE 9

Centre for Research in Evolution, Search & Testing

http://crest.dcs.kcl.ac.uk/

Digital Humanities

Mapping outwards from software to systems Software Engineering Analysis translates to – musicology – archaeology

Thursday, 10 December 2009

slide-10
SLIDE 10

Centre for Research in Evolution, Search & Testing

http://crest.dcs.kcl.ac.uk/

SEBASE

Search Based Software Engineering - SBSE York, Birmingham, King’s Motorola, IBM

Thursday, 10 December 2009

slide-11
SLIDE 11

Centre for Research in Evolution, Search & Testing

http://crest.dcs.kcl.ac.uk/

What is SBSE?

In SBSE we apply search techniques to search large search spaces, guided by a fitness function that captures properties of the acceptable software artefacts we seek. Genetic Algorithms, Hill climbing, Simulated Annealing, Random, Tabu Search, Estimation of Distribution Algorithms, Particle Swarm Optimization

Thursday, 10 December 2009

slide-12
SLIDE 12

Centre for Research in Evolution, Search & Testing

http://crest.dcs.kcl.ac.uk/

Why is SBSE?

Thursday, 10 December 2009

slide-13
SLIDE 13

Centre for Research in Evolution, Search & Testing

http://crest.dcs.kcl.ac.uk/

Why is SBSE?

Thursday, 10 December 2009

slide-14
SLIDE 14

Centre for Research in Evolution, Search & Testing

http://crest.dcs.kcl.ac.uk/

Why not SBSE?

?

Thursday, 10 December 2009

slide-15
SLIDE 15

Centre for Research in Evolution, Search & Testing

http://crest.dcs.kcl.ac.uk/

Why not SBSE?

EPSRC network 1999 – 2002 Laid foundation for SBSE

Thursday, 10 December 2009

slide-16
SLIDE 16

Centre for Research in Evolution, Search & Testing

http://crest.dcs.kcl.ac.uk/

SBSE Applications

Transformation Cooper, Ryan, Schielke, Subramanian, Fatiregun, Williams Requirements Bagnall, Mansouri, Zhang Effort prediction Aguilar-Ruiz, Burgess, Dolado, Lefley, Shepperd Management Alba, Antoniol, Chicano, Di Pentam Greer, Ruhe Heap allocation Cohen, Kooi, Srisa-an Regression test Li, Yoo, Elbaum, Rothermel, Walcott, Soffa, Kampfhamer SOA Canfora, Di Penta, Esposito, Villani Refactoring Antoniol, Briand, Cinneide, O’Keeffe, Merlo, Seng, Tratt Test Generation Alba, Binkley, Bottaci, Briand, Chicano, Clark, Cohen, Gutjahr, Harrold, Holcombe, Jones, Korel, Pargass, Reformat, Roper, McMinn, Michael, Sthamer, Tracy, Tonella,Xanthakis, Xiao, Wegener, Wilkins Maintenance Antoniol, Lutz, Di Penta, Madhavi, Mancoridis, Mitchell, Swift Model checking Alba, Chicano, Godefroid Probe dist’ion Cohen, Elbaum UIOs Derderian, Guo, Hierons Comprehension Gold, Li, Mahdavi Protocols Alba, Clark, Jacob, Troya Component sel Baker, Skaliotis, Steinhofel, Yoo Agent Oriented Haas, Peysakhov, Sinclair, Shami, Mancoridis

Thursday, 10 December 2009

slide-17
SLIDE 17

Centre for Research in Evolution, Search & Testing

http://crest.dcs.kcl.ac.uk/

Transformation Cooper, Ryan, Schielke, Subramanian, Fatiregun, Williams Requirements Bagnall, Mansouri, Zhang Effort prediction Aguilar-Ruiz, Burgess, Dolado, Lefley, Shepperd Management Alba, Antoniol, Chicano, Di Pentam Greer, Ruhe Heap allocation Cohen, Kooi, Srisa-an Regression test Li, Yoo, Elbaum, Rothermel, Walcott, Soffa, Kampfhamer SOA Canfora, Di Penta, Esposito, Villani Refactoring Antoniol, Briand, Cinneide, O’Keeffe, Merlo, Seng, Tratt Test Generation Alba, Binkley, Bottaci, Briand, Chicano, Clark, Cohen, Gutjahr, Harrold, Holcombe, Jones, Korel, Pargass, Reformat, Roper, McMinn, Michael, Sthamer, Tracy, Tonella,Xanthakis, Xiao, Wegener, Wilkins Maintenance Antoniol, Lutz, Di Penta, Madhavi, Mancoridis, Mitchell, Swift Model checking Alba, Chicano, Godefroid Probe dist’ion Cohen, Elbaum UIOs Derderian, Guo, Hierons Comprehension Gold, Li, Mahdavi Protocols Alba, Clark, Jacob, Troya Component sel Baker, Skaliotis, Steinhofel, Yoo Agent Oriented Haas, Peysakhov, Sinclair, Shami, Mancoridis

SBSE Applications in which SEBASE is active

Thursday, 10 December 2009

slide-18
SLIDE 18

Centre for Research in Evolution, Search & Testing

http://crest.dcs.kcl.ac.uk/

York SEBASE team and colleagues

Task allocation

Reducing time to move between configuration During development and maintenance

  • to make systems robust to change
  • to minimise cost when change can’t be avoided

Wireless Sensor Networks

  • energy, performance, reliability, robustness

Automatic WCET test-case generation Statistical Testing Non Functional Properties

Optimize for functionality and power consumption

Thursday, 10 December 2009

slide-19
SLIDE 19

Centre for Research in Evolution, Search & Testing

http://crest.dcs.kcl.ac.uk/

Birmingham SEBASE team

Multi objective optimization

  • Power consumption
  • Response time
  • Cohesion and coupling for modularization

Algorithms

  • Estimation of Distribution Algorithms
  • Differential Evolution

Theoretical Analysis of SBST Automatic bug fixing Co-evolution of program and test cases

Thursday, 10 December 2009

slide-20
SLIDE 20

Centre for Research in Evolution, Search & Testing

http://crest.dcs.kcl.ac.uk/

King’s SEBASE team

Multi objective optimization:

  • cost and value
  • faults, coverage, time
  • metric sets
  • risk and reward

Software Engineering Application areas:

  • Requirements
  • All kinds of Testing
  • Project Management
  • Refactoring
  • Source Code Analysis

Survey work, Repositories, Community support

Thursday, 10 December 2009

slide-21
SLIDE 21

Centre for Research in Evolution, Search & Testing

http://crest.dcs.kcl.ac.uk/

King’s SEBASE team

Multi objective optimization:

  • cost and value
  • faults, coverage, time
  • metric sets
  • risk and reward

Software Engineering Application areas:

  • Requirements
  • All kinds of Testing
  • Project Management
  • Refactoring
  • Source Code Analysis

Survey work, Repositories, Community support

Thursday, 10 December 2009

slide-22
SLIDE 22

Trends in SBSE publication Growth

22 Thursday, 10 December 2009

slide-23
SLIDE 23

Trends in SBSE publication Growth

23 Thursday, 10 December 2009

slide-24
SLIDE 24

Trends in SBSE publication Growth

24 Thursday, 10 December 2009

slide-25
SLIDE 25

Trends in SBSE publication Growth: Testing

25

5 10 15 20 25 30 35 40 45 50 76 76 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 00 01 02 03 04 05 06 07 08 Number of Publications Year R2=0.9827 Number of Publications on Software Testing y = 0.081 * 1.2143x 5 10 15 20 25 30 35 76 76 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 00 01 02 03 04 05 06 07 08 Number of Publications Year R=0.9413 Number of Publications on Structural Testing y = 0.0099 * 1.2781x

Thursday, 10 December 2009

slide-26
SLIDE 26

New emerging areas

26 Thursday, 10 December 2009

slide-27
SLIDE 27

Centre for Research in Evolution, Search & Testing

http://crest.dcs.kcl.ac.uk/

1st COW/SEBASE workshop

Talks and Lots of discussion Lunch and refreshments will arrive here Dinner tonight upstairs Wireless Recording of talks NOT discussion A brief note about COWs

Thanks

  • Yue and Jian for organisation
  • EPSRC for funding

Logistics

  • fire alarms
  • toilets

Introductions ...

Thursday, 10 December 2009