model based mutation driven test case generation
play

MODEL-BASED, MUTATION-DRIVEN TEST CASE GENERATION VIA - PowerPoint PPT Presentation

Aug 26, 2022 •18 likes •358 views

MODEL-BASED, MUTATION-DRIVEN TEST CASE GENERATION VIA HEURISTIC-GUIDED BRANCHING SEARCH Andreas Fellner FMCAD Student Forum Wien, October 4th 2017 TEST CASE GENERATION WITH 1 Andreas Fellner TEST CASE GENERATION WITH Abstract Model UML /

  1. MODEL-BASED, MUTATION-DRIVEN TEST CASE GENERATION VIA HEURISTIC-GUIDED BRANCHING SEARCH Andreas Fellner FMCAD Student Forum Wien, October 4th 2017

  2. TEST CASE GENERATION WITH 1 Andreas Fellner

  3. TEST CASE GENERATION WITH Abstract Model UML / Event-B 1 Andreas Fellner

  4. TEST CASE GENERATION WITH Abstract Model Executable Model UML / Event-B Action System 1 Andreas Fellner

  5. TEST CASE GENERATION WITH Abstract Model Executable Model UML / Event-B Action System Automatic Translation 1 Andreas Fellner

  6. TEST CASE GENERATION WITH Abstract Model Executable Model UML / Event-B Action System Automatic Translation Mutated Action Systems 1 Andreas Fellner

  7. TEST CASE GENERATION WITH Abstract Model Executable Model UML / Event-B Action System Automatic Translation Mutated Action Systems 1 Andreas Fellner

  8. TEST CASE GENERATION WITH Abstract Model Executable Model UML / Event-B Action System Automatic Translation Mutated Action Systems c := c + 1 Original: c := c Mutation: 1 Andreas Fellner

  9. TEST CASE GENERATION WITH Abstract Model Executable Model UML / Event-B Action System Automatic Translation Mutated Action Systems c := c + 1 Original: c := c Mutation: if signal > 100 Original: … if false Mutation: … 1 Andreas Fellner

  10. TEST CASE GENERATION WITH Abstract Model Test Cases Executable Model UML / Event-B Action System Automatic Translation Mutated Action Systems c := c + 1 Original: c := c Mutation: if signal > 100 Original: … if false Mutation: … 1 Andreas Fellner

  11. TEST CASE GENERATION WITH Input/Output Abstract Model Test Cases Executable Model Sequence UML / Event-B Action System Automatic Translation Mutated Action Systems c := c + 1 Original: c := c Mutation: if signal > 100 Original: … if false Mutation: … 1 Andreas Fellner

  12. TEST CASE GENERATION WITH Input/Output Abstract Model Test Cases Executable Model Sequence UML / Event-B Action System Branching Search Automatic Translation Mutated Action Systems c := c + 1 Original: c := c Mutation: if signal > 100 Original: … if false Mutation: … 1 Andreas Fellner

  13. TEST CASE GENERATION WITH Input/Output Abstract Model Test Cases Executable Model Sequence UML / Event-B Action System Branching Search Automatic Translation Mutated Action Systems Mutants killed / alive / equivalent? c := c + 1 Original: c := c Mutation: if signal > 100 Original: … if false Mutation: … 1 Andreas Fellner

  14. TEST CASE GENERATION WITH Input/Output Abstract Model Test Cases Executable Model Sequence UML / Event-B Action System Branching Search Automatic Translation Mutated Action Systems Mutants killed / alive / equivalent? Mutant Killed: c := c + 1 Original: - Same Input c := c Mutation: - Different Output if signal > 100 Original: … if false Mutation: … 1 Andreas Fellner

  15. BRANCHING SEARCH AND MUTATION KILLING 2 Andreas Fellner

  16. BRANCHING SEARCH AND MUTATION KILLING • Explore model in branches 2 Andreas Fellner

  17. BRANCHING SEARCH AND MUTATION KILLING • Explore model in branches ? ! ? ! ? ! 2 Andreas Fellner

  18. BRANCHING SEARCH AND MUTATION KILLING • Explore model in branches ? ? ? ? ! ! ? ! ? ! 2 Andreas Fellner

  19. BRANCHING SEARCH AND MUTATION KILLING • Explore model in branches ? ? ? ? ! ! ? ? ! ! ? ! 2 Andreas Fellner

  20. BRANCHING SEARCH AND MUTATION KILLING • Explore model in branches ? ? ? ? ! ? ! ? ? ! ! ? ? ! ! 2 Andreas Fellner

  21. BRANCHING SEARCH AND MUTATION KILLING • Explore model in branches • Each branch is explored in parallel ? ? ? ? ! ? ! ? ? ! ! ? ? ! ! 2 Andreas Fellner

  22. BRANCHING SEARCH AND MUTATION KILLING • Explore model in branches • Each branch is explored in parallel ? ? ? • Explore mutated models in parallel ? ! ? ! ? ? ! ! ? ? ! ! 2 Andreas Fellner

  23. BRANCHING SEARCH AND MUTATION KILLING • Explore model in branches • Each branch is explored in parallel ? ? ? • Explore mutated models in parallel ? ! ? ! ? ? ! ! ? ? ? ! ! ! 2 Andreas Fellner

  24. BRANCHING SEARCH AND MUTATION KILLING ? • Explore model in branches ? • Each branch is explored in parallel ? ? ? ? • Explore mutated models in parallel ! ? ! ? ! ? ? ! ! ? ? ? ! ! ! 2 Andreas Fellner

  25. BRANCHING SEARCH AND MUTATION KILLING ? • Explore model in branches ? • Each branch is explored in parallel ? ? ? ? • Explore mutated models in parallel ! ? ! • Only explore relevant parts ? ! ? ? ! ! ? ? ? ! ! ! 2 Andreas Fellner

  26. BRANCHING SEARCH AND MUTATION KILLING ? • Explore model in branches ? • Each branch is explored in parallel ? ? ? ? • Explore mutated models in parallel ! ? ! • Only explore relevant parts ? ! ? ? • Set of heuristics guiding branching search ! ! ? ? ? ! ! ! 2 Andreas Fellner

  27. BRANCHING SEARCH AND MUTATION KILLING ? • Explore model in branches ? • Each branch is explored in parallel ? ? ? ? • Explore mutated models in parallel ! ? ! • Only explore relevant parts ? ! ? ? • Set of heuristics guiding branching search ! • Where to start new branches • ! How to expand branches ? ? ? ! ! ! 2 Andreas Fellner

  28. BRANCHING SEARCH AND MUTATION KILLING ? • Explore model in branches ? • Each branch is explored in parallel ? ? ? ? • Explore mutated models in parallel ! ? ! • Only explore relevant parts ? ! ? ? • Set of heuristics guiding branching search ! • Where to start new branches • ! How to expand branches ? ? • ? Construct test cases from exploration graph ! ! ! 2 Andreas Fellner

  29. BRANCHING SEARCH AND MUTATION KILLING ? • Explore model in branches ? • Each branch is explored in parallel ? ? ? ? • Explore mutated models in parallel ! ? ! • Only explore relevant parts ? ! ? ? • Set of heuristics guiding branching search ! • Where to start new branches • ! How to expand branches ? ? • ? Construct test cases from exploration graph • Prune irrelevant exploration steps ! ! ! 2 Andreas Fellner

  30. BRANCHING SEARCH AND MUTATION KILLING ? • Explore model in branches ? • Each branch is explored in parallel ? ? ? ? • Explore mutated models in parallel ! ? ! • Only explore relevant parts ? ! ? • Set of heuristics guiding branching search • Where to start new branches • ! How to expand branches ? ? • ? Construct test cases from exploration graph • Prune irrelevant exploration steps ! ! ! 2 Andreas Fellner

  31. BRANCHING SEARCH AND MUTATION KILLING ? • Explore model in branches ? • Each branch is explored in parallel ? ? ? ? • Explore mutated models in parallel ! ? ! • Only explore relevant parts ! ? • Set of heuristics guiding branching search • Where to start new branches • ! How to expand branches ? • ? Construct test cases from exploration graph • Prune irrelevant exploration steps ! ! 2 Andreas Fellner

  32. BRANCHING SEARCH AND MUTATION KILLING ? • Explore model in branches ? • Each branch is explored in parallel ? ? ? ? • Explore mutated models in parallel ! ? ! • Only explore relevant parts ! ? • Set of heuristics guiding branching search • Where to start new branches • ! How to expand branches ? • ? Construct test cases from exploration graph • Prune irrelevant exploration steps ! • ! Map test cases to mutant kills 2 Andreas Fellner

  33. SUMMARY • Model based testing • Test high level behavior based on abstract description of the system • Mutation testing • Connect tests to faults • Prune irrelevant test steps • Demanding models from industrial context, thus emphasis on scalability • Branching Search • Fully leverage parallelism • Flexibility through set of heuristics • Shorter and more effective tests Andreas Fellner Andreas Fellner 3

  34. FUTURE WORK • Distance metric based on mutant constraints • Designated strong killing algorithm • Semi symbolic methods • Dynamic symbolic execution • Unfoldings, Partial Orders & Petri Nets • Static analysis • Better estimation of state space • Eliminate equivalent mutants Andreas Fellner Andreas Fellner 4

Download Presentation
Download Policy: The content available on the website is offered to you 'AS IS' for your personal information and use only. It cannot be commercialized, licensed, or distributed on other websites without prior consent from the author. To download a presentation, simply click this link. If you encounter any difficulties during the download process, it's possible that the publisher has removed the file from their server.

Recommend

Automating the Generation of Mutation-based Test Cases Mik ike e Pap apad adakis akis

Automating the Generation of Mutation-based Test Cases Mik ike e Pap apad adakis akis

Automating the Generation of Mutation-based Test Cases Mik ike e Pap apad adakis akis Department of Informatics Athens University of Economics and Business 1 Mutation Testing White-box, fault-based testing technique Considered as

540 views • 22 slides
GENERATION O OF MUTATION T TESTING T TOOLS WITH WODEL-TEST TEST P. Gmez-Abajo , E. Guerra,

GENERATION O OF MUTATION T TESTING T TOOLS WITH WODEL-TEST TEST P. Gmez-Abajo , E. Guerra,

GENERATION O OF MUTATION T TESTING T TOOLS WITH WODEL-TEST TEST P. Gmez-Abajo , E. Guerra, J. de Lara Modelling&Software Engineering Research Group http://miso.es Universidad Autnoma de Madrid (Spain) Mercedes G. Merayo Design

350 views • 13 slides
Model-Based Testing: Automated Generation of Test Cases, Test Data, and Test Procedures from

Model-Based Testing: Automated Generation of Test Cases, Test Data, and Test Procedures from

Model-Based Testing: Automated Generation of Test Cases, Test Data, and Test Procedures from SysML Models Jrg Brauer and Jan Peleska Verified Systems International GmbH support@verified.de Space Tech Expo Europe 2015-11-19 Motivation

499 views • 26 slides
Combining Model-Based and Risk-Based Testing for Effective Test Case Generation Duygu Metin

Combining Model-Based and Risk-Based Testing for Effective Test Case Generation Duygu Metin

Combining Model-Based and Risk-Based Testing for Effective Test Case Generation Duygu Metin Hasan Szer Ceren ahin Gebizli Vestel Electronics R&D zye in University Vestel Electronics R&D duygu.metin@vestel.com.tr

266 views • 3 slides
Mutation Testing of Memory- Related Operators Jay Nanavati, Fan Wu, Mark Harman, Yue Jia, Jens

Mutation Testing of Memory- Related Operators Jay Nanavati, Fan Wu, Mark Harman, Yue Jia, Jens

Mutation Testing of Memory- Related Operators Jay Nanavati, Fan Wu, Mark Harman, Yue Jia, Jens Krinke UCL, UK Mutation Testing Test case Test case Test case Test case Test case Test case Test case Jay Nanavati, Fan Wu, Mark

606 views • 28 slides
1 Mutation pressure Let = the mutation rate from A a Let = the mutation rate from a

1 Mutation pressure Let = the mutation rate from A a Let = the mutation rate from a

Population Genetics 5: Mutation pressure Mutation pressure Table 1 : Estimates of per generation mutation rates for a range of organisms Organism Per nucleotide rate Genomic rate RNA GENOMES 1.97 10 -5 Poliovirus 0.15 1.10 10 -4

350 views • 6 slides
1 Mutation pressure Let = the mutation rate from A a Let = the mutation rate from a

1 Mutation pressure Let = the mutation rate from A a Let = the mutation rate from a

Population Genetics 5: Mutation pressure Mutation pressure Table 1 : Estimates of per generation mutation rates for a range of organisms Organism Per nucleotide rate Genomic rate RNA GENOMES 1.97 10 -5 Poliovirus 0.15 1.10 10 -4

306 views • 7 slides
A UML-Based Testing Approach Using Sequence Diagrams, Statecharts, and OCL Constraints Dehla

A UML-Based Testing Approach Using Sequence Diagrams, Statecharts, and OCL Constraints Dehla

A UML-Based Testing Approach Using Sequence Diagrams, Statecharts, and OCL Constraints Dehla Sokenou TU Berlin Softwaretechnik Overview of the Test System test data test generation driver test case abstract test data generation test

444 views • 20 slides
RE-TARGETABLE GRAMMAR BASED TEST CASE GENERATION 2 TESTING PARSERS IS HARD 3 HOW WE GOT

RE-TARGETABLE GRAMMAR BASED TEST CASE GENERATION 2 TESTING PARSERS IS HARD 3 HOW WE GOT

JOE ROZNER / @JROZNER RE-TARGETABLE GRAMMAR BASED TEST CASE GENERATION 2 TESTING PARSERS IS HARD 3 HOW WE GOT HERE Mostly clean room (ish) implementation of complex languages (context-free- ish) ~35k lines of grammar in total

400 views • 19 slides
Automated Test Case Generation or: How to not write test cases Stefan Klikovits EN-ICE-SCD

Automated Test Case Generation or: How to not write test cases Stefan Klikovits EN-ICE-SCD

Automated Test Case Generation Stefan Klikovits Automated Test Case Generation or: How to not write test cases Stefan Klikovits EN-ICE-SCD Universit e de Gen` eve 28 th September, 2015 Automated Test Reminder: Testing is not easy Case

609 views • 33 slides
! ? b s i real-time testing s o p Attitude is changing: s t s n e d m o h e t

! ? b s i real-time testing s o p Attitude is changing: s t s n e d m o h e t

Contents introduction & background testing pre-orders Model-Based Testing input/output & quiescence ioco implementation relation Ed Brinksma test generation TorX test case study University of Twente Dept. of

451 views • 11 slides
Real-Time Modeling and Test Case Generation Konrad Krentz A Convincing Safety Case [1] 2 A

Real-Time Modeling and Test Case Generation Konrad Krentz A Convincing Safety Case [1] 2 A

Real-Time Modeling and Test Case Generation Konrad Krentz A Convincing Safety Case [1] 2 A Convincing Safety Case Fault Formal () Architecture Tree Testing Methods Analysis UPPAAL Agenda 3 Timed Timed UPPAAL Model- Overview

369 views • 36 slides
Mutation Score, Coverage, Model Inference: Quality Assessment for t -way Combinatorial Test-Suites

Mutation Score, Coverage, Model Inference: Quality Assessment for t -way Combinatorial Test-Suites

Mutation Score, Coverage, Model Inference: Quality Assessment for t -way Combinatorial Test-Suites Hermann Felbinger , Franz Wotawa, Mihai Nica Graz University of Technology Motivation Extend existing empirical evaluation results

477 views • 19 slides
UML-Based Statistical Test Case Generation Matthias Riebisch, Ilka Philippow, Marco Gtze

UML-Based Statistical Test Case Generation Matthias Riebisch, Ilka Philippow, Marco Gtze

UML-Based Statistical Test Case Generation Matthias Riebisch, Ilka Philippow, Marco Gtze Ilmenau Technical University; Germany http://www.theoinf.tu-ilmenau.de/~pld ALEXANDRIA NetObjectDays02, Erfurt, October 10, 2002 ALEXANDRIA Research

527 views • 13 slides
1 2 3 4 Most of the traditional approaches that drive test strategies are based on some

1 2 3 4 Most of the traditional approaches that drive test strategies are based on some

1 2 3 4 Most of the traditional approaches that drive test strategies are based on some attributes that is derived from other assessments such as requirements-driven, risk-driven or metrics-driven test strategies. The problem with these

526 views • 37 slides
Model-based Testing Model-based Testing Gordon Fraser Saarland University Gordon Fraser

Model-based Testing Model-based Testing Gordon Fraser Saarland University Gordon Fraser

Model-based Testing Model-based Testing Gordon Fraser Saarland University Gordon Fraser Saarland University Slides by Lars Frantzen Conformance Testing specifies Model System System conforms to Test Generation Test Execution Test

1.71k views • 143 slides
Why Dave, a Database Engineer, Quit Hey Dave, our DB costs $30 M/year. Can you make it less

Why Dave, a Database Engineer, Quit Hey Dave, our DB costs $30 M/year. Can you make it less

M UTANT : Balancing Storage Cost and Performance in LSM-Tree Data Stores Hobin Yoon 1 , Juncheng Yang 2 Sveinn Kristjansson 3 , Steinn Sigurdarson 4 Ymir Vigfusson 2,5 , Ada Gavrilovska 1 1 Georgia Institute of Technology, 2 Emory University 3

434 views • 19 slides
The logic of learning: The logic of learning: logic and knowledge representation logic and

The logic of learning: The logic of learning: logic and knowledge representation logic and

The logic of learning: The logic of learning: logic and knowledge representation logic and knowledge representation in machine learning in machine learning Peter A. Flach Department of Computer Science University of Bristol

771 views • 59 slides
Research Ar*cle Advice The Importance of Subsec*ons An effec*ve way to help readers follow

Research Ar*cle Advice The Importance of Subsec*ons An effec*ve way to help readers follow

Research Ar*cle Advice The Importance of Subsec*ons An effec*ve way to help readers follow the logic of your argument, improve flow Definitely used in Methods, Results Usually helpful in Discussion, too (underused!) Rarely

147 views • 10 slides
Biophysics of Metalloenzymes Topics and Themes: (Metallo-) Proteins and Enzymes in the Cell 1)

Biophysics of Metalloenzymes Topics and Themes: (Metallo-) Proteins and Enzymes in the Cell 1)

Biophysics of Metalloenzymes Topics and Themes: (Metallo-) Proteins and Enzymes in the Cell 1) 2) Some Principles of Coordination Chemistry 3) Methods for Investigation at Molecular Level 4) Overview on Metal Cofactors in Biology 5)

638 views • 28 slides
Fault-Based Testing (c) 2007 Mauro Pezz & Michal Young Ch 16, slide 1 Learning objectives

Fault-Based Testing (c) 2007 Mauro Pezz & Michal Young Ch 16, slide 1 Learning objectives

Fault-Based Testing (c) 2007 Mauro Pezz & Michal Young Ch 16, slide 1 Learning objectives Learning objectives Understand the basic ideas of fault based Understand the basic ideas of fault -based testing How knowledge of a

630 views • 17 slides
RoboStar Technology Systematic Software Testing for Robotics Robert M. Hierons 1 and Raluca

RoboStar Technology Systematic Software Testing for Robotics Robert M. Hierons 1 and Raluca

RoboStar Technology Systematic Software Testing for Robotics Robert M. Hierons 1 and Raluca Lefticaru 2 University of Sheffield, University of Bradford, UK 14th November 2019 Thanks : Ana Cavalcanti, James Baxter, Manuel N u nez, Mercedes

459 views • 35 slides
Leveraging Program Equivalence for Adaptive Program Repair: Models and First Results Westley

Leveraging Program Equivalence for Adaptive Program Repair: Models and First Results Westley

Leveraging Program Equivalence for Adaptive Program Repair: Models and First Results Westley Weimer, UVA Zachary P . Fry, UVA Stephanie Forrest, UNM Automated Program Repair Given a program, a notion of correct behavior, and evidence

679 views • 30 slides
Evolutionary Graph Theory J. D az LSI-UPC Nice, May, 2014 Population Genetics Models

Evolutionary Graph Theory J. D az LSI-UPC Nice, May, 2014 Population Genetics Models

Evolutionary Graph Theory J. D az LSI-UPC Nice, May, 2014 Population Genetics Models Model the forces that produce and maintain genetic evolution within a population. Mutation: the process by which one individual (gene) changes.

707 views • 34 slides

More recommend