Towards Model-Based Testing of Domain-Specific Modelling Languages - - PowerPoint PPT Presentation

Towards Model-Based Testing of Domain-Specific Modelling Languages

• J. Merilinna, Olli-Pekka Puolitaival, J. Pärssinen

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

2

Index

• Testing Domain-Specific Modelling Languages (DSML)
• Model-Based Testing (MBT)
• Application Testing
• Modelling Language Testing
• Test Suite Generation in Practice
• Case Lego
• Future research

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

3

Testing Domain-Specific Modelling Languages (DSML)

• Currently: Manual testing during iterative and incremental DSML

development

• Problems:
• Test applications in synch in metamodel?
• Test coverage
• How DSML testing can be systematized and automated?

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

4

Model-Based Testing (MBT)

• MBT is a black box testing

technique

• Phases:
• 1. Modelling
• 2. Test generation
• 3. Test execution
• MBT is decreasing test suite

maintenance efforts and improves coverage.

Implementing MBT

Modelling Test case generation Test Execution

Application

Implementing Requirements

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

5

Application Testing

• Tests and the implementation

are generated from the same model

• Code generator and metamodel

(from the utilized parts) are under testing

• Comprehensive test suite is

automatically generated and always in synch with implementation

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

6

Modelling Language Testing

• One application can be

considered as one test case. Multiple test cases are required!

• Metamodel describes rules of

the language

• We argue that applications can

be generated from metamodel definitions

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

7

Test Suite Generation in Practice

• DSM tool requirements
• Allows exporting the

metamodel and importing the application models

• MetaEdit+ fulfils the

requirements

• MBT tool requirements
• Supports model importing

and exporting the test cases

• Conformiq Qtronic fulfils

the requirements

Met2QML

Conformiq Qtronic Metaedit+ XML Test suite Code generator Mod2QML Q M L

Application models Application generator Test generator Metamodel Application model Metamodel Testing Application Test executor

Q M L

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

8

Case Lego: Generating Application

Generated code

Compiling Application model Application Execution

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

9

Application Model

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

10

Generated Code

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

11

Compiling

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

12

Application Execution

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

13

Case Lego: Generating Tests

Application model Model into QML format Test cases Test generation

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

14

Application Model

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

15

Transform the Model into QML Format

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

16

Test Generation

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

17

Test Execution

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

18

Case Lego: One Generated Test Case

1. 1. 2. 2. 3. 3.

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

19

Future Research

• More applications model tests
• Metamodel testing and make a demo of that
• Identifying the most potential domains, and possible restrictions.
• Identifying effects in quality, processes…

VTT TECHNICAL RESEARCH CENTRE OF FINLAND

20

Questions?