Feedback-controlled Random Test Generation Kohsuke Yatoh 1* , - - PowerPoint PPT Presentation

▶
feedback controlled random test generation
SMART_READER_LITE
LIVE PREVIEW

Feedback-controlled Random Test Generation Kohsuke Yatoh 1* , - - PowerPoint PPT Presentation

Mar 03, 2024 183 likes •301 views

ISSTA 2015 Demo Feedback-controlled Random Test Generation Kohsuke Yatoh 1* , Kazunori Sakamoto 2 , Fuyuki Ishikawa 2 , Shinichi Honiden 12 1:University of Tokyo, 2:National Institute of Informatics * He is currently a ffi liated with Google

slide-1
SLIDE 1

ISSTA 2015 Demo

Feedback-controlled Random Test Generation

Kohsuke Yatoh1*, Kazunori Sakamoto2, Fuyuki Ishikawa2, Shinichi Honiden12

1:University of Tokyo, 2:National Institute of Informatics

* He is currently affiliated with Google Inc., Japan. All work is done in Univ. Tokyo and nothing to do with Google.

slide-2
SLIDE 2

Introduction

Today's demonstrations:

  • Randoop (with multi-pool generator)

○ To generate random tests

  • OpenCodeCoverageFramework

○ To instrument Java sources ○ To observe coverage on the fly All artifacts are available on http://www.klazz.net/pub/issta2015/

2

slide-3
SLIDE 3

Randoop

Random tester for object-oriented programs

[ICSE 07, http://mernst.github.io/randoop/]

Example: class List; class Int; Example: List l1 = new List(); Int i1 = new Int(0); l1.add(i1); List l2 = new List(); l2.addAll(l1);

3

slide-4
SLIDE 4

Randoop Multi-pool Generator

We wrote 'multi-pool' generator for Randoop.

  • Improves coverage of generated tests

○ No change on Input / Output formats

  • Tracks coverage on the fly by

OpenCodeCoverageFramework

  • Detailed technical talk on Friday!

4

slide-5
SLIDE 5

Workflow

  • 1. OpenCodeCoverage

Framework

5

  • 2. Randoop with

multi-pool generator Input Output

slide-6
SLIDE 6

OpenCodeCoverageFramework

[ICST 2013, https://github.com/exKAZUu/OpenCodeCoverageFramework]

  • AST(CST) manipulation library for 8+ languages
  • Can insert coverage handler function calls
  • Not-so-optimized, but very flexible

int abs(int a) { if (a < 0) { a = -a; } return a; } int abs(int a) { H.stmt(0); if (H.branch(0, a < 0)) { H.stmt(1); a = -a; } H.stmt(2); return a; } 6

slide-7
SLIDE 7

Demo 1: OpenCodeCoverageFramework On typical project with ant build file:

# 1. Instrument source files

> $ SimpleOccf.exe src/

# 2. Add soccf-runtime.jar to classpath

> $ vi build.xml

# 3. Compile

> $ ant

7

slide-8
SLIDE 8

Randoop (multi-pool)

Creates random method sequences from given class list

  • We added 'multi-pool' generator
  • We wrapped Randoop by Docker to isolate

test environment for safe execution

8

slide-9
SLIDE 9

Demo 2: Randoop (multi-pool) on Docker

# 1. Run randoop (multi-pool) on Docker

> $ python ./run.py \ /path/to/randoop-control.jar \ /path/to/target.jar

# 2. Pull generated regression tests

> $ sudo docker cp \ `cat data/0/cid.txt`:/work .

9

slide-10
SLIDE 10

Summary

Today's demonstrations:

  • Randoop (with multi-pool generator)

○ To generate random tests

  • OpenCodeCoverageFramework

○ To instrument Java sources ○ To observe coverage on the fly All artifacts are available on http://www.klazz.net/pub/issta2015/

10