Dynamic Analysis for Model-Driven Software Modernization Andr van - - PowerPoint PPT Presentation

Dynamic Analysis for Model-Driven Software Modernization

André van Hoorn2 (avh@informatik.uni-kiel.de),

Software Engineering Group, University of Kiel, Germany

• S. Frey2, W. Goerigk1, W. Hasselbring2, H. Knoche1, S. Köster4,
• H. Krause3, M. Porembski4, T. Stahl1, M. Steinkamp4, and N. Wittmüss3

March 01, 2011 @ MDSM Workshop, Oldenburg

The DynaMod project is funded by the German Federal Ministry of Education and Research (BMBF) under grant no. 01IS10051

Kiel — “the City by the Sea” [Kie]

Oldenburg (Oldb) Kiel

André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 2 / 17

Kiel — “the City by the Sea” [Kie]

Oldenburg (Oldb) Kiel

Photo: http://www.port-of-kiel.de/ André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 2 / 17

Overview of Project Topic

Dynamic Analysis for Model-Driven Software Modernization

Motivation

• Long-lived software systems require continuous modernization
• System behavior & usage important for modernization decisions
• MDSD techniques promise high degree of automation

WP 7 Project Management WP 8 Publication of Results Static Analysis Dynamic Analysis Model-Based Testing Code Generation Definition of Transformations Evaluation

S1 S0 S2 . 1 . 5 . 5 . 1 . 7 . 1 Exit Exit Exit . 2 . 4 . 4 S1 S0 S2 0.1 0.3 0.1 0.7 0.3 0.65 Exit Exit Exit 0.05 0.2 0.6

André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 3 / 17

Overview of Project Topic

Dynamic Analysis for Model-Driven Software Modernization

Motivation

• Long-lived software systems require continuous modernization
• System behavior & usage important for modernization decisions
• MDSD techniques promise high degree of automation

Methodology

• Combining static and dynamic analysis for model reconstruction
• Model enrichment supporting reverse and forward engineering
• Architectural transformation from outdated to modernized system
• Generating code & tests employing mature MDSD techniques

WP 7 Project Management WP 8 Publication of Results Static Analysis Dynamic Analysis Model-Based Testing Code Generation Definition of Transformations Evaluation

S1 S0 S2 . 1 . 5 . 5 . 1 . 7 . 1 Exit Exit Exit . 2 . 4 . 4 S1 S0 S2 0.1 0.3 0.1 0.7 0.3 0.65 Exit Exit Exit 0.05 0.2 0.6

André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 3 / 17

Overview of Project Topic

Dynamic Analysis for Model-Driven Software Modernization

Motivation

• Long-lived software systems require continuous modernization
• System behavior & usage important for modernization decisions
• MDSD techniques promise high degree of automation

Methodology

• Combining static and dynamic analysis for model reconstruction
• Model enrichment supporting reverse and forward engineering
• Architectural transformation from outdated to modernized system
• Generating code & tests employing mature MDSD techniques

WP 7 Project Management WP 8 Publication of Results Static Analysis Dynamic Analysis Model-Based Testing Code Generation Definition of Transformations Evaluation

Expected Results

• Developing resuable methods, techniques, and tools for MDM
• Evaluation by 3 representative case studies
• Sustainable value of models for MDSD-based evolution & operation

S1 S0 S2 . 1 . 5 . 5 . 1 . 7 . 1 Exit Exit Exit . 2 . 4 . 4 S1 S0 S2 0.1 0.3 0.1 0.7 0.3 0.65 Exit Exit Exit 0.05 0.2 0.6

André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 3 / 17

Project Consortium & Funding

Project Consortium:

1

b+m Informatik AG

(Development partner, consortium leader)

• Comprehensive MDSD know-how
• Initiated openArchitectureWare (oAW)

b+m Informatik AG, Melsdorf http://www.bmiag.de/ Software Engineering Group University of Kiel, Kiel http://se.informatik.uni-kiel.de/ HSH Nordbank AG, Kiel http://www.hsh-nordbank.de/ Dataport, Altenholz http://www.dataport.de/ André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 4 / 17

Project Consortium & Funding

Project Consortium:

1

b+m Informatik AG

(Development partner, consortium leader)

• Comprehensive MDSD know-how
• Initiated openArchitectureWare (oAW)

2

Software Engineering Group, Univ. Kiel

(Research partner)

• Model-driven engineering, operation,

and evolution of software systems

• Emphasis on software quality (of service)

b+m Informatik AG, Melsdorf http://www.bmiag.de/ Software Engineering Group University of Kiel, Kiel http://se.informatik.uni-kiel.de/ HSH Nordbank AG, Kiel http://www.hsh-nordbank.de/ Dataport, Altenholz http://www.dataport.de/ André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 4 / 17

Project Consortium & Funding

Project Consortium:

1

b+m Informatik AG

(Development partner, consortium leader)

• Comprehensive MDSD know-how
• Initiated openArchitectureWare (oAW)

2

Software Engineering Group, Univ. Kiel

(Research partner)

• Model-driven engineering, operation,

and evolution of software systems

• Emphasis on software quality (of service)

3

Dataport

(Associated partner)

• Provides ICT services for public/tax

administrations

b+m Informatik AG, Melsdorf http://www.bmiag.de/ Software Engineering Group University of Kiel, Kiel http://se.informatik.uni-kiel.de/ HSH Nordbank AG, Kiel http://www.hsh-nordbank.de/ Dataport, Altenholz http://www.dataport.de/ André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 4 / 17

Project Consortium & Funding

Project Consortium:

1

b+m Informatik AG

(Development partner, consortium leader)

• Comprehensive MDSD know-how
• Initiated openArchitectureWare (oAW)

2

Software Engineering Group, Univ. Kiel

(Research partner)

• Model-driven engineering, operation,

and evolution of software systems

• Emphasis on software quality (of service)

3

Dataport

(Associated partner)

• Provides ICT services for public/tax

administrations 4

HSH Nordbank AG

(Associated partner)

• Leading bank for corporate and private clients in

northern Germany

b+m Informatik AG, Melsdorf http://www.bmiag.de/ Software Engineering Group University of Kiel, Kiel http://se.informatik.uni-kiel.de/ HSH Nordbank AG, Kiel http://www.hsh-nordbank.de/ Dataport, Altenholz http://www.dataport.de/ André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 4 / 17

Project Consortium & Funding

Project Consortium:

1

b+m Informatik AG

(Development partner, consortium leader) 2

Software Engineering Group, Univ. Kiel

(Research partner) 3

Dataport

(Associated partner) 4

HSH Nordbank AG

(Associated partner)

Funding:

• BMBF “KMU-innovativ”
• 2 years (01/11–12/12)

Under grant no. 01IS10051 b+m Informatik AG, Melsdorf http://www.bmiag.de/ Software Engineering Group University of Kiel, Kiel http://se.informatik.uni-kiel.de/ HSH Nordbank AG, Kiel http://www.hsh-nordbank.de/ Dataport, Altenholz http://www.dataport.de/ André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 4 / 17

The Reengineering Horseshoe Model

Development New System Source Legacy Source design patterns program plans Based Architecture- Base Architecture Desired Architecture Architectural Rep’n Architectural Conformance Architecture Transformation Recovery/ code styles Architecture Rep’n Rep’n Code-Structure Function-Level Rep’n Source Text Rep’n Code-Structure Rep’n Function-Level Rep’n & styles Concepts Concepts

[KWC98]

The horseshoe model — “A visual metaphor of the integration of code-level and architectural reengineering views of the world” [KWC98]

André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 5 / 17

Working Packages & Involved Technologies

Working Packages:

WP 1 Static Analysis WP 2 Dynamic Analysis WP 5 Model-Based Testing WP 4 Code Generation WP 3 Definition of Transformations WP 6 Evaluation

Involved Technologies:

• Eclipse Modeling Framework/Project (EMF [SBPM09], EMP [ecl10]) for meta-modeling and tooling
• DSLs based on OMG’s ADM meta-models (KDM [Obj09a], SMM [Obj09b] et al.)
• Kieker [vHRH+09] for dynamic analysis (monitoring, reconstruction, visualization etc.)
• Apache JMeter [Apa] & Markov4JMeter [vHRH08] for model-based testing

André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 6 / 17

Working Packages & Involved Technologies

Working Packages:

WP 1 Static Analysis WP 2 Dynamic Analysis WP 5 Model-Based Testing WP 4 Code Generation WP 3 Definition of Transformations WP 6 Evaluation

Involved Technologies:

• Eclipse Modeling Framework/Project (EMF [SBPM09], EMP [ecl10]) for meta-modeling and tooling
• DSLs based on OMG’s ADM meta-models (KDM [Obj09a], SMM [Obj09b] et al.)
• Kieker [vHRH+09] for dynamic analysis (monitoring, reconstruction, visualization etc.)
• Apache JMeter [Apa] & Markov4JMeter [vHRH08] for model-based testing
• Legacy technology (VB6, Natural etc.) subject to modernization (next slides)

André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 6 / 17

Case Study Scenarios

1 AIDA-SH (Dataport)

• Information management and retrieval

system for inventory data of historical archives

• Client/server architecture
• Technologies
• Visual Basic 6
• MS SQL Server (7.0, 2000, 2003) and MSDE
• Impulse for modernization
• Outdated technology
• Representative of many modernization

projects

André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 7 / 17

Case Study Scenarios (cont’d)

2 Nordic Analytics (HSH Nordbank AG)

• Function library for assessment and risk

control of finance products

• Deployments

1

Desktop installations (Excel front-end)

2

Trading systems

3

Batch processing systems

• C# implementation
• Impulse for modernization
• Architectural restructuring

André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 8 / 17

Case Study Scenarios (cont’d)

3 Permis-B (Dataport)

• System for managing health care allowance
• Complex and critical
• Technologies
• z/OS (mainframe OS)
• Adabas-C (DBMS)
• Natural (online) & COBOL (batch)
• EskerTun/HOBLink (terminal emulation)
• ApplinX (web GUI)
• Impulses for modernization
• Outdated technology
• Eroded architecture

André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 9 / 17

Kieker Framework for Dynamic Analysis

Analysis Plug-In

Monitoring log e.g., file system, database, message-oriented middleware e.g., trace information, workload, response times, resource utilization, loop counts

Monitoring Record

M M M M M M

e.g., AOP-based method call interception

M

e.g., architecture reconstruction, performance evaluation, online adaptation control, failure diagnosis

Kieker.Monitoring Kieker.Analysis

Core Characteristics [vHRH+09]

• Flexible architecture (custom probes, readers, writers, analysis plug-ins)
• Integrated & extensible record type model for monitoring & analysis
• Logging, reconstruction, analysis/visualization of (distributed) traces
• Low overhead (designed for continuous operation in multi-user systems)
• Evaluated in industry case studies

http://kieker.sourceforge.net André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 10 / 17

Kieker Framework for Dynamic Analysis

Analysis Plug-In

Monitoring log e.g., file system, database, message-oriented middleware e.g., trace information, workload, response times, resource utilization, loop counts

Monitoring Record

M M M M M M

e.g., AOP-based method call interception

M

e.g., architecture reconstruction, performance evaluation, online adaptation control, failure diagnosis

Kieker.Monitoring

Kieker.Monitoring Monitoring Probe Monitoring Controller Monitoring Log Writer

Kieker.Analysis

Kieker.Analysis Monitoring Record Consumer Analysis Controller Monitoring Log Reader

Core Characteristics [vHRH+09]

• Flexible architecture (custom probes, readers, writers, analysis plug-ins)
• Integrated & extensible record type model for monitoring & analysis
• Logging, reconstruction, analysis/visualization of (distributed) traces
• Low overhead (designed for continuous operation in multi-user systems)
• Evaluated in industry case studies

http://kieker.sourceforge.net André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 10 / 17

Sequence Diagrams

Visualization Examples

@3:..Bookstore @1:..Catalog @2:..CRM searchBook() getBook(..) getOffers() getBook(..)

(a) Assembly-level view

SRV0:: @3:..Bookstore SRV1:: @1:..Catalog SRV0:: @2:..CRM SRV0:: @1:..Catalog searchBook() getBook(..) getOffers() getBook(..)

(b) Deployment-level view

André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 11 / 17

Calling Dependency Graphs

Visualization Examples (cont’d)

$ <<assembly component>> @3:..Bookstore 1635 <<assembly component>> @1:..Catalog <<assembly component>> @2:..CRM 1635 1635 1635

(a) Assembly-level component dependency graph

<<execution container>> SRV0 <<deployment component>> @3:..Bookstore <<deployment component>> @2:..CRM <<deployment component>> @1:..Catalog <<execution container>> SRV1 <<deployment component>> @1:..Catalog searchBook() getOffers() 1635 getBook(..) 543 getBook(..) 1092 573 1062 $ 1635

(b) Deployment-level operation dependency graph

André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 12 / 17

Dynamic Call Trees

Visualization Examples (cont’d)

$ SRV0:: @3:..Bookstore .searchBook() 1. SRV1:: @1:..Catalog .getBook(..) 2. SRV0:: @2:..CRM .getOffers() 3. SRV0:: @1:..Catalog .getBook(..) 4.

(a) Dynamic call tree (single trace)

$ SRV0:: @3:bookstoreTracingBookstore .searchBook() 1635 SRV1:: @1:bookstoreTracingCatalog .getBook(..) 1092 SRV0:: @2:bookstoreTracingCRM .getOffers() 1635 SRV0:: @1:bookstoreTracingCatalog .getBook(..) 543 SRV1:: @1:bookstoreTracingCatalog .getBook(..) 1062 SRV0:: @1:bookstoreTracingCatalog .getBook(..) 573

(b) Aggregated deployment-level call tree

André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 13 / 17

Kieker.TraceAnalysis Tool

System Model Repository

Execution Filter Message Trace Sink Plug-Ins Execution Trace Sink Plug-Ins Trace Recon- struction Filter ...

Kieker.TraceAnalysis Tool

Analysis Plug-In

Kieker.Analysis Sequence diagrams, Dependency graphs, Dynamic call trees, System model (html), ... André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 14 / 17

Instrumentation of Visual Basic 6 Code

Uninstrumented VB 6 code

André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 15 / 17

Instrumentation of Visual Basic 6 Code

Manually instrumented VB 6 code (Kieker.VB6)

André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 15 / 17

Instrumentation of Visual Basic 6 Code

VB 6 code instrumentation by annotation

André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 15 / 17

Model-Driven Instrumentation & Analysis

Call catalog.getBook(False) André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 16 / 17

Model-Driven Instrumentation & Analysis

Static analysis

Call catalog.getBook(False) André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 16 / 17

Model-Driven Instrumentation & Analysis

rtmean [ms]

Static analysis

Call catalog.getBook(False) André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 16 / 17

Model-Driven Instrumentation & Analysis

rtmean [ms]

Static analysis Model-driven instrumentation

'@OperationExecutionMonitoringProbe() Call catalog.getBook(False) Call catalog.getBook(False) André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 16 / 17

Model-Driven Instrumentation & Analysis

rtmean [ms]

Static analysis Model-driven instrumentation Aspect weaving

Dim tin As Variant Dim tout As Variant Dim r As OperationExecutionRecord ' 1.) Calls the Catalog component's getBook() method and logs its entry and exit timestamp using Kieker Set r = New OperationExecutionRecord tin = monitoringCtrl.currentTimeNanos Call catalog.getBook(False) tout = monitoringCtrl.currentTimeNanos Call r.initField("Catalog", "getBook", index, tin, tout, 1, 1) Call monitoringCtrl.writeRecord(r) '@OperationExecutionMonitoringProbe() Call catalog.getBook(False) Call catalog.getBook(False) André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 16 / 17

Model-Driven Instrumentation & Analysis

rtmean [ms] 200 ms

Static analysis Model-driven instrumentation Aspect weaving Dynamic analysis

Dim tin As Variant Dim tout As Variant Dim r As OperationExecutionRecord ' 1.) Calls the Catalog component's getBook() method and logs its entry and exit timestamp using Kieker Set r = New OperationExecutionRecord tin = monitoringCtrl.currentTimeNanos Call catalog.getBook(False) tout = monitoringCtrl.currentTimeNanos Call r.initField("Catalog", "getBook", index, tin, tout, 1, 1) Call monitoringCtrl.writeRecord(r) '@OperationExecutionMonitoringProbe() Call catalog.getBook(False) Call catalog.getBook(False) André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 16 / 17

Conclusion

Additional Information:

• http://kosse-sh.de/dynamod (in German)
• A. van Hoorn, S. Frey, W. Goerigk, W. Hasselbring, H. Knoche, S. Köster, H. Krause, M.

Porembski, T. Stahl, M. Steinkamp, and N. Wittmüss. DynaMod project: Dynamic analysis for model-driven software modernization. In Proceedings of the 1st International Workshop on Model-Driven Software Migration (MDSM) 2011, Project Presentations, 2011. To appear.

André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 17 / 17

Literature

Apache Software Foundation. Apache JMeter – homepage. Eclipse Modeling Project. http://www.eclipse.org/modeling/, 2010. Kiel — A City Portrait. http://www.kiel.de/Aemter_01_bis_20/05/Stadtportrait_English/cityportrt1.htm. Rick Kazman, Steven G. Woods, and S. Jeromy Carrière. Requirements for integrating software architecture and reengineering models: CORUM II. In Proceedings of the Working Conference on Reverse Engineering (WCRE’98), WCRE ’98, pages 154–, Washington, DC, USA, 1998. IEEE Computer Society. Object Management Group, Inc. Architecture-Driven Modernization (ADM): Knowledge Discovery Meta-Model (KDM) Version 1.1. http://www.omg.org/cgi-bin/doc?formal/2009-01-02/, 2009. Object Management Group, Inc. Architecture-Driven Modernization (ADM): Software Metrics Meta-Model (SMM) Version 1.0 Beta 1. http://www.omg.org/cgi-bin/doc?ptc/2009-03-03/, 2009. David Steinberg, Frank Budinsky, Marcelo Paternostro, and Ed Merks. EMF: Eclipse Modeling Framework. Addison-Wesley, 2nd edition, 2009. Thomas Stahl and Markus Völter. Model-Driven Software Development – Technology, Engineering, Management. Wiley & Sons, 2006. André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 18 / 17

Literature (cont’d)

André van Hoorn, Sören Frey, Wolfgang Goerigk, Wilhelm Hasselbring, Holger Knoche, Sönke Köster, Harald Krause, Marcus Porembski, Thomas Stahl, Marcus Steinkamp, and Norman Wittmüss. DynaMod project: Dynamic analysis for model-driven software modernization. In Andreas Fuhr, Wilhelm Hasselbring, Volker Riediger, Magiel Bruntink, and Kostas Kontogiannis, editors, Joint Proceedings of the 1st International Workshop on Model-Driven Software Migration (MDSM 2011) and the 5th International Workshop on Software Quality and Maintainability (SQM 2011), volume 708 of CEUR Workshop Proceedings, pages 12–13, March 2011. Invited paper. André van Hoorn, Matthias Rohr, and Wilhelm Hasselbring. Markov4JMeter: Generating probabilistic workload for web-based applications. In 30th International Conference on Software Engineering (ICSE ’08), 2008. rejected. André van Hoorn, Matthias Rohr, Wilhelm Hasselbring, Jan Waller, Jens Ehlers, Sören Frey, and Dennis Kieselhorst. Continuous monitoring of software services: Design and application of the Kieker framework. Technical Report TR-0921, Department of Computer Science, University of Kiel, Germany, November 2009. André van Hoorn (Univ. Kiel) et al. DynaMod Project — http://kosse-sh.de/dynamod/ March 01, 2011 19 / 17