Review and Update on Wilhelm Hasselbring 1 & Andr van Hoorn 2 1 - - PowerPoint PPT Presentation

▶
review and update on
SMART_READER_LITE
LIVE PREVIEW

Review and Update on Wilhelm Hasselbring 1 & Andr van Hoorn 2 1 - - PowerPoint PPT Presentation

Jan 06, 2023 1.02k likes •1.32k views

Review and Update on Wilhelm Hasselbring 1 & Andr van Hoorn 2 1 Kiel University (CAU) Software Engineering Group & 2 University of Stuttgart Reliable Software Systems Group SSP 2015 05. November 2015 @ Munich W. Hasselbring, A. van

slide-1
SLIDE 1

Review and Update on

Wilhelm Hasselbring1 & André van Hoorn2

1 Kiel University (CAU)

Software Engineering Group &

2 University of Stuttgart

Reliable Software Systems Group SSP 2015

  • 05. November 2015 @ Munich
  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

1 / 26

slide-2
SLIDE 2

Dynamic Analysis with Kieker

[van Hoorn et al. 2012]

Overview

Monitoring Probe Software System with Monitoring Instrumentation

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

2 / 26

slide-3
SLIDE 3

Dynamic Analysis with Kieker

[van Hoorn et al. 2012]

Overview

Monitoring Probe Software System with Monitoring Instrumentation M e a s u r e m e n t Monitoring log/stream Monitoring Records

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

2 / 26

slide-4
SLIDE 4

Dynamic Analysis with Kieker

[van Hoorn et al. 2012]

Overview

Monitoring Probe Software System with Monitoring Instrumentation M e a s u r e m e n t Monitoring log/stream Monitoring Records A n a l y s i s Analysis Configuration (via API and WebGUI) Pipes and Filters

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

2 / 26

slide-5
SLIDE 5

Dynamic Analysis with Kieker

[van Hoorn et al. 2012]

Overview

Monitoring Probe Software System with Monitoring Instrumentation M e a s u r e m e n t Monitoring log/stream Monitoring Records A n a l y s i s Analysis Configuration (via API and WebGUI) Pipes and Filters

Invocations/minute [x 1000] Calendar time (hh:mm) Workload Anomaly Detection 0.0 0.5 1.0 1.5 2.0

SRV0:: @3:..Bookstore SRV0:: @1:..Catalog SRV0:: @2:..CRM SRV1:: @1:..Catalog searchBook() getBook(..) getOffers() getBook(..) <<execution container>> SRV0 <<deployment component>> @3:..Bookstore <<deployment component>> @2:..CRM <<deployment component>> @1:..Catalog <<execution container>> SRV1 <<deployment component>> @1:..Catalog searchBook() getOffers() 1635 getBook(..) 543 getBook(..) 1092 573 1062 $ 1635

Online and Offline Visualization

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

2 / 26

slide-6
SLIDE 6

Framework Features & Extension Points

Essential Characteristics [Rohr et al. 2008, van Hoorn et al. 2009; 2012]

Overview

  • Modular, flexible, and extensible architecture

(Probes, records, readers, writers, filters etc.)

  • Pipes-and-filters framework for analysis configuration
  • Distributed tracing (logging, reconstruction, visualization)
  • Low overhead (designed for continuous operation)
  • Evaluated in lab and industrial case studies

Kieker is open-source software (Apache License, V. 2.0) ❤tt♣✿✴✴❦✐❡❦❡r✲♠♦♥✐t♦r✐♥❣✳♥❡t Recommended Tool of the SPEC Research Group Kieker is distributed as part of SPEC RG’s repository

  • f peer-reviewed tools for quantitative system

evaluation and analysis, ❤tt♣✿✴✴r❡s❡❛r❝❤✳s♣❡❝✳♦r❣✴♣r♦❥❡❝ts✴t♦♦❧s✳❤t♠❧

Kieker.Analysis

Analysis Controller Analysis / Visualization Plugin AnalysisTConfiguration

Monitoring Log/Stream Kieker.Monitoring Sampling JMX Interface Time Source Logging Adaptive Monitoring

MonitoringT Controller

CurrentDtime ResourceDutilization CPUDutilization OperationDexecution Control/flowDevents <custom monitoring record type> <custom monitoring reader> FileDsystem <custom visualization> SequenceDdiagrams DependencyDgraphs CallDgraphs Visualization ArchitectureDreconstrN PipesDandDfiltersDframework MonitoringT Records MonitoringTT Readers Analysis/VisualizationT Plug-Ins <custom trace analysis> TraceDanalysis <custom reconstruction plug-in> <custom analysis plug-in/tool> JavaDMessagingDServiceDMJMS( JavaDManagementDExtNDMJMX( MemorybswapDusage Real/timeDreplayer NamedDpipe DatabaseDMSQL( TCPbIP PerformanceDAnalysis NamedDpipe <custom monitoring writer> Control/flow tracing Resource monitoring <custom technology> CPUDutilization MemoryDusage Sigar Servlet <custom monitoring probe> JavaDMessagingDServiceDMJMS( JavaDManagementDExtNDMJMX( MonitoringTT Writers MonitoringT Probes/Samplers SystemDtime TimeT Sources OutputDstream TCPbIP FileDsystem DatabaseDMSQL( AspectJ Manual Servlet CXFbSOAP <custom interception technology> Spring VB6XDCOBOLXDNNN

Monitoring Probe MonitoringT Writer Monitoring Record Monitoring Reader

<custom time source>

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

3 / 26

slide-7
SLIDE 7

Agenda

Review

1

Overview

2

Review

3

Summary and Outlook

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

4 / 26

slide-8
SLIDE 8

Looking back . . . 2006–2009

Review

2009 May Sept. 2006 May Sept. 2007 May Sept. 2008 May Sept. 2009 2006 2008 2007

Component Technology Availability Privacy Security Safety Performance Reliability Correctness Certification Quality of Service

Trustworthy Software Systems

DEPARTMENT FÜR INFORMATIK SOFTWARE ENGINEERING Diplomarbeit

Performance Monitoring von Middleware-basierten Applikationen

  • 31. März 2006

Diplomand Thilo Focke Am Schloßgarten 4 26122 Oldenburg thilo.focke@informatik.uni-oldenburg.de Erstprüfer

  • Prof. Dr. Wilhelm Hasselbring

Zweitprüfer

  • Prof. Dr. Ralf Reussner (Universität Karlsruhe)

Betreuer MIT Matthias Rohr Dipl.-Math. Johannes-Gerhard Schute

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

5 / 26

slide-9
SLIDE 9

Looking back . . . 2006–2009

Review

2009 May Sept. 2006 May Sept. 2007 May Sept. 2008 May Sept. 2009 2006 2008 2007

Component Technology Availability Privacy Security Safety Performance Reliability Correctness Certification Quality of Service

Trustworthy Software Systems

DEPARTMENT FÜR INFORMATIK SOFTWARE ENGINEERING Diplomarbeit

Performance Monitoring von Middleware-basierten Applikationen

  • 31. März 2006

Diplomand Thilo Focke Am Schloßgarten 4 26122 Oldenburg thilo.focke@informatik.uni-oldenburg.de Erstprüfer

  • Prof. Dr. Wilhelm Hasselbring

Zweitprüfer

  • Prof. Dr. Ralf Reussner (Universität Karlsruhe)

Betreuer MIT Matthias Rohr Dipl.-Math. Johannes-Gerhard Schute

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

5 / 26

slide-10
SLIDE 10

Looking back . . . 2006–2009

Review

2009 May Sept. 2006 May Sept. 2007 May Sept. 2008 May Sept. 2009 2006 2008 2007 0.6 0.5

Component Technology Availability Privacy Security Safety Performance Reliability Correctness Certification Quality of Service

Trustworthy Software Systems

DEPARTMENT FÜR INFORMATIK SOFTWARE ENGINEERING Diplomarbeit

Performance Monitoring von Middleware-basierten Applikationen

  • 31. März 2006

Diplomand Thilo Focke Am Schloßgarten 4 26122 Oldenburg thilo.focke@informatik.uni-oldenburg.de Erstprüfer

  • Prof. Dr. Wilhelm Hasselbring

Zweitprüfer

  • Prof. Dr. Ralf Reussner (Universität Karlsruhe)

Betreuer MIT Matthias Rohr Dipl.-Math. Johannes-Gerhard Schute

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

5 / 26

slide-11
SLIDE 11

Looking back . . . 2010–2013

Review

2009 May Sept. 2006 May Sept. 2007 May Sept. 2008 May Sept. 2009 2006 2008 2007 0.91 0.95a 1.0 0.6 0.5

Component Technology Availability Privacy Security Safety Performance Reliability Correctness Certification Quality of Service

Trustworthy Software Systems

DEPARTMENT FÜR INFORMATIK SOFTWARE ENGINEERING Diplomarbeit

Performance Monitoring von Middleware-basierten Applikationen

  • 31. März 2006

Diplomand Thilo Focke Am Schloßgarten 4 26122 Oldenburg thilo.focke@informatik.uni-oldenburg.de Erstprüfer

  • Prof. Dr. Wilhelm Hasselbring

Zweitprüfer

  • Prof. Dr. Ralf Reussner (Universität Karlsruhe)

Betreuer MIT Matthias Rohr Dipl.-Math. Johannes-Gerhard Schute

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

5 / 26

slide-12
SLIDE 12

Looking back . . . 2010–2013

Review

2010 May Sept. 2011 May Sept. 2012 May Sept. 2011 2012 2010 2013 May Sept. 2013

JUnit

1.1 1.2

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

5 / 26

slide-13
SLIDE 13

Looking back . . . 2010–2013

Review

2010 May Sept. 2011 May Sept. 2012 May Sept. 2011 2012 2010 2013 May Sept. 2013 1.3 1.4

JUnit

1.1 1.2

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

5 / 26

slide-14
SLIDE 14

Looking back . . . 2010–2013

Review

2010 May Sept. 2011 May Sept. 2012 May Sept. 2011 2012 2010 2013 May Sept. 2013

JUnit

1.1 1.2

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

5 / 26

slide-15
SLIDE 15

Looking back . . . 2010–2013

Review

2010 May Sept. 2011 May Sept. 2012 May Sept. 2011 2012 2010 2013 May Sept. 2013 1.3 1.4

regular meetings

FindBugs

JUnit

1.1 1.2

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

5 / 26

slide-16
SLIDE 16

Looking back . . . 2010–2013

Review

2010 May Sept. 2011 May Sept. 2012 May Sept. 2011 2012 2010 2013 May Sept. 2013

iObserve

1.5 1.6

Kieker Days '12

ESN SL

1.3 1.4

regular meetings

FindBugs

JUnit

1.1 1.2

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

5 / 26

slide-17
SLIDE 17

Looking back . . . 2010–2013

Review

2010 May Sept. 2011 May Sept. 2012 May Sept. 2011 2012 2010 2013 May Sept. 2013 1.7 1.8

Kieker/ Palladio Days '13

iObserve

1.5 1.6

Kieker Days '12

ESN SL

1.3 1.4

regular meetings

FindBugs

JUnit

1.1 1.2

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

5 / 26

slide-18
SLIDE 18

Looking back . . . 2014–2015

Review

2015 2014 2014 May Sept. 2015 May Sept.

regular meetings

iObserve

SOSP '14

1.9 1.10

FindBugs

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

5 / 26

slide-19
SLIDE 19

Looking back . . . 2014–2015

Review

2015 2014 2014 May Sept. 2015 May Sept. 1.11 1.12

SSP '15 ? regular meetings

iObserve

SOSP '14

1.9 1.10

FindBugs

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

5 / 26

slide-20
SLIDE 20

Evolution of Code Size and Downloads

LOC obtained via ✇❝ ✲❧ ❁❢✐❧❡❃✳❥❛✈❛

Review Lines of Code (branch 'master')

Release number 0.5 0.91 1.0 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 1.10 1.11 Month of year (from Aug 2008 to Jun 2015) 05 09 01 05 09 01 05 09 01 05 09 01 05 09 01 05 09 01 05 09 01 05 2009 2010 2011 2012 20 40 60 80 100 KLOC (LOC in thousands) LOC (sources + tests) LOC (tests only)

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

6 / 26

slide-21
SLIDE 21

Evolution of Code Size and Downloads

LOC obtained via ✇❝ ✲❧ ❁❢✐❧❡❃✳❥❛✈❛

Review Lines of Code (branch 'master')

Release number 0.5 0.91 1.0 1.1 1.2 1.3 1.4 1.5 1.6 1.7 1.8 1.9 1.10 1.11 Month of year (from Aug 2008 to Jun 2015) 05 09 01 05 09 01 05 09 01 05 09 01 05 09 01 05 09 01 05 09 01 05 2009 2010 2011 2012 20 40 60 80 100 KLOC (LOC in thousands) LOC (sources + tests) LOC (tests only)

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

6 / 26

slide-22
SLIDE 22

Agenda

Summary and Outlook

1

Overview

2

Review

3

Summary and Outlook

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

7 / 26

slide-23
SLIDE 23

Outlook

Summary and Outlook

Current Activities (Selection) toward Kieker 2.0

  • New high-throughput infrastructure for Kieker Analysis
  • Based on TeeTime [Wulf et al. 2014], ❤tt♣✿✴✴t❡❡t✐♠❡✳s❢✳♥❡t
  • Kieker Trace Diagnosis
  • Trace diagnosis tool to identify typical performance problems
  • Eclipse plugin for profiling
  • Docker-based Kieker example (NetflixOSS RSS reader application)
  • Interoperability with other monitoring tools via a common trace API
  • Analysis of Kieker development process and infrastructure

Ticket System: Current/Upcoming Issues

❤tt♣✿✴✴tr❛❝✳❦✐❡❦❡r✲♠♦♥✐t♦r✐♥❣✳♥❡t

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

8 / 26

slide-24
SLIDE 24

Literature

Summary and Outlook

For a comprehensive list of publications, talks, and theses about Kieker, visit: ❤tt♣✿✴✴❦✐❡❦❡r✲♠♦♥✐t♦r✐♥❣✳♥❡t✴r❡s❡❛r❝❤✴

  • T. Focke. Performance Monitoring von Middleware-basierten Applikationen. Diplomarbeit, University Oldenburg, Mar. 2006.
  • M. Rohr, A. van Hoorn, J. Matevska, N. Sommer, L. Stoever, S. Giesecke, and W. Hasselbring. Kieker: Continuous monitoring and on demand visualization
  • f Java software behavior. In C. Pahl, editor, Proceedings of the IASTED International Conference on Software Engineering 2008 (SE’08), pages

80–85, Feb. 2008.

  • A. van Hoorn, M. Rohr, W. Hasselbring, J. Waller, J. Ehlers, S. Frey, and D. Kieselhorst. Continuous monitoring of software services: Design and application
  • f the Kieker framework. Technical Report TR-0921, Department of Computer Science, University of Kiel, Germany, Nov. 2009.
  • A. van Hoorn, J. Waller, and W. Hasselbring. Kieker: A framework for application performance monitoring and dynamic software analysis. In Proceedings of

the 3rd ACM/SPEC International Conference on Performance Engineering (ICPE 2012), pages 247–248. ACM, Apr. 2012.

  • C. Wulf, N. C. Ehmke, and W. Hasselbring. Toward a generic and concurrency-aware pipes & filters framework. In Symposium on Software Performance

2014: Joint Descartes/Kieker/Palladio Days, pages 70–82, Nov. 2014. URL ❤tt♣✿✴✴❡♣r✐♥ts✳✉♥✐✲❦✐❡❧✳❞❡✴✷✼✸✽✷✴.

  • W. Hasselbring, A. van Hoorn

Kieker

  • 05. November 2015 @ Munich

9 / 26