Marcel de Vries CTO Xpirit @marcelv @marcelv Lets sell music - - PowerPoint PPT Presentation

▶

Aug 20, 2023 485 likes •838 views

#TESTWORKSCONF #XPIRT Marcel de Vries CTO Xpirit @marcelv @marcelv Lets sell music online! @marcelv Assemble a team We do Scrum We read THE book @marcelv @marcelv Marketing is doing great! @marcelv Website looks great . @marcelv

SLIDE 1

@marcelv

Marcel de Vries

CTO Xpirit #TESTWORKSCONF #XPIRT

@marcelv

SLIDE 2

@marcelv

Lets sell music online!

SLIDE 3

@marcelv

Assemble a team We read THE book We do Scrum

SLIDE 4

@marcelv

SLIDE 5

@marcelv

Marketing is doing great!

SLIDE 6

@marcelv

Website looks great ….

SLIDE 7

@marcelv

Launch date ….

SLIDE 8

@marcelv

What just happened?

SLIDE 9

@marcelv

SLIDE 10

@marcelv

We did the lean startup thing…. We used agile methodology to produce the software…. We wrote tons of tests, everything is unit tested, we have 98% coverage!!! We use Microsoft Azure…. We have auto scaling turned on…..

But…….?!?

SLIDE 11

@marcelv

Welcome to the pitfall called success!

Applications always behave differently when running under high load and stress conditions!

SLIDE 12

@marcelv

I never make the same mistake twice. I make it five or six times, just to be sure.”

– Anonymous

SLIDE 13

@marcelv

Load testing:

How will the application behave in front of the expected users load?

Performance testing:

How fast will the application code perform?

Stress testing:

What is point of users- load that will break your application?

Capacity planning:

Will the application be able to scale up to the expected future capacity?

SLIDE 14

@marcelv

T

ols that can help in this space

Variation of Open Source and Commecial software Some common tools used:

SLIDE 15

@marcelv

We have done an amazing job of hiding this diamond (a 10K+ load testing tool) inside the box for years

- Charles Sterling .Net Rocks episode 1202

Visual Studio Ultimate(2010,12,13) Visual Studio Enterprise 2015 Web Performance T est Any unit test

Performance testing in VS

SLIDE 16

@marcelv

Demo

SLIDE 17

@marcelv

Typical Enterprise setup

Prod.myenterprise.com

Prod servers

Workplace clients

Prod network

AD server & DNS Server

Dev.myenterprise.com

TFS Server

Dev Clients

DEV network

AD server & DNS Server

TST.myenterprise.com TST Clients

TST network

AD server & DNS Server

Dev Servers TST Servers

SLIDE 18

@marcelv

Load test configuration

TST.myenterprise.com

TST network

AD server & DNS Server

Load test rig System Under Test

Load generator Load generator + Controller

Http(s)://myurl.tst.myenterprise.com

Load test database

TST Workstation

SLIDE 19

@marcelv

Install your software/agents Physically setup computers Appropriate/buy/ rent computers

What is needed to make this work?

Replicate this to all the computers

SLIDE 20

@marcelv

Get infrastructure in cloud when you need it. No need to setup your own infrastructure and maintain it. Use the same load test project which you use for on premises today. Scale out easily in case of doing stress testing.

Benefits of cloud load testing

SLIDE 21

@marcelv

Cloud Load test configuration

TST.myenterprise.com TST Workstation

TST network

AD server & DNS Server

Load test rig System Under Test

Load generator Load generator + Controller

Http(s)://myurl.tst.myenterprise.com

SLIDE 22

@marcelv @marcelv

New capabilities in VS 2015 & Update 5 13 regions up to 100 Cores for 72 hrs!

SLIDE 23

@marcelv

Demo

SLIDE 24

@marcelv

But I don’t want Visual Studio!

SLIDE 25

@marcelv

No worries, don’t need it

SLIDE 26

@marcelv

Demo

SLIDE 27

@marcelv

“It is not hard to break something with a load test but it is extremely hard to learn something when you do”

- Richard Campbell, .Net Rocks episode 1202

Need to create representative scenarios Need to provide a real life scenario mix Start with a baseline Always compare to the baseline and check improvements Make it part of your daily routine

Load testing Approach

SLIDE 28

@marcelv

Example Node.JS & Mongo optimization done in April

SLIDE 29

@marcelv

Load testing part of build & Release

VSTS standard build engine VSTS Release pipelines

SLIDE 30

@marcelv

Demo

SLIDE 31

@marcelv

But what does this cost?

First we need to define a VUM..
E.g run a test for 1 hour to simulate 10,000 users =>

SLIDE 32

@marcelv

Conclusion

Cloud based load testing enables easy road to load testing for your external facing sites / API’s Visual Studio supports simple to set up load tests Visual Studio T eam Services(VSTS) provides cloud based load tests supports various formats including JMeter Make load testing part of you automated deployment strategy!

SLIDE 33

@marcelv

@marcelv http://fluentbytes.com mdevries@xpirit.com

SLIDE 34

@marcelv

@marcelv http://fluentbytes.com mdevries@xpirit.com

xpir.it/XpiritMagazine