96% Successful Daily Deploys with 6500+ Functional Automated Tests x A n toine Craske 1 TestCon Europe 2020
2 TestCon Europe 2020
La Redoute ? TestCon Europe 2020 3
Preferred Family & Lifestyle Platform TestCon Europe 2020 4
TestCon Europe 2020 5 TITRE DE LA PRESENTATION
TestCon Europe 2020 6
7 TestCon Europe 2020
8 TestCon Europe 2020
9 TestCon Europe 2020
10 TITRE DE LA PRESENTATION
Key Figures 750+m€ sales Top 10 Visited 99% Notoriety European Market in France in France 73% Internal Design 7m unique visitor/m 96+% Sales 50 Stores & Corners Most Automated on Digital Channel Galeries Lafayette Warehouse Europe 50%+ mobile Shareholder at 51% 11 TestCon Europe 2020
Context Web Delivery Web Performance 2019-Beyond Phygital Architecture Reactive and new UX AI, Automation Organisation Takeaways 2018-2019 Omnichannel GL Ownership 51% 2013-2017 Stores Acceleration e-commerce La Redoute exits PPR 2000 < 2000 4 years to transform Web VAD TestCon Europe 2020 12
Transformation Imperatives X10 faster collection Operational Develop and scale E-commerce player cycle-time Excellence new business models 2 => 20 1.5 day to 2 hours 60% to >90% online catalogs/year order processing Home, MKP, ideas 13 TestCon Europe 2020
Transformation Imperatives X10 faster collection Operational Develop and scale E-commerce player cycle-time Excellence new business models 2 => 20 1.5 day to 2 hours 60% to >90% online catalogs/year order processing Home, MKP, ideas Accelerate Web Architecture to be Architecture to be Architecture to be Delivery & faster and more faster and more faster and more Performance flexible flexible flexible 14 TestCon Europe 2020
Context Web Delivery Web Performance 2019-Beyond Phygital Architecture Reactive and new UX AI, Automation Organisation Takeaways 2018-2019 Omnichannel GL Ownership 51% 2013-2017 Stores Acceleration e-commerce La Redoute exits PPR 2000 < 2000 4 years to transform Web VAD TestCon Europe 2020 15
Accelerate Web Delivery & Performance Initial State Optimisation Migration m.laredoute.xy laredoute.xy .fr .intl laredoute.xy Double specs & coding Single implementation Mobile-1st 100% responsive Platform Choice 16 TestCon Europe 2020
Our Web Delivery was slow down mainly on the Testing Phase Req. Design Code QA UAT Deploy Run 2 weeks 2 weeks 2 weeks 2 weeks 3 months 2 weeks 2 weeks 17 TestCon Europe 2020
Accidental complexity was creating symptoms over the value-chain Req. Design Code QA UAT Deploy Run Slow UAT Big & Risky releases Manual Test Changes accumulation Technical Test Branches Merges Other accidental complexity Inconsistent environment Highly complex codebase Indirect bugs … 18 TestCon Europe 2020
We decided to address Testing for improve our releases speed and quality Req. Design Code QA UAT Deploy Run Slow UAT Big & Risky releases Manual Test Changes accumulation Technical Test Branches Merges Smaller & Faster Releases Other accidental complexity Inconsistent environment Functional Test Automation Highly complex codebase Trunk-Based Development Indirect bugs … Features Flags, A/B Testing Incremental Features & Specs 19 TestCon Europe 2020
Smaller and Faster Releases Principles Confidence to deliver with UX tested Functional Test Automation Automate boring, slow, repetitive manual testing Design tests for reuse and maintenability Limit WIP, reducing overhead, accumulation Trunk-Based Development Remove branching accidental complexity Decouple deploy from activation Features Flags, A/B Testing Early and gradual feedback Think incremental experience and value Incremental Features & Specs Identify hypothesis and data points 20 TestCon Europe 2020
The delivery process was changed to delivery every day incremental value Req. Design Code QA UAT Deploy Run Trunk-Based Development Shift-left Functional Test Automation Features Flags, A/B Testing Incremental Features & Specs 21 TestCon Europe 2020
The delivery process was changed to delivery every day incremental value Req. Design Code QA UAT Deploy Run Trunk-Based Development Shift-left Functional Test Automation Scope until 11 am Features Flags, A/B Testing Incremental Features & Specs UAT in 2 hours Daily Deploy 22 TestCon Europe 2020
The delivery process was changed to delivery every day incremental value Req. Design Code QA UAT Deploy Run Trunk-Based Development Shift-left Functional Test Automation Functional Test Automation Functional Test Automation Scope until 11 am Features Flags, A/B Testing Incremental Features & Specs UAT in 2 hours Daily Deploy UX Monitoring A/B Testing Features Flag Hotfix – plan B 23 TestCon Europe 2020
The delivery process was changed to delivery every day incremental value Req. Design Code QA UAT Deploy Run Trunk-Based Development Shift-left Functional Test Automation Functional Test Automation Functional Test Automation Scope until 11 am Features Flags, A/B Testing Incremental Features & Specs UAT in 2 hours Daily Deploy Automated Test Suite UX Monitoring 2020: 6500+ Tests A/B Testing 5500 4500 96% successful 2900 Features Flag 2000 180 production deploy on business days Hotfix – plan B 2014 2015 2016 2017 2018 24 TestCon Europe 2020
Our Test Strategy relies on End-to-End Functional Testing as a priority La Redoute Test Pyramid Exploratory Testing Functional Testing End-to-End User Experience Component Features Integration Testing Unit Testing Code Architecture Manual Books 25 TestCon Europe 2020
Context Web Delivery Web Performance 2019-Beyond Phygital Architecture Reactive and new UX AI, Automation Organisation Takeaways 2018-2019 Omnichannel GL Ownership 51% 2013-2017 Stores Acceleration e-commerce La Redoute exits PPR 2000 < 2000 4 years to transform Web VAD TestCon Europe 2020 26
Functional tests are also running in Production with alerting threshold 27 TestCon Europe 2020
Running Customer Oriented Tests in Production supports UX performance What we do 0013C - Homepage 6001A - Login 6001M - Create Account Scope : Desktop + apps Scope : Desktop + apps Scope : Desktop + apps Frequency : Every minute Frequency : Every minute Frequency : Every 5 minutes SLO : OK and x ms SLO : OK and x ms SLO : OK and x ms Main benefits emerged from this practice Business & IT Collaboration Common KPIs and facts, increased transparency and trust Tests Stability Flaky test ratio through all environments for value and low noise MTTA & MTTR Variance detected early at any time, easier to reproduce 28 TestCon Europe 2020
Context Web Delivery Web Performance 2019-Beyond Phygital Architecture Reactive and new UX AI, Automation Organisation Takeaways 2018-2019 Omnichannel GL Ownership 51% 2013-2017 Stores Acceleration e-commerce La Redoute exits PPR 2000 < 2000 4 years to transform Web VAD TestCon Europe 2020 29
We evolve to a single platform, accelerating delivery through our journey Initial State Optimisation Migration m.laredoute.xy laredoute.xy .fr .intl laredoute.xy Double specs & coding Single implementation Mobile-1st 100% responsive Ideas every 3-6 months Ideas every 1-3 months Ideas every week/month Releases every 2-4 weeks Releases every day Releases every 1-2 week 2 weeks QA 1-2 weeks QA 2 hours QA 30 TestCon Europe 2020
We now need to parallel faster experiments and UX ensuring quality Growth Optimisation Inspire Search & PDP/PLP Find Product Customer & Checkout Buy Post-order & Support Platform laredoute.xy laredoute.xy Limiting Factors Omnichannel & Personnal Mobile-1st 100% responsive Ideas every week/month Reactive Micro front-ends Architecture for parallel scaling Releases every day Elastic Test Pool (K8S) Campaign Execution 40-60min 2 hours QA Explore ML/Statistics/AI Manual Test Analysis 31 TestCon Europe 2020
Context Web Delivery Web Performance 2019-Beyond Phygital Architecture Reactive and new UX Organisation AI, Automation Takeaways 2018-2019 Omnichannel GL Ownership 51% 2013-2017 Stores Acceleration e-commerce La Redoute exits PPR 2000 < 2000 4 years to transform Web VAD TestCon Europe 2020 32
Aligning the organisation on the transformation objectives was key Start with Help Expand gradually Make it repeatable 2014-2016 2017-2018 2019-2021 Test Expertise Business & IT Quality Owner Digital Quality Owner Initial Automation & Tooling Test Training & Center Testers per Feature/Functions 33 TestCon Europe 2020
Context Web Delivery Web Performance 2019-Beyond Phygital Architecture Reactive and new UX AI, Automation Organisation Takeaways 2018-2019 Omnichannel GL Ownership 51% 2013-2017 Stores Acceleration e-commerce La Redoute exits PPR 2000 < 2000 4 years to transform Web VAD TestCon Europe 2020 34
The Test Pyramids are not necessarily the answers in your context 35 TestCon Europe 2020
Step Back on the Big Picture First Front Data Back What is YOUR Starting Portal Point and Target? Problems to be solved? Transversal? Localized? 36 TestCon Europe 2020
Recommend
More recommend
