VBaaS: VNF Benchmark-as-a-Service EWSDN 2015 . Rosa, Raphael V. - PowerPoint PPT Presentation

VBaaS: VNF Benchmark-as-a-Service EWSDN 2015 . Rosa, Raphael V. Rothenberg, Christian E. Szabo, Robert September 21, 2015 FEEC/UNICAMP and Ericsson Research Hungary

. . . Outline Introduction VBaaS Use Cases Related Work Conclusion 1

. INTRODUCTION

Introduction • Dynamic workloads, infrastructure failures, etc (after and before deployment) * Monitor and validate operational quality of services * Modular applications in production-like systems * Repeatable and reliable processes . . DevOps . • Service Assurance/Continuity (IT – Telco) • Customers Key Quality Indicators (KQIs) . . . NFV Performance and portability requirements . VNFs and performance metrics . Motivation . . 3

Introduction . . . VNF Benchmark-as-a-Service (VBaaS) . Fundamentals Assist orchestration manager (e.g., NFVO) decisions On-demand test-before-deploy Capacity Planning = Customized performance assessments = Migration, scaling and auditing VNF-FGs Conformance testing Compliance and Auditing = VNF continuous integration = Proactive policy enforcement in infrastructure setups 4

. VBAAS

VBaaS . . . Proposal Sweet spot between continuous monitoring vs. static view Figure: VBaaS motivation points: static view (VBaaS) continuous monitoring 6

VBaaS . . . General Aspects • Why VBaaS? • What is VBaaS? • How VBaaS can be performed? • When VBaaS can be used? (policies) 7 ¬ NFV performance reliability (KQIs) and agility (Service Assurance) ¬ VNF/NFVI features (performance) extraction framework ¬ Independently, oriented by orchestration managers requests ¬ Whenever costs and time scales favour its associated costs

VBaaS . . . Components . Actors and Interfaces Figure: VBaaS Main Design: Components and Interfaces 8

VBaaS . . . Components . VBaaS - Information Base Figure: VBaaS Information Base and VNF Benchmark Profile 9

. USE CASES

Use Cases . . . VBaaS Workflows Figure: VBaaS lifecycle 11

Use Cases . . . Use Case: Provision . Test-before-deploy Figure: VBaaS provision workflow 12

Use Cases Compliance Audit Tear-down Service continuity Assurance Test-before-deploy Provision Discovery . Objective Workflow Table: VBaaS Applicability Use Cases Comparison . . 13

Use Cases . . . VBaaS Details . VNF and NFVI PoPs performance profiles Figure: Correlation of VBaaS results 14

Use Cases . . . VBaaS Details . Profiles Results Figure: Assumptions of VBaaS reports 15

Use Cases . . . Analysis . Considerations 1. When NFVI PoPs or VNFs are in certain % of utilization 2. Noisy behaviour 3. Long-term tests 4. Constant flux 5. Recovery exam of failed VNF/NFVI 6. Shared resources, comparison with non-virtualized, metrics dependence, etc 16

. RELATED WORK

Related Work . . . Projects • T-NOVA • Trilogy • Unify 18

Related Work . . . Open Source • OPNFV: Yardstick and vSwitchPerf 19

. CONCLUSION

Conclusion . • Benchmark Considerations! • VBaaS processes: discovery, provision, maintenance, tear-down decisions) • Instrumentation before VNF-FGs deployment (fine-tune • Certification of performance profiles for VNFs and NFVI PoPs • Motivation: NFV performance reliability/agility and DevOps . . VBaaS . “Trust, but verify”, maybe better: verify, then trust Summary . . 21

Conclusion . . . Future Work * NFVO decision process for NFVI PoP targets selection * Benchmark dependencies and consistent tasks * Correlation of VBaaS results * Prototyping in Unify architecture * Input for Multi Domain Distributed NFV 22

Conclusion . . . Acknowledgements 23

Thanks! Questions? 24

. . Figure: VBaaS Detailed Workflow 25 Backup Slides . VNF 1 VNF 2 VNF-FG {VNF1: {10Mbps,200ms}{ Customers {{2CPU, 8GB}@PoP1} NF-IB {{4CPU, 4GB}@PoP3}}} 2 VNF Profiles {20Mbps,300ms}...} {VNF2: ...} 3 1 12 11 NFVO / VNFM 4 5 VBaaS 7 {VNF1{ 8 VNF-FG, VBaaS-IB 6 Metrics{ VNF-BPs {VCPU, mem}-> {BW, delay}}} VIMs VNF2...} 10 9 NFVI PoPs Manager Agents, Monitors and SUT VNF

. . Figure: VBaaS Activities Flow 26 Backup Slides . Check Wait NFVO VBaaS-IB VNF-FG for target request VNF No Has VNF-BP? Yes Embed Return VNF-BP Benchmark VNF-FG elements to NFVO in VNF-FG Wait Manager Yes No If VNF-FG establish deployed? connection Send Process and benchmark store benchmark tasks reports in VNF-IB

. . Figure: VBaaS Recursive API 27 . Backup Slides VNF 1 VNF 2 VNF 1 VNF-FG Target PoP1 Customer PoP2 PoP3 VNF-FG VBaaS NFVO VBaaS-IB VBaaS API VNF-BPs Ref Point: NFVO – VIM VNF-FG Monitors VIM Agent 1 VNF 1 Agent 2 PoP1 PoP2 NFVI PoP3 Manager PoP1 — PoP2 — PoP3

. . Figure: VBaaS Deployments Optimization 28 Backup Slides . VNF-FG VIM (Target 1) Monitors Agent 1 VNF 1 Agent 2 PoP1 VNF-FG PoP2 PoP3 (Target 2) Monitors Manager Agent 1 VNF 1 Agent 2 PoP1 PoP4 VNF-FG PoP3 (Target 3) Manager Monitors Agent 1 VNF 1 Agent 2 PoP1 PoP3 PoP4 Manager NFVI

. . Figure: VBaaS and Unify: General Ideas 29 . Backup Slides VbaaS Orchestration Standalone Layer Framework VBaaS Resource Orchestrator RO NF-IB (VNF-Profiles) VbaaS Controller Adaptation IB CA VbaaS (VNF-BPs) Standalone Framework VBaaS NF-IB Orchestration (VNF-Profiles) Layers VbaaS IB Infrastructure (VNF-BPs) Infrastructure

. . Figure: VBaaS and Unify Abstractions 30 Backup Slides . SAP 1 SAP 2 VNF 1 VNF 1 VNF 2 Target PoP1 VNF-FG PoP2 PoP3 Customer 1 Customer 2 VNF-FG Request Virt1 Virt2 Virt1 Virt2 Virt3 VNF 1 Resource Orchestrator VBaaS RO Virt1 Virt Infrastructure VbaaS IB (VNF-BPs) VNF-FG Controller Adaptation Infrastructure Reply CA Monitors PoP1 — PoP2 — PoP3 Agent 1 VNF 1 Agent 2 PoP1 PoP2 PoP3 Manager

. . Figure: VBaaS and Unify Bis-Bis 31 . Backup Slides SAP 1 SAP 2 VNF 1 VNF 2 VNF-FG Customer 1 Customer 2 PoP3 Virt1 Virt2 PoP1 Bis-Bis Resource Orchestrator VBaaS RO VbaaS IB SAP 1 SAP 2 (VNF-BPs) Controller Adaptation Bis-Bis CA Infrastructure VIew VNF-FG Monitors Deployment Orchestration VBaaS Agent 1 Layer VNF 1 Agent 2 Monitors VbaaS PoP1 IB Bis-Bis PoP3 (VNF-BPs) VNF 1 Manager PoP5

. . Figure: VBaaS and Unify Universal Node 32 . Backup Slides VBaaS VBaaS Tasks Manager Probe Instructions Probe PoP4 Instructions Agent 1 Monitor Instructions Agent 2 PoP1 PoP2 VNF 1 Monitors Bis-Bis Benchmark Paths Universal Node Manager Monitors LO VNF1 VNF2 CA VNF Exec Env NF-FG LSI Monitors Unified LSI-0 Resource Manager VSE Agents NICs PoPs