VBaaS: VNF Benchmark-as-a-Service EWSDN 2015 . Rosa, Raphael V. - - PowerPoint PPT Presentation

▶
vbaas vnf benchmark as a service
SMART_READER_LITE
LIVE PREVIEW

VBaaS: VNF Benchmark-as-a-Service EWSDN 2015 . Rosa, Raphael V. - - PowerPoint PPT Presentation

Nov 28, 2022 200 likes •544 views

VBaaS: VNF Benchmark-as-a-Service EWSDN 2015 . Rosa, Raphael V. Rothenberg, Christian E. Szabo, Robert September 21, 2015 FEEC/UNICAMP and Ericsson Research Hungary . . . Outline Introduction VBaaS Use Cases Related Work Conclusion

slide-1
SLIDE 1

VBaaS: VNF Benchmark-as-a-Service

EWSDN 2015

.

Rosa, Raphael V. Rothenberg, Christian E. Szabo, Robert September 21, 2015

FEEC/UNICAMP and Ericsson Research Hungary

slide-2
SLIDE 2

. . . Outline

Introduction VBaaS Use Cases Related Work Conclusion

1

slide-3
SLIDE 3

. INTRODUCTION

slide-4
SLIDE 4

Introduction

. . . Motivation .

VNFs and performance metrics

. NFV Performance and portability requirements . .

  • Customers Key Quality Indicators (KQIs)
  • Dynamic workloads, infrastructure failures, etc
  • Service Assurance/Continuity (IT – Telco)

. DevOps . . * Repeatable and reliable processes * Modular applications in production-like systems * Monitor and validate operational quality of services (after and before deployment)

3

slide-5
SLIDE 5

Introduction

. . . VNF Benchmark-as-a-Service (VBaaS) .

Fundamentals

Assist orchestration manager (e.g., NFVO) decisions On-demand test-before-deploy Capacity Planning = Customized performance assessments = Migration, scaling and auditing VNF-FGs Conformance testing Compliance and Auditing = VNF continuous integration = Proactive policy enforcement in infrastructure setups

4

slide-6
SLIDE 6

. VBAAS

slide-7
SLIDE 7

VBaaS

. . . Proposal

Sweet spot between continuous monitoring vs. static view

Figure: VBaaS motivation points: static view (VBaaS) continuous monitoring

6

slide-8
SLIDE 8

VBaaS

. . . General Aspects

  • Why VBaaS?

¬ NFV performance reliability (KQIs) and agility (Service Assurance)

  • What is VBaaS?

¬ VNF/NFVI features (performance) extraction framework

  • How VBaaS can be performed?

¬ Independently, oriented by orchestration managers requests

  • When VBaaS can be used?

¬ Whenever costs and time scales favour its associated costs (policies)

7

slide-9
SLIDE 9

VBaaS

. . . Components .

Actors and Interfaces Figure: VBaaS Main Design: Components and Interfaces

8

slide-10
SLIDE 10

VBaaS

. . . Components .

VBaaS - Information Base Figure: VBaaS Information Base and VNF Benchmark Profile

9

slide-11
SLIDE 11

. USE CASES

slide-12
SLIDE 12

Use Cases

. . . VBaaS Workflows

Figure: VBaaS lifecycle

11

slide-13
SLIDE 13

Use Cases

. . . Use Case: Provision .

Test-before-deploy Figure: VBaaS provision workflow

12

slide-14
SLIDE 14

Use Cases

. . . Use Cases Comparison

Table: VBaaS Applicability

Workflow Objective Discovery Compliance Provision Test-before-deploy Assurance Service continuity Tear-down Audit

13

slide-15
SLIDE 15

Use Cases

. . . VBaaS Details .

VNF and NFVI PoPs performance profiles Figure: Correlation of VBaaS results

14

slide-16
SLIDE 16

Use Cases

. . . VBaaS Details .

Profiles Results Figure: Assumptions of VBaaS reports

15

slide-17
SLIDE 17

Use Cases

. . . Analysis .

Considerations

  • 1. When NFVI PoPs or VNFs are in certain % of utilization
  • 2. Noisy behaviour
  • 3. Long-term tests
  • 4. Constant flux
  • 5. Recovery exam of failed VNF/NFVI
  • 6. Shared resources, comparison with non-virtualized, metrics

dependence, etc

16

slide-18
SLIDE 18

. RELATED WORK

slide-19
SLIDE 19

Related Work

. . . Projects

  • T-NOVA
  • Trilogy
  • Unify

18

slide-20
SLIDE 20

Related Work

. . . Open Source

  • OPNFV: Yardstick and vSwitchPerf

19

slide-21
SLIDE 21

. CONCLUSION

slide-22
SLIDE 22

Conclusion

. . . Summary

“Trust, but verify”, maybe better: verify, then trust . VBaaS . .

  • Motivation: NFV performance reliability/agility and DevOps
  • Certification of performance profiles for VNFs and NFVI PoPs
  • Instrumentation before VNF-FGs deployment (fine-tune

decisions)

  • VBaaS processes: discovery, provision, maintenance, tear-down
  • Benchmark Considerations!

21

slide-23
SLIDE 23

Conclusion

. . . Future Work

* NFVO decision process for NFVI PoP targets selection * Benchmark dependencies and consistent tasks * Correlation of VBaaS results * Prototyping in Unify architecture * Input for Multi Domain Distributed NFV

22

slide-24
SLIDE 24

Conclusion

. . . Acknowledgements

23

slide-25
SLIDE 25

Thanks! Questions?

24

slide-26
SLIDE 26

. . . Backup Slides

NFVO / VNFM VBaaS-IB VNF-BPs NF-IB VNF Profiles Customers NFVI PoPs VNF 1 VNF 2 {VNF1{ VNF-FG, Metrics{ {VCPU, mem}-> {BW, delay}}} VNF2...} VNF-FG {VNF1: {10Mbps,200ms}{ {{2CPU, 8GB}@PoP1} {{4CPU, 4GB}@PoP3}}} {20Mbps,300ms}...} {VNF2: ...}

VBaaS

VIMs

1 2 3 4 8 9 10 11 12 7 6 5

Agents, Monitors and SUT VNF Manager

Figure: VBaaS Detailed Workflow

25

slide-27
SLIDE 27

. . . Backup Slides

Check VBaaS-IB for target VNF Has VNF-BP? Wait NFVO VNF-FG request Embed VNF-BP elements in VNF-FG Return Benchmark VNF-FG to NFVO If VNF-FG deployed? Wait Manager establish connection Send benchmark tasks Process and store benchmark reports in VNF-IB

No Yes Yes No

Figure: VBaaS Activities Flow

26

slide-28
SLIDE 28

. . . Backup Slides

VBaaS NFVO Customer

VNF 1 VNF 2 VNF 1

PoP1 — PoP2 — PoP3

PoP1 PoP2 PoP3 VNF-FG VNF-FG

VIM

VNF 1 PoP1 PoP2 PoP3 VNF-FG

Agent 1 Agent 2 Manager Monitors

Target VBaaS-IB VNF-BPs Ref Point: NFVO – VIM

VBaaS API

NFVI

Figure: VBaaS Recursive API

27

slide-29
SLIDE 29

. . . Backup Slides

VNF 1 PoP1

PoP4

PoP3

Agent 1 Agent 2 Manager Monitors

VIM NFVI

VNF 1 PoP1

PoP3

PoP4

Agent 1 Agent 2 Manager Monitors

VNF 1 PoP1

PoP2

PoP3

Agent 1 Agent 2 Manager Monitors

VNF-FG (Target 1) VNF-FG (Target 2) VNF-FG (Target 3)

Figure: VBaaS Deployments Optimization

28

slide-30
SLIDE 30

. . . Backup Slides

VBaaS Resource Orchestrator RO Controller Adaptation CA Orchestration Layer VbaaS IB (VNF-BPs) NF-IB (VNF-Profiles) Orchestration Layers Infrastructure Infrastructure VBaaS VbaaS IB (VNF-BPs) NF-IB (VNF-Profiles) VbaaS Standalone Framework VbaaS Standalone Framework

Figure: VBaaS and Unify: General Ideas

29

slide-31
SLIDE 31

. . . Backup Slides

VBaaS

Resource Orchestrator RO Controller Adaptation CA Virt1 Virt2 Customer 1 Customer 2 Virt1 Virt2 Virt Infrastructure Virt3 Virt1 VNF 1 PoP1 PoP2 PoP3 VNF-FG Request Target VNF 1 PoP1 PoP2 PoP3

Agent 1 Agent 2 Manager Monitors

VNF-FG Reply VNF 1 VNF 1 VNF 2 VNF-FG SAP 1 SAP 2

PoP1 — PoP2 — PoP3

Infrastructure

VbaaS IB (VNF-BPs)

Figure: VBaaS and Unify Abstractions

30

slide-32
SLIDE 32

. . . Backup Slides

Resource Orchestrator RO Controller Adaptation CA Virt1 Virt2 Customer 1 Customer 2 VNF 1 VNF 2 VNF-FG SAP 1 SAP 2

VbaaS IB (VNF-BPs)

VBaaS Orchestration Layer

VbaaS IB (VNF-BPs)

VBaaS

SAP 1 SAP 2

Bis-Bis

VNF 1 PoP1 PoP3 VNF-FG Deployment

Agent 1 Agent 2 Manager Monitors

Bis-Bis

PoP1 PoP3

Bis-Bis

Infrastructure VIew VNF 1

Monitors

PoP5

Figure: VBaaS and Unify Bis-Bis

31

slide-33
SLIDE 33

. . . Backup Slides

PoP1 PoP4

VBaaS Manager

Bis-Bis PoP2

Agent 1 Agent 2

VNF 1

Monitors

Probe Instructions Probe Instructions Monitor Instructions VBaaS Tasks

Benchmark Paths

Manager

LO CA

Unified Resource Manager VSE VNF Exec Env VNF2 VNF1

Monitors

NF-FG LSI LSI-0

PoPs

Agents Monitors

NICs

Universal Node

Figure: VBaaS and Unify Universal Node

32