VNF Benchmark-as-a-Service (VBaaS): A Teaser - - PowerPoint PPT Presentation

▶
vnf benchmark as a service vbaas a teaser
SMART_READER_LITE
LIVE PREVIEW

VNF Benchmark-as-a-Service (VBaaS): A Teaser - - PowerPoint PPT Presentation

Jul 29, 2023 31 likes •255 views

Teaser Backup slides VNF Benchmark-as-a-Service (VBaaS): A Teaser (draft-rorosz-nfvrg-vbaas-00.txt) Rosa, Raphael V. Rothenberg, Christian E. Szabo, Robert FEEC/UNICAMP and Ericsson Research Hungary NFVRG, IETF 94

slide-1
SLIDE 1

Teaser Backup slides

VNF Benchmark-as-a-Service (VBaaS): A Teaser

(draft-rorosz-nfvrg-vbaas-00.txt) Rosa, Raphael V.†‡ Rothenberg, Christian E.‡ Szabo, Robert†

‡FEEC/UNICAMP and †Ericsson Research Hungary

NFVRG, IETF 94 11/4/2015

1 / 11

slide-2
SLIDE 2

Teaser Backup slides

VNF Benchmarking

Different NFVI PoP/host may perform differently VNF development and NFVI upgrades are independent Orchestration needs to know how much resources (e.g., cpu, memory, storage) to allocate for given target KPI values (e.g., throughput, latency).

+---------+ ,----. |Customers| ( VNF1 ) +----------+ +-+-------+ ‘----’ | VNF | | SAP1 +----+ +----+ ,----. |Developers| | O---|VNF1|---|VNF2|---O ( VNF2 )+--------+-+ | +----+ +----+ SAP2 ‘----’ | | <========VNF-FG=======> +-+-------+---+ | NFVO / VNFM | | (Service | | Provider) | +-+----+----+-+ / | \ V V V +-------+ +-------+ +-------+ | VIM1 | | VIM2 | | VIM3 | +-+-----+ +---+---+ +-----+-+ | | | | | | | | | SAP1 +-----+-+ WAN +---+---+ WAN +-+-----+ SAP2 O-| PoP 1 |-----| PoP 2 |-----| PoP 3 |-O +-------+ +-------+ +-------+ PoP1 PoP2 PoP3 Container Enhanced Baremetal OS Hypervisor 2 / 11

slide-3
SLIDE 3

Teaser Backup slides

VNF Benchmarking

Different NFVI PoP/host may perform differently VNF development and NFVI upgrades are independent Orchestration needs to know how much resources (e.g., cpu, memory, storage) to allocate for given target KPI values (e.g., throughput, latency). Problem to be solved: Gain information autonomously about VNFs’ benchmark metrics with given reserved resources at a “host” (execution environment).

+---------+ ,----. |Customers| ( VNF1 ) +----------+ +-+-------+ ‘----’ | VNF | | SAP1 +----+ +----+ ,----. |Developers| | O---|VNF1|---|VNF2|---O ( VNF2 )+--------+-+ | +----+ +----+ SAP2 ‘----’ | | <========VNF-FG=======> +-+-------+---+ | NFVO / VNFM | | (Service | | Provider) | +-+----+----+-+ / | \ V V V +-------+ +-------+ +-------+ | VIM1 | | VIM2 | | VIM3 | +-+-----+ +---+---+ +-----+-+ | | | | | | | | | SAP1 +-----+-+ WAN +---+---+ WAN +-+-----+ SAP2 O-| PoP 1 |-----| PoP 2 |-----| PoP 3 |-O +-------+ +-------+ +-------+ PoP1 PoP2 PoP3 Container Enhanced Baremetal OS Hypervisor 2 / 11

slide-4
SLIDE 4

Teaser Backup slides

Highlights

Components VBaaS service function VBaaS Information Base for VNF Benchmark Profiles

structural functional: manager, monitors and agents

Work-flows for ETSI NFVO and VIMs for recursive orchestration

SAP1+----+ +----+ O--|VNF1|--|VNF2|--O {VNF1{ +----+ +----+SAP2 VNF-FG, <========VNF-FG=======> Metrics{ ,----. +---------+ {vCPU, mem}-> ( VNF2 ) ,----. |Customers| {BW, Delay}}} ‘----’ ( VNF1 ) +-+-------+ ,-------. ‘----’ | /VBaaS-IB:\ +----------+ | \ VNF-BPs / | VNF | | ‘---+---’ +--|Developers| | | | +--------+-+ | _____+___ | | | | |<------+ +---+--------++ | VBaaS |<------------->| NFVO / VNFM | |___ _____| VBaaS | (Service | + API | Provider) | | +-+------+----+ ,----+-----. | | \ / NF-IB: \ V V V \VNF-Profiles/ +-----+ +-----+ +-----+ ’----------’ |VIM1 | |VIM2 | |VIM3 | {VNF1: {10Mbps,200ms}{ ++----+ +--+--+ +-----+ {{2CPU, 8GB}@PoP1} | | | {{8CPU, 16GB}@PoP2} | | | {{4CPU, 4GB}@PoP3}}} | | | {20Mbps,300ms}...} +--+--+ WAN ++----+ WAN +-----+ {VNF2:{10Mbps,200ms}{ O-|PoP 1|-----|PoP 2|-----|PoP 3|-O {{8CPU, 16GB}@PoP1} SAP1 +-----+ +-----+ +-----+ SAP2 3 / 11

slide-5
SLIDE 5

Teaser Backup slides

Summary

VNF Benchmarking as a Service (VBaaS) aims at defining complementary functional components to ETSI NFV and other approaches; defining interfaces to the VBaaS service; defining possible VBaaS work-flows.

Acknowledgements This work is partially supported by FP7 UNIFY, a research project partially funded by the European Community under the Seventh Framework Program (grant agreement no. 619609). The views expressed here are those of the authors only. The European Commission is not liable for any use that may be made of the information in this document This work is partially supported by Ericsson Brazil. 4 / 11

slide-6
SLIDE 6

Teaser Backup slides

Outline

1

Teaser

2

Backup slides

5 / 11

slide-7
SLIDE 7

Teaser Backup slides

How? VNF Benchmarking as a Service (VBaaS)

VBaaS NFVO Customer

VNF 1 VNF 2 VNF 1

PoP1 — PoP2 — PoP3

PoP1 PoP2 PoP3 VNF-FG VNF-FG

VIM

VNF 1 PoP1 PoP2 PoP3 VNF-FG

Agent 1 Agent 2 Manager Monitors

Target VBaaS-IB VNF-BPs Ref Point: NFVO – VIM

VBaaS API

NFVI

6 / 11

slide-8
SLIDE 8

Teaser Backup slides

How? VNF Benchmarking as a Service (VBaaS)

VBaaS objectives “Black box” VNF benchmarking, with respect to the

NVFO Benchmarking Service

VBaaS NFVO Customer

VNF 1 VNF 2 VNF 1

PoP1 — PoP2 — PoP3

PoP1 PoP2 PoP3 VNF-FG VNF-FG

VIM

VNF 1 PoP1 PoP2 PoP3 VNF-FG

Agent 1 Agent 2 Manager Monitors

Target VBaaS-IB VNF-BPs Ref Point: NFVO – VIM

VBaaS API

NFVI

6 / 11

slide-9
SLIDE 9

Teaser Backup slides

How? VNF Benchmarking as a Service (VBaaS)

VBaaS objectives “Black box” VNF benchmarking, with respect to the

NVFO Benchmarking Service

VBaaS uses NFVO (or VIMs) to deploy benchmark measurements

e.g., by VNF-FG

VBaaS NFVO Customer

VNF 1 VNF 2 VNF 1

PoP1 — PoP2 — PoP3

PoP1 PoP2 PoP3 VNF-FG VNF-FG

VIM

VNF 1 PoP1 PoP2 PoP3 VNF-FG

Agent 1 Agent 2 Manager Monitors

Target VBaaS-IB VNF-BPs Ref Point: NFVO – VIM

VBaaS API

NFVI

6 / 11

slide-10
SLIDE 10

Teaser Backup slides

VBaaS Process Walk-through

NFVO / VNFM VBaaS-IB VNF-BPs NF-IB VNF Profiles Customers NFVI PoPs VNF 1 VNF 2 {VNF1{ VNF-FG, Metrics{ {VCPU, mem}-> {BW, delay}}} VNF2...} VNF-FG {VNF1: {10Mbps,200ms}{ {{2CPU, 8GB}@PoP1} {{4CPU, 4GB}@PoP3}}} {20Mbps,300ms}...} {VNF2: ...}

VBaaS

VIMs

1 2 3 4 8 9 10 11 12 7 6 5

Agents, Monitors and SUT VNF Manager 7 / 11

slide-11
SLIDE 11

Teaser Backup slides

Usage: Benchmarking, Dimensioning and Verification

Benchmarking To measure VNF’s throughput, latency, jitter parameters for given cpu, memory, storage reservation at given VIM.

8 / 11

slide-12
SLIDE 12

Teaser Backup slides

Usage: Benchmarking, Dimensioning and Verification

Benchmarking To measure VNF’s throughput, latency, jitter parameters for given cpu, memory, storage reservation at given VIM. Dimensioning To determine cpu, memory, storage reservation parameters for given VNF at given VIM for target throughput, latency, jitter parameters.

8 / 11

slide-13
SLIDE 13

Teaser Backup slides

Usage: Benchmarking, Dimensioning and Verification

Benchmarking To measure VNF’s throughput, latency, jitter parameters for given cpu, memory, storage reservation at given VIM. Dimensioning To determine cpu, memory, storage reservation parameters for given VNF at given VIM for target throughput, latency, jitter parameters. Verification To assess if given throughput, latency, jitter parameters of a VNF is met with given cpu, memory, storage reservation at given VIM.

8 / 11

slide-14
SLIDE 14

Teaser Backup slides

Usage: Benchmarking, Dimensioning and Verification

Benchmarking To measure VNF’s throughput, latency, jitter parameters for given cpu, memory, storage reservation at given VIM. Dimensioning To determine cpu, memory, storage reservation parameters for given VNF at given VIM for target throughput, latency, jitter parameters. Verification To assess if given throughput, latency, jitter parameters of a VNF is met with given cpu, memory, storage reservation at given VIM. Observation Dimensioning and verification boil down to benchmarking operation(s).

8 / 11

slide-15
SLIDE 15

Teaser Backup slides

Recursive Orchestration with VBaaS

UNIFYing carrier network and cloud resources Recurrent joint software and networking control APIa

adraft-unify-nfvrg-recursive-programming-02

+--------------+ | | |Orchestration | Domain 4 | [VBaaS] | +--+-----------+ **********************|****************** * +--------------+ | * |NFVO: | | * |Service | | * |Lifecycle | | * |Management | | * +-------+------+ / * | / <-- Joint API * +-+---------+--+ * | | * |Orchestration | ******************** * | [VBaaS] | +--------------+ * * +--+---+-------+ Domain 3 |NFVO: | * ********|***|************************* |Service | * / | |Lifecycle | /---------/ | |Management | / * | +---------+----+ | * | | | * | <-- Joint API +--+-------+---+* | | |* | |Orchestration |* | | [VBaaS] |* | | |* | +------+-------+* | | * *********|********** <-- Joint API +------+-------+* * +------+-------+ * |VIM: |* * |VIM: | * |Virtualized 2 |* * |Virtualized 2 | * |Pys mapping |* * |Pys mapping | * +--------------+* * +--------------+ * Domain 1 * * Domain 2 * ************************* * *

9 / 11

slide-16
SLIDE 16

Teaser Backup slides

Recursive Orchestration with VBaaS

UNIFYing carrier network and cloud resources Recurrent joint software and networking control APIa Flexibility in resource virtualization with Big Switch with Big Software

adraft-unify-nfvrg-recursive-programming-02

+--------------+ | | |Orchestration | Domain 4 | [VBaaS] | +--+-----------+ **********************|****************** * +--------------+ | * |NFVO: | | * |Service | | * |Lifecycle | | * |Management | | * +-------+------+ / * | / <-- Joint API * +-+---------+--+ * | | * |Orchestration | ******************** * | [VBaaS] | +--------------+ * * +--+---+-------+ Domain 3 |NFVO: | * ********|***|************************* |Service | * / | |Lifecycle | /---------/ | |Management | / * | +---------+----+ | * | | | * | <-- Joint API +--+-------+---+* | | |* | |Orchestration |* | | [VBaaS] |* | | |* | +------+-------+* | | * *********|********** <-- Joint API +------+-------+* * +------+-------+ * |VIM: |* * |VIM: | * |Virtualized 2 |* * |Virtualized 2 | * |Pys mapping |* * |Pys mapping | * +--------------+* * +--------------+ * Domain 1 * * Domain 2 * ************************* * *

9 / 11

slide-17
SLIDE 17

Teaser Backup slides

Recursive Orchestration with VBaaS

UNIFYing carrier network and cloud resources Recurrent joint software and networking control APIa Flexibility in resource virtualization with Big Switch with Big Software

adraft-unify-nfvrg-recursive-programming-02

VBaaS is part of each orchestration component; options:

+--------------+ | | |Orchestration | Domain 4 | [VBaaS] | +--+-----------+ **********************|****************** * +--------------+ | * |NFVO: | | * |Service | | * |Lifecycle | | * |Management | | * +-------+------+ / * | / <-- Joint API * +-+---------+--+ * | | * |Orchestration | ******************** * | [VBaaS] | +--------------+ * * +--+---+-------+ Domain 3 |NFVO: | * ********|***|************************* |Service | * / | |Lifecycle | /---------/ | |Management | / * | +---------+----+ | * | | | * | <-- Joint API +--+-------+---+* | | |* | |Orchestration |* | | [VBaaS] |* | | |* | +------+-------+* | | * *********|********** <-- Joint API +------+-------+* * +------+-------+ * |VIM: |* * |VIM: | * |Virtualized 2 |* * |Virtualized 2 | * |Pys mapping |* * |Pys mapping | * +--------------+* * +--------------+ * Domain 1 * * Domain 2 * ************************* * *

9 / 11

slide-18
SLIDE 18

Teaser Backup slides

Recursive Orchestration with VBaaS

UNIFYing carrier network and cloud resources Recurrent joint software and networking control APIa Flexibility in resource virtualization with Big Switch with Big Software

adraft-unify-nfvrg-recursive-programming-02

VBaaS is part of each orchestration component; options: request VNF profiling from the virtualization provider;

+--------------+ | | |Orchestration | Domain 4 | [VBaaS] | +--+-----------+ **********************|****************** * +--------------+ | * |NFVO: | | * |Service | | * |Lifecycle | | * |Management | | * +-------+------+ / * | / <-- Joint API * +-+---------+--+ * | | * |Orchestration | ******************** * | [VBaaS] | +--------------+ * * +--+---+-------+ Domain 3 |NFVO: | * ********|***|************************* |Service | * / | |Lifecycle | /---------/ | |Management | / * | +---------+----+ | * | | | * | <-- Joint API +--+-------+---+* | | |* | |Orchestration |* | | [VBaaS] |* | | |* | +------+-------+* | | * *********|********** <-- Joint API +------+-------+* * +------+-------+ * |VIM: |* * |VIM: | * |Virtualized 2 |* * |Virtualized 2 | * |Pys mapping |* * |Pys mapping | * +--------------+* * +--------------+ * Domain 1 * * Domain 2 * ************************* * *

9 / 11

slide-19
SLIDE 19

Teaser Backup slides

Recursive Orchestration with VBaaS

UNIFYing carrier network and cloud resources Recurrent joint software and networking control APIa Flexibility in resource virtualization with Big Switch with Big Software

adraft-unify-nfvrg-recursive-programming-02

VBaaS is part of each orchestration component; options: request VNF profiling from the virtualization provider; do it on your own “transparently” over the underlying substrates.

+--------------+ | | |Orchestration | Domain 4 | [VBaaS] | +--+-----------+ **********************|****************** * +--------------+ | * |NFVO: | | * |Service | | * |Lifecycle | | * |Management | | * +-------+------+ / * | / <-- Joint API * +-+---------+--+ * | | * |Orchestration | ******************** * | [VBaaS] | +--------------+ * * +--+---+-------+ Domain 3 |NFVO: | * ********|***|************************* |Service | * / | |Lifecycle | /---------/ | |Management | / * | +---------+----+ | * | | | * | <-- Joint API +--+-------+---+* | | |* | |Orchestration |* | | [VBaaS] |* | | |* | +------+-------+* | | * *********|********** <-- Joint API +------+-------+* * +------+-------+ * |VIM: |* * |VIM: | * |Virtualized 2 |* * |Virtualized 2 | * |Pys mapping |* * |Pys mapping | * +--------------+* * +--------------+ * Domain 1 * * Domain 2 * ************************* * *

9 / 11

slide-20
SLIDE 20

Teaser Backup slides

VBaaS Request and Reporting as Capabilities

Capability reporting Based on a virtualization yang model each execution environment can report VNF benchmarking results.

+--------------+ VBaaS +--------------+ |Orchestration | API-1 |Orchestration | | (NFVO |<---------->| (NFVO | | Consumer) | | Producer) | +------+-------+ +------+-------+ | 1)get-config() | |------------------------->>| | 2)rpc-reply(virt) | |<<-------------------------+ | | | 3)edit-config(NF1@cap) | +------------------------->>| | 4) rpc-ok | |<<-------------------------+--+ | | | | | VBaaS | 5)<notification> | | |<<-------------------------+<-+ | 6)get-config(NF1@cap) | |------------------------->>| | 7)rpc-reply(NF1@cap) | |<<-------------------------+ 10 / 11

slide-21
SLIDE 21

Teaser Backup slides

VBaaS Request and Reporting as Capabilities

Capability reporting Based on a virtualization yang model each execution environment can report VNF benchmarking results. Consumer can request a capability report by defining partial capability entries

Providing only performance KPI means a dimensioning request Providing only resource allocation means a benchmarking request Providing both mean verification

+--------------+ VBaaS +--------------+ |Orchestration | API-1 |Orchestration | | (NFVO |<---------->| (NFVO | | Consumer) | | Producer) | +------+-------+ +------+-------+ | 1)get-config() | |------------------------->>| | 2)rpc-reply(virt) | |<<-------------------------+ | | | 3)edit-config(NF1@cap) | +------------------------->>| | 4) rpc-ok | |<<-------------------------+--+ | | | | | VBaaS | 5)<notification> | | |<<-------------------------+<-+ | 6)get-config(NF1@cap) | |------------------------->>| | 7)rpc-reply(NF1@cap) | |<<-------------------------+ 10 / 11

slide-22
SLIDE 22

Teaser Backup slides

Acknowledgements

This work is partially supported by FP7 UNIFY, a research project partially funded by the European Community under the Seventh Framework Program (grant agreement no. 619609). The views expressed here are those of the authors only. The European Commission is not liable for any use that may be made of the information in this document This work is partially supported by Ericsson Brazil.

11 / 11