MCS TaaSTing 1 Mission Critical Services (MCS) Certification MCS - - PowerPoint PPT Presentation

▶
mcs taasting
SMART_READER_LITE
LIVE PREVIEW

MCS TaaSTing 1 Mission Critical Services (MCS) Certification MCS - - PowerPoint PPT Presentation

Apr 29, 2023 128 likes •516 views

This work was performed under the following financial assistance award 70NANB20H005 from U.S. Department of Commerce, National Institute of Standards and Technology, PSCR MCS TaaSTing 1 Mission Critical Services (MCS) Certification MCS

slide-1
SLIDE 1

MCS TaaSTing

This work was performed under the following financial assistance award 70NANB20H005 from U.S. Department of Commerce, National Institute of Standards and Technology, PSCR 1

slide-2
SLIDE 2

Mission Critical Services (MCS) Certification

  • MCS certification Chicken or the Egg issue
  • No MCS Testing equipment ó no certification programs ó jeopardized customers

confidence ó demand for testing equipment in a “niche market”

  • Meanwhile…
  • “MCPTT aligned”
  • 3GPP ready….
  • “Certified in the Plugtest”
  • Avalailable in –your MCS network- app store
  • 1st in the certification
  • Public Safety Grade
  • How am I supposed to write my RFI/RFQ?
  • How am I supposed to write my tender response?

2/20

slide-3
SLIDE 3

X

OS OS

MCS Certification: Why it’s More Important Than Ever

  • First flagship projects deploying MCS solutions
  • Std. compliance & interop ó innovation and competition
  • Avoid vendor lock-in from the very beginning
  • More certification needs
  • Much quicker release cycles than in PMR world
  • More stakeholders and relationships

All-in-one COTS LTE device to be certified MCS UE vendor A + MCS Client from vendor B/C/D

RF LTE IP

SERVICE

RF LTE IP

MCS MCS MCS CLIENT CERTIFICATION SCOPE CERTIFICATION SCOPE?

vs.

3/20

slide-4
SLIDE 4

Background: different kind of Testing and Certification

  • Interoperability
  • Conformance
  • Performance
  • Field test

4/20

slide-5
SLIDE 5

Interop and Conformance

VENDOR A VENDOR B MESSAGE X: Header1 Header2 x …. Header n Body MESSAGE Y: OK MESSAGE X: Header1 Wrong Header2 Missing Header x …. Header n Body

PASS FAILED

Conformance & Interop Vs Interop & conformance MESSAGE X: Header1 Header2 x …. Header n Body

5/20

slide-6
SLIDE 6

How does conformance certification usually work ?

3GPP Core Test Specs

TC prose specification

RAN5_SIG MCC TF160

TC TTCN3 implementation

3GPP RAN5 Test Cases Certification Program

Certified Lab Test Equipment Test Equipment

6/20

slide-7
SLIDE 7

MCS Conformance testing: status (2019)

  • No certified MCS test equipment
  • RAN5 TS (MCPTT/MCData/MCVideo Rel 14) ongoing
  • Full TTCN3 completion & verification pending
  • Users’ demand pushing….
  • ….but economy of scale and 5G activity delaying the availability
  • Early initiatives in certification programs
  • GCF-TTCA-JTF => MCS WI

7/20

slide-8
SLIDE 8

3GPP Core MCS TS

TC prose specification

RAN5_SIG MCC TF160

TC TTCN3 implementation

3GPP RAN5 Testing

Certification Program

Certified Lab Test Equipment Test Equipment

MCS Conformance testing: status (2019)

NIST funding opportunity came to help!

3GPP Core MCS TS

TC prose specification

RAN5_SIG MCC TF160

TC TTCN3 implementation

3GPP RAN5 Testing

Certification Program

Certified Lab Test Equipment Test Equipment

8/20

slide-9
SLIDE 9

Project description

FUNDING OPPORTUNITY (NOFO) - NIST Public Safety Innovation Accelerator Program - Mission Critical Voice Test Equipment

Ref: https://www.nist.gov/news-events/news/2020/01/pscr-awards-over-6m-rd-supporting-mission-critical-voice-test-equipment

9/20

slide-10
SLIDE 10

Project Description

KEY FACTS

Project lifetime: Dec 2019-Dec 2021 7 Partners led by UPV/EHU 3.6 MUSD Targeting two commercial solutions

Ref: https://www.nist.gov/news-events/news/2020/01/pscr-awards-over-6m-rd-supporting-mission-critical-voice-test-equipment

10/20

slide-11
SLIDE 11

Objectives

O5

Deployment and evaluation of a sample testing lab

RF test equipment Development of an e2e RF MCS testing equipment => eMBMS/MC

O4

TaaS Platform

O3

Definition and development

  • f MCS TaaS platform

MCS experts Client Server TTCN3 UE

RAN5 TS analysis New rules /Upgrades TTCN3 troubleshooting

Stable TTCN3 rules TTCN3 tester

O1

Building a comprehensive MCS TTCN3 suite

O2

Definition of flexible MCS (re)certification programs

11/20

slide-12
SLIDE 12

Expected outcomes at the end of the Project

  • Enhanced / troubleshooted RAN5 TC
  • Complete TTCN3 code
  • TTCN3 tester capable of validating the test cases
  • TaaS commercial service providing remote access to the tester
  • RF capable commercial product
  • Global Certification programs
  • Testing Lab procedures and experience

12/20

slide-13
SLIDE 13

3GPP Test Models

  • 3GPP RAN5 defines the testing procedures and reference pints to be

tested

  • Also the so called testing models
MCPTT Server simulation MCPTT Client under test Test Point (1) UE under test System Simulator

º

13/20

slide-14
SLIDE 14

3GPP Test Models

RAN5 Uu model vs IP model

Traditional telco equipment From LTE Phy to MCS Complex/Expensive

Traditional testers manufacturers Economy of scale

Test Equipment

OS

MCS UE vendor A + MCS Client vendor X

RF LTE IP

MCS CLIENT CERTIFICATION SCOPE

RF LTE IP MCS

Uu Reference Point

NAS EMU IP PTC System Simulator IPCanEmu: EUTRA

IP_SOCK Ut IPsec_CTRL IP_CTRL HTTPCTRL HTTPDATA IP_SOCK IPsec_CTRL IP_CTRL

MCPTT IMS PTC

IMS_CTRL IMS_CTRL IMS S/C IMS S/C FloorCtrl

EUTRA TCP/UDP/ICMP IPsec

MCPTT HTTP PTC

HTTPCTRL HTTPDATA

MTC

Create, Start Done IPCAN IPCAN IMS HTTP E_SRB SYS_SRB NASCTRL NASCTRL SRB SRB SYSIND E_SYSIND SYS E_SYS Ut Create, Start Done Create, Start Done Create, Start Done MMI PTC_Ut EUTRA_CTRL IP DHCP Server- Simulation DNS Server- Simulation ICMPv6 Server- Simulation UT PTC_Ut PTC_Ut MMI

(S)RTP/RTCP

SRTP

IUT (MCPTT UE)

RF cable

System Interface

TTCN-3 domain

14/20

slide-15
SLIDE 15

3GPP Test Models

RAN5

OS MCS UE vendor A + MCS Client vendor X

RF LTE IP

MCS CLIENT CERTIFICATION SCOPE

IP MCS

IP PTC System Simulator IPCanEmu : DUMMY_EUTRA

IP_SOCK Ut IPsec_CTRL IP_CTRL HTTPCTRL HTTPDATA IP_SOCK IPsec_CTRL IP_CTRL

MCPTT IMS PTC

IMS_CTRL IMS_CTRL IMS S/C IMS S/C FloorCtrl

TCP/UDP/ICMP IPsec

MCPTT HTTP PTC

HTTPCTRL HTTPDATA

MTC

Create, Start Done Ut Create, Start Done Create, Start Done Create, Start Done MMI PTC_Ut DHCP Server- Simulation DNS Server- Simulation ICMPv6 Server- Simulation UT PTC_Ut PTC_Ut MMI

(S)RTP/RTCP

SRTP

IUT (MCPTT client application)

IP connection System Interface

TTCN-3 domain IPCAN IPCAN IMS HTTP EUTRA_CTRL IP

Test Equipment

Any IP network

Uu model vs IP model

OTT testing Can not guarantee LTE MC features eMBMS/MC QCI? KPIS/Integration with UE?

15/20

slide-16
SLIDE 16

IP Model and TaaS

INTERNET

TaaS Platform

OS

MCS UE vendor A + MCS Client vendor X

RF LTE IP

MCS CLIENT

Testing as a Service (pre)certification purposes Foster continuous SW integration/testing

Testcase Management

  • Version Management
  • Upgrades
  • Review / Feedback Loop

Test Execution Control

  • User Interface
  • Configuration
  • Parameterisation
  • Status Overview

Test Result Management

  • Store Test Results
  • Create Reports
  • Wireshark Traces, etc.

TTCN3 tester

Client – Server Interface MCS Signalling and media certification

Test Execution

  • Execute TTCN-3

Testcases

  • Execute Tools,

Simulators

16/20

slide-17
SLIDE 17

MC LTE

MCS TaaSting 1.5 Model

RAN5 IMS IPCAN-like model

Intermediate Uu ó IP model MCS testing + RF capable MC features MC QCIs eMBMS bearer handling

OS MCS UE vendor A + MCS Client vendor X

RF LTE IP

MCS CLIENT TESTING SCOPE

IP MCS

Test Equipment

RF LTE

XCAP Server (SS implementation) DNSServer- Simulation IP ADAPTOR PTC System Adaptor IPCanCrtl- Component

IPCAN_CTRL UnsecClient UnsecServer SecClient SecServer MMI_SYS IPConf SigComp HTTPCTRL HTTPDATA DhcpServer DnsServer

DHCPServer- Simulation

Create, Start Create, Start Done Done UnsecClient UnsecServer SecClient SecServer IpConf SigComp DnsServer DhcpServer

IMS PTC

IMS_CTRL IMS_CTRL IMS_Server IMS_Client IMS_Server IMS_Client

EUTRA / UTRAN / GERAN TCP/UDP/ICMP SigComp IPsec

HTTP XCAP PTC

HTTPCTRL HTTPDATA

MTC

Create, Start Done Create, Start Done Done Create, Start MMI_SYS IPCAN IPCAN_CTRL IPCAN XCAP XCAP IMS XCAP Create, Start D
  • n
e IP PTC System Simulator eIPCanEmu : IP_SOCK Ut IPsec_CTRL IP_CTRL HTTPCTRL HTTPDATA IP_SOCK IPsec_CTRL IP_CTRL MCPTT IMS PTC IMS_CTRL IMS_CTRL IMS S/C IMS S/C FloorCtrl TCP/UDP/ICMP IPsec MCPTT HTTP PTC HTTPCTRL HTTPDATA MTC Create, Start Done Ut Create, Start Done Create, Start Done Create, Start Done MMI PTC_Ut DHCP Server
  • Simulation
DNS Server
  • Simulation
ICMPv6 Server
  • Simulation
UT PTC_Ut PTC_Ut MMI (S)RTP/RTCP SRTP System Interface TTCN -3 domain IPCAN IPCAN IMS HTTP EUTRA_CTRL IP IUT (MCPTT UE) (MCPTT client application) TaaSting connector RF cable EUTRA NOT_THAT_ DUMMY_EUTRA

TS 34229-4

17/20

slide-18
SLIDE 18

Testcase Management

  • Version Management
  • Upgrades
  • Review / Feedback

Loop

Test Execution Control

  • User Interface
  • Configuration
  • Parameterisation
  • Status Overview

Test Execution

  • Execute TTCN-3

Testcases

  • Execute Tools,

Simulators

Test Result Management

  • Store Test Results
  • Create Reports
  • Wireshark Traces, etc.

MC LTE

INTERNET

RF Capable Tester

1.5 Model TTCN3 MCS tester + MC LTE features Remote controlling / synching

OS MCS UE vendor A + MCS Client vendor X

RF LTE IP

MCS CLIENT TESTING SCOPE

IP MCS

Test Equipment

RF LTE TaaS Platform

TTCN3 tester

Testcase Management
  • Version Management
  • Upgrades
  • Review / Feedback Loop
Test Execution Control
  • User Interface
  • Configuration
  • Parameterisation
  • Status Overview

Test Execution

  • Execute TTCN-3
Testcases
  • Execute Tools, Simulators
Test Result Management
  • Store Test Results
  • Create Reports
  • Wireshark Traces, etc.

TTCN3 tester

Synching Off-loading Remote Control

18/20

slide-19
SLIDE 19

CURRENT STATUS (Q2’20)

  • RAN5 GAP analysis
  • Enchanced TTCN3 MCPTT rules
  • Intensive troubleshooting with TF160
  • Feedback to RAN5 (RAN5#87-e)
  • First TCCN3 tester developed
  • First RAN5 TCs verified
  • TaaS platform… following

19/20

slide-20
SLIDE 20

MCS TaaSTing

This work was performed under the following financial assistance award 70NANB20H005 from U.S. Department of Commerce, National Institute of Standards and Technology, PSCR 20

slide-21
SLIDE 21
slide-22
SLIDE 22
slide-23
SLIDE 23

→

Monthly Security Updates Yearly Hardware Releases Weekly / Daily Application Updates

slide-24
SLIDE 24
slide-25
SLIDE 25
slide-26
SLIDE 26
slide-27
SLIDE 27
slide-28
SLIDE 28
slide-29
SLIDE 29
slide-30
SLIDE 30
slide-31
SLIDE 31
slide-32
SLIDE 32
slide-33
SLIDE 33
slide-34
SLIDE 34
slide-35
SLIDE 35
slide-36
SLIDE 36

09/10 2020 03 2021 12 2020

slide-37
SLIDE 37

MCS Platform 3GPP RAN5 Test Cases Buyers Testing Houses Vendors MCS TaaSTing Project

slide-38
SLIDE 38