Certification of the open-source SCA Reference Implementation - - PowerPoint PPT Presentation

▶
certification of the open source sca reference
SMART_READER_LITE
LIVE PREVIEW

Certification of the open-source SCA Reference Implementation - - PowerPoint PPT Presentation

Jun 24, 2023 29 likes •351 views

Certification of the open-source SCA Reference Implementation (SCARI) Hugues Latour Communications Research Centre Canada Advanced Radio Systems 1 Outline Overview of CRC SCARI Projects Introduction to Certification Process

slide-1
SLIDE 1

1

Certification of the open-source SCA Reference Implementation (SCARI)

Hugues Latour Communications Research Centre Canada Advanced Radio Systems

slide-2
SLIDE 2

2

Outline

  • Overview of CRC
  • SCARI Projects
  • Introduction to Certification Process
  • SCARI 2 OE Certification
  • Conclusion
slide-3
SLIDE 3

3

slide-4
SLIDE 4

4

CRC’s SCA Debut

First demo of a commercial SCA application (DAB™) Released Java SCARI for the SDR Forum (SCAv2.1) 2002 Introduced the concept of “Ports” and “connections” for SCAv1.0 2001 Implemented an SCAv0.3 FM-LoS demo for DND 2000 Designed a proprietary SDR architecture 1998 Submitted over 40 change proposals to JTeL 2003 Released SCARI2, JTeL Certified (97.39%) SCAv2.2 CF 2004

slide-5
SLIDE 5

5

SCARI Projects

  • 2001 - SDR Forum sponsored CRC to develop an
  • pen source reference implementation of the

SCAv2.1

– Development done in collaboration with Defense R&D Canada (DRDC-Ottawa) – Implementation was completed in December 2002 – Included SCA CF source code, documentation and an example application (audio effects) – Over 10,000 downloads worldwide of the various deliverables

slide-6
SLIDE 6

6

SCARI Projects

  • 2004 - SDR Forum sponsored CRC to update

SCARI Open project to SCAv2.2 and obtain JTRS certification

  • 2002 - First demonstration of a commercial SCA

compliant waveform

– SDR Forum technical conference (San Diego) – Digital Audio Broadcast (DAB) developed at CRC

slide-7
SLIDE 7

7

SCARI Projects

  • CRC assembled an

international team of Forum members to participate in SCARI Open project

– ISR Technologies – Joint Tactical Radio System Joint Project Office – NASA Glenn Research Centre – Rohde and Schwarz – Mercury Computer System

slide-8
SLIDE 8

8

SCARI v2.2 Deliverables

  • Source code

– Java Source code of SCAv2.2 Core Framework – Java/C Source code of simple demonstration application – 60,000 LOC

  • Documentation

– Code convention for Java – SCA CF design documentation – SW / HW platform requirements and installation procedures – 300 pages of documentation – JTRS / JTel certification report

  • Demonstration to SDR Forum community
slide-9
SLIDE 9

9

Java / C++ and the RI

  • A Java implementation of the SCA does not

preclude C++ for applications

  • However, C++ will usually require

– An additional compiler and ORB compatible with C++ – A set of makefiles

  • JNI can be used to avoid the use of C++ ORB

– The CRC RI uses JNI to “wrap” signal processing intensive modules

slide-10
SLIDE 10

10

SCARI Projects

  • Still used world wide by academia and industry

– Used in Mercury FM3TR waveform project for SDR Forum – Inspired Virginia Tech C++ SCA CF : Ossie – Used as a base for derived Robotic SCA standard – Book

  • Software Defined Radio: The Software Communications

Architecture John Bard, Vincent J. Kovarik, – Used in graduate and post graduate projects – Used in many research activities

slide-11
SLIDE 11

11

Outline

  • Who is CRC?
  • SCARI Projects
  • Introduction to Certification Process
  • SCARI 2 OE Certification
  • Conclusion
slide-12
SLIDE 12

12

JTeL Certification Terminology

  • Joint Tactical Radio (JTR) Set Software is

composed of:

– Operating Environment – SCA Devices – Radio System Applications – Cryptographic Subsystem

slide-13
SLIDE 13

13

Operating Environment (OE)

  • SCA Core Framework (CF)
  • CORBA Middleware (ORB)
  • Operating System (OS)

JTR Set CORBA Middleware CORBA Middleware SCA Core Framework SCA Core Framework Operating System Operating System

OE

slide-14
SLIDE 14

14

Test Model OE-1

1. JTAP software delivered to JTR set manufacturer 2. Port JTAP components to JTR set 3. Conduct SCA OE tests:

– By the JTR Manufacturer – Witnessed by JTeL rep

4. JTeL test report review 5. JTeL submission of recommendation for SCA compliance to JPO 6. JPO issue certificate for JTR set compliance

slide-15
SLIDE 15

15

  • JTAP = JTRS Test Application
  • Automated SCA requirements testing

– Core framework interfaces (SCA IDL) – CORBA Services (Naming Service, Event Service) – Application and Device deployment – Required Operating Environment support for external components

  • FileSystem, FileManager, File

Automated Testing: JTAP

slide-16
SLIDE 16

16

Automated Testing: JTAP Automated Testing: JTAP

  • Test components provided

– Code: written in C++ – OS: been tested on Window or VxWorks – ORB: been tested for TAO and ORBexpress

  • Test components needs to be ported to

programming language, ORB and OS.

  • Test components software package descriptor

(SPD) needs to be adapted to target environment.

slide-17
SLIDE 17

17

Automated Testing: JTAP

  • Node Test Components

– PseudoDeviceManager (optional) – PseudoDevice – PseudoCompositeDevice – PseudoService

  • Application Test Components

– PseudoAssemblyController – PseudoResourceFactory – PseudoResource

slide-18
SLIDE 18

18

  • Operated from a Windows PC
  • Utilizes the ACE TAO CORBA ORB
  • JTAP tool requires a IIOP/TCP connection to the

Operating Environment

– Requires TCP/IP access to the Radio

  • JTAP v2.3.2 certifies SCA CF v2.0 and v2.2
  • JTAP v3.5 now certifies SCA CF v2.2.2

Automated Testing: JTAP Automated Testing: JTAP

slide-19
SLIDE 19

19

Outline

  • Who is CRC?
  • SCARI Projects
  • Introduction to Certification Process
  • SCARI 2 OE Certification
  • Conclusion
slide-20
SLIDE 20

20

Tester Window PC Target Linux Laptop Ethernet Switch/Hub

SCARI Open Testing Suite

slide-21
SLIDE 21

21

Tester Window Platform Target Linux Platform Software Bus (CORBA ORB) Software Bus (CORBA ORB)

JTAP JTAP Executable Device Executable Device Domain Manager Domain Manager

ACE/TAO ACE/TAO ACE/TAO ACE/TAO javaIDL javaIDL

Log Service Log Service Pseudo Device Pseudo Device Pseudo CompositeDevice Pseudo CompositeDevice Pseudo Service Pseudo Service Application Factory Application Factory Application Application Device Manager Device Manager File Manager File Manager

SCARI Open Test Suite

slide-22
SLIDE 22

22

Tester Window Platform Target Linux Platform Software Bus (CORBA ORB) Software Bus (CORBA ORB)

JTAP JTAP

ACE/TAO ACE/TAO

Domain Manager Domain Manager

javaIDL javaIDL

Log Service Log Service Application Factory Application Factory File Manager File Manager JTAP Device Manager JTAP Device Manager JTAP Service JTAP Service JTAP Application JTAP Application JTAP File Manager JTAP File Manager JTAP ExecDevice JTAP ExecDevice Application Application

DomainManager Testing

slide-23
SLIDE 23

23

Tester Window Platform Target Linux Platform Software Bus (CORBA ORB) Software Bus (CORBA ORB)

JTAP JTAP Domain Manager Domain Manager

ACE/TAO ACE/TAO ACE/TAO ACE/TAO javaIDL javaIDL

Pseudo Device Pseudo Device Pseudo CompositeDevice Pseudo CompositeDevice Pseudo Service Pseudo Service Device Manager Device Manager File Manager File Manager deploys deploys deploys

DeviceManager Testing

slide-24
SLIDE 24

24

Tester Window Platform Target Linux Platform Software Bus (CORBA ORB) Software Bus (CORBA ORB)

JTAP JTAP Executable Device Executable Device Domain Manager Domain Manager

ACE/TAO ACE/TAO ACE/TAO ACE/TAO javaIDL javaIDL

Log Service Log Service Pseudo AssemblyController Pseudo AssemblyController Pseudo ResourceFactory Pseudo ResourceFactory Pseudo Resource Pseudo Resource Application Factory Application Factory Application Application Device Manager Device Manager File Manager File Manager

Application Factory Testing

slide-25
SLIDE 25

25

Tester Window Platform Target Linux Platform Software Bus (CORBA ORB) Software Bus (CORBA ORB)

JTAP JTAP Executable Device Executable Device Domain Manager Domain Manager

ACE/TAO ACE/TAO javaIDL javaIDL

Log Service Log Service Device Manager Device Manager File Manager File Manager

Components Under Test

Optional Testing

slide-26
SLIDE 26

26

Test Report

slide-27
SLIDE 27

27

Requirements Results

Categories # of Req % of Req Passed 635 97.39% SCA Issues 5 0.77% Failed 6 0.92% JTAP Interpretations 6 0.92 %

  • SCA Issues are usually specification contradictions
  • Failed are non implemented SCA features.
  • JTAP interpretations are debatable interpretations
  • f the specification
slide-28
SLIDE 28

28

Requirements Results

  • Failed

– priority and stacksize is not supported by all OS even less the Java JVM – OS process is abstracted from Java – UsesDevice not supported

  • SPEC Issues

– Native exception never provide return code – PRODUCER_LOG_ID: numerical pre 2.2 then became string

  • JTAP Interpretation

– Application delayed connection to services – exclusive exception: InvalidFileName or InvalidProfile – JTAP tries to remove the application twice – FileSystem copy file: performed recursive copy

slide-29
SLIDE 29

29

Testing Method

  • Automatic

– Using the JTAP tool

  • Manual Inspection

– Code inspection – Using SCARIOpen GUI tools

  • Semi-Automatic

– Using the JTAP tool – Using SCARIOpen GUI tools

  • Mixed

– Any combination of the above

slide-30
SLIDE 30

30

Testing Method

TestMethod # of Tests

Auto 498 Inspection 99 Semi-Automated 17 Mixed 21 Total 635

slide-31
SLIDE 31

31

Positive Outcome

  • First CF provider to exercise 100% of the

tests

– AggregateDevice Test Procedure

  • At the time, Fastest Certification

– Completed in 5.5 days over 9 Calendar days – Used the ScariOpen GUI tools to support and accelerate manual testing

slide-32
SLIDE 32

32

Questions ? Questions ?

For more details, visit: www.crc.ca/scari Or send an email to: info_scari@crc.ca