? LAAS-CNRS 2 / Laboratoire danalyse et darchitecture des systmes - - PowerPoint PPT Presentation

▶
laas cnrs 2 laboratoire d analyse et d architecture des
SMART_READER_LITE
LIVE PREVIEW

? LAAS-CNRS 2 / Laboratoire danalyse et darchitecture des systmes - - PowerPoint PPT Presentation

Nov 27, 2022 294 likes •471 views

Q UALITY Q UANTIFICATION A PPLIED TO A UTOMOTIVE E MBEDDED S YSTEMS AND S OFTWARE A DVANCES WITH QUALIMETRY SCIENCE Y ANN A RGOTTI , C LAUDE B ARON , P HILIPPE E STEBAN , D ENIS C HATON Embedded Real Time Systems Conference 2020

slide-1
SLIDE 1

LAAS-CNRS / Laboratoire d’analyse et d’architecture des systèmes du CNRS

Laboratoire conventionné avec l’Université Fédérale de Toulouse Midi-Pyrénées

QUALITY QUANTIFICATION APPLIED TO AUTOMOTIVE EMBEDDED SYSTEMS AND SOFTWARE

ADVANCES WITH QUALIMETRY SCIENCE

YANN ARGOTTI, CLAUDE BARON, PHILIPPE ESTEBAN, DENIS CHATON

Embedded Real Time Systems Conference 2020

Attribution-NonCommercial-ShareAlike 3.0 Unported (CC BY-NC-SA 3.0)

slide-2
SLIDE 2

LAAS-CNRS / Laboratoire d’analyse et d’architecture des systèmes du CNRS

2

INTRODUCTION INTRODUCTION

?

slide-3
SLIDE 3

LAAS-CNRS / Laboratoire d’analyse et d’architecture des systèmes du CNRS

3

> Conformance to standards and regulations

  • eg. ARP4754, DO-178C, ISO26262, A-Spice, ISO/TS 16949, CE

> Help to characterize / define adequately Quality

  • Identify and organize multitude of characteristics
  • Quality model as central point

> Help to control / optimize metrics flow

  • Metrics are essential and everywhere
  • Outputs from many tools
  • Loopback & digitalization of characteristics / properties

> Help on Cost / Delay / Quality trade-off

  • Non-Quality costs companies 5% of total revenue

[Afnor group, 2017]

WHY DOES IT MATTER? WHY DOES IT MATTER?

?

?

? ?

slide-4
SLIDE 4

LAAS-CNRS / Laboratoire d’analyse et d’architecture des systèmes du CNRS

4

IMPORTANCE OF RIGHT QUALITY QUANTIFICATION IMPORTANCE OF RIGHT QUALITY QUANTIFICATION

Toyota Hybrid System 2018

recall of 2.4 million vehicles

Ariane 5 4th, Jun, 1996

loss of $370M

Therac-25 1985-1987

loss of 6 patients

Source https://www.wsj.com/articles/toyota-recalls-more-than-2-million-vehicles-over-hybrid-system-fault-1538725425 Source http://radonc.wikidot.com/radiation-accident-therac25 licensed under CC BY-NC-ND Source http://naticomseguranca.blogspot.com/2014/02/seguranca-x-confianca-problemas.html licensed under CC BY Source https://www.flickr.com/photos/dlr_de/8967685954/ licensed under CC BY Source https://commons.wikimedia.org/wiki/File:Ariane_5_1.jpg licensed under CC BY-SA

slide-5
SLIDE 5

LAAS-CNRS / Laboratoire d’analyse et d’architecture des systèmes du CNRS

5

PROBLEM WITH CURRENT APPROACHES PROBLEM WITH CURRENT APPROACHES

> Solution too general

  • Wide scope with ambition to cover as much as possible
  • e.g. standard such as CMMI, ISO/IEC9126, ISO/IEC25010
  • 28% of companies use standards and 79% of these companies customized them [Wagner et al., 2012]

> Solution too specific, focus is on applied aspect

  • Reuse / adaptation of previous work cannot be or hard to generalize
  • McCall et al. with Factor / Criteria / Metric [McCall et al., 1977],
  • Basili et al. with Goal / Question / Method [Basili et al., 1994],

> Solution set too large

  • In literature, many quality models for SW product: no obvious right quality model

> Few works about theory and applied quality quantification,

  • SW product oriented, Wagner on SW product quality control [Wagner, 2013],
  • General approach, Azgaldov et al. on general quality assessment [Azgaldov et al., 1968 & 2015]

Qualimetry

slide-6
SLIDE 6

LAAS-CNRS / Laboratoire d’analyse et d’architecture des systèmes du CNRS

6

QUALIMETRY QUALIMETRY

> Science of quality quantification

  • from the Latin qualis “of what kind”
  • and the Greek μετρεω “to measure”

> Science Id

  • Goal is to generalize quality quantification approach
  • Born in former USSR in 1968 [Azgaldov et al., 1968]
  • Theoretical & Applied aspect
  • Scope: any fields

> House of Qualimetry and its 6 pillars

  • a synthetic view of Qualimetry
slide-7
SLIDE 7

LAAS-CNRS / Laboratoire d’analyse et d’architecture des systèmes du CNRS

7

THE HOUSE OF QUALIMETRY THE HOUSE OF QUALIMETRY

Quality characteristic identification Rules to support quality characteristic organization Importance of quality characteristics among others

  • Operational, Representational

and various minors (Diez 1997)

  • Gives mathematical & statistical

tools Combining measurements (Logical scoring of preferences, mean, median, variance, …) weighted or not Reject, accept, target, reference

(can be extended with “forecasted”)

Quality Model

Candidate object(s) for quality quantification

Measurement

slide-8
SLIDE 8

LAAS-CNRS / Laboratoire d’analyse et d’architecture des systèmes du CNRS

8

THE HOUSE OF QUALIMETRY: quality model example - ISO/IEC 25010:2011 THE HOUSE OF QUALIMETRY: quality model example - ISO/IEC 25010:2011

Automotive SW Product

slide-9
SLIDE 9

LAAS-CNRS / Laboratoire d’analyse et d’architecture des systèmes du CNRS

9

QUALITY MODEL PILLARS: POLYMORPHISM CONCEPT QUALITY MODEL PILLARS: POLYMORPHISM CONCEPT

> Polymorphic quality model

1. For same type of objects, we may have

  • Common quality model characteristics or “interface” (ie Ad

hoc polymorphism: overloading & coercion,),

  • Variations with heritage between quality models (ie

Universal polymorphism: sub-classing, inheritance, or

  • verriding, extension)

2. Over a project or product life cycle, for example, quality model can change (e.g in design phase we have different focus than in maintenance one),

* Source https://commons.wikimedia.org/wiki/File:Butterfly_icon_(Noun_Project).svg licensed under CC BY-SA ** Source https://pt.wikipedia.org/wiki/Mimetismo_m%C3%BClleriano licensed under CC BY-SA *** Source http://lib-air.fr/hypnose/ licensed under CC BY-NC-ND

Note: nucleotide = leaf characteristics, gene = group of characteristics, xi frequencies of the ith sequence

ij nucleotide difference between sequence i and j

* ** ***

> Quality model distance: Degree of polymorphism (from genetic)

  • The nucleotide diversity formula introduced by Nei and Li in 1979
slide-10
SLIDE 10

LAAS-CNRS / Laboratoire d’analyse et d’architecture des systèmes du CNRS

10

QUALITY MODEL PILLARS: QUALITY MODEL DISTANCE IMPORTANCE QUALITY MODEL PILLARS: QUALITY MODEL DISTANCE IMPORTANCE

>

Sources of Quality model change or adaptation

  • Change of life cycle stage (e.g. from design to implementation),
  • Evolution of product (e.g. addition of new features),
  • Insufficient quality area coverage (e.g. gaps in safety or security),
  • Change of targeted product (e.g. from car to truck),
  • New or updated process or standard (e.g. from ISO/IEC 9126 to ISO/IEC 25010),
  • …

> Benefits from Quality model distance

  • Evaluate risk linked to quality model change
  • low distance = low risk, high distance = high risk,
  • Evaluate change workload and cost,
  • Identify most impacted areas and characteristics,
  • Identify where quality quantification, assessment and control are changing,
  • Identify and evaluate validation path finding change
  • Capture of different types of bugs possibly never found before
  • Discarding other areas and path
  • Support decision and control change / update of quality model
slide-11
SLIDE 11

LAAS-CNRS / Laboratoire d’analyse et d’architecture des systèmes du CNRS

11

QUALITY MODEL PILLARS: APPLICATION TO AUTOMOTIVE QUALITY MODEL PILLARS: APPLICATION TO AUTOMOTIVE

> As embedded Systems

  • Vehicle platform
  • Variants: mini-compact, crossover, supercar, convertible, commercial, sport, van ….
  • Complex system, composed of more than 40 systems, distributed over more than 60 Electronic Control Units

(ECU): hardware + software

  • Each ECU has
  • Common characteristics with other ECUs: e.g. diagnostic, connection interface, power,
  • A set of specific characteristics: e.g. HMI, communication, safety,
  • A context: e.g. door control, engine control, telematic control, seat control.

> As embedded Software

  • Automotive-SPICE Process Assessment / Reference Model guidelines
  • In v2.5: reference to ISO/IEC 9126
  • In v3.0/1: reference ISO/IEC 25010
  • Distance between ISO/IEC 9126 and ISO/IEC 25010
  • Degree of polymorphism = 0.6792

(0 = identical; 1 = 100% disjoined)

[53 leaf characteristics, 32 unique, 8 similar]

slide-12
SLIDE 12

LAAS-CNRS / Laboratoire d’analyse et d’architecture des systèmes du CNRS

12

Example of some differences between ISO/IEC 9126 & ISO/IEC 25010 Example of some differences between ISO/IEC 9126 & ISO/IEC 25010

ISO/EIC 9126

(2001)

ISO/EIC 25010

(2011)

slide-13
SLIDE 13

LAAS-CNRS / Laboratoire d’analyse et d’architecture des systèmes du CNRS

13

QUALITY MODEL & MEASUREMENT PILLARS: POLYMORPHISM APPLIED TO AUTOMOTIVE QUALITY MODEL & MEASUREMENT PILLARS: POLYMORPHISM APPLIED TO AUTOMOTIVE

Is derived from Derived into Measurements Measurements

slide-14
SLIDE 14

LAAS-CNRS / Laboratoire d’analyse et d’architecture des systèmes du CNRS

14

YANN ARGOTTI yann.argotti@laas.fr yann.argotti@renault.com

CONCLUSION CONCLUSION

>

Review why quality quantification is important and gaps with current approaches

>

Strengthen current quality quantification relying on Qualimetry by

  • Introducing synthetic view of the “House of Qualimetry”,
  • Introducing polymorphism to capture quality model evolution, adaptation and replication aspects,
  • Introducing degree of polymorphism to setup intrinsic distance between quality models,
  • Explaining the importance of quality model distance,

>

Open new perspective with regards to quality quantification in systems engineering

  • Bring homogeneity, consistency and compatibility to quality characteristics and quantification
  • Helps specify a joint “vocabulary”,
  • Define a derivable quality model (e.g. ECU or car platform one)
  • Allow smooth incremental change management which is key in agile development methodology

>

Our next steps focus

  • quality model consolidation and deployment for all ECUs & aggregation at vehicle platform level

>

Contacts

CLAUDE BARON claude.baron@laas.fr PHILIPPE ESTEBAN philippe.esteban@laas.fr DENIS CHATON denis.chaton@renault.com

slide-15
SLIDE 15

LAAS-CNRS / Laboratoire d’analyse et d’architecture des systèmes du CNRS

15

THANK YOU !

slide-16
SLIDE 16

LAAS-CNRS / Laboratoire d’analyse et d’architecture des systèmes du CNRS

16

Back-up