IEEE-SA P2020 Kick-Off Meeting 20 September 2016, AutoWorld, - PowerPoint PPT Presentation

IEEE-SA P2020 Kick-Off Meeting 20 September 2016, AutoWorld, Brussels, Belgium

Agenda • Call to Order & Introductions – Robert Stead • Scope and Purpose of Working Group – Robert Stead • IEEE Patent Policy – Michael Kipness • Approval of Working Group P&Ps – Robert Stead and Michael Kipness • Appointment of Officers – Robert Stead • Technical Discussion – Sven Fleck • Adjourn

Introductions • Robert Stead, Sense Media Group • Benjamin May, AMX13 • Sven Fleck, SmartSurv • Patrick Denny, Valeo Vision Systems • Michael Kipness, IEEE-SA • CPIQ WG members

Affiliation Declarations • Name • Job title • Declaration of which entity is supporting your participation in this working group (company, individual or other organisation)

PAR Summary • Sponsoring Society and Committee: IEEE Vehicular Technology Society/Intelligent Transportation Systems (VT/ITS) • PAR link: https://development.standards.ieee.org/get- file/P2020.pdf?t=89521200003 • Project information: https://standards.ieee.org/develop/project/2020.html • Contact Information for IEEE-SA Liaison Name: Michael Kipness Email Address: m.Kipness@ieee.org Phone: +1 732-562-3810 • Contact Information for Standards Representative Name: Thomas Kurihara Email Address: t.kurihara@ieee.org

Scope of PAR This standard addresses the fundamental attributes that contribute to image and quality for automotive Advanced Driver Assistance Systems (ADAS) applications, as well as identifying existing metrics and other useful information relating to these attributes. It defines a standardized suite of objective and subjective test methods for measuring automotive camera image quality attributes, and it specifies tools and test methods to facilitate standards-based communication and comparison among OEM and Tier 1 system integrators and component vendors regarding automotive ADAS image quality.

Purpose of the PAR Purpose: • This standard specifies methods and metrics for measuring and testing automotive image quality to ensure consistency and create cross-industry reference points. Need for the Project: • Cameras are being used in greater numbers in automotive applications. Most of these systems have been developed independently, with no standardised calibration or measurement of image quality. Consumers have no standard reference point when using camera enabled systems, and OEM/Tier 1 developers cannot compare camera systems side by side. Stakeholders for the Standard: • Automotive OEMs, Automotive Tier 1 suppliers, image processing software and hardware companies, optics companies, sensor manufacturers, safety certification

Today’s Meeting and General Expectations See Q4 & Q7 on survey for details… • Define standard terminology, test methods and KPIs • Industry collaboration across supply chain • Increase knowledge transfer and harmonisation • Define scope, roles and responsibilities • Meet the other participants • Establish sub-groups and objectives

IEEE Patent Policy • MK slides

P2020 Policies and Procedures • Review of document • Q&A

Appointment of P2020 Officers Chair Robert Stead +44 208 133 5116 rob@sensemedia-events.com Vice Chair Dr. Sven Fleck +49 176 61040825 fleck@smartsurv.de Secretary Benjamin May +49 173 2386833 Benjamin.may@amx13.com Treasurer Prof. Patrick Denny +353 93 23184 patrick.denny@valeo.com

Technical Discussion • Review of survey results • Response to proposed work packages • New packages proposed • Draft Outline – review and feedback • Establishment of work packages • Include / exclude in P2020 • Proposal and nomination of work package leaders • Goals of ‘work package’ group

Example of work packet aims • Definitions of relevant terms • Review of existing relevant standards • Review of existing relevant technical studies • Definition of proposed standard test / method / KPI / measurement • Objective measurement outcomes

Next meetings? • Teleconference – 6 weeks? • Finalise work packet teams with balanced representation • Present proposed draft outline for work packet • Complete definition of terms • Propose and confirm outstanding work packet leaders • Face to Face • 6 months? • Present review of relevant standards and studies • ???

IEEE-SA Project 2020 Subproject Summary 2016-09-20 M. Kipness, R. Stead, S. Fleck, B. May, P. Denny

Agenda Questionnaire Feedback Discussion of Project Proposals Expectations Lets make a motion… ... for the agenda of course. Locations Next Steps

IEEE P2020 A UTOMOTIVE S YSTEM I MAGE Q UALITY R OBERT S TEAD (C HAIR ), D R . S VEN F LECK (V ICE C HAIR ), B ENJAMIN M AY (S ECRETARY ), P ROF . D R . P ATRICK D ENNY (T REASURER ) Q1 S UGGESTED I MAGE Q UALITY W ORK P ACKAGES Q4 W HAT DO YOU EXPECT MOST FROM P2020? Q2 I MAGE Q UALITY WORK PACKAGES – ADDITIONAL PROPOSALS Q3 L EADING A SUB - GROUP Q5/6 P2020 MEETINGS [ EVERY N WEEKS ] ? 1. W EB , 2. F ACE TO FACE

IEEE P2020 A UTOMOTIVE S YSTEM I MAGE Q UALITY R OBERT S TEAD (C HAIR ), D R . S VEN F LECK (V ICE C HAIR ), B ENJAMIN M AY (S ECRETARY ), P ROF . D R . P ATRICK D ENNY (T REASURER ) Q7 E XPECTATION OF P2020 MEETING @A UTO S ENS CONFERENCE Q9 C ONTACT I NFORMATION Q8 B EST LOCATION FOR THE NEXT FACE - TO - FACE MEETING ?

Questionaire Feedback Q1-3: Working Groups, Additional Proposals, Leaders of Sub Groups Q4: Expectations IEEE P2020 A UTOMOTIVE S YSTEM I MAGE Q UALITY Q5&6: Meeting Cadence R OBERT S TEAD (C HAIR ), D R . S VEN F LECK (V ICE C HAIR ), B ENJAMIN M AY (S ECRETARY ), P ROF . D R . P ATRICK D ENNY (T REASURER ) Q1 S UGGESTED I MAGE Q UALITY W ORK P ACKAGES Q4 W HAT DO YOU EXPECT MOST FROM P2020? Q7: Expectation of Meeting Q8: Location for F2F meeting Q2 I MAGE Q UALITY WORK PACKAGES – ADDITIONAL PROPOSALS Q9: Contact Information Q3 L EADING A SUB - GROUP Q5/6 P2020 MEETINGS [ EVERY N WEEKS ] ? 1. W EB , 2. F ACE TO FACE

Topic Summary • [proj #1] LED flicker standards • [proj #2.X] IQ for viewing • [proj #3.X] IQ for computer vision • [proj #4] Camera system interface standards Initial proposals • [proj #5] IQ safety standards beyond ISO26262 • [proj #6] Mapping P2020 standards -> SAE levels • [proj #7] Customer perception quality standards • [proj #8] Video quality • [proj #9] Calibration quality standards additional proposals • [proj #10] IQ requirements/specification standards

Topic Summary

Project Goal - [proj #1] LED flicker standards Harmonization of different settings as this reduces impact on image and machine vision functions such as: • vehicle illumination • street illumination • traffic sign control

[proj #2.X] IQ for viewing Two subprojects proposed: [proj #2.1] IQ for viewing - component level • KPI standards and test setups [proj #2.2] IQ for viewing - system level • KPI standards and test setups

[proj #3.X] IQ for computer vision Two subprojects proposed: [proj #3.1] IQ for computer vision - component level • KPI standards and test setups [proj #3.2] IQ for computer vision - system level • KPI standards and test setups

[proj #4] Camera system interface standards especially to measurement systems including: • firmware requirements • "ONVIF for automotive"

[proj #5] IQ safety standards beyond ISO26262 Potential extension of ISO26262 for image quality due to new applications for viewing systems in automotive

[proj #6] Mapping P2020 standards -> SAE levels minimum image quality requirements for each SAE level Link to autonomous driving

[proj #7] Customer perception quality standards End customer studies and correlation with defined system-level standards (e.g. proj #2.2)

[proj #8] Video quality • framerate, jitter, lag, etc. • motion related issues (artefacts, motion blur, rolling shutter, etc.) • video coding standards and tools

[proj #9] Calibration quality standards • KPI standards for intrinsic + extrinsic calibration • component and system calibration • plant and online calibration in the field

[proj #10] IQ requirements/specification standards • standardization of variables, terms and system descriptions

Q4: What to Expect…? Terminology Automotive lighting harmonization standardization (on- & offboard) Automotive specific requirements End-to-end automotive Unified Testing EU H2020 projects system description Industry Exchange Convergence of Viewing and Processing Best In Class IQ Standardization KPI-driven development Deep learning Viewing and Perception Harmonization of Expectations

Q5&6: Meeting Cadence • Mean for Webmeeting: Every 7.5 weeks • Mean for F2F Meeting: Every 20 weeks

Q8: LOCATION – Where next?

Q8: LOCATION – Where next?

Next Steps • Organization of Sub Group meetings • Define Future milestones of Sub Groups • Introduction of Sub Group priorities and their respective leaders • Beer and Fun…

Key Contacts – P2020 Officers Chair Robert Stead +44 208 133 5116 rob@sensemedia-events.com Vice Chair Dr. Sven Fleck +49 176 61040825 fleck@smartsurv.de Secretary Benjamin May +49 173 2386833 Benjamin.may@amx13.com Treasurer Prof. Patrick Denny +353 93 23184 patrick.denny@valeo.com