IEEE-SA P2020 Kick-Off Meeting 20 September 2016, AutoWorld, - - PowerPoint PPT Presentation
IEEE-SA P2020 Kick-Off Meeting 20 September 2016, AutoWorld, - - PowerPoint PPT Presentation
IEEE-SA P2020 Kick-Off Meeting 20 September 2016, AutoWorld, Brussels, Belgium Agenda Call to Order & Introductions Robert Stead Scope and Purpose of Working Group Robert Stead IEEE Patent Policy Michael Kipness
Agenda
- Call to Order & Introductions – Robert Stead
- Scope and Purpose of Working Group – Robert Stead
- IEEE Patent Policy – Michael Kipness
- Approval of Working Group P&Ps – Robert Stead and Michael Kipness
- Appointment of Officers – Robert Stead
- Technical Discussion – Sven Fleck
- Adjourn
Introductions
- Robert Stead, Sense Media Group
- Benjamin May, AMX13
- Sven Fleck, SmartSurv
- Patrick Denny, Valeo Vision Systems
- Michael Kipness, IEEE-SA
- CPIQ WG members
Affiliation Declarations
- Name
- Job title
- Declaration of which entity is supporting your
participation in this working group (company, individual or other organisation)
PAR Summary
- Sponsoring Society and Committee: IEEE Vehicular Technology Society/Intelligent
Transportation Systems (VT/ITS)
- PAR link: https://development.standards.ieee.org/get-
file/P2020.pdf?t=89521200003
- Project information: https://standards.ieee.org/develop/project/2020.html
- Contact Information for IEEE-SA Liaison
Name: Michael Kipness Email Address: m.Kipness@ieee.org Phone: +1 732-562-3810
- Contact Information for Standards Representative
Name: Thomas Kurihara Email Address: t.kurihara@ieee.org
Scope of PAR
This standard
addresses the fundamental attributes that contribute to image and quality for automotive Advanced Driver Assistance Systems (ADAS) applications, as well as identifying existing metrics and other useful information relating to these attributes. It defines a standardized suite of objective and subjective test methods for measuring automotive camera image quality attributes, and it specifies tools and test methods to facilitate standards-based communication and comparison among OEM and Tier 1 system integrators and component vendors regarding automotive ADAS image quality.
Purpose of the PAR
Purpose:
- This standard specifies methods and metrics for measuring and testing automotive image quality
to ensure consistency and create cross-industry reference points. Need for the Project:
- Cameras are being used in greater numbers in automotive applications. Most of these systems
have been developed independently, with no standardised calibration or measurement of image
- quality. Consumers have no standard reference point when using camera enabled systems, and
OEM/Tier 1 developers cannot compare camera systems side by side. Stakeholders for the Standard:
- Automotive OEMs, Automotive Tier 1 suppliers, image processing software and hardware
companies, optics companies, sensor manufacturers, safety certification
Today’s Meeting and General Expectations
See Q4 & Q7 on survey for details…
- Define standard terminology, test methods and KPIs
- Industry collaboration across supply chain
- Increase knowledge transfer and harmonisation
- Define scope, roles and responsibilities
- Meet the other participants
- Establish sub-groups and objectives
IEEE Patent Policy
- MK slides
P2020 Policies and Procedures
- Review of document
- Q&A
Appointment of P2020 Officers
Chair Robert Stead +44 208 133 5116 rob@sensemedia-events.com Vice Chair
- Dr. Sven Fleck
+49 176 61040825 fleck@smartsurv.de Secretary Benjamin May +49 173 2386833 Benjamin.may@amx13.com Treasurer
- Prof. Patrick Denny
+353 93 23184 patrick.denny@valeo.com
Technical Discussion
- Review of survey results
- Response to proposed work packages
- New packages proposed
- Draft Outline – review and feedback
- Establishment of work packages
- Include / exclude in P2020
- Proposal and nomination of work package leaders
- Goals of ‘work package’ group
Example of work packet aims
- Definitions of relevant terms
- Review of existing relevant standards
- Review of existing relevant technical studies
- Definition of proposed standard test / method / KPI /
measurement
- Objective measurement outcomes
Next meetings?
- Teleconference – 6 weeks?
- Finalise work packet teams with balanced representation
- Present proposed draft outline for work packet
- Complete definition of terms
- Propose and confirm outstanding work packet leaders
- Face to Face
- 6 months?
- Present review of relevant standards and studies
- ???
IEEE-SA Project 2020 Subproject Summary
2016-09-20
- M. Kipness, R. Stead, S. Fleck, B. May, P. Denny
Agenda
Questionnaire Feedback Discussion of Project Proposals Expectations Locations Next Steps
Lets make a motion… ... for the agenda of course.
IEEE P2020 AUTOMOTIVE SYSTEM IMAGE QUALITY
ROBERT STEAD (CHAIR), DR. SVEN FLECK (VICE CHAIR), BENJAMIN MAY (SECRETARY), PROF. DR. PATRICK DENNY (TREASURER) Q1 SUGGESTED IMAGE QUALITY WORK PACKAGES Q2 IMAGE QUALITY WORK PACKAGES – ADDITIONAL PROPOSALS Q3 LEADING A SUB-GROUP Q4 WHAT DO YOU EXPECT MOST FROM P2020? Q5/6 P2020 MEETINGS [EVERY N WEEKS] ? 1. WEB, 2. FACE TO FACE
IEEE P2020 AUTOMOTIVE SYSTEM IMAGE QUALITY
ROBERT STEAD (CHAIR), DR. SVEN FLECK (VICE CHAIR), BENJAMIN MAY (SECRETARY), PROF. DR. PATRICK DENNY (TREASURER) Q7 EXPECTATION OF P2020 MEETING @AUTOSENS CONFERENCE Q8 BEST LOCATION FOR THE NEXT FACE-TO-FACE MEETING? Q9 CONTACT INFORMATION
Questionaire Feedback
Q1-3: Working Groups, Additional Proposals, Leaders of Sub Groups Q4: Expectations Q5&6: Meeting Cadence Q7: Expectation of Meeting Q8: Location for F2F meeting Q9: Contact Information
IEEE P2020 AUTOMOTIVE SYSTEM IMAGE QUALITY
ROBERT STEAD (CHAIR), DR. SVEN FLECK (VICE CHAIR), BENJAMIN MAY (SECRETARY), PROF. DR. PATRICK DENNY (TREASURER) Q1 SUGGESTED IMAGE QUALITY WORK PACKAGES Q2 IMAGE QUALITY WORK PACKAGES – ADDITIONAL PROPOSALS Q3 LEADING A SUB-GROUP Q4 WHAT DO YOU EXPECT MOST FROM P2020? Q5/6 P2020 MEETINGS [EVERY N WEEKS] ? 1. WEB, 2. FACE TO FACETopic Summary
- [proj #1] LED flicker standards
- [proj #2.X] IQ for viewing
- [proj #3.X] IQ for computer vision
- [proj #4] Camera system interface standards
- [proj #5] IQ safety standards beyond ISO26262
- [proj #6] Mapping P2020 standards -> SAE levels
- [proj #7] Customer perception quality standards
- [proj #8] Video quality
- [proj #9] Calibration quality standards
- [proj #10] IQ requirements/specification standards
Initial proposals additional proposals
Topic Summary
Project Goal - [proj #1] LED flicker standards
Harmonization of different settings as this reduces impact on image and machine vision functions such as:
- vehicle illumination
- street illumination
- traffic sign control
[proj #2.X] IQ for viewing
Two subprojects proposed: [proj #2.1] IQ for viewing - component level
- KPI standards and test setups
[proj #2.2] IQ for viewing - system level
- KPI standards and test setups
[proj #3.X] IQ for computer vision
Two subprojects proposed: [proj #3.1] IQ for computer vision - component level
- KPI standards and test setups
[proj #3.2] IQ for computer vision - system level
- KPI standards and test setups
[proj #4] Camera system interface standards
especially to measurement systems including:
- firmware requirements
- "ONVIF for automotive"
[proj #5] IQ safety standards beyond ISO26262
Potential extension of ISO26262 for image quality due to new applications for viewing systems in automotive
[proj #6] Mapping P2020 standards -> SAE levels
minimum image quality requirements for each SAE level Link to autonomous driving
[proj #7] Customer perception quality standards
End customer studies and correlation with defined system-level standards (e.g. proj #2.2)
[proj #8] Video quality
- framerate, jitter, lag, etc.
- motion related issues (artefacts, motion blur, rolling shutter, etc.)
- video coding standards and tools
[proj #9] Calibration quality standards
- KPI standards for intrinsic + extrinsic calibration
- component and system calibration
- plant and online calibration in the field
[proj #10] IQ requirements/specification standards
- standardization of variables, terms and system descriptions
Q4: What to Expect…?
KPI-driven development
Industry Exchange
IQ Standardization
EU H2020 projects
Convergence of Viewing and Processing Viewing and Perception
Automotive specific requirements Harmonization of Expectations
Unified Testing
End-to-end automotive system description
Automotive lighting standardization (on- & offboard)
Terminology harmonization
Best In Class
Deep learning
Q5&6: Meeting Cadence
- Mean for Webmeeting:
Every 7.5 weeks
- Mean for F2F Meeting:
Every 20 weeks
Q8: LOCATION – Where next?
Q8: LOCATION – Where next?
Next Steps
- Organization of Sub Group meetings
- Define Future milestones of Sub Groups
- Introduction of Sub Group priorities and their respective leaders
- Beer and Fun…
Key Contacts – P2020 Officers
Chair Robert Stead +44 208 133 5116 rob@sensemedia-events.com Vice Chair
- Dr. Sven Fleck
+49 176 61040825 fleck@smartsurv.de Secretary Benjamin May +49 173 2386833 Benjamin.may@amx13.com Treasurer
- Prof. Patrick Denny
+353 93 23184 patrick.denny@valeo.com