Driving with AI: The Future of Mobility and Transportation Harsha - - PowerPoint PPT Presentation
Driving with AI: The Future of Mobility and Transportation Harsha Badarinarayan , Ph.D. Director and Laboratory Manager Global Center for Social Innovation North America, Hitachi America, Ltd. Overview Hitachi Leaders in Digital
Harsha Badarinarayan, Ph.D.
Director and Laboratory Manager Global Center for Social Innovation – North America,
Hitachi America, Ltd.
As a global technology leader, digital innovation is at the heart of everything we do.
* As of March 31, 2016
culture
annual R&D*
3-year IoT R&D*
consolidated revenue*
IoT revenue* 15,000+ global customers
strategic alliances Industrial and IT Leader
Heritage of innovation
global patents
IoT patents Thomson Reuters
Global Innovators
global partners
technology and product development
subsidiaries
employees
Creating new markets; breaking down industry boundaries; and disrupting value chains
IoT 3D Printing Cloud AI Blockchain Big Video Automation
Technical Innovation
Peer-to-peer As-a-Service Automated Shared Connected
Social Innovation
Global Mega Trends
Globalisation Aging Populations Mass Migration Urbanisation Sustainability Terrorism Cyber Crime
Rail Manufacturing and Industry Public Service Energy Automotive Financial Service
Combustion engine advancements Fuel Cells Start-up OEMs New Retail – Direct to Customer Light-weighting Shared Mobility Low cost brands Electrification Intelligent and Automated Vehicles Alternative Fuels Shift to Asia Connectivity & AI Non-traditional entrants Digital Experience
Source: Roland Berger
Big Data/ Analytics
Short-term trends Mid-term trends Long-term trends
Source: Roland Berger
Synergy to create eco-friendly propulsion systems
AD/ADAS Technologies Powertrain Control
AD/ADAS Features
Autonomous Driving for highway Lane keep system (lane recognition) ACC/AEB (Preceding vehicle recognition)
AD: Autonomous Driving ADAS: Advanced Driver Assistance System ACC: Adaptive Cruise Control AEB: Autonomous Emergency Braking Powertrain Control Opportunity for Start & Stop
E.g. Start & Stop control
Sailing stop Coasting stop
Idling stop
Vehicle Speed VSP
Driving Cycle (Acceleration suppression) HEV control (Regeneration)
HD LDM + V2X + Traffic Estimating accurate position via HD Map Information Weather- robust Vision System and Sensor Fusion Architecture RADAR/LiDAR
Engine Map Real World Driving
Road Grade, Weather, Traffic Drive Cycle
Input layer Extract Features + Live Traffic
Feature Extraction
Output layer
min (𝐺 𝑦, 𝑣 = 𝑛𝑗𝑜 . 𝑔𝑣𝑓𝑚_𝑠𝑏𝑢𝑓(𝑄
789, ω789|𝑄<=>?7=_=7@)
Vehicle Speed (mph)
Time (Secs)
§ Emission reduction § CAFÉ Improvements § Gas Savings § Comfort Ride
§ Perform large scale traffic simulation using Real World Driving data § Evaluate benefit of ‘look-ahead’ controls & calibration for powertrain
Multiple co-simulation platform
Speed (mph)
Free Flow Traffic Speed
Throttle Control Brake Control Predicted Traffic Speed (mph)
3D vehicle dynamics
§ Traffic Flow § Vehicle Velocity
Large-scale traffic on Michigan road network
Safety Drive Experience Ride Comfort
Ex: Driver Assist Technology Ex: Configurable seats Ex: Semi-Active Dampers
Our AI based approach for Enhanced Ride Comfort Sensing Technology Fusion coupled with AI
Maps/Traffic Road Topology Road Profile Dynamic Localization AI – Machine Learning Safe, Smooth & Comfortable Ride
Pitching – Acceleration/Deceleration Yaw / Roll – Turns & Curved Roads
Image: DSPORT Magazine
GPS OBD Accel/ Gyro Feature Extraction Identify Driver Model Training/Test Drive Mode Calculate G-Force Speed Gyro_Z Predict Turn GPS Heading Polish Features Trained Model
Consumer/Commercial Vehicles Fleet Vehicles Warranty Costs as a Percentage of Annual Sales
Proactive and predictive maintenance approach are needed to minimize warranty and service related expense for next generation mobility: ‒ Reactive maintenance approach no longer relevant/applicable in this landscape ‒ Need Proactive and Predictive maintenance ‒ Use-case of a shock absorber to emphasize the predictive maintenance benefits for reducing warranty costs
Source: ELEMENT Source: WarrantyWeek
Potential Reduction in Component Life
Background and Value
v Market projections $7.74B by 2020 v Effective distraction monitoring v Remote health monitoring v Estimate driver fatigue level
Requirements and Challenges Our Key Differentiation
ü Breath Alcohol Detection ü Facial state recognition ü Fusion of physiological sensors and vision system ü On-going field trials in the US
Before Driving – Breath Alcohol Detection During Driving – Monitor Psychophysiological State
Drunk Driving Accounts for 30% of Total Deaths in USA ü Multi-gas Sensor ü 3X More Accurate ü Facial Recognition ü Abuse Prevention Features – Anywhere, Anytime, and Easy Measurement . Humidity and Multi-gas Sensor distinguish human breathe from artificial gas
6月1日 8: 30 2. 45 ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ○ 6月2日 8: 31 2. 14 ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ○ 6月3日 8: 32 1. 58 ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ○ 6月4日 8: 33 2. 16 ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ○ 6月5日 8: 34 2. 45 ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ○ 6月6日 8: 35 2. 14 ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ○ 6月7日 8: 36 1. 58 ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ○ 6月8日 8: 37 2. 16 ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ○ 6月9日 8: 38 2. 45 ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ○ 6月10日 8: 39 2. 14 ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ○ 6月11日 8: 40 1. 58 ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ○ 6月12日 8: 41 2. 16 ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ○ 6月13日 8: 42 2. 16 ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ○ 6月14日 8: 43 2. 16 ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ・ ○Data log sheet
A Driver Management System Could Improve Business Efficiency Especially for Transport Industry Utilizing Breathe Alcohol Detection System
In-vehicle sensor fusion Cloud Platform Real-Time Data Usage by Service Provider Current System Architecture
Camera
Pulse Sensor Breathing Sensor
Experimental Setup Real-Time Pulse & Respiration Monitoring Real-Time Driver’s Facial State Monitoring System Sample Experimental Results of Subjects Heart and Respiration Rate
107 YEARS
INDUSTRIAL CONSUMER BUSINESS CITY
57 YEARS
APPLICATIONS ANALYTICS INFRASTRUCTURE BIG DATA CLOUD
Is in our DNA
OT asset IT asset
Human data Business data
Edge AI/Analytics Studio Core Foundry
Leap-frogging competitors through collaborative co-creation Embed Hitachi’s IT x OT Experience OT x Market Disruption
Machine data
Connectivity Security
Unparalleled OT + IT + IoT Expertise Social Innovation Flexible Business Models
Accelerates time to value Solutions that benefit business and society Focused on delivering value