Vehicle Velocity Prediction Using Artificial Neural Networks and - - PowerPoint PPT Presentation
Vehicle Velocity Prediction Using Artificial Neural Networks and - - PowerPoint PPT Presentation
21-23 20 Vehicle Velocity Prediction Using Artificial Neural Networks and Effect of Real-World Signals on Prediction Window Tushar D. Gaikwad , Zachary D. Asher, Aaron Rabinowitz, Farhang Motallebiaraghi, Thomas Bradley, Alvis Fong, Rick Meyer
2020-01-0729 2
Special Thanks
- Dr. Thomas H. Bradley
2020-01-0729 3
Special Thanks
This material is based upon work supported by the U.S. Department of Energy’s Office of Energy Efficiency and Renewable Energy (EERE). The specific organization overseeing this report is the Vehicle Technologies Office under award number DE-EE0008468.
Conclusions Results Methods Introduction
Agenda:
Introduction/Background Drive Cycle Development LSTM Assessment methods Effect of different signals Summary Results Future Goal
2020-01-0729 4
Conclusions Results Methods Introduction Intelligent Transportation Systems(ITS)
- The shift that we are witnessing toward
Intelligent Transportation Systems(ITS), will be the most disruptive since the Initial days
- f automobiles.
- It has potential to completely transform the
movement of people and goods, enabling safer and smarter transportation.
- ITS consists of several technologies such as
Advanced Driver Assistance System(ADAS), Automated Driving Functions(ADF), Vehicle to Vehicle(V2V) and Vehicle to Infrastructure(V2I) communication.
2020-01-0729 5
Conclusions Results Methods Introduction
Use of Autonomous Vehicles
- Autonomous vehicle technology is the key
to improve driver and passenger safety.
- Control strategies and AI software that
powers it are some of the most critical components.
- Increase
in computational capabilities, enable to train complex and deep neural networks
2020-01-0729 6
Conclusions Results Methods Introduction
Motivation for velocity prediction
Fuel economy strategy:
Optimal Energy Management Systems Ego Vehicle velocity Predictions determines the constraints of the energy optimization problem to increase fuel economy
[Gaikwad, Tushar D., Zachary D. Asher, Kuan Liu, Mike Huang, and Ilya
- Kolmanovsky. Vehicle Velocity Prediction and Energy Management
Strategy Part 2: Integration of Machine Learning Vehicle Velocity Prediction with Optimal Energy Management to Improve Fuel Economy.
- No. 2019-01-1212. SAE Technical Paper, 2019.]
Safety improvement strategy:
Collision Risk Estimator Ego Vehicle velocity Predictions can be integrated into collision risk estimators thereby helping drivers avoid accidents.
[Phillips, Derek J., Real-time Prediction of Automotive Collision Risk from Monocular Video (2019)]
2020-01-0729 7
Conclusions Results Methods Introduction
2020-01-0729 8
Novel Contribution
- Use of different real-world signals in groups to estimate effect on prediction.
- Understanding effects of different inputs in LSTM for varied prediction window.
- Use of two assessment methods to understand results.
Conclusions Results Methods Introduction
2020-01-0729 9
Vehicle Velocity Prediction Strategy
- Drive Input
- Deep Learning and Machine Learning Models
- Prediction Window
- Assessment
LSTM
Model
Conclusions Results Methods Introduction
2020-01-0729 10
Drive Cycle Development and Signal Recording
- Collected in August 2019 at Fort Collins, Colorado.
- Dataset from repeated drives collected along a fixed route by the same driver.
- Route Details
1. Parking Lot 2. West on Mulberry until Shields 3. South on Shields until Prospect 4. East on Prospect until College 5. North on College until Mulberry 6. West on Mulberry until Parking Lot 7. Parking Lot
Conclusions Results Methods Introduction
2020-01-0729 11
Data Collection
- Autonomous
driver assistance system (ADAS) data for the vehicle forward cone from smart radar.
- Vehicle to infrastructure (V2I) data in the form
- f traffic signal information and segment
travel times.
- EGO Vehicle Parameters using Freematics
logger.
- Sr. No.
Parameters 1 Time 2 Latitude 3 Longitude 4 Distance 5 Brake Pedal Position 6 Transmission Gear 7 Engine Speed 8 Max Torque 9 Min Torque 10 Engine Torque 11 Turn Signal 12 Vehicle Speed 13 Acceleration Longitude 14 Acceleration Latitude 15 Yaw Rate 16 Altitude 17 SPaT 18 Segment Speed 19 ADAS
Conclusions Results Methods Introduction
2020-01-0729 12
Recorded Signals Velocity on the Longitude vs Latitude vs time Radar Object Detections immediately in front.
Conclusions Results Methods Introduction
2020-01-0729 13
Recorded Signals Velocity vs Time for one drive instance. Velocity on the map Terrain
Conclusions Results Methods Introduction
2020-01-0729 14
LSTM(Long Short-term memory)
- Special type of Recurrent Neural Network
(RNN)
- A typical LSTM unit is composed of a cell, an
input gate, an output gate, and a forget gate
- The cell remembers values and the three
gates regulate the flow of information into and out of the cell.
- Forget Gate: Decides what information to
discard from the cell.
- Input Gate: Decides which values from the
input to update the memory state.
- Output Gate: Decides what to output based
- n input and the memory of the cell
Conclusions Results Methods Introduction
2019-01-1212 15
Assessment methods
Conclusions Results Methods Introduction
2019-01-1212 16
Assessment methods
- MAE = 1.6763 m/s
- Time Shift = 0 Seconds
Increase in MAE
- MAE = 1.6763 m/s
- Time Shift = 10 Seconds
Increase in MAE and Time shift
Conclusions Results Methods Introduction
2019-01-1212 17
Assessment methods
- MAE = 4.3901 m/s
- Time Shift = 10 Seconds
Conclusions Results Methods Introduction
2019-01-1212 18
Effect of Different Signals on Prediction
Data Group A Current Velocity GPS Data Group B Current Velocity GPS Previous 5 Seconds EGO and Engine Parameters Data Group C Current Velocity GPS Previous 5 Seconds EGO and Engine Parameters Radar Data Data Group D Current Velocity GPS Previous 5 Seconds EGO and Engine Parameters SPat Data Group E Current Velocity GPS Previous 5 Seconds EGO and Engine Parameters SPat Segment Speed
Group A Group B Group B Group D
Data Group F Current Velocity GPS Previous 5 Seconds EGO and Engine Parameters SPat Segment Speed Radar Data Group G Current Velocity GPS Previous 5 Seconds EGO and Engine Parameters Segment Speed
Group E Group B
Conclusions Results Methods Introduction
2019-01-1212 19
Effect of Different Signals on Prediction
Conclusions Results Methods Introduction
2019-01-1212 20
Effect of Different Signals on Prediction
Conclusions Results Methods Introduction
2019-01-1212 21
Effect of Different Signals on Prediction
Prediction with Group D Prediction with Group E
Conclusions Results Methods Introduction
2019-01-1212 22
Effect of Different Signals on Prediction Window
Conclusions Results Methods Introduction
2019-01-1212 23
Forward Prediction Window Prediction for every second shown for Every 10 second interval
Conclusions Results Methods Introduction
2019-01-1212 24
Forward Prediction Window Prediction for every second shown for Every 10 second interval
Conclusions Results Methods Introduction
2019-01-1212 25
Group D LSTM 10 second prediction MAE and Time Shift MAE = 1.78 m/s Time Shift =2.35 LSTM
Model
Summary
- Autonomous vehicles is the key to move towards ITS
- It uses AI to power different strategies to enable safer and smarter transportation.
- Velocity prediction is very important to develop those strategies.
Conclusions Results Methods Introduction
- For Evaluating Results its better to use MAE along with time shift.
- Dataset with SPaT data performs better in terms of getting accurate results
- LSTM performs the best in terms of MAE, which is 1.78m/s, at prediction window of 10
seconds.
- Increase in Prediction Window Increases MAE and Time shift in case of ANN.
2019-01-1212 26
Conclusion
- Study with More drive cycle on different types of roads
- Inclusion of V2V data and Camera data
- More V2I data.
- Implementation of trained model on NVIDIA drive PX2 to test prediction accuracy on the road.
Future Work
2019-01-1212 27