|
Title: A Deep-Reinforcement Learning Algorithm for Eco-Driving Control at Signalized Intersections with Prioritized Experience Replay, Target Network, and Double Learning
Accession Number: 01659718
Record Type: Component
Abstract: Eco-driving is a complex control problem where the driver’s actions are guided over a period of time or distance so as to achieve a certain goal such as optimizing fuel consumption. This paper presents an Eco-driving control system, developed to optimize vehicle trajectories near the signalized intersection by minimizing the acceleration noise and reducing stopped delay. The developed system interfaces with non-linear microscopic fuel consumption models. The model also utilizes the Deep Reinforced Learning (DRL) in developing a DRL algorithm using Artificial Neural Network concepts and novel techniques such as prioritized experience replay, target network, and double learning to overcome the expected instabilities during the training process. The developed model was applied to simulate vehicle movements along a 400-control section at a signalized intersection. Simulation was executed in Ptv-Vissim environment where driver’s actions were passed from the model to Vissim via Vissim-Com interface. Simulation results obtained for guided vehicles within the control section were compared with their counterparts of the typical movement without any guidance. Results showed that the estimated fuel consumption for guided case was about 17.5% less than that of the case with no guidance. Furthermore, the estimated acceleration noise for the guided case was less than that of the case with no guidance by about 16.9%. This reduction in fuel consumption and acceleration noise is an indicator for reducing vehicle emissions and improving traffic safety. This finding is considered promising for potential applications of the developed model and further enhancement of its features.
Supplemental Notes: This paper was sponsored by TRB committee ABJ00 Section - Data and Information Systems.
Report/Paper Numbers: 18-06104
Language: English
Authors: Mousa, Saleh RMousa, RagabIshak, SherifPagination: 2p
Publication Date: 2018
Conference:
Transportation Research Board 97th Annual Meeting
Location:
Washington DC, United States Media Type: Digital/other
TRT Terms: Subject Areas: Energy; Environment; Highways; Operations and Traffic Management; Planning and Forecasting
Source Data: Transportation Research Board Annual Meeting 2018 Paper #18-06104
Files: TRIS, TRB, ATRI
Created Date: Jan 8 2018 11:34AM
|