TRB Pubsindex
Text Size:

Title:

Deep Reinforcement Learning Agent with Varying Actions Strategy for Solving the Eco-Approach and Departure Problem at Signalized Intersections

Accession Number:

01744819

Record Type:

Component

Availability:

Find a library where document is available


Order URL: http://worldcat.org/issn/03611981

Abstract:

Eco-approach and departure is a complex control problem wherein a driver’s actions are guided over a period of time or distance so as to optimize fuel consumption. Reinforcement learning (RL) is a machine learning paradigm that mimics human learning behavior, in which an agent attempts to solve a given control problem by interacting with the environment and developing an optimal policy. Unlike the methods implemented in previous studies for solving the eco-driving problem, RL does not require prior knowledge of the environment to be learned and processed. This paper develops a deep reinforcement learning (DRL) agent for solving the eco-approach and departure problem in the vicinity of signalized intersections for minimization of fuel consumption. The DRL algorithm utilizes a deep neural network for the RL. Novel strategies such as varying actions, prioritized experience replay, target network, and double learning were implemented to overcome the expected instabilities during the training process. The results revealed the significance of the DRL algorithm in reducing fuel consumption. Interestingly, the DRL algorithm was able to successfully learn the environment and guide vehicles through the intersection without red light running violation. On average, the DRL provided fuel savings of about 13.02% with no red light running violations.

Supplemental Notes:

© National Academy of Sciences: Transportation Research Board 2020.

Language:

English

Authors:

Mousa, Saleh R
Ishak, Sherif
Mousa, Ragab M
Codjoe, Julius
Elhenawy, Mohammed

Pagination:

pp 119-131

Publication Date:

2020-8

Serial:

Transportation Research Record: Journal of the Transportation Research Board

Volume: 2674
Issue Number: 8
Publisher: Sage Publications, Incorporated
ISSN: 0361-1981
EISSN: 2169-4052
Serial URL: http://journals.sagepub.com/home/trr

Media Type:

Web

Features:

References (25)

Subject Areas:

Data and Information Technology; Energy; Environment; Highways; Operations and Traffic Management; Safety and Human Factors

Files:

TRIS, TRB, ATRI

Created Date:

Jul 5 2020 3:03PM