Document Type
Article
Publication Date
2024
DOI
10.1016/j.trc.2024.104703
Publication Title
Transportation Research Part C: Emerging Technologies
Volume
165
Pages
104703 (1-19)
Abstract
In a lane change (LC) scenario, the lane change vehicle interacts with surrounding vehicles. The interactions not only affect their driving behaviors but also influence the traffic flow. This study aims to model the coupled behavior of the lane changer and the follower in the target lane during LC. Large-scale real-world connected vehicle (CV) data from the Safety Pilot Model Deployment (SPMD) program are used to extract LCs and study vehicle interactions. A multi-agent Transformer-based deep deterministic policy gradient (MA-TDDPG) method is proposed to model the coupled behaviors during LC. The multi-agent framework can handle the multiple agents’ behaviors with interactions, and the Transformer can process the observation-action memory accurately and efficiently. The MA-TDDPG algorithm can learn the sequential decision-making process over continuous action space during LC with the accommodation of the multi-vehicle interaction and the driver’s memory effect. Compared to traditional supervised learning and reinforcement learning methods, it demonstrates superior performance in imitating the longitudinal and lateral actions of the lane changer and the follower. The findings of this study provide insights into the development of microscopic simulations by producing realistic LC behaviors, and assistance/automation LC systems by generating LC motions and responses conforming to human driving habits. The model also creates an interactive simulation environment and lays the foundation for optimizing driving strategies.
Rights
© 2024 The Authors.
This is an open access article under the Creative Commons Attribution 4.0 International (CC BY 4.0) license.
ORCID
0000-0002-8191-2786 (Xie)
Original Publication Citation
Guo, H., Keyvan-Ekbatani, M., & Xie, K. (2024). Modeling coupled driving behavior during lane change: A multi-agent Transformer reinforcement learning approach. Transportation Research Part C: Emerging Technologies, 165, 1-19, Article 104703. https://doi.org/10.1016/j.trc.2024.104703
Repository Citation
Guo, Hongyu; Keyvan-Ekbatani, Mehdi; and Xie, Kun, "Modeling Coupled Driving Behavior During Lane Change: A Multi-Agent Transformer Reinforcement Learning Approach" (2024). Civil & Environmental Engineering Faculty Publications. 114.
https://digitalcommons.odu.edu/cee_fac_pubs/114
Included in
Automotive Engineering Commons, Theory and Algorithms Commons, Transportation Engineering Commons