EBSCO Logo
Connecting you to content on EBSCOhost
Results
Title

Proximal policy optimization learning based control of congested freeway traffic.

Authors

Mo, Shurong; Wu, Nailong; Qi, Jie; Pan, Anqi; Feng, Zhiguang; Yan, Huaicheng; Wang, Yueying

Abstract

In this paper, a delay compensation feedback controller based on reinforcement learning is proposed to adjust the time interval of the adaptive cruise control (ACC) vehicle agents in the traffic congestion by introducing the proximal policy optimization (PPO) scheme. The high‐speed traffic flow is characterized by a two‐by‐two Aw Rasle Zhang nonlinear first‐order partial differential equations (PDEs). Unlike the backstepping delay compensation control,23 the PPO controller proposed in this paper consists of the current traffic flow velocity, the current traffic flow density and the previous one step control input. Since the system dynamics of the traffic flow are difficult to be expressed mathematically, the control gains of the three feedback can be determined via learning from the interaction between the PPO and the digital simulator of the traffic system. The performance of Lyapunov control, backstepping control and PPO control are compared with numerical simulation. The results demonstrate that PPO control is superior to Lyapunov control in terms of the convergence rate and control efforts for the traffic system without delay. As for the traffic system with unstable input delay value, the performance of PPO controller is also equivalent to that of backstepping controller. Besides, PPO is more robust than backstepping controller when the parameter is sensitive to Gaussian noise.

Subjects

TRAFFIC flow; BACKSTEPPING control method; TRAFFIC congestion; ADAPTIVE control systems; TRAFFIC density; PARTIAL differential equations

Publication

Optimal Control - Applications & Methods, 2024, Vol 45, Issue 2, p719

ISSN

0143-2087

Publication type

Academic Journal

DOI

10.1002/oca.3068

EBSCO Connect | Privacy policy | Terms of use | Copyright | Manage my cookies
Journals | Subjects | Sitemap
© 2025 EBSCO Industries, Inc. All rights reserved