We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Adaptive traffic signal control using deep Q-learning: case study on optimal implementations.
- Authors
Pan, Guangyuan; Muresan, Matthew; Fu, Liping
- Abstract
Deep reinforcement learning has found great successes in addressing many challenging control problems; however, real-world implementations are still scarce if not non-existent. This is primarily due to three main challenges pertaining to the implementation, the stability, the optimal settings, and a lack of knowledge on methods that can be applied to field settings. This research attempts to address these issues with an adaptive simulation-based control framework proposed specifically for the training and evaluation. The control framework has implemented simulation models to conduct an extensive sensitivity analysis on the effects of key design variables, including rewarding schemes, state spaces, and model training parameters. The feasibility of transfer learning as a training strategy is also studied on scenarios with different layouts and different driver behavior models. Complex scenarios are also evaluated and used as test cases, including multiphase ring-and-barrier control and multi-intersection control. The research has contributed a significant amount of evidence on several critical design and implementation-related questions such as input representation, data (technology) requirements, training methods, and model transferability.
- Subjects
TRAFFIC signs &; signals; TRAFFIC engineering; TRAFFIC signal control systems; ADAPTIVE control systems; REINFORCEMENT learning; LEARNING strategies; TRANSFER of training
- Publication
Canadian Journal of Civil Engineering, 2023, Vol 50, Issue 6, p488
- ISSN
0315-1468
- Publication type
Article
- DOI
10.1139/cjce-2022-0273