We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
An improved transformer model with multi-head attention and attention to attention for low-carbon multi-depot vehicle routing problem.
- Authors
Zou, Yang; Wu, Hecheng; Yin, Yunqiang; Dhamotharan, Lalitha; Chen, Daqiang; Tiwari, Aviral Kumar
- Abstract
Low-carbon logistics is an emerging and sustainable development industry in the era of a low-carbon economy. The end-to-end deep reinforcement learning (DRL) method with an encoder-decoder framework has been proven effective for solving logistics problems. However, in most cases, the recurrent neural networks (RNN) and attention mechanisms are used in encoders and decoders, which may result in the long-distance dependence problem and the neglect of the correlation between query vectors. To surround this problem, we propose an improved transformer model (TAOA) with both multi-head attention mechanism (MHA) and attention to attention mechanism (AOA), and apply it to solve the low-carbon multi-depot vehicle routing problem (MDVRP). In this model, the MHA and AOA are implemented to solve the probability of route nodes in the encoder and decoder. The MHA is used to process different parts of the input sequence, which can be calculated in parallel, and the AOA is used to deal with the deficiency problem of correlation between query results and query vectors in the MHA. The actor-critic framework based on strategy gradient is constructed to train model parameters. The 2opt operator is further used to optimize the resulting routes. Finally, extensive numerical studies are carried out to verify the effectiveness and operation efficiency of the proposed TAOA, and the results show that the proposed TAOA performs better in solving the MDVRP than the traditional transformer model (Kools), genetic algorithm (GA), and Google OR-Tools (Ortools).
- Subjects
REINFORCEMENT learning; DEEP reinforcement learning; MACHINE learning; VEHICLE routing problem; RECURRENT neural networks
- Publication
Annals of Operations Research, 2024, Vol 339, Issue 1/2, p517
- ISSN
0254-5330
- Publication type
Article
- DOI
10.1007/s10479-022-04788-z