We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Q-learning-based simulated annealing algorithm for constrained engineering design problems.
- Authors
Samma, Hussein; Mohamad-Saleh, Junita; Suandi, Shahrel Azmin; Lahasan, Badr
- Abstract
Simulated annealing (SA) was recognized as an effective local search optimizer, and it showed a great success in many real-world optimization problems. However, it has slow convergence rate and its performance is widely affected by the settings of its parameters, namely the annealing factor and the mutation rate. To mitigate these limitations, this study presents an enhanced optimizer that integrates Q-learning algorithm with SA in a single optimization model, named QLSA. In particular, the Q-learning algorithm is embedded into SA to enhance its performances by controlling its parameters adaptively at run time. The main characteristics of Q-learning are that it applies reward/penalty technique to keep track of the best performing values of these parameters, i.e., annealing factor and the mutation rate. To evaluate the effectiveness of the proposed QLSA algorithm, a total of seven constrained engineering design problems were used in this study. The outcomes show that QLSA was able to report a mean fitness value of 1.33 on cantilever beam design, 263.60 on three-bar truss design, 1.72 on welded beam design, 5905.42 on pressure vessel design, 0.0126 on compression coil spring design, 0.25 on multiple disk clutch brake design, and 2994.47 on speed reducer design problem. Further analysis was conducted by comparing QLSA with the state-of-the-art population optimization algorithms including PSO, GWO, CLPSO, harmony, and ABC. The reported results show that QLSA significantly (i.e., 95% confidence level) outperforms other studied algorithms.
- Subjects
ENGINEERING design; REINFORCEMENT learning; SIMULATED annealing; SPEED reducers; PRESSURE vessels; BRAKE design &; construction; CANTILEVERS; PROCESS optimization
- Publication
Neural Computing & Applications, 2020, Vol 32, Issue 9, p5147
- ISSN
0941-0643
- Publication type
Article
- DOI
10.1007/s00521-019-04008-z