We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Curiosity model policy optimization for robotic manipulator tracking control with input saturation in uncertain environment.
- Authors
Tu Wang; Fujie Wang; Zhongye Xie; Feiyan Qin
- Abstract
In uncertain environments with robot input saturation, both model-based reinforcement learning (MBRL) and traditional controllers struggle to perform control tasks optimally. In this study, an algorithmic framework of Curiosity Model Policy Optimization (CMPO) is proposed by combining curiosity and model-based approach, where tracking errors are reduced via training agents on control gains for traditional model-free controllers. To begin with, a metric for judging positive and negative curiosity is proposed. Constrained optimization is employed to update the curiosity ratio, which improves the efficiency of agent training. Next, the novelty distance buffer ratio is defined to reduce bias between the environment and the model. Finally, CMPO is simulated with traditional controllers and baseline MBRL algorithms in the robotic environment designed with non-linear rewards. The experimental results illustrate that the algorithm achieves superior tracking performance and generalization capabilities.
- Subjects
CURIOSITY; REINFORCEMENT learning; CONSTRAINED optimization; MANIPULATORS (Machinery); ROBOTICS
- Publication
Frontiers in Neurorobotics, 2024, p1
- ISSN
1662-5218
- Publication type
Article
- DOI
10.3389/fnbot.2024.1376215