We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
End-to-end active non-cooperative target tracking of free-floating space manipulators.
- Authors
Lei, Wenxiao; Sun, Guanghui
- Abstract
Active non-cooperative target tracking is an important ability for free-floating space manipulator (FFSM) systems. Aiming at the difficulty of pose and posture estimation of non-cooperative targets and the complexity of FFSM planning and control, the paper proposed an end-to-end target tracking algorithm using deep reinforcement learning (DRL) algorithm. The algorithm uses raw camera images as input and directly outputs the manipulator joint velocities. To deal with the partially observable Markov decision processes (POMDP) problem caused by single image input, we combine the soft actor–critic algorithm with recurrent neural networks. Therefore, the velocity information of the target is introduced to transform the task into a fully observable Markov decision-making process (MDP). Our approach is completely data-driven. It avoids the position and posture estimation of non-cooperative target and the complex modeling motion planning process of FFSM. We trained and tested the algorithm by building a simulation environment in CoppeliaSim. The results showed that our approach achieved good results in active non-cooperative target tracking of FFSM systems and demonstrated the great potential of DRL algorithms in solving space tasks.
- Subjects
PARTIALLY observable Markov decision processes; RECURRENT neural networks; REINFORCEMENT learning; DEEP reinforcement learning; ARTIFICIAL satellite tracking; TRACKING algorithms
- Publication
Transactions of the Institute of Measurement & Control, 2024, Vol 46, Issue 2, p379
- ISSN
0142-3312
- Publication type
Article
- DOI
10.1177/01423312231177778