We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Memory‐based deep reinforcement learning for cognitive radar target tracking waveform resource management.
- Authors
Qin, Jiahao; Zhu, Mengtao; Pan, Zesi; Li, Yunjie; Li, Yan
- Abstract
A cognitive radar (CR) system can offer enhanced target tracking performance due to its intelligence on the perception‐action cycle, wherein a CR adaptively allocates the limited transmitting resources based on its perception of surrounding environments. To effectively manage the transmit waveform resource for the target tracking task, CR resource management problem is formulated under the partially observable Markov decision process framework. The sequential decision‐making and the inherent partial observability for target tracking problem are considered. In the proposed method, a long short‐term memory (LSTM)‐based twin delayed deep deterministic policy gradient (TD3) algorithm is developed to effectively solve the problem. A reward function is designed considering Haykin's cognitive executive attention mechanism for radar systems such that the CR resource management policy has stability in the decision of transmit waveform, which follows the principle of minimum disturbance. Simulation results demonstrate the superiority of the proposed LSTM memory‐based TD3 with improved target tracking performance and increased mean rewards for CR.
- Subjects
DEEP reinforcement learning; REINFORCEMENT learning; RADAR targets; MIMO radar; PARTIALLY observable Markov decision processes; COGNITIVE learning; TRACKING radar
- Publication
IET Radar, Sonar & Navigation (Wiley-Blackwell), 2023, Vol 17, Issue 12, p1822
- ISSN
1751-8784
- Publication type
Article
- DOI
10.1049/rsn2.12469