We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Anti-jamming transmission in softwarization UAV network: a federated deep reinforcement learning approach.
- Authors
Li, Haitao; Lv, Xin; Zhang, Hao; Huang, Jiawei
- Abstract
This paper presents the concept and studies of federated deep reinforcement learning (DRL) based anti-jamming communication in softwarization UAV network (SUNET). First, task-driven SUNET framework is presented and joint beamforming and power control (JBPC) based multidomain anti-jamming model is built to balance the spectrum efficiency (SE) and energy efficiency (EE) of the SUENT. Then a weighted dueling DQN (wDDQN) learning algorithm with upper confidence bound (UCB) action exploration is provided to handle the formulated model. Further, we propose federated wDDQN-UCB (F-wDDQN) based JBPC anti-jamming strategy to tackle the challenge of agent training would consume a large of communication resources, and design the link state aware quantity of service (LSAQ) routing of SUNET to reduce transmission delay of the model parameters during F-wDDQN training. Simulation results validate that the spectrum-energy efficiency and convergence performance achieved by the F-wDDQN based JBPC anti-jamming strategy is superior to existing DRL methods, and the LSAQ routing is benefit to reduce the transmission delay of the F-wDDQN learning strategy and accelerate its convergence.
- Subjects
REINFORCEMENT learning; DEEP reinforcement learning; MACHINE learning; RADAR interference; LEARNING strategies
- Publication
Wireless Networks (10220038), 2024, Vol 30, Issue 2, p923
- ISSN
1022-0038
- Publication type
Article
- DOI
10.1007/s11276-023-03500-8