We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Generative facial prior embedded degradation adaption network for heterogeneous face hallucination.
- Authors
Wang, Huan; Chi, Jianning; Li, Xiaoqiang; Wu, Chengdong; Wu, Hao
- Abstract
In real-world long-range surveillance systems, thermal face images captured from a distance suffer from low resolution and noise, posing challenges for thermal-to-visible face image translation. Current methods assume similar resolutions and noise-free conditions between thermal and visible images, limiting their applicability. To address these issues, we propose the Generative Facial Prior Embedded Degradation Adaption Network (GDANet), which synthesizes high-quality visible images from low-quality thermal images. GDANet combines pretrained Generative Adversarial Network (GAN) blocks with a U-shaped deep neural network (DNN) to incorporate faithful facial priors, including geometry, facial textures, and colors. Additionally, an unsupervised degradation representation learning scheme is developed to capture abstract degradation representations of degraded thermal images in a representation space. This approach allows GDANet to adapt spatial features based on the degradation representation, striking a balance between fidelity and texture faithfulness using degradation-aware feature fusion (DAFF) blocks. Experimental results demonstrate that GDANet outperforms state-of-the-art methods, showing its effectiveness in handling real-world low-quality thermal images across diverse practical applications.
- Subjects
ARTIFICIAL neural networks; GENERATIVE adversarial networks; THERMOGRAPHY; HALLUCINATIONS; IMAGE representation
- Publication
Multimedia Tools & Applications, 2024, Vol 83, Issue 15, p43955
- ISSN
1380-7501
- Publication type
Article
- DOI
10.1007/s11042-023-16932-3