We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Continuous digital zooming using generative adversarial networks for dual camera system.
- Authors
Yang, Yifan; Li, Qi; Yu, Yongyi; He, Zhuang; Feng, Huajun; Xu, Zhihai; Chen, Yueting
- Abstract
This paper presents a generative adversarial network (GAN) with patch match algorithm to realize a high‐quality digital zooming using two camera modules with different focal lengths. In dual camera system, shorter focal length module produces the wide‐view image with the low resolution. On the other hand, the longer focal length module produces the tele‐view image via optical zooming. The long‐focal image contains more details than short‐focal image and can be used to guide short‐focal image to reconstruct high frequency part. Firstly, a feature extraction block (FEB) is advanced to extract feature of long‐focal image and short focal‐image to reconstruct a wide‐view image with different resolutions. Next, a patch match algorithm is integrated into convolution neural networks (CNN) to fuse information of long‐focal with short‐focal image and generate a new fused image. Finally, the fused image and short‐focal image are merged with a feature fusion block (FFB) to predict high‐resolution images. In addition, generative adversarial networks are used for filtering information integrated by previous network and output the zoomed image. Extensive experiments on benchmark datasets show that our algorithm achieves favorable performance against state‐of‐the‐art methods.
- Subjects
GENERATIVE adversarial networks; ARTIFICIAL neural networks; IMAGE processing; IMAGING systems; CAMERAS
- Publication
IET Image Processing (Wiley-Blackwell), 2021, Vol 15, Issue 12, p2880
- ISSN
1751-9659
- Publication type
Article
- DOI
10.1049/ipr2.12274