We found a match
Your institution may have rights to this item. Sign in to continue.
- Title
Virtual View Generation Based on 3D-Dense-Attentive GAN Networks.
- Authors
Fu, Junwei; Liang, Jun
- Abstract
A binocular vision system is a common perception component of an intelligent vehicle. Benefiting from the biomimetic structure, the system is simple and effective. Which are extremely snesitive on external factors, especially missing vision signals. In this paper, a virtual view-generation algorithm based on generative adversarial networks (GAN) is proposed to enhance the robustness of binocular vision systems. The proposed model consists of two parts: generative network and discriminator network. To improve the quality of a virtual view, a generative network structure based on 3D convolutional neural networks (3D-CNN) and attentive mechanisms is introduced to extract the time-series features from image sequences. To avoid gradient vanish during training, the dense block structure is utilized to improve the discriminator network. Meanwhile, three kinds of image features, including image edge, depth map and optical flow are extracted to constrain the supervised training of model. The final results on KITTI and Cityscapes datasets demonstrate that our algorithm outperforms conventional methods, and the missing vision signal can be replaced by a generated virtual view.
- Subjects
ARTIFICIAL neural networks; BINOCULAR vision; BIONICS; ALGORITHMS; INTELLIGENT transportation systems; FEATURE extraction
- Publication
Sensors (14248220), 2019, Vol 19, Issue 2, p344
- ISSN
1424-8220
- Publication type
Article
- DOI
10.3390/s19020344