We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Cross-Viewpoint Template Matching Based on Heterogeneous Feature Alignment and Pixel-Wise Consensus for Air- and Space-Based Platforms.
- Authors
Hui, Tian; Xu, Yuelei; Zhou, Qing; Yuan, Chaofeng; Rasol, Jarhinbek
- Abstract
Template matching is the fundamental task in remote sensing image processing of air- and space-based platforms. Due to the heterogeneous image sources, different scales and different viewpoints, the realization of a general end-to-end matching model is still a challenging task. Considering the abovementioned problems, we propose a cross-view remote sensing image matching method. Firstly, a spatial attention map was proposed to solve the problem of the domain gap. It is produced by two-dimensional Gaussian distribution and eliminates the distance between the distributed heterogeneous features. Secondly, in order to perform matching at different flight altitudes, a multi-scale matching method was proposed to perform matching on three down-sampling scales in turn and confirm the optimal result. Thirdly, to improve the adaptability of the viewpoint changes, a pixel-wise consensus method based on a correlation layer was applied. Finally, we trained the proposed model based on weakly supervised learning, which does not require extensive annotation but only labels one pair of feature points of the template image and search image. The robustness and effectiveness of the proposed methods were demonstrated by evaluation on various datasets. Our method accommodates three types of template matching with different viewpoints, including SAR to RGB, infrared to RGB, and RGB to RGB.
- Subjects
SUPERVISED learning; REMOTE sensing; IMAGE registration; GAUSSIAN distribution; PATTERN matching; PROBLEM solving; IMAGE processing
- Publication
Remote Sensing, 2023, Vol 15, Issue 9, p2426
- ISSN
2072-4292
- Publication type
Article
- DOI
10.3390/rs15092426