We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Multi-Sensor Data Fusion Method Based on Self-Attention Mechanism.
- Authors
Lin, Xuezhu; Chao, Shihan; Yan, Dongming; Guo, Lili; Liu, Yue; Li, Lijuan
- Abstract
Featured Application: The proposed multi-sensor data fusion method utilizes the self-attention mechanism in CNN-SA networks to enhance data integrity and accuracy, and it has potential applications in various fields where accurate and reliable multi-sensor data fusion is required. In 3D reconstruction tasks, single-sensor data fusion based on deep learning is limited by the integrity and accuracy of the data, which reduces the accuracy and reliability of the fusion results. To address this issue, this study proposes a multi-sensor data fusion method based on a self-attention mechanism. A multi-sensor data fusion model for acquiring multi-source and multi-modal data is constructed, with the core component being a convolutional neural network with self-attention (CNN-SA), which employs CNNs to process multi-source and multi-modal data by extracting their features. Additionally, it introduces an SA mechanism to weigh and sum the features of different modalities, adaptively focusing on the importance of different modal data. This enables mutual support, complementarity, and correction among the multi-modal data. Experimental results demonstrate that the accuracy of the CNN-SA network is improved by 72.6%, surpassing the improvements of 29.9% for CNN-CBAM, 23.6% for CNN, and 11.4% for CNN-LSTM, exhibiting enhanced generalization capability, accuracy, and robustness. The proposed approach will contribute to the effectiveness of multi-sensor data fusion processing.
- Subjects
MULTISENSOR data fusion; CABLE News Network; DEEP learning; CONVOLUTIONAL neural networks; DATA integrity; ELECTRONIC data processing
- Publication
Applied Sciences (2076-3417), 2023, Vol 13, Issue 21, p11992
- ISSN
2076-3417
- Publication type
Article
- DOI
10.3390/app132111992