We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Cross-Modal Transfer Learning From EEG to Functional Near-Infrared Spectroscopy for Classification Task in Brain-Computer Interface System.
- Authors
Wang, Yuqing; Yang, Zhiqiang; Ji, Hongfei; Li, Jie; Liu, Lingyu; Zhuang, Jie
- Abstract
The brain-computer interface (BCI) based on functional near-infrared spectroscopy (fNIRS) has received more and more attention due to its vast application potential in emotion recognition. However, the relatively insufficient investigation of the feature extraction algorithms limits its use in practice. In this article, to improve the performance of fNIRS-based BCI, we proposed a method named R-CSP-E, which introduces EEG signals when computing fNIRS signals' features based on transfer learning and ensemble learning theory. In detail, we used the Independent Component Analysis (ICA) algorithm for the correspondence between the sources of the two signals. We then introduced the EEG signals when computing the spatial filter based on a modified Common Spatial Pattern (CSP) algorithm. Experimental results on public datasets show that the proposed method in this paper outperforms traditional methods without transfer. In general, the mean classification accuracy can be increased by up to 5%. To our knowledge, it is an innovation that we tried to apply transfer learning between EEG and fNIRS. Our study's findings not only prove the potential of the transfer learning algorithm in cross-model brain-computer interface, but also offer a new and innovative perspective to research the hybrid brain-computer interface.
- Subjects
BRAIN-computer interfaces; NEAR infrared spectroscopy; INDEPENDENT component analysis; ELECTROENCEPHALOGRAPHY; EMOTION recognition; LEARNING theories in education; SPATIAL filters; MOTOR imagery (Cognition)
- Publication
Frontiers in Psychology, 2022, Vol 13, p1
- ISSN
1664-1078
- Publication type
Article
- DOI
10.3389/fpsyg.2022.833007