We found a match
Your institution may have rights to this item. Sign in to continue.
- Title
Mammalian-brain-inspired neuromorphic motion-cognition nerve achieves cross-modal perceptual enhancement.
- Authors
Jiang, Chengpeng; Liu, Jiaqi; Ni, Yao; Qu, Shangda; Liu, Lu; Li, Yue; Yang, Lu; Xu, Wentao
- Abstract
Perceptual enhancement of neural and behavioral response due to combinations of multisensory stimuli are found in many animal species across different sensory modalities. By mimicking the multisensory integration of ocular-vestibular cues for enhanced spatial perception in macaques, a bioinspired motion-cognition nerve based on a flexible multisensory neuromorphic device is demonstrated. A fast, scalable and solution-processed fabrication strategy is developed to prepare a nanoparticle-doped two-dimensional (2D)-nanoflake thin film, exhibiting superior electrostatic gating capability and charge-carrier mobility. The multi-input neuromorphic device fabricated using this thin film shows history-dependent plasticity, stable linear modulation, and spatiotemporal integration capability. These characteristics ensure parallel, efficient processing of bimodal motion signals encoded as spikes and assigned with different perceptual weights. Motion-cognition function is realized by classifying the motion types using mean firing rates of encoded spikes and postsynaptic current of the device. Demonstrations of recognition of human activity types and drone flight modes reveal that the motion-cognition performance match the bio-plausible principles of perceptual enhancement by multisensory integration. Our system can be potentially applied in sensory robotics and smart wearables. Inspired by the multisensory cue integration in macaque's brain for spatial perception, the authors develop a neuromorphic motion-cognition nerve that achieves cross-modal perceptual enhancement for robotics and wearable applications.
- Subjects
HUMAN activity recognition; SPACE perception; NERVES; ANIMAL species; THIN films
- Publication
Nature Communications, 2023, Vol 14, Issue 1, p1
- ISSN
2041-1723
- Publication type
Article
- DOI
10.1038/s41467-023-36935-w