We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Cross‐modal semantic correlation learning by Bi‐CNN network.
- Authors
Wang, Chaoyi; Li, Liang; Yan, Chenggang; Wang, Zhan; Sun, Yaoqi; Zhang, Jiyong
- Abstract
Cross modal retrieval can retrieve images through a text query and vice versa. In recent years, cross modal retrieval has attracted extensive attention. The purpose of most now available cross modal retrieval methods is to find a common subspace and maximize the different modal correlation. To generate specific representations consistent with cross modal tasks, this paper proposes a novel cross modal retrieval framework, which integrates feature learning and latent space embedding. In detail, we proposed a deep CNN and a shallow CNN to extract the feature of the samples. The deep CNN is used to extract the representation of images, and the shallow CNN uses a multi‐dimensional kernel to extract multi‐level semantic representation of text. Meanwhile, we enhance the semantic manifold by constructing cross modal ranking and within‐modal discriminant loss to improve the division of semantic representation. Moreover, the most representative samples are selected by using online sampling strategy, so that the approach can be implemented on a large‐scale data. This approach not only increases the discriminative ability among different categories, but also maximizes the relativity between different modalities. Experiments on three real word datasets show that the proposed method is superior to the popular methods.
- Subjects
SEMANTIC computing; MACHINE learning; INFORMATION retrieval; DATA extraction; DATA analysis
- Publication
IET Image Processing (Wiley-Blackwell), 2021, Vol 15, Issue 14, p3674
- ISSN
1751-9659
- Publication type
Article
- DOI
10.1049/ipr2.12176