We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Cross-Media Retrieval Based on Two-Level Similarity and Collaborative Representation.
- Authors
Jiahua Zhang
- Abstract
In the exploration of cross-media retrieval encompassing images and text, an advanced method incorporating two-level similarity and collaborative representation (TLSCR) is presented. Initially, two sub-networks were designed to handle both global and local features, facilitating enhanced semantic associations between images and textual content. Whole images, along with regional image sectors, served as representations for images, while textual content was depicted both through complete sentences and select keywords. An innovative two-level alignment approach was introduced to segregate and then amalgamate the global and local depictions of paired images and texts. Subsequently, employing collaborative representation (CR) technology, each experimental image was collaboratively reconstructed by utilising the entirety of the training images, and every experimental text by incorporating all the training texts. The collaborative coefficients derived were subsequently employed as congruent dimensional representations for both images and texts. Upon completion of these operations, cross-media retrieval between the two modalities was conducted. Experimental outcomes on datasets like Wikipedia and Pascal Sentence confirm the superior precision of the proposed method, surpassing conventional cross-media retrieval methodologies.
- Subjects
WIKIPEDIA; IMAGE representation; IMAGE retrieval; PAIRED comparisons (Mathematics)
- Publication
Traitement du Signal, 2023, Vol 40, Issue 5, p2161
- ISSN
0765-0019
- Publication type
Article
- DOI
10.18280/ts.400533