We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
An Efficient Cross-Modal Privacy-Preserving Image–Text Retrieval Scheme.
- Authors
Zhang, Kejun; Xu, Shaofei; Song, Yutuo; Xu, Yuwei; Li, Pengcheng; Yang, Xiang; Zou, Bing; Wang, Wenbin
- Abstract
Preserving the privacy of the ever-increasing multimedia data on the cloud while providing accurate and fast retrieval services has become a hot topic in information security. However, existing relevant schemes still have significant room for improvement in accuracy and speed. Therefore, this paper proposes a privacy-preserving image–text retrieval scheme called PITR. To enhance model performance with minimal parameter training, we freeze all parameters of a multimodal pre-trained model and incorporate trainable modules along with either a general adapter or a specialized adapter, which are used to enhance the model's ability to perform zero-shot image classification and cross-modal retrieval in general or specialized datasets, respectively. To preserve the privacy of outsourced data on the cloud and the privacy of the user's retrieval process, we employ asymmetric scalar-product-preserving encryption technology suitable for inner product calculation, and we employ distributed index storage technology and construct a two-level security model. We construct a hierarchical index structure to speed up query matching among massive high-dimensional index vectors. Experimental results demonstrate that our scheme can provide users with secure, accurate, fast cross-modal retrieval service while preserving data privacy.
- Subjects
DATA privacy; IMAGE recognition (Computer vision); PRIVACY; SPEED; STORAGE
- Publication
Symmetry (20738994), 2024, Vol 16, Issue 8, p1084
- ISSN
2073-8994
- Publication type
Article
- DOI
10.3390/sym16081084