We found a match
Your institution may have access to this item. Find your institution then sign in to continue.
- Title
Few-shot object detection based on self-supervised feature pyramid network.
- Authors
Lv, Wen; Qi, Xinwei; Shi, Hongbo; Tan, Shuai; Song, Bing; Tao, Yang
- Abstract
In few-shot object detection, the limited amount of labeled data fails to adequately represent all possible scenarios and objects. This limitation leads to the model's inability to fully learn the features and attributes of novel classes. In some cases, novel classes may be confused with base classes due to feature similarity, resulting in inaccurate detection results. During the two-stage fine-tuning phase, when there is a significant difference between the novel class and the base class data, the candidate boxes generated by the backbone network trained on the base class may not be suitable for the novel class targets. Therefore, it is a forward-looking research problem to explore how to mine novel class knowledge during the feature extraction process to supplement the disadvantage of having limited feature samples and improve the sensitivity in recognizing novel classes. To enrich the feature representation of novel classes, we propose a self-supervised feature pyramid network. This approach explores novel class attributes in the lower-level network, thereby encouraging the feature extractor to generate candidate boxes that are consistent with the novel class targets. The goal is to enhance the sensitivity of the backbone network in recognizing novel classes. We validate the effectiveness of our proposed framework by comparing it with state-of-the-art methods on two popular datasets and achieve an improvement of up to +5.2% on the standard PASCAL VOC benchmark and a 1.4% boost on the challenging COCO benchmark.
- Subjects
SPINE; FEATURE extraction; OBJECT tracking (Computer vision)
- Publication
Journal of Electronic Imaging, 2024, Vol 33, Issue 2, p23021
- ISSN
1017-9909
- Publication type
Article
- DOI
10.1117/1.JEI.33.2.023021