Multilabel Remote Sensing Image Retrieval Based on Fully Convolutional Network 论文

2020IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing引用 231顶会
Advanced Image and Video Retrieval TechniquesImage Retrieval and Classification TechniquesRemote-Sensing Image Classification

摘要

Conventional remote sensing image retrieval (RSIR) system usually performs single-label retrieval where each image is annotated by a single label representing the most significant semantic content of the image. In this scenario, however, the scene complexity of remote sensing images is ignored, where an image might have multiple classes (i.e., multiple labels), resulting in poor retrieval performance. We therefore propose a novel multilabel RSIR approach based on fully convolutional network (FCN). Specifically, FCN is first trained to predict segmentation map of each image in the considered image archive. We then obtain multilabel vector and extract region convolutional features of each image based on its segmentation map. The extracted region features are finally used to perform region-based multilabel retrieval. The experimental results show that our approach achieves state-of-the-art performance in contrast to handcrafted and convolutional neural network features.