Pairwise Relationship Guided Deep Hashing for Cross-Modal Retrieval 论文

2017Proceedings of the AAAI Conference on Artificial Intelligence引用 343
Advanced Image and Video Retrieval TechniquesMultimodal Machine Learning ApplicationsVideo Surveillance and Tracking Methods

详细信息

发表期刊/会议
Proceedings of the AAAI Conference on Artificial Intelligence
发表日期
2017-02-12
发表年份
2017

关键词

Advanced Image and Video Retrieval TechniquesMultimodal Machine Learning ApplicationsVideo Surveillance and Tracking Methods

摘要

With benefits of low storage cost and fast query speed, cross-modal hashing has received considerable attention recently. However, almost all existing methods on cross-modal hashing cannot obtain powerful hash codes due to directly utilizing hand-crafted features or ignoring heterogeneous correlations across different modalities, which will greatly degrade the retrieval performance. In this paper, we propose a novel deep cross-modal hashing method to generate compact hash codes through an end-to-end deep learning architecture, which can effectively capture the intrinsic relationships between various modalities. Our architecture integrates different types of pairwise constraints to encourage the similarities of the hash codes from an intra-modal view and an inter-modal view, respectively. Moreover, additional decorrelation constraints are introduced to this architecture, thus enhancing the discriminative ability of each hash bit. Extensive experiments show that our proposed method yields state-of-the-art results on two cross-modal retrieval datasets.