Learning Label Preserving Binary Codes For Multimedia Retrieval: A General Approach

Keywords

Binary integer programming; Discrete optimization; Large-scale similarity search; Learning to hash; Multimedia retrieval; Supervised learning

Abstract

Learning-based hashing has been researched extensively in the past few years due to its great potential in fast and accurate similarity search among huge volumes of multimedia data. In this article, we present a novel multimedia hashing framework, called Label Preserving Multimedia Hashing (LPMH) for multimedia similarity search. In LPMH, a general optimization method is used to learn the joint binary codes of multiple media types by explicitly preserving semantic label information. Compared with existing hashing methods which are typically developed under and thus restricted to some specific objective functions, the proposed optimization strategy is not tied to any specific loss function and can easily incorporate bit balance constraints to produce well-balanced binary codes. Specifically, our formulation leads to a set of Binary Integer Programming (BIP) problems that have exact solutions both with and without bit balance constraints. These problems can be solved extremely fast and the solution can easily scale up to large-scale datasets. In the hash function learning stage, the boosted decision trees algorithm is utilized to learn multiple media-specific hash functions that can map heterogeneous data sources into a homogeneous Hamming space for cross-media retrieval.We have comprehensively evaluated the proposed method using a range of large-scale datasets in both singlemedia and cross-media retrieval tasks. The experimental results demonstrate that LPMH is competitive with state-of-the-art methods in both speed and accuracy.

Publication Date

12-1-2017

Publication Title

ACM Transactions on Multimedia Computing, Communications and Applications

Volume

14

Issue

1

Document Type

Article

Personal Identifier

scopus

DOI Link

https://doi.org/10.1145/3152126

Socpus ID

85040309396 (Scopus)

Source API URL

https://api.elsevier.com/content/abstract/scopus_id/85040309396

This document is currently not available here.

Share

COinS