An Empirical Study And Analysis Of Generalized Zero-Shot Learning For Object Recognition In The Wild
Abstract
We investigate the problem of generalized zero-shot learning (GZSL). GZSL relaxes the unrealistic assumption in conventional zeroshot learning (ZSL) that test data belong only to unseen novel classes. In GZSL, test data might also come from seen classes and the labeling space is the union of both types of classes. We show empirically that a straightforward application of classifiers provided by existing ZSL approaches does not perform well in the setting of GZSL. Motivated by this, we propose a surprisingly simple but effective method to adapt ZSL approaches for GZSL. The main idea is to introduce a calibration factor to calibrate the classifiers for both seen and unseen classes so as to balance two conflicting forces: recognizing data from seen classes and those from unseen ones. We develop a new performance metric called the Area Under Seen-Unseen accuracy Curve to characterize this tradeoff. We demonstrate the utility of this metric by analyzing existing ZSL approaches applied to the generalized setting. Extensive empirical studies reveal strengths and weaknesses of those approaches on three well-studied benchmark datasets, including the large-scale ImageNet with more than 20,000 unseen categories. We complement our comparative studies in learning methods by further establishing an upper bound on the performance limit of GZSL. In particular, our idea is to use class-representative visual features as the idealized semantic embeddings. We show that there is a large gap between the performance of existing approaches and the performance limit, suggesting that improving the quality of class semantic embeddings is vital to improving ZSL.
Publication Date
1-1-2016
Publication Title
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume
9906 LNCS
Number of Pages
52-68
Document Type
Article; Proceedings Paper
Personal Identifier
scopus
DOI Link
https://doi.org/10.1007/978-3-319-46475-6_4
Copyright Status
Unknown
Socpus ID
84990852341 (Scopus)
Source API URL
https://api.elsevier.com/content/abstract/scopus_id/84990852341
STARS Citation
Chao, Wei Lun; Changpinyo, Soravit; Gong, Boqing; and Sha, Fei, "An Empirical Study And Analysis Of Generalized Zero-Shot Learning For Object Recognition In The Wild" (2016). Scopus Export 2015-2019. 4477.
https://stars.library.ucf.edu/scopus2015/4477