Skip to main content

Embarrassingly Easy Zero-Shot Image Recognition

  • Conference paper
  • First Online:
  • 1655 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 11818))

Abstract

Zero-shot Learning (ZSL) aims to transfer knowledge from seen image categories to unseen ones by leveraging semantic information. It is generally assumed that the seen and unseen classes share a common semantic space. A number of methods propose to design a common space to accomplish the projection between image and class embeddings by learning a compatibility function, which make up sample pairs to train the object function. However, considering the drawbacks of previous compatibility function, we design a new compatibility function in this paper. Different from previous compatibility pattern, our proposed compatibility function is more discriminative by employing label vectors, which can measure the similarity between the projected image features and all seen class prototypes. Extensive experiments on four benchmark datasets show the effectiveness of our proposed approach.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   59.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   79.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Akata, Z., Reed, S., Walter, D., Lee, H., Schiele, B.: Evaluation of output embeddings for fine-grained image classification. In: Computer Vision & Pattern Recognition (2015)

    Google Scholar 

  2. Changpinyo, S., Chao, W.L., Gong, B., Sha, F.: Synthesized classifiers for zero-shot learning. In: Computer Vision & Pattern Recognition (2016)

    Google Scholar 

  3. Farhadi, A., Endres, I., Hoiem, D., Forsyth, D.: Describing objects by their attributes. In: IEEE Conference on Computer Vision & Pattern Recognition (2009)

    Google Scholar 

  4. Frome, A., et al.: Devise: a deep visual-semantic embedding model. In: International Conference on Neural Information Processing Systems (2013)

    Google Scholar 

  5. Fu, Y., Hospedales, T.M., Xiang, T., Fu, Z., Gong, S.: Transductive multi-view embedding for zero-shot recognition and annotation. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8690, pp. 584–599. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10605-2_38

    Chapter  Google Scholar 

  6. Jiang, H., Wang, R., Shan, S., Yi, Y., Chen, X.: Learning discriminative latent attributes for zero-shot classification. In: IEEE International Conference on Computer Vision (2017)

    Google Scholar 

  7. Kodirov, E., Xiang, T., Gong, S.: Semantic autoencoder for zero-shot learning (2017)

    Google Scholar 

  8. Lampert, C.H., Hannes, N., Stefan, H.: Attribute-based classification for zero-shot visual object categorization. IEEE Trans. Pattern Anal. Mach. Intell. 36(3), 453–465 (2014)

    Article  Google Scholar 

  9. Lampert, C.H., Nickisch, H., Harmeling, S.: Learning to detect unseen object classes by between-class attribute transfer (2009)

    Google Scholar 

  10. Larochelle, H., Erhan, D., Bengio, Y.: Zero-data learning of new tasks. In: AAAI Conference on Artificial Intelligence (2014)

    Google Scholar 

  11. Morgado, P., Vasconcelos, N.: Semantically consistent regularization for zero-shot recognition (2017)

    Google Scholar 

  12. Genevieve Patterson, X., Hang, C.S., Hays, J.: The sun attribute database: beyond categories for deeper scene understanding. Int. J. Comput. Vis. 108(1–2), 59–81 (2014)

    Article  Google Scholar 

  13. Romera-Paredes, B., Torr, P.H.S.: An embarrassingly simple approach to zero-shot learning. In: International Conference on International Conference on Machine Learning (2015)

    Google Scholar 

  14. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. Comput. Sci. (2014)

    Google Scholar 

  15. Szegedy, C., et al.: Going deeper with convolutions (2014)

    Google Scholar 

  16. Wah, C., Branson, S., Welinder, P., Perona, P., Belongie, S.: The caltech-ucsd birds200-2011 dataset. In: Advances in Water Resources - ADV WATER RESOUR, July 2011

    Google Scholar 

  17. Xian, Y., Akata, Z., Sharma, G., Nguyen, Q., Hein, M., Schiele, B.: Latent embeddings for zero-shot classification. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 69–77, June 2016

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lei Zhang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Song, W., Zhang, L., Fu, J. (2019). Embarrassingly Easy Zero-Shot Image Recognition. In: Sun, Z., He, R., Feng, J., Shan, S., Guo, Z. (eds) Biometric Recognition. CCBR 2019. Lecture Notes in Computer Science(), vol 11818. Springer, Cham. https://doi.org/10.1007/978-3-030-31456-9_14

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-31456-9_14

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-31455-2

  • Online ISBN: 978-3-030-31456-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics