Zheng Zhang
ABSTRACT
Deep hashing has shown great potentials in large-scale visual similarity search due to preferable storage and computation efficiency. Typically, deep hashing encodes visual features into compact binary codes by preserving representative semantic visual features. Works in this area mainly focus on building the relationship between the visual and objective hash space, while they seldom study the triadic cross-domain semantic knowledge transfer among visual, semantic and hashing spaces, leading to serious semantic ignorance problem during space transformation. In this paper, we propose a novel deep tripartite semantically interactive hashing framework, dubbed Semantically Cycle-consistent Hashing Networks (SCHN), for discriminative hash code learning. Particularly, we construct a flexible semantic space and a transitive latent space, in conjunction with the visual space, to jointly deduce the privileged discriminative hash space. Specifically, a semantic space is conceived to strengthen the flexibility and completeness of categories in feature inference. Moreover, a transitive latent space is formulated to explore the shared semantic interactivity embedded in visual and semantic features. Our SCHN, for the first time, establishes the cyclic principle of deep semantic-preserving hashing by adaptive semantic parsing across different spaces in visual similarity search. In addition, the entire learning framework is jointly optimized in an end-to-end manner. Extensive experiments performed on diverse large-scale datasets evidence the superiority of our method against other state-of-the-art deep hashing algorithms.
- Zhangjie Cao, Mingsheng Long, Jianmin Wang, and Philip S Yu. 2017. Hashnet: Deep learning to hash by continuation. In Proceedings of the IEEE International Conference on Computer Vision. 5608–5617.Google Scholar
Cross Ref
- Yaxiong Chen and Xiaoqiang Lu. 2020. Deep Category-Level and Regularized Hashing With Global Semantic Similarity Learning. IEEE Transactions on Cybernetics(2020).Google Scholar
- Cheng Deng, Zhaojia Chen, Xianglong Liu, Xinbo Gao, and Dacheng Tao. 2018. Triplet-based deep hashing network for cross-modal retrieval. IEEE Transactions on Image Processing 27, 8 (2018), 3893–3903.Google ScholarCross Ref
- Cheng Deng, Erkun Yang, Tongliang Liu, and Dacheng Tao. 2019. Two-stream deep hashing with class-specific centers for supervised image search. IEEE Transactions on Neural Networks and Learning Systems 31, 6(2019), 2189–2201.Google ScholarCross Ref
- Lianli Gao, Xiaosu Zhu, Jingkuan Song, Zhou Zhao, and Heng Tao Shen. 2019. Beyond Product Quantization: Deep Progressive Quantization for Image Retrieval. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence. 723–729.Google ScholarCross Ref
- Aristides Gionis, Piotr Indyk, and Rajeev Motwani. 1999. Similarity Search in High Dimensions via Hashing. In Proceedings of 25th International Conference on Very Large Data Bases. 518–529.Google ScholarDigital Library
- Yunchao Gong, Svetlana Lazebnik, Albert Gordo, and Florent Perronnin. 2013. Iterative quantization: A procrustean approach to learning binary codes for large-scale image retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence 35, 12(2013), 2916–2929.Google ScholarDigital Library
- Himalaya Jain, Joaquin Zepeda, Patrick Pérez, and Rémi Gribonval. 2017. SuBiC: A supervised, structured binary code for image search. In Proceedings of the IEEE International Conference on Computer Vision. 833–842.Google ScholarCross Ref
- Qing-Yuan Jiang and Wu-Jun Li. 2015. Scalable graph hashing with feature transformation.. In Proceedings of the International Joint Conference on Artificial Intelligence. 2248–2254.Google Scholar
- Wang-Cheng Kang, Wu-Jun Li, and Zhi-Hua Zhou. 2016. Column sampling based discrete supervised hashing. In Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence. 1230–1236.Google ScholarCross Ref
- Thomas N Kipf and Max Welling. 2016. Semi-supervised classification with graph convolutional networks. arXiv preprint arXiv:1609.02907(2016).Google Scholar
- Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. Advances in Neural Information Processing Systems 25 (2012), 1097–1105.Google ScholarDigital Library
- Hanjiang Lai, Yan Pan, Ye Liu, and Shuicheng Yan. 2015. Simultaneous feature learning and hash coding with deep neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3270–3278.Google ScholarCross Ref
- Hanjiang Lai, Yan Pan, Ye Liu, and Shuicheng Yan. 2015. Simultaneous Feature Learning and Hash Coding With Deep Neural Networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3270–3278.Google ScholarCross Ref
- Chao Li, Cheng Deng, Ning Li, Wei Liu, Xinbo Gao, and Dacheng Tao. 2018. Self-supervised adversarial hashing networks for cross-modal retrieval. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4242–4251.Google ScholarCross Ref
- Qi Li, Zhenan Sun, Ran He, and Tieniu Tan. 2020. A general framework for deep supervised discrete hashing. International Journal of Computer Vision 128, 8 (2020), 2204–2222.Google ScholarDigital Library
- Wu-Jun Li, Sheng Wang, and Wang-Cheng Kang. 2016. Feature learning based deep supervised hashing with pairwise labels. In Proceedings of the International Joint Conference on Artificial Intelligence. 1711–1717.Google Scholar
- Kevin Lin, Huei-Fang Yang, Jen-Hao Hsiao, and Chu-Song Chen. 2015. Deep learning of binary hash codes for fast image retrieval. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops. 27–35.Google ScholarCross Ref
- Hong Liu, Rongrong Ji, Jingdong Wang, and Chunhua Shen. 2018. Ordinal constraint binary coding for Approximate Nearest Neighbor Search. IEEE Transactions on Pattern Analysis and Machine Intelligence 41, 4(2018), 941–55.Google ScholarDigital Library
- Wei Liu, Jun Wang, Rongrong Ji, Yu-Gang Jiang, and Shih-Fu Chang. 2012. Supervised hashing with kernels. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2074–2081.Google Scholar
- Wei Liu, Jun Wang, Sanjiv Kumar, and Shih-Fu Chang. 2011. Hashing with graphs. In Proceedings of the 28th International Conference on Machine Learning. 1–8.Google Scholar
- Laurens van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. Journal of Machine Learning Research 9, Nov (2008), 2579–2605.Google Scholar
- Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, 2019. Pytorch: An imperative style, high-performance deep learning library. Advances in Neural Information Processing Systems 32 (2019), 8026–8037.Google Scholar
- Yuxin Peng, Jian Zhang, and Zhaoda Ye. 2020. Deep Reinforcement Learning for Image Hashing. IEEE Transactions on Multimedia 22, 8 (2020), 2061–2073.Google ScholarCross Ref
- Mohammad Rastegari, Vicente Ordonez, Joseph Redmon, and Ali Farhadi. 2016. Xnor-net: Imagenet classification using binary convolutional neural networks. In European Conference on Computer Vision. Springer, 525–542.Google ScholarCross Ref
- Fumin Shen, Yadong Mu, Yang Yang, Wei Liu, Li Liu, Jingkuan Song, and Heng Tao Shen. 2017. Classification by retrieval: Binarizing data and classifiers. In Proceedings of the 40th International ACM SIGIR conference on Research and Development in Information Retrieval. 595–604.Google ScholarDigital Library
- Fumin Shen, Chunhua Shen, Wei Liu, and Heng Tao Shen. 2015. Supervised discrete hashing. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 37–45.Google ScholarCross Ref
- Weiwei Shi, Yihong Gong, Badong Chen, and Xinhong Hei. 2021. Transductive Semi-supervised Deep Hashing. IEEE Transactions on Neural Networks and Learning Systems (2021), 1–14.Google Scholar
- Jingdong Wang, Ting Zhang, Nicu Sebe, Heng Tao Shen, 2018. A survey on learning to hash. IEEE Transactions on Pattern Analysis and Machine Intelligence 40, 4(2018), 769–790.Google ScholarCross Ref
- Zijian Wang, Zheng Zhang, Yandan Luo, Zi Huang, and Heng Tao Shen. 2020. Deep collaborative discrete hashing with semantic-invariant structure construction. IEEE Transactions on Multimedia 23 (2020), 1274–1286.Google ScholarDigital Library
- Yair Weiss, Antonio Torralba, and Rob Fergus. 2009. Spectral hashing. In Proceedings of the Neural Information Processing Systems. 1753–1760.Google Scholar
- Rongkai Xia, Yan Pan, Hanjiang Lai, Cong Liu, and Shuicheng Yan. 2014. Supervised hashing for image retrieval via image representation learning. In Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence. 2156–2162.Google ScholarCross Ref
- Hanwang Zhang, Fumin Shen, Wei Liu, Xiangnan He, Huanbo Luan, and Tat-Seng Chua. 2016. Discrete collaborative filtering. In Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval. 325–334.Google ScholarDigital Library
- Peichao Zhang, Wei Zhang, Wu-Jun Li, and Minyi Guo. 2014. Supervised hashing with latent factor models. In Proceedings of the 37th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 173–182.Google ScholarDigital Library
- Zheng Zhang, Zhihui Lai, W Wong, Guo-Sen Xie, Li Liu, and Ling Shao. 2019. Scalable Supervised Asymmetric Hashing with Semantic and Latent Factor Embedding. IEEE Transactions on Image Processing 28, 10 (2019), 4803–4818.Google ScholarCross Ref
- Zheng Zhang, Luyao Liu, Yadan Luo, Zi Huang, Fumin Shen, Heng Tao Shen, and Guangming Lu. 2021. Inductive Structure Consistent Hashing via Flexible Semantic Calibration. IEEE Transactions on Neural Networks and Learning Systems 32, 10(2021), 4514–4528.Google ScholarCross Ref
- Zheng Zhang, Li Liu, Fumin Shen, Heng Tao Shen, and Ling Shao. 2019. Binary Multi-View Clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence 41, 7(2019), 1774–1782.Google ScholarCross Ref
- Zheng Zhang, Guo-sen Xie, Yang Li, Sheng Li, and Zi Huang. 2019. SADIH: Semantic-aware discrete hashing. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 5853–5860.Google ScholarDigital Library
- Han Zhu, Mingsheng Long, Jianmin Wang, and Yue Cao. 2016. Deep hashing network for efficient similarity retrieval. In Proceedings of the Thirtieth AAAI Conference on Artificial Intelligence. 2415–2421.Google ScholarCross Ref
Index Terms
- Towards Discriminative Visual Search via Semantically Cycle-consistent Hashing Networks
Recommendations
Discriminative Visual Similarity Search with Semantically Cycle-consistent Hashing Networks
Deep hashing has great potential in large-scale visual similarity search due to its preferable efficiency in storage and computation. Technically, deep hashing for visual similarity search inherits the powerful representation capability of deep neural ...
Towards Joint Multiply Semantics Hashing for Visual Search
Image and GraphicsAbstractWith the rapid growth of visual data on the web, deep hashing has shown enormous potential in preserving semantic similarity for visual search. Currently, most of the existing hashing methods employ pairwise or triplet-wise constraint to obtain ...
Integration of semantic and visual hashing for image retrieval
Semantic hashing codes are learned by leveraging the similarity between textual structure and visual structure.Maximum entropy principle is exploited to achieve compact binary codes.Function decay principle is introduced to remove noisy visual ...
Comments