Abstract
Domain adaption image classification uses source domain task knowledge to enhance the classification effect of target domain tasks. It can reduce the work of data labeling in the target domain and significantly improve the network’s adaptive ability. However, the existing methods can not deal well with the performance degradation in large differences in data distribution between the source domain and the target domain. Therefore, based on the idea of reverse gradient layer, a multi-step domain adaptive image classification network with an attention mechanism aligned with multi-level features is proposed in this paper. Specifically, firstly, the attention mechanism is used to combine the source domain and target domain data to generate an intermediate domain. Secondly, several feature alignment strategies are proposed to align the source domain and the target domain from the pixel and global levels.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Gretton, A., Smola, A., Huang, J., Schmittfull, M., Borgwardt, K.: Covariate shift by kernel mean matching. Schölkopf BJDsiml 3(4), 5 (2009)
Tzeng, E., Hoffman, J., Saenko, K., Darrell, T.: Adversarial discriminative domain adaptation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017)
Xu, M., Zhang, J., Ni, B., Li, T., Wang, C., Tian, Q., et al.: Adversarial domain adaptation with domain mixup. In: Proceedings of the AAAI Conference on Artificial Intelligence (2020)
Wang, F., Jiang, M., Qian, C., Yang, S., Li, C., Zhang, H., et al.: Residual attention network for image classification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017)
Wang, H., Shen, T., Zhang, W., Duan, L.-Y., Mei, T.: Classes matter: a fine-grained adversarial approach to cross-domain semantic segmentation. In: Vedaldi, A., Bischof, H., Brox, T., Frahm, J.-M. (eds.) ECCV 2020. LNCS, vol. 12359, pp. 642–659. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-58568-6_38
Mnih, V., Heess, N.: Recurrent models of visual attention. Graves AJAinips. 27, 2204–2212 (2014)
Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2018)
Lin, T.-Y., Goyal, P., Girshick, R., He, K., Dollár, P.: Focal loss for dense object detection. In: Proceedings of the IEEE International Conference on Computer Vision (2017)
Saenko, K., Kulis, B., Fritz, M., Darrell, T.: Adapting visual category models to new domains. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010. LNCS, vol. 6314, pp. 213–226. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-15561-1_16
Venkateswara, H., Eusebio, J., Chakraborty, S., Panchanathan, S.: Deep hashing network for unsupervised domain adaptation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2017)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2016)
Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., et al.: Domain-adversarial training of neural networks. J. Mach. Lear. Res. 17(1), 2096–2130 (2016)
Roy, S., Siarohin, A., Sangineto, E., Bulo, S.R., Sebe, N., Ricci, E.: Unsupervised domain adaptation using feature-whitening and consensus loss. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2019)
Long, M., Zhu, H., Wang, J., Jordan, M.I.: Deep transfer learning with joint adaptation networks. In: International Conference on Machine Learning (2017). PMLR
Saito, K., Watanabe, K., Ushiku, Y., Harada, T.: Maximum classifier discrepancy for unsupervised domain adaptation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (2018)
Long, M., Cao, Z., Wang, J., Jordan, M.I.: Conditional adversarial domain adaptation. In: Advances in Neural Information Processing Systems (2018)
Acknowledgment
This work was supported by Joint Fund of Natural Science Foundation of Anhui Province in 2020 (2008085UD08), Intelligent Networking and New Energy Vehicle Special Project of Intelligent Manufacturing Institute of HFUT (IMIWL2019003) and Anhui Provincial Key R&D Program (202004a05020004, 201904d08020008).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Xiang, Y., Zhao, C., Wei, X., Lu, Y., Liu, S. (2021). Multi-step Domain Adaption Image Classification Network via Attention Mechanism and Multi-level Feature Alignment. In: Liu, Z., Wu, F., Das, S.K. (eds) Wireless Algorithms, Systems, and Applications. WASA 2021. Lecture Notes in Computer Science(), vol 12939. Springer, Cham. https://doi.org/10.1007/978-3-030-86137-7_2
Download citation
DOI: https://doi.org/10.1007/978-3-030-86137-7_2
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-86136-0
Online ISBN: 978-3-030-86137-7
eBook Packages: Computer ScienceComputer Science (R0)