Abstract
In recent years, graph convolutional networks have achieved great success in unsupervised domain adaptation task. Although these works make effort to reduce the distribution difference between domains, they do not take into account the issue of distribution difference reduction in the class level. In this paper, we propose a Dual-aligned Unsupervised Domain Adaptation with Graph Convolutional Networks (DUDA-GCN) framework to align domain distributions and the distributions of two domains corresponding to each category jointly. The framework contains two parts, i.e., a cross-domain feature extractor and a dual aligner of distribution. The former adopts a two-channel sub-network, with each channel to fully explore the relation among within-domain samples, based on GCN with shared weights to learn common feature representations of two domains. The dual aligner contains an adversarial domain discriminator and a category aligner, where the domain discriminator is designed to reduce the distribution difference across domains. A pseudo-label generator is designed to generate pseudo-labels for unlabeled samples. With the generated pseudo-labels of unlabeled samples and the real labels of labeled samples, the category aligner aligns the sample distributions across domains of the same category. Extensive empirical evaluation on three real-world datasets shows that DUDA-GCN can perform better than state-of-the-art related domain adaptation methods.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Busbridge D, Sherburn D, Cavallo P, Hammerla NY (2019) Relational Graph Attention Networks. arXiv:1904.05811
Dai Q, Shen X, Wu X, Wang D (2019) Network Transfer Learning via Adversarial Domain Adaptation with Graph Convolution. arXiv:1909.01541
Ding Y, Fan H, Xu M, Yang Y (2020) Adaptive exploration for unsupervised person re-identification. ACM Trans Multimed Comput Commun Appl 16 (1):1–19
Fang M, Yin J, Zhu X (2013) Transfer learning across networks for collective classification. Int Conf Data Min:161–170
Feng H, Chen M, Hu J, Shen D, Liu H, Cai D (2021) Complementary pseudo labels for unsupervised domain adaptation on person Re-Identification. IEEE Trans Image Process 30:2898–2907
Ganin Y, Lempitsky V (2015) Unsupervised domain adaptation by backpropagation. Int Conf Mach Learn:1180–1189
Ghifary M, Kleijn W, Zhang M, Balduzzi D, Li W (2016) Deep Reconstruction-Classification networks for unsupervised domain adaptation. Eur Conf Comput Vis:597–613
Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. Adv Neural Inf Process Syst:2672–2680
Grover A, Leskovec J (2016) Node2vec: Scalable feature learning for networks. Int Conf Knowl Discov Data Min:855–864
Hamilton WL, Ying Z, Leskovec J (2017) Inductive representation learning on large graphs. Adv Neural Inf Process Syst:1024–1034
Kipf TN, Welling M (2016) Variational Graph Auto-encoders. arXiv:1611.07308
Kipf TN, Welling M (2016) Semi-supervised Classification with Graph Convolutional Networks. arXiv:1609.02907
Li J, Hu X, Tang J, Liu H (2015) Unsupervised streaming feature selection in social media. ACM Int Conf Inf Knowl Manag:1041–1050
Liu Q, Xue H (2021) Adversarial spectral kernel matching for unsupervised time series domain adaptation. Int Joint Conf Artif Intell:2744–2750
Long M, Zhu H, Wang J, Jordan M (2016) Unsupervised domain adaptation with residual transfer networks. Adv Neural Inf Process Syst:136–144
Luo Y, Zheng L, Guan T, Yu J, Yang Y (2019) Taking a closer look at domain shif Category-Level adversaries for semantics consistent domain adaptation. IEEE Conf Comput Vis Pattern Recogn:2507–2516
Ma X, Zhang T, Xu C (2019) GCAN Graph convolutional adversarial adaptation. IEEE Conf Comput Vis Pattern Recogn:8266–8276
Perozzi B, Al-Rfou R, Skiena S (2014) Deepwalk: Online learning of social representations. Int Conf Knowl Discov Data Min:701–710
Shen X, Chung F (2019) Network Embedding for Cross-network Node Classification. arXiv:1901.07264
Shen J, Qu Y, Zhang W, Yu Y (2018) Wasserstein distance guided representation learning for domain adaptation. AAAI Conf Artif Intell:4058–4065
Tang J, Zhang J, Yao L, Li J, Zhang L, Su Z (2008) Arnetminer extraction and mining of academic social networks. Int Conf Knowl Discov Data Min:990–998
Tzeng E, Hoffman J, Saenko K, Darrell T (2017) Adversarial discriminative domain adaptation. IEEE Conf Comput Vis Pattern Recogn:7167–7176
Tzeng E, Hoffman J, Zhang N, Saenko K, Darrell T (2014) Deep Domain Confusion: Maximizing for Domain Invariance. arXiv:1412.3474
Veličkovic̀ P, Cucurull G, Casanova A, Romero A, Liò P, Bengio Y (2018) Graph attention networks. Int Conf Learn Represent:1–12
Wang M, Deng W (2018) Deep visual domain adaptation: a survey, vol 312
Wilson G, Cook DJ (2020) A survey of unsupervised deep domain adaptation. ACM Trans Intell Syst Technol 11(5):1–46
Wu M, Pan S, Du L, Zhu X (2021) Learning graph neural networks with positive and unlabeled nodes. ACM Trans Knowl Discov Data 15 (6):101:1–101:25
Wu M, Pan S, Zhou C, Chang X, Zhu X (2020) Unsupervised domain adaptive graph convolutional networks. Int Conf World Wide Web:1457–1467
Xiao J, Dai Q, Xie X, Lam J, Kwok KW (2021) Adversarially Regularized Graph Attention Networks for Inductive Learning on Partially Labeled Graphs. arXiv:2106.03393
Yao L, Mao C, Luo Y (2019) Graph convolutional networks for text classification. AAAI Conf Artif Intell 33(01):7370–7377
Ying R, He R, Chen K, Eksombatchai P, Hamilton WL, Leskovec J (2018) Graph convolutional neural networks for web-scale recommender systems. ACM SIGKDD Int Conf Knowl Discov Data Min:974–983
Zhang Z, Yang H, Bu J, Zhou S, Yu P, Zhang J, Ester M, Wang C (2018) ANRL Attributed network representation learning via deep neural networks. Int Joint Conf Artif Intell:3155–3161
Zhao L, Song Y, Zhang C, Liu Y, Wang P, Lin T, Deng M, Li H (2019) T-gcn A Temporal Graph Convolutional Network for Traffic Prediction. IEEE Trans Intell Transp Syst 21(9):3848– 3858
Zhu JY, Park T, Isola P, Efros AA (2017) Unpaired image-to-image translation using cycle-consistent adversarial networks. IEEE Int Conf Comput Vis:2223–2232
Zou H, Yang J, Wu X (2021) Unsupervised Energy-based Adversarial Domain Adaptation for Cross-domain Text Classification. The Joint Conference of Annual Meeting of the Association for Computational Linguistics and the International Joint Conference on Natural Language Processing, pp 1208–1218
Acknowledgements
This work was supported by the National Natural Science Foundation of China (Nos. 62076139, 61702280, 62176069), Zhejiang Lab (No. 2021KF0AB05), the National Postdoctoral Program for Innovative Talents (No. BX20180146), China Postdoctoral Science Foundation (No. 2019M661901), Jiangsu Planned Projects for Postdoctoral Research Funds (No. 2019K024), Future Network Scientific Research Fund Project (No. FNSRFP-2021-YB-15), 1311 Talent Program of Nanjing University of Posts and Telecommunications, and Natural Science Foundation of Jiangsu Province (No. BK20170900).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflicts of interests
The authors have nothing to declare about the financial or non-financial interests, conflicts of interests, or competing interests.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Wu, F., Wei, P., Gao, G. et al. Dual-aligned unsupervised domain adaptation with graph convolutional networks. Multimed Tools Appl 81, 14979–14997 (2022). https://doi.org/10.1007/s11042-022-12379-0
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-022-12379-0