Abstract
When a task of a certain domain doesn’t have enough labels and good features, traditional supervised learning methods usually behave poorly. Transfer learning addresses this problem, which transfers data and knowledge from a related domain to improve the learning performance of the target task. Sometimes, the related task and the target task have the same labels, but have different data distributions and heterogeneous features. In this paper, we propose a general heterogeneous transfer learning framework which combines linear kernel and graph regulation. Linear kernel is used to project the original data of both domains to a Reproducing Kernel Hilbert Space, in which both tasks have the same feature dimensions and close distance of data distributions. Graph regulation is designed to preserve geometric structure of data. We present the algorithms in both unsupervised and supervised way. Experiments on synthetic dataset and real dataset about user web-behavior and personality are performed, and the effectiveness of our method is demonstrated.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Pan, S., Yang, Q.: A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering 22(10), 1345–1359 (2010)
Blitzer, J., McDonald, R., Pereira, F.: Domain Adaptation with Structural Correspondence Learning. In: Proc. Conf. Empirical Methods in Natural Language, pp. 120–128 (2006)
Daumé III, H.: Frustratingly Easy Domain Adaptation. In: Proc. 45th Ann. Meeting of the Assoc. Computational Linguistics, pp. 256–263 (2007)
Pan, S.J., Kwok, J.T., Yang, Q.: Transfer learning via dimensionality reduction. In: Proc. 23rd AAAI Conf. Artif. Intell., Chicago, IL, pp. 677–682 (2008)
Dai, W., Yang, Q., Xue, G., Yu, Y.: Boosting for Transfer Learning. In: Proc. 24th Int’l Conf. Machine Learning, pp. 193–200 (2007)
Dai, W., Chen, Y., Xue, G.-R., Yang, Q., Yu, Y.: Translated learning: Transfer learning across different feature spaces. In: NIPS (2009)
Yang, Q., Chen, Y., Xue, G., Dai, W., Yu, Y.: Heterogeneous transfer learning for image clustering via the social web. In: Proceedings of the 47th Annual Meeting of the ACL and the 4th IJCNLP of the AFNLP, pp. 1–9 (2009)
Zhu, Y., Chen, Y., Lu, Z., Pan, S.J., Xue, G., Yu, Y., Yang, Q.: Heterogeneous Transfer Learning for Image Classification. In: Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence, pp. 1304–1309 (2011)
Shi, X., Liu, Q., Fan, W., Yu, P.S., Zhu, R.: Transfer learning on heterogenous feature spaces via spectral transformation. In: ICDM (2010)
Wang, C., Mahadevan, S.: Heterogeneous domain adaptation using manifold alignment. In: IJCAI (2011)
Kulis, B., Saenko, K., Darrell, T.: What you saw is not what you get: Domain adaptation using asymmetric kernel transforms. In: CVPR (2011)
Duan, L., Xu, D., Tsang, I.W.: Learning with Augmented Features for Heterogeneous Domain Adaptation. In: Proceedings of the 29 th International Conference on Machine Learning, Edinburgh, Scotland, UK (2012)
Pan, S.J., Tsang, I.W., Kwok, J.T., Yang, Q.: Domain Adaptation via Transfer Component Analysis. IEEE Transactions on Neural Networks 22(2), 199–210 (2011)
Gu, Q., Li, Z., Han, J.: Learning a Kernel for Multi-Task Clustering. In: Proceedings of the Twenty-Fifth AAAI Conference on Artificial Intelligence (2011)
Borgwardt, K., Gretton, A., Rasch, M., Kriegel, H.P., Scholkopf, B., Smola, A.J.: Integrating structured biological data by kernel maximum mean discrepancy. Bioinformatics 22(14), 49–57 (2006)
Cai, D., He, X., Han, J.: Document clustering using locality preserving indexing. IEEE Trans. Knowl. Data Eng. 17(12), 1624–1637 (2005)
Grant, M., Boyd, S.: CVX: Matlab software for disciplined convex programming, version 1.22 (2012), http://cvxr.com/cvx
Burger, J.: Personality. Thomson Wadsworth, Belmont (2008)
Costa, P., McCrae, R.: Neo personality inventorycrevised (neo-pi-r) and neo five-factor inventory (neo-ffi) professional manual. Psychological Assessment Resources, Odessa (1992)
Goldberg, L.: The structure of phenotypic personality traits. American Psychologist 48(1), 26 (1993)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Guan, Z., Bai, S., Zhu, T. (2014). Heterogeneous Domain Adaptation Using Linear Kernel. In: Zu, Q., Vargas-Vera, M., Hu, B. (eds) Pervasive Computing and the Networked World. ICPCA/SWS 2013. Lecture Notes in Computer Science, vol 8351. Springer, Cham. https://doi.org/10.1007/978-3-319-09265-2_14
Download citation
DOI: https://doi.org/10.1007/978-3-319-09265-2_14
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-09264-5
Online ISBN: 978-3-319-09265-2
eBook Packages: Computer ScienceComputer Science (R0)