Abstract
Multi-task learning (MTL) has been shown to improve prediction performance in a number of different contexts by learning models jointly on multiple different, but related tasks. In this paper, we propose to do MTL on general network data, which provide an important context for MTL. We first show that MTL on network data is a common problem that has many concrete and valuable applications. Then, we propose a metric learning approach that can effectively exploit correlation across multiple tasks and networks. The proposed approach builds on structural metric learning and intermediate parameterization, and has efficient an implementation via stochastic gradient descent. In experiments, we challenge it with two common real-world applications: citation prediction for Wikipedia articles and social circle prediction in Google+. The proposed method achieves promising results and exhibits good convergence behavior.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Adafre, S.F., de Rijke, M.: Discovering missing links in wikipedia. In: Proceedings of the 3rd International Workshop on Link Discovery (2005)
Agarwal, A., III, H.D., Gerber, S.: Learning multiple tasks using manifold regularization. In: Neural Information Processing Systems (2010)
Caruana, R.: Multitask learning. Machine Learning 28(1), 41–75 (1997)
Chechik, G., Sharma, V., Shalit, U., Bengio, S.: Large scale online learning of image similarity through ranking. Journal of Machine Learning Research 11, 1109–1135 (2010)
Comar, P.M., Tan, P.N., Jain, A.K.: Multi-task learning on multiple related networks. In: ACM International Conference on Information and Knowledge Management (2010)
Daumé, III, H.: Bayesian multitask learning with latent hierarchies. In: Conference on Uncertainty in Artificial Intelligence (2009)
Evgeniou, T., Pontil, M.: Regularized multi-task learning. In: ACM International Conference on Knowledge Discovery and Data Mining (2004)
Hasan, M.A., Chaoji, V., Salem, S., Zaki, M.: Link prediction using supervised learning. In: SDM workshop on Link Analysis, Counterterrorism and Security (2006)
Kashima, H., Abe, N.: A parameterized probabilistic model of network evolution for supervised link prediction. In: ICDM (2006)
Liben-Nowell, D., Kleinberg, J.: The link prediction problem for social networks. In: ACM International Conference on Information and Knowledge Management (2003)
McAuley, J.J., Leskovec, J.: Learning to discover social circles in ego networks. In: Neural Information Processing Systems (2012)
Parameswaran, S., Weinberger, K.: Large margin multi-task metric learning. In: Neural Information Processing Systems (2010)
Qi, G.J., Aggarwal, C.C., Huang, T.S.: Link prediction across networks by biased cross-network sampling. In: ICDE (2013)
Seltzer, M., Droppo, J.: Multi-task learning in deep neural networks for improved phoneme recognition. In: IEEE International Conference on Acoustics, Speech, and Signal Processing (2013)
Shalev-Shwartz, S., Singer, Y., Srebro, N.: Pegasos: primal estimated sub-GrAdient SOlver for SVM. In: International Conference on Machine Learning (2007)
Shaw, B., Huang, B., Jebara, T.: Learning a distance metric from a network. In: Neural Information Processing Systems (2011)
Tang, W., Lu, Z., Dhillon, I.S.: Clustering with multiple graphs. In: IEEE International Conference on Data Mining (2009)
Taskar, B., fai Wong, M., Abbeel, P., Koller, D.: Link prediction in relational data. In: Neural Information Processing Systems (2003)
Wang, X., Zhang, C., Zhang, Z.: Boosted multi-task learning for face verification with applications to web image and video search. In: IEEE International Conference on Computer Vision and Pattern Recognition (2009)
Weinberger, K.Q., Saul, L.K.: Distance metric learning for large margin nearest neighbor classification. Journal of Machine Learning Research 10, 207–244 (2009)
Yu, K., Tresp, V., Schwaighofer, A.: Learning gaussian processes from multiple tasks. In: International Conference on Machine Learning (2005)
Zhou, D., Zhu, S., Yu, K., Song, X., Tseng, B.L., Zha, H., Giles, C.L.: Learning multiple graphs for document recommendations. In: WWW (2008)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Fang, C., Rockmore, D.N. (2015). Multi-Task Metric Learning on Network Data. In: Cao, T., Lim, EP., Zhou, ZH., Ho, TB., Cheung, D., Motoda, H. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2015. Lecture Notes in Computer Science(), vol 9077. Springer, Cham. https://doi.org/10.1007/978-3-319-18038-0_25
Download citation
DOI: https://doi.org/10.1007/978-3-319-18038-0_25
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-18037-3
Online ISBN: 978-3-319-18038-0
eBook Packages: Computer ScienceComputer Science (R0)