Abstract
We derive a generalization bound for domain adaptation by using the properties of robust algorithms. Our new bound depends on λ-shift, a measure of prior knowledge regarding the similarity of source and target domain distributions. Based on the generalization bound, we design SVM variants for binary classification and regression domain adaptation algorithms.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ben-David, S., Blitzer, J., Crammer, K., Kulesza, A., Pereira, F., Vaughan, J.W.: A theory of learning from different domains. Mach. Learn. 79(1–2), 151–175 (2010)
Ben-David, S., Blitzer, J., Crammer, K., Pereira, F.: Analysis of Representations for Domain Adaptation. Advances in Neural Information Processing Systems 19: Proceedings of the 2006 Conference (2007)
Ben-David, S., Lu, T., Luu, T., Pál, D.: Impossibility theorems for domain adaptation. J. Mach. Learn. Res. Proc. Track 9, 129–136 (2010)
Ben-David, S., Urner, R.: On the hardness of domain adaptation and the utility of unlabeled target samples. In: ALT, pp. 139–153 (2012)
Blitzer, J., Crammer, K., Kulesza, A., Pereira, F., Wortman, J.: Learning Bounds for Domain Adaptation. Advances in Neural Information Processing Systems (2007)
Blitzer, J., Dredze, M., Pereira, F.: Biographies, bollywood, boom-boxes and blenders: domain adaptation for sentiment classification. In: Association for Computational Linguistics. Prague, Czech Republic (2007)
Cortes, C., Mohri, M.: Domain adaptation in regression. In: ALT, pp. 308–323 (2011)
Mansour, Y.: Learning and domain adaptation. In: ALT, pp. 4–6 (2009)
Mansour, Y., Mohri, M., Rostamizadeh, A.: Domain adaptation: learning bounds and algorithms. In: COLT (2009)
Mansour, Y., Mohri, M., Rostamizadeh, A.: Multiple source adaptation and the renyi divergence. In: UAI (2009)
Minmin Chen, J.B., Weinberger, K.: Co-training for domain adaptation. In: Neural Information Processing Systems. MIT Press, Cambridge (2011)
Mohri, M., Rostamizadeh, A., Talwalkar, A.: Foundations of Machine Learning. MIT Press, Cambridge (2012)
Valiant, L.G.: A Theory of the Learnable. ACM, New York (1984)
Vapnik, V.N.: Statistical Learning Theory. Wiley-Interscience, New York (1998)
Xu, H., Caramanis, C., Mannor, S.: A distributional interpretation of robust optimization. Math. Oper. Res. 37(1), 95–110 (2012)
Xu, H., Mannor, S.: Robustness and generalization. In: COLT, pp. 503–515 (2010)
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported in by The Israeli Centers of Research Excellence (I-CORE) program, (Center No. 4/11), by a grant from the Israel Science Foundation, by a grant from United States-Israel Binational Science Foundation (BSF), and by a grant from the Israeli Ministry of Science (MoS).
Rights and permissions
About this article
Cite this article
Mansour, Y., Schain, M. Robust domain adaptation. Ann Math Artif Intell 71, 365–380 (2014). https://doi.org/10.1007/s10472-013-9391-5
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10472-013-9391-5