Abstract
Domain generalization (DG) is to learn knowledge from multiple training domain, and build a domain-agnostic model that could be used to an unseen domain. In this paper, take advantage of aggregating data method from all source and latent domains as a novel, we propose episodic training for domain generalization, aim to improve the performance during the trained model used for prediction in the unseen domain. To address this goal, we first designed an episodic training procedure that train a domain-generalized model without using domain labels. Firstly, we divide samples into latent domains via clustering, and design an episodic training procedure. Then, trains the model via adversarial learning in a way that exposes it into domain shift which decompose the model into feature extractor and classifier components, and train each component on the episodic domain. We utilize domain-invariant feature for clustering. Experiments show that our proposed method not only successfully achieves un-labeled domain generalization but also the training procedure improve the performance compared conventional DG methods.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Munkhdalai, T., Yu, H.: Meta networks. In: ICML (2017)
Ravi, S., Larochelle, H.: Optimization as a model for fewshot learning. In: ICLR (2017)
Finn, C., Abbeel, P., Levine, S.: Model-agnostic metalearning for fast adaptation of deep networks. In: ICML (2017)
Li, Y., Swersky, K., Zemel, R.: Generative moment matching networks. In: ICML (2015)
Makhzani, A., Shlens, J., Jaitly, N., Goodfellow, I., Frey, B.: Adversarial autoencoders. In: ICLR Workshop (2016)
Finn, C., Abbeel, P., Levine, S.: Model-agnostic meta-learning for fast adaptation of deep networks. In: ICML (2017)
Snell, J., Swersky, K., Zemel, R.S.: Prototypical networks for few shot learning. In: NIPS (2017)
Mishra, N., Rohaninejad, M., Chen, X., Abbeel, P.: Meta-learning with temporal convolutions. arXiv (2017)
Ravi, S., Larochelle, H.: Optimization as a model for few-shot learning. In: ICLR (2017)
Ganin, Y., Lempitsky, V.: Unsupervised domain adaptation by backpropagation. In: ICML (2015)
Li, H., Jialin Pan, S., Wang, S., Kot, A.C.: Domain generalization with adversarial feature learning. In: CVPR (2018)
Grandvalet, Y., Bengio, Y.: Semi-supervised learning by entropy minimization. In: NIPS (2005)
Long, M., Zhu, H., Wang, J., Jordan, M.I.: Unsupervised domain adaptation with residual transfer networks. In: NIPS (2016)
Zhang, Y., Tang, H., Jia, K., Tan, M.: Domain-symmetric networks for adversarial domain adaptation. In: CVPR (2019)
Gatys, L.A., Ecker, A.S., Bethge, M.: Image style transfer using convolutional neural networks. In: CVPR (2016)
Li, Y., Wang, N., Liu, J., Hou, X.: Demystifying neural style transfer. In: IJCAI (2017)
Huang, X., Belongie, S.: Arbitrary style transfer in real-time with adaptive instance normalization. In: ICCV (2017)
Munkres, J.: Algorithms for the assignment and transportation problems. J. Soc. Ind. Appl. Math. 5, 32–38 (1957)
LeCun, Y.: The MNIST database of handwritten digits (1998). https://yann.lecun.com/exdb/mnist/
Fang, C., Xu, Y., Rockmore, D.N.: Unbiased metric learning: on the utilization of multiple datasets and web images for softening bias. In: ICCV (2013)
Everingham, M., Van Gool, L., Williams, C.K.I., Winn, J., Zisserman, A.: The pascal visual object classes (VOC) challenge. IJCV 88, 303–338 (2010)
Russell, B.C., Torralba, A., Murphy, K.P., Freeman, W.T.: LabelMe: a database and web-based tool for image annotation. IJCV 77, 157–173 (2008)
Li, F.-F., Rob, F., Pietro, P.: Learning generative visual models from few training examples: an incremental bayesian approach tested on 101 object categories. In: CVPR Workshop on Generative-Model Based Vision (2004)
Choi, M.J., Lim, J., Torralba, A.: Exploiting hierarchical context on a large database of object categories. In: CVPR (2010)
Xu, Z., Li, W., Niu, L., Xu, D.: Exploiting low-rank structure from latent domains for domain generalization. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8691, pp. 628–643. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10578-9_41
Ganin, Y., et al.: Domain-adversarial training of neural networks. JMLR 17, 2096-2030 (2016)
Li, D., Yang, Y., Song, Y.-Z., Hospedales, T.: Learning to generalize: meta-learning for domain generalization. In: AAAI (2018)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Huang, B., Chen, S., Zhou, F., Zhang, C., Zhang, F. (2021). Episodic Training for Domain Generalization Using Latent Domains. In: Sun, F., Liu, H., Fang, B. (eds) Cognitive Systems and Signal Processing. ICCSIP 2020. Communications in Computer and Information Science, vol 1397. Springer, Singapore. https://doi.org/10.1007/978-981-16-2336-3_7
Download citation
DOI: https://doi.org/10.1007/978-981-16-2336-3_7
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-2335-6
Online ISBN: 978-981-16-2336-3
eBook Packages: Computer ScienceComputer Science (R0)