26 October 2019 Semisupervised learning with adversarial training among joint distributions
Linyong Zhou, Zhijie Liu, Hongwei Tan, Xiaoyao Xie
Author Affiliations +
Abstract

Joint distribution matching based on generative adversarial nets (GANs) is an effective method to alleviate the insufficient diversity of labeled samples in semisupervised learning. In fact, in addition to the existing samples, generated samples and corresponding predictive labels must be taken into account to further increase the diversity of labeled samples and the controllability of generated samples. However, current works have not considered this. Therefore, a semisupervised learning model with adversarial training among joint distributions is proposed. The model consists of a generator, a classifier, and three discriminators incorporated with four joint distributions of samples and labels. The theoretical research indicates that, when the model reaches equilibrium, the classifier happens to be the inference network of the generator. Hence, the controllability of the generator and the generalization ability of the classifier are mutually improved. In semisupervised classification experiments, our model achieved state-of-the-art error rates of 0.59%, 16.45%, and 4.86% on MNIST, CIFAR10, and SVHN datasets, respectively. When only 20 labels are available on MNIST dataset, the error rate dropped from the current best of 4% to 1.09%, which indicates that the model is extremely robust to the number of labels. Meanwhile, the model also shows competitiveness in semisupervised generation.

© 2019 SPIE and IS&T 1017-9909/2019/$28.00 © 2019 SPIE and IS&T
Linyong Zhou, Zhijie Liu, Hongwei Tan, and Xiaoyao Xie "Semisupervised learning with adversarial training among joint distributions," Journal of Electronic Imaging 28(5), 053030 (26 October 2019). https://doi.org/10.1117/1.JEI.28.5.053030
Received: 30 June 2019; Accepted: 19 September 2019; Published: 26 October 2019
Lens.org Logo
CITATIONS
Cited by 1 scholarly publication.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Statistical modeling

Gallium nitride

Data modeling

Error analysis

Machine learning

Binary data

Neural networks

Back to Top