An Ensemble Model for Error Modeling with Pseudoinverse Learning Algorithm | IEEE Conference Publication | IEEE Xplore

An Ensemble Model for Error Modeling with Pseudoinverse Learning Algorithm


Abstract:

In Bayesian theory, the maximum posterior estimator uses prior information to estimate the noise in the machine learning model by adding the regularization term. The regu...Show More

Abstract:

In Bayesian theory, the maximum posterior estimator uses prior information to estimate the noise in the machine learning model by adding the regularization term. The regularization terms L1 and L2 correspond to Laplacian prior and Guassian prior, respectively. In existing deep learning models, in order to use the gradient descent optimization algorithm and achieve good results, most models take L2 regularization as the regularization term of the network model to fit the complex Guassian noise. However in practice, the Laplace noise and the Guassian noise are both considered as data noise. For multi-layer perceptrons, the difficulty caused by adding L1 and L2 into the optimization function of the network is solved by proposing an ensemble model for error modeling through adopting the divide and conquer strategy. First, several base learners are trained to fit different noise distributions of data, then the final results can be obtained by taking the results of each base leaner as new data to train a meta leaner, and get the final results. Among them, coordinate regression method is used to solve L1 loss, while the pseudo-inverse learning algorithm is employed to solve L2 loss. Both methods are nongradient optimization algorithms. The comparison results of the model on several data sets show that the proposed ensemble model achieves better performance.
Date of Conference: 06-09 October 2019
Date Added to IEEE Xplore: 28 November 2019
ISBN Information:

ISSN Information:

Conference Location: Bari, Italy

References

References is not available for this document.