Abstract
Machine learning, and more specifically regression, usually focuses on the search for a precise model, when precise data are available. It is well-known that the model thus found may not exactly describe the target concept, due to the existence of learning biases. So, we are interested in a learning process that accounts also for the uncertainty around the predicted value which should not be illusionary precise. The goal of imprecise regression is to find a model that offers a good trade-off between faithfulness w.r.t. data and (meaningful) precision. The function that is learnt associates, to each input vector, a possibility distribution which represents a family of probability distributions. Based on this interpretation of a possibilistic distribution, we define the notion of possibilistic likelihood. Then, we propose a framework of imprecise regression based on the previous notion and a particle swarm optimization process. This approach takes advantage of the capability of triangular possibility distributions to approximate any unimodal probability distribution from above. We illustrate our approach with a generated dataset.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Celmins, A.: Least squares model fitting to fuzzy vector data. Fuzzy Sets and Systems 22(3), 245–269 (1987)
Diamond, P.: Fuzzy least squares. Information Science 46(3), 141–157 (1988)
Dubois, D.: Possibility theory and statistical reasoning. Computational Statistics and Data Analysis 51, 47–69 (2006)
Dubois, D., Foulloy, L., Mauris, G., Prade, H.: Probability-possibility transformations, triangular fuzzy sets, and probabilistic inequalities. Reliable Computing 10, 273–297 (2004)
Dubois, D., Prade, H.: When upper probabilities are possibility measures. Fuzzy Sets and Systems 49, 65–74 (1992)
Dubois, D., Prade, H., Sandri, S.: On possibility/probability transformations. In: Proceedings of Fourth IFSA Conference, pp. 103–112. Kluwer Academic Publ., Dordrecht (1993)
Kennedy, J., Eberhart, R.: Particle swarm optimization. In: Proceedings of IEEE International Conference on Neural Networks 1995, pp. 1942–1948 (1995)
Koenker, R., Hallock, K.F.: Quantile regression. Journal of Economic Perspectives 15, 143–156 (2001)
Prade, H., Serrurier, M.: Why Imprecise regression: a discussion. In: International Conference on Soft Methods in Probability and Statistics (SMPS), Oviedo (Espagne), pp. 527–535. Springer, Heidelberg (2010)
Serrurier, M., Prade, H.: A general framework for imprecise regression. In: FUZZ-IEEE 2007, London, pp. 1597–1602 (2007)
Serrurier, M., Prade, H.: Maximum-likelihood principle for possibility distributions viewed as families of probabilities. In: Proceeding of 2011 International Conference on Fuzzy Systems, FUZZ-IEEE (2011)
Tanaka, H.: Fuzzy data analysis by possibilistic linear models. Fuzzy Sets and Systems 24(3), 363–376 (1987)
Xu, S.-Q., Luo, Q.-Y., Xu, G.-H., Zhang, L.: Asymmetrical interval regression using extended epsilon-SVM with robust algorithm. Fuzzy Sets and Systems 160(7), 988–1002 (2009)
Zadeh, L.A.: Fuzzy sets as a basis for a theory of possibility. Fuzzy sets and systems 1, 3–25 (1978)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Serrurier, M., Prade, H. (2011). Imprecise Regression Based on Possibilistic Likelihood. In: Benferhat, S., Grant, J. (eds) Scalable Uncertainty Management. SUM 2011. Lecture Notes in Computer Science(), vol 6929. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-23963-2_35
Download citation
DOI: https://doi.org/10.1007/978-3-642-23963-2_35
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-23962-5
Online ISBN: 978-3-642-23963-2
eBook Packages: Computer ScienceComputer Science (R0)