Abstract
We propose and discuss improved Bayes rules to discriminate between two populations using ordered predictors. To address the problem we propose an alternative formulation using a latent space that allows to introduce the information about the order in the theoretical rules. The rules are first defined when the marginal densities are fully known and then under normality when the parameters are unknown and training samples are available. Several numerical examples and simulations in the paper illustrate the methodology and show that the new rules handle the information appropriately. We compare the new rules with the classical Bayes and Fisher rules in these examples and we show that the misclassification probability is smaller for the new rules. The method is also applied to data from a diabetes study where we again show that the new rules improve over the usual Fisher rule.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
ABELSON, R.P. and TUKEY, J.W. (1963), “Efficient Utilization of Non-Numerical Information in Quantitative Analysis: General Theory and the Case of the Simple Order”, Annals of Mathematical Statistics 34, 1347–1369.
ATTALLAH, A.M., TOSON, E.A., EL-WASEEF,A.M., ABO-SEIF,M.A.,OMRAN,M.M., and SHIHA, G.E. (2006), “Discriminant Function Based on Hyaluronic Acid and Its Degrading Enzymes and Degradation Products for Differentiating Cirrhotic from Non-Cirrhotic Liver Diseased Patients in Chronic HCV Infection”, Clinica Chimica Acta 369, 66–72.
BARLOW, R.E., BARTHOLOMEW, D.J., BREMNER, J.M., and BRUNK, H.D. (1972), Statistical Inference under Order Restrictions, New York: Wiley.
BLAKE, C.L. and MERZ, C.J. (1998), UCI Repository Learning Databases, http://www.ics.uci.edu/~mlearn/MLRepository.html, Irvine, CA: University of California, Department of Information and Computer Science.
BRETZ, F. and HOTHORN, L.A. (2003), “Statistical Analysis of Monotone or Non-Monotone Dose-Response Data from In Vitro Toxicological Assays”, Alternatives to Laboratory Animals 31, Supp. 1, 81–96.
CONDE, D., FERNÁNDEZ,M.A., and SALVADOR, B. (2005), “A Classification Rule for Ordered Exponential Populations”, Journal of Statistical Planning and Inference 153, 339–356.
DUNSON, D.B. (2005), “Bayesian Semiparametric Isotonic Regression for Count Data”, Journal of the American Statistical Association 100, 618–627.
DYKSTRA, R., HEWETT, J., and ROBERTSON, T. (1999), “Nonparametric Isotonic Discriminant Procedures”, Biometrika 86, 429–438.
EL BARMI, H. and DYKSTRA, R. (1998), “Maximum Likelihood Methods for Log-Convex Models When Cell Probabilities Are Subject to Convex Constraints”, Annals of Statistics 26, 1878–1893.
FERNÁNDEZ,M.A., RUEDA, C., and SALVADOR, B. (2006), “Incorporating Additional Information to Normal Linear Discriminant Rules”, Journal of the American Statistical Association 101, 569–577.
GENZ, A. (1992), “Numerical Computation of Multivariate Normal Probabilities”, Journal of Computational and Graphical Statatistics 1, 142–150.
HOFF, P.D. (2003a), “Bayesian Methods for Partial Stochastic Ordering”, Biometrika 90, 303–317.
HOFF, P.D. (2003b), “Nonparametric Estimation of Convex Models Via Mixtures”, Annals of Statistics 31, 174–200.
LONG, T. and GUPTA, R.D. (1998), “Alternative Linear Classification Rules Under Order Restrictions”, Communications in Statististics - Theory and Methods 27, 559–575.
MOON, H.R. and SCHORFHEIDE, F. (2005), “Empirical Likelihood Estimation with Inequality Moment Constraints”, Working paper: http://www.econ.princeton.edu/seminars/ECONOMETRICS/Metrirs_Fall_2005/Schorfheide.pdf.
NEELON, B. and DUNSON, D.B. (2004), “Bayesian Isotonic Regression and Trend Analysis”, Biometrics 60, 398–406.
PEDDADA, S.D., HARRIS, S., ZAJD, J., and HARVEY, E. (2005), “ORIOGEN: Order Restricted Inference for Ordered Gene Expression Data”, Bioinformatics 21, 3933–3934.
PEDDADA, S.D., PRESCOTT, K.E., LI, L.P., AFSHARI, C.A., WEINBERG, C.R., and UMBACH, D. (2003), “Gene Selection and Clustering for Time.Course And Dose-Response Microarray Experiments Using Order-Restricted Inference”, Bioinformatics 19, 834–841.
ROBERTSON, T., WRIGHT, F.T., and DYKSTRA, R.L. (1988), Order Restricted Statistical Inference, New York: John Wiley and Sons.
SILVAPULLE, M.J. and SEN, P.K. (2005), Constrained Statistical Inference, New Jersey: John Wiley and Sons.
Author information
Authors and Affiliations
Corresponding author
Additional information
Research partially supported by Spanish DGES and by PAPIJCL. The authors thank the editor and an anonymous reviewer for their detailed reading that resulted in this much improved version of the paper.
Rights and permissions
About this article
Cite this article
Rueda, C., Fernández, M.A. & Salvador, B. Bayes Discriminant Rules with Ordered Predictors. J Classif 26, 201–225 (2009). https://doi.org/10.1007/s00357-009-9034-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00357-009-9034-z