skip to main content
10.1145/3411408.3411422acmotherconferencesArticle/Chapter ViewAbstractPublication PagessetnConference Proceedingsconference-collections
short-paper

Multivariate two-sample hypothesis testing through AUC maximization for biomedical applications

Published: 02 September 2020 Publication History

Abstract

Clinical datasets usually carry numerous features (biomarkers, characteristics, etc.) concerning the examined populations. This fact, although beneficial, challenges the statistical analysis via standard univariate approaches. In the two-sample setting, the majority of the clinical studies evaluate their assumptions relying on a variety of available univariate tests, such as the Student’s t-test or Mann-Whitney Wilcoxon. We developed an easy-to-use-and-interpret non-parametric two-sample hypothesis testing framework (ts-AUC) particularly using machine learning and the AUC maximization criterion. We test and verify the effectiveness of ts-AUC in real data containing posturographic features of Parkinsonian patients (PS) with and without history of falling.

References

[1]
S. Agarwal, T. Graepel, R. Herbrich, S. Har-Peled, and D. Roth. 2005. Generalization bounds for the area under the ROC curve. Journal of Machine Learning Research 6, Apr (2005), 393–425.
[2]
J. Audiffren and E. Contal. 2016. Preprocessing the Nintendo Wii board signal to derive more accurate descriptors of statokinesigrams. Sensors 16, 8 (2016), 1208.
[3]
L. Breiman. 2001. Random forests. Machine Learning 45, 1 (2001), 5–32.
[4]
S. Clémençon, G. Lugosi, and N. Vayatis. 2005. Ranking and scoring using empirical risk minimization. In Int. Conf. on Comp. Learning Theory. 1–15.
[5]
C. Cortes and M. Mohri. 2004. AUC optimization vs. error rate minimization. In Advances in Neural Information Processing Systems. 313–320.
[6]
J. Davis and M. Goadrich. 2006. The relationship between Precision-Recall and ROC curves. In Int. Conf. on Machine Learning. ACM, 233–240.
[7]
J.A. Doornik and H. Hansen. 1996. Out-of-bag estimation. Technical Report. Dept. of Statistics, Univ. of California, Berkeley.
[8]
R.J. Feise. 2002. Do multiple outcome measures require p-value adjustment?BMC Medical Research Methodology 2, 1 (2002), 8.
[9]
R. Genuer, J.-M. Poggi, and C. Tuleau-Malot. 2010. Variable selection using random forests. Pattern Recognition Letters 31, 14 (2010), 2225–2236.
[10]
A. Gretton, K.M. Borgwardt, M.J. Rasch, B. Schölkopf, and A. Smola. 2012. A kernel two-sample test. Journal of Machine Learning Research 13, Mar (2012), 723–773.
[11]
G.K. Kerr, C.J. Worringham, M.H. Cole, P.F. Lacherez, J.M. Wood, and P.A. Silburn. 2010. Predictors of future falls in Parkinson disease. Neurology 75, 2 (2010), 116–124.
[12]
J.M. Leach, M. Mancini, R.J. Peterka, T.L. Hayes, and F.B. Horak. 2014. Validating and calibrating the Nintendo Wii balance board to derive reliable center of pressure measures. Sensors 14, 10 (2014), 18244–18267.
[13]
M. Mancini, P. Carlson-Kuhta, C. Zampieri, J.G. Nutt, L. Chiari, and F.B. Horak. 2012. Postural sway as a marker of progression in Parkinson’s disease: a pilot longitudinal study. Gait & Posture 36, 3 (2012), 471–476.
[14]
I. Melzer, N. Benjuya, and J. Kaplanski. 2004. Postural stability in the elderly: a comparison between fallers and non-fallers. Age and Ageing 33, 6 (2004), 602–607.
[15]
M.S. Thiese, Z.C. Arnold, and S.D. Walker. 2015. The misuse and abuse of statistics in biomedical research. Biochemia Medica 25, 1 (2015), 5–11.
[16]
N. Vayatis, M. Depecker, and S.J. Clémençcon. 2009. AUC optimization and the two-sample problem. In Advances in Neural Information Processing Systems. 360–368.
[17]
A.A. Zecevic, A.W. Salmoni, M. Speechley, and A.A. Vandervoort. 2006. Defining a fall and reasons for falling: comparisons among the views of seniors, health care providers, and the research literature. The Gerontologist 46, 3 (2006), 367–376.

Cited By

View all
  • (2022)AUC Maximization in the Era of Big Data and AI: A SurveyACM Computing Surveys10.1145/355472955:8(1-37)Online publication date: 3-Aug-2022
  • (2022)Preventing falls: the use of machine learning for the prediction of future falls in individuals without history of fallJournal of Neurology10.1007/s00415-022-11251-3270:2(618-631)Online publication date: 11-Jul-2022
  • (2021)Sleep apnea syndrome and subthalamic stimulation in Parkinson’s diseaseSleep Medicine10.1016/j.sleep.2021.07.031Online publication date: Jul-2021

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences
SETN 2020: 11th Hellenic Conference on Artificial Intelligence
September 2020
249 pages
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 September 2020

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. AUC maximization
  2. Machine learning
  3. Parkinson’s disease.
  4. multiple testing
  5. multivariate two-sample hypothesis tests

Qualifiers

  • Short-paper
  • Research
  • Refereed limited

Conference

SETN 2020

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)35
  • Downloads (Last 6 weeks)6
Reflects downloads up to 14 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2022)AUC Maximization in the Era of Big Data and AI: A SurveyACM Computing Surveys10.1145/355472955:8(1-37)Online publication date: 3-Aug-2022
  • (2022)Preventing falls: the use of machine learning for the prediction of future falls in individuals without history of fallJournal of Neurology10.1007/s00415-022-11251-3270:2(618-631)Online publication date: 11-Jul-2022
  • (2021)Sleep apnea syndrome and subthalamic stimulation in Parkinson’s diseaseSleep Medicine10.1016/j.sleep.2021.07.031Online publication date: Jul-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media