Abstract
The property of calibration of Multi-Label Learning (MLL) has not been well studied. Because of the excellent calibration property of Conformal Predictors (CP), it is valuable to achieve calibrated MLL prediction via CP. Three practical implementations of Multi-Label Conformal Predictors (MLCP) can be established. Among them are Instance Reproduction MLCP (IR-MLCP), Binary Relevance MLCP (BR-MLCP) and Power Set MLCP (PS-MLCP). The experimental results on benchmark datasets show that all three MLCP methods possess calibration property. Comparatively speaking, BR-MLCP performs better in terms of prediction efficiency and computational cost than the other two.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Balasubramanian, V., Ho, S.S., Vovk, V.: Conformal Prediction for Reliable Machine Learning: Theory. Adaptations and Applications. Morgan Kaufmann, Massachusetts (2014)
Fedorova, V.: Conformal prediction and testing under on-line compression models. PhD Thesis, Royal Holloway University of London (2014)
Madjarov, G., Kocev, D., Gjorgjevikj, D., Dzeroski, S.: An extensive experimental comparison of methods for multi-label learning. Pattern Recognition 45(9), 3084–3104 (2012)
Nouretdinov, I., Melluish, T., Vovk, V.: Ridge regression confidence machine. In: ICML, pp. 385–392. Citeseer (2001)
Papadopoulos, H.: A Cross-Conformal Predictor for Multi-label Classification. In: Iliadis, L., Maglogiannis, I., Papadopoulos, H., Sioutas, S., Makris, C. (eds.) AIAI 2014 Workshops. IFIP AICT, vol. 437, pp. 241–250. Springer, Heidelberg (2014)
Tsoumakas, G., Katakis, I.: Multi-label classification: An overview. International Journal of Data Warehousing and Mining (IJDWM) 3(3), 1–13 (2007)
Vovk, V., Gammerman, A., Shafer, G.: Algorithmic Learning in a Random World. Springer, New York (2005)
Wang, H., Liu, X., Lv, B., Yang, F., Hong, Y.: Reliable multi-label learning via conformal predictor and random forest for syndrome differentiation of chronic fatigue in traditional chinese medicine. PLoS ONE 9(6), e99565 (2014)
Zhang, M.L., Zhou, Z.H.: A review on multi-label learning algorithms. IEEE Transactions on Knowledge and Data Engineering 26(8), 1819–1837 (2014)
Zhang, M., Zhou, Z.: Ml-knn: A lazy learning approach to multi-label learning. Pattern Recognition 40(7), 2038–2048 (2007)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Wang, H., Liu, X., Nouretdinov, I., Luo, Z. (2015). A Comparison of Three Implementations of Multi-Label Conformal Prediction. In: Gammerman, A., Vovk, V., Papadopoulos, H. (eds) Statistical Learning and Data Sciences. SLDS 2015. Lecture Notes in Computer Science(), vol 9047. Springer, Cham. https://doi.org/10.1007/978-3-319-17091-6_19
Download citation
DOI: https://doi.org/10.1007/978-3-319-17091-6_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-17090-9
Online ISBN: 978-3-319-17091-6
eBook Packages: Computer ScienceComputer Science (R0)