Skip to main content
SpringerLink
Log in

Systematic Review of an Automated Multiclass Detection and Classification System for Acute Leukaemia in Terms of Evaluation and Benchmarking, Open Challenges, Issues and Methodological Aspects

  • Systems-Level Quality Improvement
  • Published:
Journal of Medical Systems Aims and scope Submit manuscript

Abstract

This study aims to systematically review prior research on the evaluation and benchmarking of automated acute leukaemia classification tasks. The review depends on three reliable search engines: ScienceDirect, Web of Science and IEEE Xplore. A research taxonomy developed for the review considers a wide perspective for automated detection and classification of acute leukaemia research and reflects the usage trends in the evaluation criteria in this field. The developed taxonomy consists of three main research directions in this domain. The taxonomy involves two phases. The first phase includes all three research directions. The second one demonstrates all the criteria used for evaluating acute leukaemia classification. The final set of studies includes 83 investigations, most of which focused on enhancing the accuracy and performance of detection and classification through proposed methods or systems. Few efforts were made to undertake the evaluation issues. According to the final set of articles, three groups of articles represented the main research directions in this domain: 56 articles highlighted the proposed methods, 22 articles involved proposals for system development and 5 papers centred on evaluation and comparison. The other taxonomy side included 16 main and sub-evaluation and benchmarking criteria. This review highlights three serious issues in the evaluation and benchmarking of multiclass classification of acute leukaemia, namely, conflicting criteria, evaluation criteria and criteria importance. It also determines the weakness of benchmarking tools. To solve these issues, multicriteria decision-making (MCDM) analysis techniques were proposed as effective recommended solutions in the methodological aspect. This methodological aspect involves a proposed decision support system based on MCDM for evaluation and benchmarking to select suitable multiclass classification models for acute leukaemia. The said support system is examined and has three sequential phases. Phase One presents the identification procedure and process for establishing a decision matrix based on a crossover of evaluation criteria and acute leukaemia multiclass classification models. Phase Two describes the decision matrix development for the selection of acute leukaemia classification models based on the integrated Best and worst method (BWM) and VIKOR. Phase Three entails the validation of the proposed system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21

Similar content being viewed by others

References

  1. De Paz, J. F. et al., Biomedic Organizations: An intelligent dynamic architecture for KDD. Inf. Sci. 224:49–61, 2013.

    Google Scholar 

  2. Chen, X. and Jian, C. A tumor classification model using least square regression. In: 2014 10th International Conference on Natural Computation (ICNC). 2014.

  3. Deegalla, S. and Boström, H. Improving Fusion of Dimensionality Reduction Methods for Nearest Neighbor Classification. In: 2009 International Conference on Machine Learning and Applications. 2009.

  4. Alsalem, M. A. et al., A review of the automated detection and classification of acute leukaemia: Coherent taxonomy, datasets, validation and performance measurements, motivation, open challenges and recommendations. Comput. Methods Prog. Biomed. 158:93–112, 2018.

    CAS  Google Scholar 

  5. Fann, Y. C., Enhancing patient care and outcomes through innovative informatics systems and tools. Comput. Methods Prog. Biomed. 158:A1, 2018.

    Google Scholar 

  6. Torkaman, A., et al. A recommender system for detection of leukemia based on cooperative game. In: 2009 17th Mediterranean Conference on Control and Automation. 2009.

  7. Zhiyong, Y., Jingcheng, L., and Zhang, T., Extreme Large Margin Distribution Machine and its applications for biomedical datasets. In: 2016 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). 2016.

  8. Al-Sahaf, H., Song, A., and Zhang, M., Hybridisation of Genetic Programming and Nearest Neighbour for classification. In: 2013 IEEE Congress on Evolutionary Computation. 2013.

  9. Escalante, H. J. et al., Acute leukemia classification by ensemble particle swarm model selection. Artif. Intell. Med. 55(3):163–175, 2012.

    PubMed  Google Scholar 

  10. Labati, R.D., et al., ALL-IDB: The acute lymphoblastic leukemia image database for image processing. In: 2011 18th Ieee International Conference on Image Processing. 2011.

  11. Singhal, V. and Singh, P. Local Binary Pattern for automatic detection of Acute Lymphoblastic Leukemia. In: 2014 Twentieth National Conference on Communications (NCC). 2014.

  12. Cornet, E., Perol, J. P., and Troussard, X., Performance evaluation and relevance of the CellaVision (TM) DM96 system in routine analysis and in patients with malignant hematological diseases. Int. J. Lab. Hematol. 30(6):536–542, 2008.

    CAS  PubMed  PubMed Central  Google Scholar 

  13. Bhattacharjee, R. and Saini, L.M. Detection of Acute Lymphoblastic Leukemia using watershed transformation technique. In: 2015 International Conference on Signal Processing, Computing and Control (ISPCC). 2015.

  14. Laosai, J. and Chamnongthai, K., Acute leukemia classification by using SVM and K-Means clustering. In: 2014 International Electrical Engineering Congress (iEECON). 2014.

  15. Goutam, D. and Sailaja, S., Classification of acute myelogenous leukemia in blood microscopic images using supervised classifier. In: 2015 IEEE International Conference on Engineering and Technology (ICETECH). 2015.

  16. Agaian, S., Madhukar, M., and Chronopoulos, A. T., Automated Screening System for Acute Myelogenous Leukemia Detection in Blood Microscopic Images. IEEE Syst. J. 8(3):995–1004, 2014.

    Google Scholar 

  17. Mohapatra, S., et al., Fuzzy Based Blood Image Segmentation for Automated Leukemia Detection>. In: 2011 International Conference on Devices and Communications (ICDeCom). 2011.

  18. Mohapatra, S., Patra, D., and Satpathi, S., Image analysis of blood microscopic images for acute leukemia detection. In: 2010 International Conference on Industrial Electronics, Control and Robotics. 2010.

  19. Srisukkham, W. et al., Intelligent leukaemia diagnosis with bare-bones PSO based feature optimization. Appl. Soft Comput. 56:405–419, 2017.

    Google Scholar 

  20. Snousy, M. B. A. et al., Suite of decision tree-based classification algorithms on cancer gene expression data. Egypt. Informatics J. 12(2):73–82, 2011.

    Google Scholar 

  21. Mishra, S. et al., Gray level co-occurrence matrix and random forest based acute lymphoblastic leukemia detection. Biomed. Signal Process. Control. 33:272–280, 2017.

    Google Scholar 

  22. Nguyen, T., and Nahavandi, S., Modified AHP for Gene Selection and Cancer Classification Using Type-2 Fuzzy Logic. IEEE Trans. Fuzzy Syst. 24(2):273–287, 2016.

    Google Scholar 

  23. Lei, X., and Chen, Y., Multiclass Classification of Microarray Data Samples with Flexible Neural Tree. In: 2012 Spring Congress on Engineering and Technology. 2012.

  24. Soares, C., et al., Automating Microarray Classification Using General Regression Neural Networks. In: 2008 Seventh International Conference on Machine Learning and Applications. 2008.

  25. Wang, H.-Q. et al., A neural network-based biomarker association information extraction approach for cancer classification. J. Biomed. Inform. 42(4):654–666, 2009.

    CAS  PubMed  Google Scholar 

  26. Wang, X., and Wang, S., Enhanced algorithm for high-dimensional data classification. Appl. Soft Comput. 40:1–9, 2016.

    CAS  Google Scholar 

  27. Huang, H.L., et al., Boosting Evolutionary Support Vector Machine for Designing Tumor Classifiers from Microarray Data. In: 2007 IEEE Symposium on Computational Intelligence and Bioinformatics and Computational Biology. 2007.

  28. Kumar, M., and Kumar Rath, S., Classification of microarray using MapReduce based proximal support vector machine classifier. Knowl.-Based Syst. 89:584–602, 2015.

    Google Scholar 

  29. Nasir, A. S. A., Mashor, M. Y., and Hassan, R., Leukaemia screening based on fuzzy ARTMAP and simplified fuzzy ARTMAP neural networks. In: 2012 IEEE-EMBS Conference on Biomedical Engineering and Sciences. 2012.

  30. Qasem, M., and Nour, M., Improving Accuracy for Classifying Selected Medical Datasets with Weighted Nearest Neighbors and Fuzzy Nearest Neighbors Algorithms. In: 2015 International Conference on Cloud Computing (ICCC). 2015.

  31. Ludwig, S. A., Jakobovic, D., and Picek, S., Analyzing gene expression data: Fuzzy decision tree algorithm applied to the classification of cancer data. In: 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE). 2015.

  32. Supardi, N. Z., et al., Classification of blasts in acute leukemia blood samples using k-nearest neighbour. In: 2012 IEEE 8th International Colloquium on Signal Processing and its Applications. 2012.

  33. Campos, L. M. d., et al., Bayesian networks classifiers for gene-expression data. In: 2011 11th International Conference on Intelligent Systems Design and Applications. 2011.

  34. Chunbao, Z., Liming, W., and Yanchun, L., A hybrid algorithm of minimum spanning tree and nearest neighbor for classifying human cancers. In: 2010 3rd International Conference on Advanced Computer Theory and Engineering(ICACTE). 2010.

  35. Wang, S.-L. et al., Tumor classification by combining PNN classifier ensemble with neighborhood rough set based gene reduction. Comput. Biol. Med. 40(2):179–189, 2010.

    CAS  PubMed  Google Scholar 

  36. Fan, Y., Hua-Zhen, W., and Hong, M., A novel classification method of microarray with reliability and confidence. In: 2008 International Conference on Machine Learning and Cybernetics. 2008.

  37. El-Nasser, A. A., Shaheen, M., and El-Deeb, H., Enhanced leukemia cancer classifier algorithm. In: 2014 Science and Information Conference. 2014.

  38. Ren, C. -X., Dai, D. -Q., and Yan, H., Robust classification using L 2,1 norm based regression model. Pattern Recogn. 45(7):2708–2718, 2012.

    Google Scholar 

  39. Kim, S., Spectral Methods for Cancer Classification Using Microarray Data. In: 2009 International Joint Conference on Computational Sciences and Optimization. 2009.

  40. Salem, H., Attiya, G., and El-Fishawy, N., Gene expression profiles based Human cancer diseases classification. In: 2015 11th International Computer Engineering Conference (ICENCO). 2015.

  41. Lu, H. et al., A cost-sensitive rotation forest algorithm for gene expression data classification. Neurocomputing. 228:270–276, 2017.

    Google Scholar 

  42. Zhang, L. et al., Similarity-balanced discriminant neighbor embedding and its application to cancer classification based on gene expression data. Comput. Biol. Med. 64:236–245, 2015.

    PubMed  Google Scholar 

  43. Chandra, B., and Gupta, M., Robust approach for estimating probabilities in Naïve–Bayes Classifier for gene expression data. Expert Syst. Appl. 38(3):1293–1298, 2011.

    Google Scholar 

  44. Saengsiri, P., et al., Classification models based-on incremental learning algorithm and feature selection on gene expression data. In: The 8th Electrical Engineering/ Electronics, Computer, Telecommunications and Information Technology (ECTI) Association of Thailand - Conference 2011. 2011.

  45. Wang, H. -Q. et al., Extracting gene regulation information for cancer classification. Pattern Recogn. 40(12):3379–3392, 2007.

    Google Scholar 

  46. Rajwa, B. et al., Automated Assessment of Disease Progression in Acute Myeloid Leukemia by Probabilistic Analysis of Flow Cytometry Data. IEEE Trans. Biomed. Eng. 64(5):1089–1098, 2017.

    PubMed  Google Scholar 

  47. He, Y., and Hui, S. C., Exploring ant-based algorithms for gene expression data analysis. Artif. Intell. Med. 47(2):105–119, 2009.

    PubMed  Google Scholar 

  48. Li, J. -T., and Jia, Y. -M., An Improved Elastic Net for Cancer Classification and Gene Selection. Acta Automat. Sin. 36(7):976–981, 2010.

    Google Scholar 

  49. Krappe, S., et al., Automated morphological analysis of bone marrow cells in microscopic images for diagnosis of leukemia: Nucleus-plasma separation and cell classification using a hierarchical tree model of hematopoesis. In: Tourassi, G. D., and Armato, S. G., (Eds.), Medical Imaging 2016: Computer-Aided Diagnosis. 2015.

  50. Mohapatra, P., Chakravarty, S., and Dash, P. K., Microarray medical data classification using kernel ridge regression and modified cat swarm optimization based gene selection system. Swarm Evol. Comput. 28:144–160, 2016.

    Google Scholar 

  51. Chakraborty, S., Simultaneous cancer classification and gene selection with Bayesian nearest neighbor method: An integrated approach. Comput. Stat. Data Anal. 53(4):1462–1474, 2009.

    Google Scholar 

  52. Yongqiang, D., et al., Feature selection of high-dimensional biomedical data using improved SFLA for disease diagnosis. In: 2015 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). 2015.

  53. Tran, V. N., et al., An automated method for the nuclei and cytoplasm of Acute Myeloid Leukemia detection in blood smear images. In: 2016 World Automation Congress (WAC). 2016.

  54. Cui, Y. et al., Sparse maximum margin discriminant analysis for feature extraction and gene selection on gene expression data. Comput. Biol. Med. 43(7):933–941, 2013.

    CAS  PubMed  Google Scholar 

  55. Rashid, S., and Maruf, G. M., An adaptive feature reduction algorithm for cancer classification using wavelet decomposition of serum proteomic and DNA microarray data. In: 2011 IEEE International Conference on Bioinformatics and Biomedicine Workshops (BIBMW). 2011.

  56. Hasan, A., and Akhtaruzzaman, A. Md., High dimensional microarray data classification using correlation based feature selection. In: 2012 International Conference on Biomedical Engineering (ICoBE). 2012.

  57. Cao, J. et al., A fast gene selection method for multi-cancer classification using multiple support vector data description. J. Biomed. Inform. 53:381–389, 2015.

    PubMed  Google Scholar 

  58. Zhang, L., and Xiaojuan, H., Multiple SVM-RFE for multi-class gene selection on DNA Microarray data. In: 2015 International Joint Conference on Neural Networks (IJCNN). 2015.

  59. Paul, S., and Maji, P., Rough set based gene selection algorithm for microarray sample classification. In: 2010 International Conference on Methods and Models in Computer Science (ICM2CS-2010). 2010.

  60. Mohapatra, P., and Chakravarty, S., Modified PSO based feature selection for Microarray data classification. In: 2015 IEEE Power, Communication and Information Technology Conference (PCITC). 2015.

  61. Shi, T. W., et al., Random Forest and Gene Ontology for functional analysis of microarray data. In: 2014 IEEE 7th International Workshop on Computational Intelligence and Applications (IWCIA). 2014.

  62. Dash, S., Hill-climber based fuzzy-rough feature extraction with an application to cancer classification. In: 13th International Conference on Hybrid Intelligent Systems (HIS 2013). 2013.

  63. Yusen, Z., and Liangyun, R., Two feature selections for analysis of microarray data. In: 2010 IEEE Fifth International Conference on Bio-Inspired Computing: Theories and Applications (BIC-TA). 2010.

  64. Lu, X., et al., A novel feature selection method based on CFS in cancer recognition. In: 2012 IEEE 6th International Conference on Systems Biology (ISB). 2012.

  65. Rosa, J. L. D., et al., Cluster center genes as candidate biomarkers for the classification of Leukemia. In: IISA 2014, The 5th International Conference on Information, Intelligence, Systems and Applications. 2014.

  66. Chiang, J. H., and Ho, S. H., A Combination of Rough-Based Feature Selection and RBF Neural Network for Classification Using Gene Expression Data. IEEE Trans. NanoBiosci. 7(1):91–99, 2008.

    CAS  Google Scholar 

  67. Pisharady, P. K., Vadakkepat, P., and Poh, L. A., Fuzzy-rough discriminative feature selection and classification algorithm, with application to microarray and image datasets. Appl. Soft Comput. 11(4):3429–3440, 2011.

    Google Scholar 

  68. Qizhong, Z., Gene selection and classification using non-linear kernel support vector machines based on gene expression data. In: 2007 IEEE/ICME International Conference on Complex Medical Engineering. 2007.

  69. Garro, B. A., Rodríguez, K., and Vazquez, R. A., Designing artificial neural networks using differential evolution for classifying DNA microarrays. In: 2017 IEEE Congress on Evolutionary Computation (CEC). 2017.

  70. Begum, S., Chakraborty, D., and Sarkar, R., Data Classification Using Feature Selection and kNN Machine Learning Approach. In: 2015 International Conference on Computational Intelligence and Communication Networks (CICN). 2015.

  71. Chen, T. C., et al., Feature selection and classification by using grid computing based evolutionary approach for the microarray data. In: 2010 3rd International Conference on Computer Science and Information Technology. 2010.

  72. Roy, A., Mackin, P. D., and Mukhopadhyay, S., Methods for pattern selection, class-specific feature selection and classification for automated learning. Neural Netw. 41:113–129, 2013.

    PubMed  Google Scholar 

  73. Maulik, U., Mukhopadhyay, A., and Chakraborty, D., Gene-Expression-Based Cancer Subtypes Prediction Through Feature Selection and Transductive SVM. IEEE Trans. Biomed. Eng. 60(4):1111–1117, 2013.

    PubMed  Google Scholar 

  74. Madhloom, H. T., Kareem, S. A., and Ariffin, H., A Robust Feature Extraction and Selection Method for the Recognition of Lymphocytes versus Acute Lymphoblastic Leukemia. In: 2012 International Conference on Advanced Computer Science Applications and Technologies (ACSAT). 2012.

  75. Nazlibilek, S. et al., Automatic segmentation, counting, size determination and classification of white blood cells. Measurement. 55:58–65, 2014.

    Google Scholar 

  76. Rawat, J. et al., Computer Aided Diagnostic System for Detection of Leukemia Using Microscopic Images. Procedia Computer Science. 70:748–756, 2015.

    Google Scholar 

  77. Bhattacharjee, R., and Saini, L. M., Robust technique for the detection of Acute Lymphoblastic Leukemia. In: 2015 IEEE Power, Communication and Information Technology Conference (PCITC). 2015.

  78. Dehghan Khalilabad, N., and Hassanpour, H., Employing image processing techniques for cancer detection using microarray images. Comput. Biol. Med. 81:139–147, 2017.

    PubMed  Google Scholar 

  79. Putzu, L., Caocci, G., and Di Ruberto, C., Leucocyte classification for leukaemia detection using image processing techniques. Artif. Intell. Med. 62(3):179–191, 2014.

    PubMed  Google Scholar 

  80. Shankar, V., et al., Automatic detection of acute lymphoblasitc leukemia using image processing. In: 2016 IEEE International Conference on Advances in Computer Applications (ICACA). 2016.

  81. Horng, J. -T., et al., An expert system to classify microarray gene expression data using gene selection by decision tree. Expert Syst. Appl. 36(5):9072–9081, 2009.

    Google Scholar 

  82. Wang, Z., and Palade, V., A Comprehensive Fuzzy-Based Framework for Cancer Microarray Data Gene Expression Analysis. In: 2007 IEEE 7th International Symposium on BioInformatics and BioEngineering. 2007.

  83. Ganesh Kumar, P., et al., Design of fuzzy expert system for microarray data classification using a novel Genetic Swarm Algorithm. Expert Syst. Appl. 39(2):1811–1821, 2012.

    Google Scholar 

  84. Krappe, S., et al., Automated classification of bone marrow cells in microscopic images for diagnosis of leukemia: A comparison of two classification schemes with respect to the segmentation quality. In: Hadjiiski, L. M., and Tourassi, G. D., (Eds.), Medical Imaging 2015: Computer-Aided Diagnosis. 2015.

  85. Rota, P., Groeneveld-Krentz, S., and Reiter, M., On automated Flow Cytometric analysis for MRD estimation of Acute Lymphoblastic Leukaemia: A comparison among different approaches. In: 2015 IEEE International Conference on Bioinformatics and Biomedicine (BIBM). 2015.

  86. Hossin, M., and Sulaiman, M., A review on evaluation metrics for data classification evaluations. Int. J. Data Min. Knowl. Manag. Process. 5(2):1, 2015.

    Google Scholar 

  87. Tai, W.L., et al., Blood Cell Image Classification Based on Hierarchical SVM. In: 2011 IEEE International Symposium on Multimedia. 2011.

  88. Gul, M., et al., A state of the art literature review of VIKOR and its fuzzy extensions on applications. Appl. Soft Comput. 46:60–89, 2016.

    Google Scholar 

  89. Sokolova, M., and Lapalme, G., A systematic analysis of performance measures for classification tasks. Inf. Process. Manag. 45(4):427–437, 2009.

    Google Scholar 

  90. Saritha, M., et al., Detection of blood cancer in microscopic images of human blood samples: A review. In: 2016 International Conference on Electrical, Electronics, and Optimization Techniques (ICEEOT). 2016.

  91. Zhang, C., et al., An imbalanced data classification algorithm of improved autoencoder neural network. In: 2016 Eighth International Conference on Advanced Computational Intelligence (ICACI). 2016.

  92. Zupan, B., and Demsar, J., Open-source tools for data mining. Clin. Lab. Med. 28(1):37–54, 2008.

    PubMed  Google Scholar 

  93. Daqqa, K. A. S. A., Maghari, A. Y. A., and Sarraj, W. F. M. A., Prediction and diagnosis of leukemia using classification algorithms. In: 2017 8th International Conference on Information Technology (ICIT), 2017.

  94. Dwivedi, S., Kasliwal P., and Soni, S., Comprehensive study of data analytics tools (RapidMiner, Weka, R tool, Knime). In: 2016 Symposium on Colossal Data Analysis and Networking (CDAN). 2016.

  95. Sharma, R., Singh, S. N., and Khatri, S., Medical Data Mining Using Different Classification and Clustering Techniques: A Critical Survey. In: 2016 Second International Conference on Computational Intelligence & Communication Technology (CICT). 2016.

  96. Cadenas, J. M., Garrido, M. C., and Martínez, R., A tool to manage low quality datasets. In: 2012 IEEE International Conference on Fuzzy Systems, 2012.

  97. Wahbeh, A.H., et al., A comparison study between data mining tools over some classification methods. Int. J. Adv. Comput. Sci. Appl. 2011. Special Issue on Artificial Intelligence: p. 18–26.

  98. Rangra, K., and Bansal, D. K. L., Comparative Study of Data Mining Tools, International Journal of Advanced Research in Computer Science and Software Engineering. Int. J. Adv. Res. Comput. Sci. Softw. Eng. 4(6), 2014.

  99. Yas, Q. M., et al., Comprehensive insights into evaluation and benchmarking of real-time skin detectors: Review, open issues & challenges, and recommended solutions. Measurement. 114:243–260, 2018.

    Google Scholar 

  100. Rawat, J., et al., Review of leukocyte classification techniques for microscopic blood images. In: 2015 2nd International Conference on Computing for Sustainable Global Development (INDIACom). 2015.

  101. Bagasjvara, R. G., et al., Automated detection and classification techniques of Acute leukemia using image processing: A review. In: 2016 2nd International Conference on Science and Technology-Computer (ICST). 2016.

  102. Singh, G., Bathla, G., and Kaur, S., A review to detect leukemia cancer in medical images. In: 2016 International Conference on Computing, Communication and Automation (ICCCA). 2016.

  103. Wahhab, H. T. A., Classification of acute leukemia using image processing and machine learning techniques. PhD thesis, University of Malaya, 2015.

  104. Shafique, S., and Tehsin, S., Computer-Aided Diagnosis of Acute Lymphoblastic Leukaemia. Comput. Math. Methods Med. 2018.

  105. Jadhav, A., and Sonar, R., Analytic hierarchy process (AHP), weighted scoring method (WSM), and hybrid knowledge based system (HKBS) for software selection: A comparative study. In: 2009 Second International Conference on Emerging Trends in Engineering & Technology. IEEE, 2009.

  106. Keeney, R. L., and Raiffa, H., Decisions with multiple objectives: Preferences and value trade-offs. Cambridge University Press, 1993

  107. Belton, V., and Stewart, T., Multiple criteria decision analysis: An integrated approach. Kluwer Academic Publishers: Boston, 2002.

    Google Scholar 

  108. Petrovic-Lazarevic, S., and Abraham, A., Hybrid fuzzy-linear programming approach for multi criteria decision making problems. arXiv preprint cs/0405019, 2004.

  109. Malczewski, J., GIS and multicriteria decision analysis. John Wiley & Sons: New York, 1999.

    Google Scholar 

  110. Zionts, S., MCDM-If not a Roman Numeral, then what? Interfaces. 9(4):94–101, 1979.

    Google Scholar 

  111. Baltussen, R., and Niessen, L., Priority setting of health interventions: The need for multi-criteria decision analysis. Cost Eff Resour Allocation. 4(1):1, 2006.

    Google Scholar 

  112. Thokala, P., et al., Multiple Criteria Decision Analysis for Health Care Decision Making—An Introduction: Report 1 of the ISPOR MCDA Emerging Good Practices Task Force. Value Health. 19(1):1–13, 2016.

    Google Scholar 

  113. Oliveira, M., Fontes, D. B., and Pereira, T., Multicriteria decision making: A case study in the automobile industry. Ann. Manag. Sci. 3(1):109, 2014.

    Google Scholar 

  114. Whaiduzzaman, M., et al., Cloud service selection using multicriteria decision analysis. Sci. World J., 2014.

  115. Hwang, C., and Yoon, K., Multiple Attribute Decision Making: Methods and Applications: A State-of-the-art Survey.Lecture Notes in Economics and Mathematical Systems. Springer, 1981.

  116. Aruldoss, M., Lakshmi, T. M., and Venkatesan, V. P., A survey on multi criteria decision making methods and its applications. Am. J. Inf. Syst. 1(1):31–43, 2013.

    Google Scholar 

  117. Guo, S., and Zhao, H., Fuzzy best-worst multi-criteria decision-making method and its applications. Knowl.-Based Syst. 121(Supplement C):23–31, 2017.

    Google Scholar 

  118. Rezaei, J., Best-worst multi-criteria decision-making method. Omega. 53(Supplement C):49–57, 2015.

    Google Scholar 

  119. Tavana, M., and Hatami-Marbini, A., A group AHP-TOPSIS framework for human spaceflight mission planning at NASA. Expert Syst. Appl. 38(11):13588–13603, 2011.

    Google Scholar 

  120. Jumaah, F. M., Zaidan, A. A., Zaidan, B. B., Bahbibi, R., Qahtan, M. Y., and Sali, A., Technique for order performance by similarity to ideal solution for solving complex situations in multi-criteria optimization of the tracking channels of GPS baseband telecommunication receivers. Telecommun. Syst. :1–19, 2017.

  121. Azeez, D. et al., Comparison of adaptive neuro-fuzzy inference system and artificial neutral networks model to categorize patients in the emergency department. SpringerPlus. 2(1):416, 2013.

    PubMed  PubMed Central  Google Scholar 

  122. Ashour, O. M., and Okudan, G. E., Fuzzy AHP and utility theory based patient sorting in emergency departments. Int. J. Collab. Enterp. 1(3–4):332–358, 2010.

    Google Scholar 

  123. Salman, O., et al., Novel methodology for triage and prioritizing using “big data” patients with chronic heart diseases through telemedicine environmental. Int. J. Inf. Technol. Decis. Mak. 16(05):1211–1245, 2017.

    Google Scholar 

  124. Mills, A. F., A simple yet effective decision support policy for mass-casualty triage. Eur. J. Oper. Res. 253(3):734–745, 2016.

    Google Scholar 

  125. Adunlin, G., Diaby, V., and Xiao, H., Application of multicriteria decision analysis in health care: A systematic review and bibliometric analysis. Health Expect. 18(6):1894–1905, 2015.

    PubMed  Google Scholar 

  126. Jumaah, F., et al., Decision-making solution based multi-measurement design parameter for optimization of GPS receiver tracking channels in static and dynamic real-time positioning multipath environment. Measurement. 2018.

  127. Zaidan, B. B., and Zaidan, A. A., Comparative Study on the Evaluation and Benchmarking Information Hiding Approaches Based Multi-Measurement Analysis Using TOPSIS Method with Different Normalisation, Separation and Context Techniques. Measurement. 117:277–294, 2017.

    Google Scholar 

  128. Zaidan, B., et al., A new approach based on multi-dimensional evaluation and benchmarking for data hiding techniques. Int. J. Inf. Technol. Decis. Mak. :1–42, 2017.

  129. Zaidan, B., and Zaidan, A., Software and hardware FPGA-based digital watermarking and steganography approaches: Toward new methodology for evaluation and benchmarking using multi-criteria decision-making techniques. J. Circuits Syst. Comput. 26(07):1750116, 2017.

    Google Scholar 

  130. Abdullateef, B. N., et al., An evaluation and selection problems of OSS-LMS packages. SpringerPlus. 5(1):248, 2016.

    PubMed  PubMed Central  Google Scholar 

  131. Opricovic, S., and Tzeng, G. -H., Compromise solution by MCDM methods: A comparative analysis of VIKOR and TOPSIS. Eur. J. Oper. Res. 156(2):445–455, 2004.

    Google Scholar 

  132. Zaidan, A., et al., Evaluation and selection of open-source EMR software packages based on integrated AHP and TOPSIS. J. Biomed. Inform. 53:390–404, 2015.

    CAS  PubMed  Google Scholar 

  133. Nilsson, H., Nordström, E. -M., and Öhman, K., Decision support for participatory forest planning using AHP and TOPSIS. Forests. 7(5):100, 2016.

    Google Scholar 

  134. Singh, A., Major MCDM Techniques and their application-A Review. 4:15–25, 2014.

  135. Kornyshova, E., and Salinesi, C., MCDM Techniques Selection Approaches: State of the Art. In: 2007 IEEE Symposium on Computational Intelligence in Multi-Criteria Decision-Making, 2007.

  136. Yas, Q. M., Zadain, A. A., Zaidan, B. B., Lakulu, M. B., and Rahmatullah, B., Towards on Develop a Framework for the Evaluation and Benchmarking of Skin Detectors Based on Artificial Intelligent Models Using Multi-Criteria Decision-Making Techniques. Int. J. Pattern Recognit. Artif. Intell. 31(3):1759002, 2017.

    Google Scholar 

  137. Kaya, İ., Çolak, M., and Terzi, F., Use of MCDM techniques for energy policy and decision-making problems: A review. Int. J. Energy Res. 42(7):2344–2372, 2018.

    Google Scholar 

  138. Tian, Z. -P., Wang, J. -Q., and Zhang, H. -Y., An integrated approach for failure mode and effects analysis based on fuzzy best-worst, relative entropy, and VIKOR methods. Appl. Soft Comput. 2018.

  139. Zaidan, A., et al., A review on smartphone skin cancer diagnosis apps in evaluation and benchmarking: Coherent taxonomy, open issues and recommendation pathway solution. Health Technol. :1–16, 2018.

  140. Opricovic, S., and Tzeng, G. -H., Extended VIKOR method in comparison with outranking methods. Eur. J. Oper. Res. 178(2):514–529, 2007.

    Google Scholar 

  141. Wan Ahmad, W. N. K., et al., Evaluation of the external forces affecting the sustainability of oil and gas supply chain using Best Worst Method. J. Clean. Prod. 153:242–252, 2017.

    Google Scholar 

  142. Gupta, H., and Barua, M. K., Supplier selection among SMEs on the basis of their green innovation ability using BWM and fuzzy TOPSIS. J. Clean. Prod. 152:242–258, 2017.

    Google Scholar 

  143. Rezaei, J., Best-worst multi-criteria decision-making method. Omega. 53:49–57, 2015.

    Google Scholar 

  144. Rezaei, J., Best-worst multi-criteria decision-making method: Some properties and a linear model. Omega. 64(Supplement C):126–130, 2016.

    Google Scholar 

  145. Zaidan, A. A., et al., Multi-criteria analysis for OS-EMR software selection problem: A comparative study. Decis. Support. Syst. 78(Supplement C):15–27, 2015.

    Google Scholar 

  146. Zavadskas, E. K., et al., Multi-Attribute Decision-Making Model by Applying Grey Numbers. Informatica. 20(2):305–320, 2009.

    Google Scholar 

  147. Medineckienė, M., and Bjork, F., Owner preferences regarding renovation measures - The demonstration of using multi-criteria decision making. 17:284–295, 2011.

  148. Zaidan, B. B., et al., A new digital watermarking evaluation and benchmarking methodology using an external group of evaluators and multi-criteria analysis based on ‘large-scale data’. Software: Practice and Experience. 47(10):1365–1392, 2017.

    Google Scholar 

  149. Mahjouri, M., et al., Optimal selection of Iron and Steel wastewater treatment technology using integrated multi-criteria decision-making techniques and fuzzy logic. Process Saf. Environ. Prot. 107(Supplement C):54–68, 2017.

    CAS  Google Scholar 

  150. Karahalios, H., The application of the AHP-TOPSIS for evaluating ballast water treatment systems by ship operators. Transp. Res. Part D: Transp. Environ. 52(Part A):172–184, 2017.

    Google Scholar 

  151. Behzadian, M., et al., A state-of the-art survey of TOPSIS applications. Expert Syst. Appl. 39(17):13051–13069, 2012.

    Google Scholar 

  152. Shih, H. -S., Shyur, H. -J., and Lee, E. S., An extension of TOPSIS for group decision making. Math. Comput. Model. 45(7):801–813, 2007.

    Google Scholar 

  153. Kaur, S., Sehra, S. K., and Sehra, S. S., A framework for software quality model selection using TOPSIS. In: 2016 IEEE International Conference on Recent Trends in Electronics, Information & Communication Technology (RTEICT). 2016.

  154. Sutadian, A. D., et al., Using the Analytic Hierarchy Process to identify parameter weights for developing a water quality index. Ecol. Indic. 75(Supplement C):220–233, 2017.

    CAS  Google Scholar 

  155. Sofuoglu, M. A., and Orak, S., A Novel Hybrid Multi Criteria Decision Making Model: Application to Turning Operations. Int. J. Intell. Syst. Appl. Eng. 5(3):124–131, 2017.

    Google Scholar 

  156. Raviv, G., Shapira, A., and Fishbain, B., AHP-based analysis of the risk potential of safety incidents: Case study of cranes in the construction industry. Saf. Sci. 91(Supplement C):298–309, 2017.

    Google Scholar 

  157. Zhao, H., Guo, S., and Zhao, H., Comprehensive benefit evaluation of eco-industrial parks by employing the best-worst method based on circular economy and sustainability. Environ. Dev. Sustain. :1–25, 2017.

  158. Chou, S. -Y., Chang, Y. -H., and Shen, C. -Y., A fuzzy simple additive weighting system under group decision-making for facility location selection with objective/subjective attributes. Eur. J. Oper. Res. 189(1):132–145, 2008.

    Google Scholar 

  159. Jablonsky, J., MS Excel based Software Support Tools for Decision Problems with Multiple Criteria. Procedia Econ. Financ. 12(Supplement C):251–258, 2014.

    Google Scholar 

  160. Rezaei, J., Best-worst multi-criteria decision-making method: Some properties and a linear model. Omega. 64:126–130, 2016.

    Google Scholar 

  161. Lo, H. -W., et al., An integrated model for solving problems in green supplier selection and order allocation. J. Clean. Prod. 190:339–352, 2018.

    Google Scholar 

  162. Yang, Q., et al., Evaluation and Classification of Overseas Talents in China Based on the BWM for Intuitionistic Relations. Symmetry. 8(11):137, 2016.

    Google Scholar 

  163. Ren, J., Selection of sustainable prime mover for combined cooling, heat, and power technologies under uncertainties: An interval multicriteria decision-making approach. Int. J. Energy Res. 2018.

  164. Gupta, H., Evaluating service quality of airline industry using hybrid best worst method and VIKOR. J. Air Transp. Manag. 68:35–47, 2018.

    Google Scholar 

  165. Serrai, W., et al., An efficient approach for Web service selection. In: 2016 IEEE Symposium on Computers and Communication (ISCC), 2016.

  166. Shojaei, P., Seyed Haeri, S. A., and Mohammadi, S., Airports evaluation and ranking model using Taguchi loss function, best-worst method and VIKOR technique. J. Air Transp. Manag. 68:4–13, 2018.

    Google Scholar 

  167. Serrai, W., et al., Towards an efficient and a more accurate web service selection using MCDM methods. J. Comput. Sci. 22:253–267, 2017.

    Google Scholar 

  168. Pamučar, D., Petrović, I., and Ćirović, G., Modification of the Best–Worst and MABAC methods: A novel approach based on interval-valued fuzzy-rough numbers. Expert Syst. Appl. 91:89–106, 2018.

    Google Scholar 

  169. Guo, S., and Zhao, H., Fuzzy best-worst multi-criteria decision-making method and its applications. Knowl.-Based Syst. 121:23–31, 2017.

    Google Scholar 

  170. Aboutorab, H., et al., ZBWM: The Z-number extension of Best Worst Method and its application for supplier development. Expert Syst. Appl. 107:115–125, 2018.

    Google Scholar 

  171. Rezaei, J., van Roekel, W. S., and Tavasszy, L., Measuring the relative importance of the logistics performance index indicators using Best Worst Method. Transp. Policy. 68:158–169, 2018.

    Google Scholar 

  172. Salimi, N., and Rezaei, J., Evaluating firms’ R&D performance using best worst method. Eval. Program Plann. 66:147–155, 2018.

    PubMed  Google Scholar 

  173. Chiu, W. -Y., Tzeng, G. -H., and Li, H. -L., A new hybrid MCDM model combining DANP with VIKOR to improve e-store business. Knowl.-Based Syst. 37:48–61, 2013.

    Google Scholar 

  174. Ou Yang, Y. -P., Shieh, H. -M., and Tzeng, G. -H., A VIKOR technique based on DEMATEL and ANP for information security risk control assessment. Inf. Sci. 232:482–500, 2013.

    Google Scholar 

  175. Jahan, A., et al., A comprehensive VIKOR method for material selection. Mater. Des. 32(3):1215–1221, 2011.

    CAS  Google Scholar 

  176. Cavallini, C., et al., Integral aided method for material selection based on quality function deployment and comprehensive VIKOR algorithm. Mater. Des. 47:27–34, 2013.

    CAS  Google Scholar 

  177. Liou, J. J. H., et al., A modified VIKOR multiple-criteria decision method for improving domestic airlines service quality. J. Air Transp. Manag. 17(2):57–61, 2011.

    Google Scholar 

  178. Shojaei, P., Haeri, S. A. S., and Mohammadi, S., Airports evaluation and ranking model using Taguchi loss function, best-worst method and VIKOR technique. J. Air Transp. Manag. 68:4–13, 2018.

    Google Scholar 

  179. Golub, T. R., et al., Molecular classification of cancer: Class discovery and class prediction by gene expression monitoring. Science. 286(5439):531–537, 1999.

    CAS  Google Scholar 

  180. Huang, P. H., and Moh, T. -t., A non-linear non-weight method for multi-criteria decision making. Ann. Oper. Res. 248(1):239–251, 2017.

    Google Scholar 

  181. Kalid, N., et al., Based on Real Time Remote Health Monitoring Systems: A New Approach for Prioritization “Large Scales Data” Patients with Chronic Heart Diseases Using Body Sensors and Communication Technology. J. Med. Syst. 42(4):69, 2018.

    PubMed  Google Scholar 

  182. Qader, M. A., et al., A methodology for football players selection problem based on multi-measurements criteria analysis. Measurement. 111:38–50, 2017.

    Google Scholar 

  183. Zaidan, A. A., et al., A survey on communication components for IoT-based technologies in smart homes. Telecommun. Syst. :1–25, 2018.

    Google Scholar 

  184. Alaa, M., Zaidan, A. A., Zaidan, B. B., Talal, M., and Kiah, M. L. M., A review of smart home applications based on Internet of Things. J. Netw. Comput. Appl. 97:48–65, 2017.

    Google Scholar 

  185. Zaidan, A. A., Karim, H. A., Ahmad, N. N., Alam, G. M., and Zaidan, B. B., A new hybrid module for skin detector using fuzzy inference system structure and explicit rules. Int. J. Phys. Sci. 5(13):2084–2097, 2010.

    Google Scholar 

  186. Zaidan, A. A., Karim, H. A., Ahmad, N. N., Zaidan, B. B., and Sali, A., An automated anti-pornography system using a skin detector based on artificial intelligence: A review. Int. J. Pattern Recognit. Artif. Intell. 27(04):1350012, 2013.

    Google Scholar 

  187. Zaidan, A. A., Abdul Karim, H., Ahmad, N. N., Zaidan, B. B., and Sali, A., A four-phases methodology to propose anti-pornography system based on neural and bayesian methods of artificial intelligence. Int. J. Pattern Recognit. Artif. Intell. 28(01):1459001, 2014.

    Google Scholar 

  188. Yas, Q. M., Zaidan, A. A., Zaidan, B. B., Hashim, M., and Lim, C. K., A systematic review on smartphone skin cancer apps: Coherent taxonomy, motivations, open challenges and recommendations, and new research direction. J. Circuits, Syst. Comput. 1830003, 2017.

  189. Zaidan, B. B., Haiqi, A., Zaidan, A. A., Abdulnabi, M., Mat Kiah, M. L., and Muzamel, H., A security framework for nationwide health information exchange based on telehealth strategy. J. Med. Syst. 39(5):1–19, 2015.

    Google Scholar 

  190. Kiah, M. L. M., Haiqi, A., Zaidan, B. B., and Zaidan, A. A., Open source EMR software: Profiling, insights and hands-on analysis. Comput. Methods Prog. Biomed. 117(2):360–382, 2014.

    CAS  Google Scholar 

  191. Salman, O. H., Zaidan, A. A., Zaidan, B. B., Kalid, N., and Hashim, M., Novel Methodology for Triage and Prioritizing Using ‘Big Data’ Patients with Chronic Heart Diseases Through Telemedicine Environmental. Int. J. Inf. Technol. Decis. Mak. 16(5):1211–1245, 2017.

    Google Scholar 

  192. Kalid, N., Zaidan, A. A., Zaidan, B. B., Salman, O. H., Hashim, M., and Muzammil, H., Based Real Time Remote Health Monitoring Systems: A Review on Patients Prioritization and Related ‘Big Data’ Using Body Sensors information and Communication Technology. J. Med. Syst. 42(2):69, 2018.

    PubMed  Google Scholar 

  193. Zaidan, A.A., Zaidan, B. B., Al-Haiqi, A, Kiah, M. L. M., Hussain, M. Evaluation and selection of opensource EMR software packages. Elsevier. 53, 2014.

  194. Alanazi, H. O., Zaidan, A. A., Zaidan, B. B., Mat Kiah, M. L., and Al-Bakri, S. H., Meeting the security requirements of electronic medical records in the ERA of high-speed computing. J. Med. Syst. 39(1):1–14, 2015.

    Google Scholar 

  195. Alanazi, H. O., Alam, G. M., Zaidan, B. B., and Zaidan, A. A., Securing electronic medical records transmissions over unsecured communications: An overview for better medical governance. J. Med. Plant Res. 4(19):2059–2074, 2010.

    Google Scholar 

  196. Hussain, M., Al-Haiqi, A., Zaidan, A., Zaidan, B., Kiah, M. L. M., Anuar, N. B., and Abdulnabi, M., The landscape of research on smartphone medical apps: Coherent taxonomy, motivations, open challenges and recommendations. Comput. Methods Prog. Biomed. 122(3):393–408, 2015.

    Google Scholar 

  197. Mat Kiah, M. L., Zaidan, B. B., Zaidan, A. A., Nabi, M., and Ibraheem, R., MIRASS: Medical informatics research activity support system using information mashup network. J. Med. Syst. 38(4):1–37, 2014a.

    Google Scholar 

  198. Mat Kiah, M. L., Al-Bakri, S. H., Zaidan, A. A., Zaidan, B. B., and Hussain, M., Design and develop a video conferencing framework for real-time telemedicine applications using secure group-based communication architecture. J. Med. Syst. 38(10):1–13, 2014c.

    Google Scholar 

  199. Mat Kiah, M. L., Nabi, M. S., Zaidan, B. B., and Zaidan, A. A., An enhanced security solution for electronic medical records based on AES hybrid technique with SOAP/XML and SHA-1. J. Med. Syst. 37(5):1–16, 2013.

    Google Scholar 

  200. Abdulnabi, M., Al-Haiqi, A., Kiah, M. L. M., Zaidan, A. A., Zaidan, B. B., and Hussain, M., A distributed framework for health information exchange using smartphone technologies. J. Biomed. Inform. 69:230–250, 2017.

    PubMed  Google Scholar 

  201. Zaidan, B. B., Zaidan, A. A., and Mat Kiah, M. L., Impact of data privacy and confidentiality on developing telemedicine applications: A review participates opinion and expert concerns. Int. J. Pharm. 7(3):382–387, 2011.

    Google Scholar 

  202. Zaidan, A. A. et al., Challenges, alternatives, and paths to sustainability: Better public health promotion using social networking pages as key tools. J. Med. Syst. 39(2):1–14, 2015.

    Google Scholar 

  203. Hussain, M., Ahmed, A.-H., Zaidan, A. A., and Zaidan, B. B., M Kiah, Salman Iqbal, S Iqbal, Mohamed Abdulnabi "A security framework for mHealth apps on Android platform". Comput. Secur. 45:191–217, 2018.

  204. Hussain, M., Zaidan, A. A., Zidan, B. B., Iqbal, S., Ahmed, M. M., Albahri, O. S., and Albahri, A. S., Conceptual Framework for the Security of Mobile Health Applications on Android Platform. 35(3):1–32. 2018.

  205. Albahri, A. S., Zaidan, A. A., Albahri, O. S., Zaidan, B. B., and Alsalem, M. A., Real-Time Fault-Tolerant mHealth System: Comprehensive Review of Healthcare Services, Opens Issues, Challenges and Methodological Aspects. J. Med. Syst. 42(8):137, 2018.

    CAS  PubMed  Google Scholar 

  206. Albahri, O. S., Zaidan, A. A., Zaidan, B. B., Hashim, M., Albahri, A. S., and Alsalem, M. A., Real-Time Remote Health-Monitoring Systems in a Medical Centre: A Review of the Provision of Healthcare Services-Based Body Sensor Information, Open Challenges and Methodological Aspects. J. Med. Syst. 42(9):164, 2018.

    CAS  PubMed  Google Scholar 

  207. Kalid, N. et al., Based on Real Time Remote Health Monitoring Systems: A New Approach for Prioritization ‘Large Scales Data’ Patients with Chronic Heart Diseases Using Body Sensors and Communication Technology. J. Med. Syst. 42(4):69, 2018.

    PubMed  Google Scholar 

  208. Albahri, O. S. et al., Systematic Review of Real-time Remote Health Monitoring System in Triage and Priority-Based Sensor Technology: Taxonomy, Open Challenges, Motivation and Recommendations. J. Med. Syst. 42(5):80, 2018.

    CAS  PubMed  Google Scholar 

  209. Nabi, M. S. A., Kiah, M. M., Zaidan, B. B., Zaidan, A. A., and Alam, G. M., Suitability of using SOAP protocol to secure electronic medical record databases transmission. Int. J. Pharmacol. 6(6):959–964, 2010.

    Google Scholar 

  210. Rahmatullah, B., Zaidan, A. A., Mohamed, F., and Sali, A., Multi-complex attributes analysis for optimum GPS baseband receiver tracking channels selection. In: 2017 4th International Conference on Control, Decision and Information Technologies, CoDIT 2017. Vol. 2017, pp. 1084–1088, 2017. https://doi.org/10.1109/CoDIT.2017.8102743

  211. Hussain, M., Al-Haiqi, A., Zaidan, A. A., Zaidan, B. B., Kiah, M. M., Anuar, N. B., and Abdulnabi, M., The rise of keyloggers on smartphones: A survey and insight into motion-based tap inference attacks. Pervasive Mob. Comput. 25:1–25, 2016.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computing, Universiti Pendidikan Sultan Idris, Tanjong Malim, Perak, Malaysia

    M. A. Alsalem, A. A. Zaidan, B. B. Zaidan, M. Hashim, O. S. Albahri, A. S. Albahri, Ali Hadi & K. I. Mohammed

Authors
  1. M. A. Alsalem
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. A. A. Zaidan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. B. B. Zaidan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. M. Hashim
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. O. S. Albahri
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. A. S. Albahri
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Ali Hadi
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. K. I. Mohammed
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to A. A. Zaidan.

Ethics declarations

Conflict of Interest

The authors declare no conflict of interest.

Ethical Approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.

Informed Consent

Informed consent was obtained from all individual participants included in the study.

Additional information

This article is part of the Topical Collection on Systems-Level Quality Improvement

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Alsalem, M.A., Zaidan, A.A., Zaidan, B.B. et al. Systematic Review of an Automated Multiclass Detection and Classification System for Acute Leukaemia in Terms of Evaluation and Benchmarking, Open Challenges, Issues and Methodological Aspects. J Med Syst 42, 204 (2018). https://doi.org/10.1007/s10916-018-1064-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10916-018-1064-9

Keywords

Search

Navigation