Abstract
Extreme learning machine (ELM) is a single-hidden layer feed-forward neural network with an efficient learning algorithm. Conventionally an ELM is trained using all the data based on the least square solution, and thus it may suffer from overfitting. In this paper, we present a new method of data and feature mixed ensemble based extreme learning machine (DFEN-ELM). DFEN-ELM combines data ensemble and feature subspace ensemble to tackle the overfitting problem and it takes advantage of the fast speed of ELM when building ensembles of classifiers. Both one-class and two-class ensemble based ELM have been studied. Experiments were conducted on computed tomography (CT) data for liver tumor detection and segmentation as well as magnetic resonance imaging (MRI) data for rodent brain segmentation. To improve the ensembles with new training data, sequential kernel learning is adopted further in the experiments on CT data for speedy retraining and iteratively enhancing the image segmentation performance. Experiment results on different testing cases and various testing datasets demonstrate that DFEN-ELM is a robust and efficient algorithm for medical object detection and segmentation.












Similar content being viewed by others
References
Cao JW, Chen T, Fan J (2014) Fast online learning algorithm for landmark recognition based on BoW framework. Proceedings of the 9th IEEE Conference on Industrial Electronics and Applications, Hangzhou, pp 9–12
Cao J, Lin Z, Huang GB, Liu N (2012) Voting based extreme learning machine. Inf Sci 185(1):66–77
Cao J, Xiong L (2014) Protein sequence classification with improved extreme learning machine algorithms. BioMed Res Int (2014) Article ID 103054, 12 p, doi: 10.1155/2014/103054.
Chi Y, Zhou J, Venkatesh SK, Huang S, Tian Q, Hennedige T, Liu J (2013) Computer-aided focal liver lesion detection. Int J Comput Assist Radiol Surg 8(4):511–525
Chou N, Wu J, Bai Bingren J, Qiu A, Chuang KH (2011) Robust automatic rodent brain extraction using 3-D pulse-coupled neural networks (PCNN). IEEE Trans Image Process 20(9):2554–2564
Erhan D, Bengio Y, Courville A, Manzagol PA, Vincent P, Bengio S (2010) Why does unsupervised pre-training help deep learning? J Mach Learn Res 11:625–660
Freund Y, Schapire R, Abe N (1999) A short introduction to boosting. J Japan Soc Artif Intell 14(771–780):1612
Häme Y, Pollari M (2012) Semi-automatic liver tumor segmentation with hidden Markov measure field model and non-parametric distribution estimation. Med Image Anal 16(1):140–149
Haykin S (1999) Neural networks: a comprehensive foundation, 2nd edn. Prentice Hall, Upper Saddle River
Huang W, Li N, Lin Z, Huang GB, Zong W, Zhou J, Duan Y (2013) Liver tumor detection and segmentation using kernel-based extreme learning machine. In Engineering in Medicine and Biology Society (EMBC), 2013 35th Annual International Conference of the IEEE, pp. 3662–3665
Huang W, Yang Y, Lin Z, Huang GB, Zhou J, Duan Y, Xiong W (2014) Random feature subspace ensemble based extreme learning machine for liver tumor detection and segmentation. IEEE Conf Eng Med Biol Soc (EMBC) 4675–4678
Huang GB, Zhou H, Ding X, Zhang R (2012) Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern B Cybern 42(2):513–529
Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1):489–501
Kasun LLC, Zhou H, Huang GB, Vong CM (2013) Representational learning with ELMs for big data. IEEE Intell Syst 28(6):31–34
Lan Y, Soh YC, Huang GB (2009) Ensemble of online sequential extreme learning machine. Neurocomputing 72(13):3391–3395
Li BN, Chui CK, Chang S, Ong SH (2012) A new unified level set method for semi-automatic liver tumor segmentation on contrast-enhanced CT images. Expert Syst Appl 39(10):9661–9668
Li J, Liu X, Zhuo J, Gullapalli RP, Zara JM (2011) A deformable surface model based automatic rat brain extraction method. Biomed Imaging: From Nano to Macro, 2011 I.E. Int Symp 1741–1745
Lin SJ, Chang C, Hsu MF (2013) Multiple extreme learning machines for a two-class imbalance corporate life cycle prediction. Knowl-Based Syst 39:214–223
Liu N, Wang H (2010) Ensemble based extreme learning machine. IEEE Signal Process Lett 17(8):754–757
Minhas R, Baradarani A, Seifzadeh S, Jonathan Wu QM (2010) Human action recognition using extreme learning machine based on visual vocabularies. Neurocomputing 73(10):1906–1917
Mirza B, Lin Z, Liu N (2015) Ensemble of subset online sequential extreme learning machine for class imbalance and concept drift. Neurocomputing 149:316–329
Oguz I, Lee J, Budin F, Rumple A, McMurray M, Ehlers C, Styner M (2011) Automatic skull-stripping of rat MRI/DTI scans and atlas building. In SPIE Med Imaging 796225–796225
Otsu N (1975) A threshold selection method from gray-level histograms. Automatica 11(285–296):23–27
Polikar R (2006) Ensemble based systems in decision making. IEEE Circuits Syst Mag 6(3):21–45
Rakha MA (2004) On the Moore–Penrose generalized inverse matrix. Appl Math Comput 158(1):185–200
Smith SM (2002) Fast robust automated brain extraction. Hum Brain Mapp 17(3):143–155
Veksler O (2008) Star shape prior for graph-cut image segmentation. Proc of 10th European Conference on Computer Vision 2008. Springer Berlin Heidelberg, pp 454–467
Wang X, Han M (2014) Online sequential extreme learning machine with kernels for nonstationary time series prediction. Neurocomputing 145:90–97
Yushkevich PA, Piven J, Hazlett HC, Smith RG, Ho S, Gee JC, Gerig G (2006) User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability. Neuroimage 31(3):1116–1128
Zhou ZH, Wu J, Tang W (2002) Ensembling neural networks: many could be better than all. Artif Intell 137(1):239–263
Zhou J, Xiong W, Tian Q, Qi Y, Liu J, Leow WK, Han Y, Venkatesh S, Wang SC (2008) Semi-automatic segmentation of 3D liver tumors from CT scans using voxel classification and propagational learning. In MICCAI Workshop (41) p. 43
Zong W, Huang GB (2011) Face recognition based on extreme learning machine. Neurocomputing 74(16):2541–2551
Acknowledgments
We wish to acknowledge the funding support for this project from Nanyang Technological University under the Undergraduate Research Experience on CAmpus (URECA) programme and the funding support by Agency for Science, Technology and Research (A*STAR) Joint Council Office under DP Grant 1334 k00084.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhu, W., Huang, W., Lin, Z. et al. Data and feature mixed ensemble based extreme learning machine for medical object detection and segmentation. Multimed Tools Appl 75, 2815–2837 (2016). https://doi.org/10.1007/s11042-015-2582-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-015-2582-9