Skip to main content
Springer Nature Link
Log in

Automatic Labeling of MR Brain Images Through the Hashing Retrieval Based Atlas Forest

  • Image & Signal Processing
  • Published:
Journal of Medical Systems Aims and scope Submit manuscript

Abstract

The multi-atlas method is one of the efficient and common automatic labeling method, which uses the prior information provided by expert-labeled images to guide the labeling of the target. However, most multi-atlas-based methods depend on the registration that may not give the correct information during the label propagation. To address the issue, we designed a new automatic labeling method through the hashing retrieval based atlas forest. The proposed method propagates labels without registration to reduce the errors, and constructs a target-oriented learning model to integrate information among the atlases. This method innovates a coarse classification strategy to preprocess the dataset, which retains the integrity of dataset and reduces computing time. Furthermore, the method considers each voxel in the atlas as a sample and encodes these samples with hashing for the fast sample retrieval. In the stage of labeling, the method selects suitable samples through hashing learning and trains atlas forests by integrating the information from the dataset. Then, the trained model is used to predict the labels of the target. Experimental results on two datasets illustrated that the proposed method is promising in the automatic labeling of MR brain images.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. https://itk.org/ITK/resources/software.html

  2. http://www.nitrc.org/projects/ibsr

  3. http://adni.loni.ucla.edu

References

  1. Bauer, S., Wiest, R., Nolte, L. P., and Reyes, M., A survey of MRI-based medical image analysis for brain tumor studies. Phys. Med. Biol. 58(13):R97, 2013.

    Article  PubMed  Google Scholar 

  2. Burgos, N., Guerreiro, F., McClelland, J., Presles, B., Modat, M., Nill, S., Dearnaley, D., deSouza, N., Oelfke, U., and Knopf, A.-C., Iterative framework for the joint segmentation and ct synthesis of mr images: Application to mri-only radiotherapy treatment planning. Phys. Med. Biol. 62(11):4237–4253, 2017.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Van Der Lijn, F., en Heijer, T., Breteler, M. M. B., and Niessen, W. J., Hippocampus segmentation in mr images using atlas registration, voxel classification, and graph cuts. Neuroimage 43(4):708–720, 2008.

    Article  Google Scholar 

  4. García-Lorenzo, D., Francis, S., Narayanan, S., Arnold, D. L., and Collins, D. L., Review of automatic segmentation methods of multiple sclerosis white matter lesions on conventional magnetic resonance imaging. Med. Image Anal. 17(1):1–18, 2013.

    Article  PubMed  Google Scholar 

  5. Iglesias, J. E., Van Leemput, K., Augustinack, J., Insausti, R., Fischl, B., and Reuter, M., Bayesian longitudinal segmentation of hippocampal substructures in brain mri using subject-specific atlases. Neuroimage 141: 542–555, 2016.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Klein, A., and Tourville, J., 101 labeled brain images and a consistent human cortical labeling protocol. Front. Neurosci. 6:171, 2012.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Išgum, I., Benders, M. J., Avants, B., Cardoso, M. J., Counsell, S. J., Gomez, E. F., Gui, L., Hűppi, P. S., Kersbergen, K. J., and Makropoulos, A., Evaluation of automatic neonatal brain segmentation algorithms: The neobrains12 challenge. Med. Image Anal. 20(1):135–151, 2015.

    Article  PubMed  Google Scholar 

  8. Makropoulos, A., Gousias, I. S., Ledig, C., Aljabar, P., Serag, A., Hajnal, J. V., Edwards, A. D., Counsell, S. J., and Rueckert, D., Automatic whole brain MRI segmentation of the developing neonatal brain. IEEE Trans. Med. Imaging 33(9):1818–1831, 2014.

    Article  PubMed  Google Scholar 

  9. Rohlfing, T., and Maurer, C. R., Multi-classifier framework for atlas-based image segmentation. Pattern Recognit. Lett. 26(13):2070–2079, 2005.

    Article  Google Scholar 

  10. Vemuri, B. C., Ye, J., Chen, Y., and Leonard, C. M., Image registration via level-set motion: Applications to atlas-based segmentation. Med. Image Anal. 7(1):1–20, 2003.

    Article  CAS  PubMed  Google Scholar 

  11. Suh, J. W., Schaap, M., Lee, A., Do, N., Ahiekpor-Dravi, A., Bai, Y., Choi, G., and Moreau-Gobard, R.: Automatic multi-atlas segmentation using dual registrations. In: 2013 IEEE 10th International Symposium on Biomedical Imaging (ISBI), pp. 1284–1287. IEEE, 2013.

  12. Zikic, D., Glocker, B., and Criminisi, A., Encoding atlases by randomized classification forests for efficient multi-atlas label propagation. Med. Image Anal. 18(8):1262–1273, 2014.

    Article  CAS  PubMed  Google Scholar 

  13. Heckemann, R. A., Hajnal, J. V., Aljabar, P., Rueckert, D., and Hammers, A., Automatic anatomical brain MRI segmentation combining label propagation and decision fusion. Neuroimage 33(1):115–26, 2006.

    Article  PubMed  Google Scholar 

  14. Romero, J. E., Manjón, J. V., Tohka, J., Coupé, P., and Robles, M., Nabs: Non-local automatic brain hemisphere segmentation. Magn. Reson. Imaging 33(4):474–484, 2015.

    Article  PubMed  Google Scholar 

  15. Rousseau, F., Habas, P. A., and Studholme, C., A supervised patch-based approach for human brain labeling. IEEE Trans. Med. Imaging 30(10):1852–62, 2011.

    Article  PubMed  PubMed Central  Google Scholar 

  16. Wang, Z., Wolz, R., Tong, T., and Rueckert, D.: Spatially aware patch-based segmentation (saps): An alternative patch-based segmentation framework. In: International Conference on Medical Computer Vision: Recognition Techniques and Applications in Medical Imaging, pp. 93–103, 2012.

    Chapter  Google Scholar 

  17. Wu, G., Wang, Q., Zhang, D., Nie, F., Huang, H., and Shen, D., A generative probability model of joint label fusion for multi-atlas based brain segmentation. Med. Image Anal. 18(6):881–90, 2014.

    Article  PubMed  Google Scholar 

  18. Bai, W., Shi, W., O’Regan, D. P., Tong, T., Wang, H., Jamilcopley, S, Peters, N. S., and Rueckert, D., A probabilistic patch-based label fusion model for multi-atlas segmentation with registration refinement: Application to cardiac mr images. IEEE Trans. Med. Imaging 32(7):1302–15, 2013.

    Article  PubMed  Google Scholar 

  19. Wang, H., Suh, J. W., Das, S. R., Pluta, J. B., Craige, C., and Yushkevich, P. A., Multi-atlas segmentation with joint label fusion. IEEE Trans. Pattern Anal. Mach. Intell. 35(3):611–623, 2013.

    Article  PubMed  Google Scholar 

  20. Aljabar, P., Heckemann, R. A., Hammers, A., Hajnal, J. V., and Rueckert, D., Multi-atlas based segmentation of brain images: Atlas selection and its effect on accuracy. Neuroimage 46(3):726–738, 2009.

    Article  CAS  PubMed  Google Scholar 

  21. Wang, H., and Yushkevich, P. A., Groupwise segmentation with multi-atlas joint label fusion. Medical Image Computing and Computer-Assisted Intervention – MICCAI 2013 16(1):711–718, 2013.

    Google Scholar 

  22. Sabuncu, M. R., Yeo, B. T., Van Leemput, K., Fischl, B., and Golland, P., A generative model for image segmentation based on label fusion. IEEE Trans. Med. Imaging 29(10):1714, 2010.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Tong, T., Wolz, R., Hajnal, J. V., and Rueckert, D.: Segmentation of brain mr images via sparse patch representation. In: MICCAI Workshop on Sparsity Techniques in Medical Imaging (STMI), 2012.

  24. Bai, W., Shi, W., Ledig, C., and Rueckert, D., Multi-atlas segmentation with augmented features for cardiac mr images. Med. Image Anal. 19(1):98–109, 2015.

    Article  PubMed  Google Scholar 

  25. Hao, Y., Wang, T., Zhang, X., Duan, Y., Yu, C., Jiang, T., and Fan, Y., Initiative Alzheimer’s Disease Neuroimaging. Local label learning (lll) for subcortical structure segmentation: Application to hippocampus segmentation. Hum Brain Mapp. 35(6):2674–97, 2014.

    Article  PubMed  Google Scholar 

  26. Akselrod-Ballin, A., Galun, M., Gomori, M. J., Basri, R., and Brandt, A.: Atlas guided identification of brain structures by combining 3d segmentation and svm classification, pp. 209–216. Springer, 2006.

  27. Kasiri, K., Kazemi, K., Dehghani, M. J., and Helfroush, M. S.: Atlas-based segmentation of brain mr images using least square support vector machines. In: 2010 2nd International Conference on Image Processing Theory Tools and Applications (IPTA), pp. 306–310. IEEE, 2010.

  28. Zhang, L., Wang, Q., Gao, Y., Wu, G., and Shen, D., Automatic labeling of mr brain images by hierarchical learning of atlas forests. Med. Phys. 43(3):1175, 2016.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Chen, H., Dou, Q., Yu, L., and Heng, P.-A.: Voxresnet: Deep voxelwise residual networks for volumetric brain segmentation. arXiv preprint arXiv:1608.05895, 2016

  30. Cao, L., Li, L., Zheng, J., Fan, X., Yin, F., Shen, H., and Zhang, J., Multi-task neural networks for joint hippocampus segmentation and clinical score regression. Multimed. Tools Appl. 77(22):1–18, 2018.

    Article  Google Scholar 

  31. Huo, J., Wu, J., Cao, J., and Wang, G., Supervoxel based method for multi-atlas segmentation of brain mr images. Neuroimage 175:201–214, 2018.

    Article  PubMed  Google Scholar 

  32. Quinlan, J. R., Induction of decision trees. Mach. Learn. 1(1):81–106, 1986.

    Google Scholar 

  33. Fonov, V., Pruessner, J., Robles, M., and Collins, D. L.: Nonlocal patch-based label fusion for hippocampus segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 129–136, 2010.

Download references

Acknowledgments

This research was supported by the National Key R&D Program of China(2017YFC0112804).

Funding

This study was funded by National Key R&D Program of China(2017YFC0112804).

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, Hubei, 430074, China

    Hong Liu, Lijun Xu, Enmin Song & Renchao Jin

  2. Kennesaw State University, Marietta, GA, USA

    Chih-Cheng Hung

Authors
  1. Hong Liu
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Lijun Xu
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Enmin Song
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Renchao Jin
    View author publications

    You can also search for this author inPubMed Google Scholar

  5. Chih-Cheng Hung
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Enmin Song.

Ethics declarations

Conflict of Interest

All authors of this research paper declare that they have no conflict of interest.

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

This article is part of the Topical Collection on Image & Signal Processing

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Liu, H., Xu, L., Song, E. et al. Automatic Labeling of MR Brain Images Through the Hashing Retrieval Based Atlas Forest. J Med Syst 43, 241 (2019). https://doi.org/10.1007/s10916-019-1385-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10916-019-1385-3

Keywords