Skip to main content
SpringerLink
Log in

A simple and effective sub-image separation method

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

A Correction to this article was published on 07 April 2022

This article has been updated

Abstract

Image retrieval system has numerous applications in different domains and generated promising results in each domain in case of single panel images. However, in addition to single panel images, the use of multi-panel images particularly in medical and research domains is increasing tremendously. The image retrieval system treats the multi-panel image as a single image and has no potential to get access to its sub-images, as a result the retrieval accuracy of image retrieval system is affected. The latest sub-image separation methods use edge image for locating the position of lines in the input multi-panel image. The edge image of the low contrast multi-panel image often contains broken lines. These broken lines in the edge image cause misdetection of line(s) in the input multi-panel image which in turn affect the accuracy of sub-image separation. Furthermore, their results are not satisfactory for large scale multi-panel images (i.e., multi-panel images having more than seven sub-images along one of its two sides) and multi-panel images having no solid border line(s). In this paper, an effective sub-image separation method for improving the accuracy of sub-image separation is proposed. The proposed method bridges the gaps in each line of the input image using Hough transform. Next, the positions of all lines (i.e., border lines and sub-image separators) in each image are determined and the true border lines among them are identified using a simple border identification model and detached. A fast sub-image separation method is then employed for separating the sub-images of multi-panel image using the true sub-image separators. We tested our proposed method on testing dataset containing 2225 images. The experimental results show that our proposed method outperforms the latest methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Change history

References

  1. Akgul CB, Rubin DL, Napel S et al (2011) Content based image retrieval in radiology: Current status and future directions. J Digit Imaging 24:208–222

    Article  Google Scholar 

  2. Ali M, Asghar MZ, Baloch A (2020) An efficient approach for sub-image separation from large-scale multi-panel images using dynamic programming. Multimed Tools Appl 80:4881–4902

    Google Scholar 

  3. Ali M, Dong L, Akhtar R et al (2018) Multi-panel medical image segmentation framework for image retrieval system. Multimed Tools Appl 77:20271–20295

    Article  Google Scholar 

  4. Antani S, Fushman DD, Li J et al (2008) Exploring use of images in clinical articles for decision support in evidence based medicine. Proc. SPIE, Document Recognition and Retrieval XV, 230–239

  5. Apostolova E, You D, Xue Z et al (2013) Image retrieval from scientific publications:text and image content processing to separate multipanel figures. J Am Soc Inf Sci Technol 64:893–908

    Article  Google Scholar 

  6. Cheng B, Antani S, Stanley RJ et al (2011) Automatic segmentation of subfigure image panels for multimodal biomedical document retrieval. Proceedings of SPIE Electronic Imaging Science and Technology, Document Retrieval and Recognition XVII I:294–304

    Google Scholar 

  7. Chhatkuli A, Markonis D, Foncubierta A et al (2013) Separating compound figures in journal articles to allow for sub-image classification. SPIE, Medical Imaging, pp 1–12

    Google Scholar 

  8. Cramer JK, Hersh W, Bedrick S (2008) Query analysis to improve medical image retrieval. Society for Imaging Informatics in Medicine, Seattle, USA

    Google Scholar 

  9. Cramer JK, Muller H, Bedrick S (2011) The clef 2011 medical image retrieval and classification tasks. Working Notes of CLEF 2011 (Cross Language Evaluation Forum) 

  10. de Herrera AGS, Cramer JK, Demner-Fushman D (2013) Overview of the imageclef 2013 medical tasks. Working Notes of CLEF 2013 (Cross Language Evaluation Forum)

  11. Demner-Fushman D, Antani S, Thoma GR (2007) Automatically finding images for clinical decision support. Seventh IEEE International Conference on Data Mining - Workshops, 139–144

  12. Demner-Fushman D, Antani S, Thoma GR et al (2007) Automatically finding images for clinical decision support. Seventh IEEE International Conference on Data Mining, 139–144

  13. Duda RO, Hart PE (1972) Use of the hough transformation to detect lines and curves in pictures. Graphics Image Process 15:11–15

    MATH  Google Scholar 

  14. Flickner M, Sawhney H, Niblack W et al (1995) Query by image and video content: The qbic system. Computer 28:23–32

    Article  Google Scholar 

  15. Kalpathy-Cramer J, Hersh W (2007) Automatic image modality based classification and annotation to improve medical image retrieval. Stud Health Technol Inform 129:1334–1338

    Google Scholar 

  16. Jain AK, Vailaya A (1996) Image retrieval using color and shape. Pattern Recogn 29, 1233–1244

  17. Li J, Wang J (2004) Studying digital imagery of ancient paintings by mixtures of stochastic models. IEEE Trans Image Process 13:340–353

    Article  Google Scholar 

  18. Li P, Jiang X, Kambhamettu C et al (2018) Compound image segmentation of published biomedical figures. Bioinformatics 34:1192–1199

    Article  Google Scholar 

  19. Lopez LD, Yu, J, Tudor CO et al (2012) Robust segmentation of biomedical figures for image-based document retrieval. IEEE International Conference on Bioinformatics and Biomedicine 1–6

  20. Muller H, de Herrera AGS, Cramer JK et al (2012) Overview of the imageclef 2012 medical image retrieval and classification tasks. Working Notes of CLEF 2012 Cross Language Evaluation Forum

  21. Muller H, Kalpathy-Cramer J, Eggel I (2010) Overview of the clef 2009 medical image retrieval track. Proceedings of the 10th international conference on Cross-language evaluation forum: multimedia experiments. CLEF’09

  22. Jhanwar N, Chaudhuri S, Seetharaman G (2004) Content based image retrieval using motif co occurrence matrix. Image Vis Comput 22:1211–1220

    Article  Google Scholar 

  23. Rui Y, Huang T, Mehrotra S et al (1997) Content-based image retrieval with relevance feedback in mars. Proceedings of International Conference on Image Processing, 815–818

  24. Rui Y, Huang T, Ortega M et al (1998) Relevance feedback: a power tool for interactive content-based image retrieval. IEEE Transactions on Circuits and Video Technology 8:644–655

    Article  Google Scholar 

  25. Rui, Y, Huang, TS, Chang SF (1999) Image retrieval: Current techniques, promising directions and open issues. J Vis Commun Image Represent 10, 39–62

  26. Sanderson M, Clough P et al (2003) Imageclef/lifeclef- multimedia retrieval in clef

  27. Siggelkow S (2002) Feature Historgrams for Content-Based Image Retrieval. PhD thesis, University, Freiburg

  28. Sreedevi S, Sebastian S et al (2012) Content based image retrieval based on database revision. IEEE International Conference on Machine Vision and Image Processing, 29–32

  29. Steven S (1992) C4.5: Programs for machine learning by j. ross quinlan. morgan kaufmann publishers, inc. Mach Learn, 235–240

  30. Tagare HD, Jaffe CC, Duncan J (1997) Medical image databases: A content-based retrieval approach. J Am Med Inform Assoc 4:184–198

    Article  Google Scholar 

  31. Wang J, Wiederhold G, Firschein O (1997) System for screening objectionable images using daubechies’ wavelets and color histograms. 4th Intl. Workshop on Interactive Distributed Multimedia Sys. and Telecom 20–30

  32. Ying W, Zhang H (1999) Content-based image indexing and retrieval. CRC Press, Palo Alto, Handbook of Multimedia Computing

    Google Scholar 

Download references

Acknowledgements

We would like to thank the ImageCLEF organizers for granting access to the imageCLEF 2013 dataset for evaluating the results of our proposed framework.

Author information

Authors and Affiliations

  1. Hazara University, Mansehra, Pakistan

    Mushtaq Ali & Mohsin Shah

  2. Institute of Computing and Information Technology, Gomal University, Dera Ismail Khan, KPK, Pakistan

    Muhammad Zubair Asghar

  3. Department of Computer Science, National Textile University, Faisalabad, 37610, Pakistan

    Toqeer Mahmood

Authors
  1. Mushtaq Ali
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Muhammad Zubair Asghar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mohsin Shah
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Toqeer Mahmood
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mushtaq Ali.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

The original online version of this article was revised: The name of Toqeer Mahmood was misspelled and the affiliation of Muhammad Zubair Asghar and Toqeer Mahmood were also incorrect.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ali, M., Asghar, M.Z., Shah, M. et al. A simple and effective sub-image separation method. Multimed Tools Appl 81, 14893–14910 (2022). https://doi.org/10.1007/s11042-021-11680-8

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-11680-8

Keywords

Search

Navigation