Skip to main content

A proposed scheme for performance evaluation of graphics/text separation algorithms

  • Performance Evaluation
  • Conference paper
  • First Online:
Graphics Recognition Algorithms and Systems (GREC 1997)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 1389))

Included in the following conference series:

Abstract

We propose an objective, comprehensive, and complexity independent metric for performance evaluation of graphics/text separation (text segmentation) algorithms. The metric includes a positive set and a negative set of indices, at both the character and the character string (text) levels, _and it evaluates the detection accuracy of the location, width, height, orientation, skew, string length, and the fragmentation of both characters and strings. Assigning a Segmentation Difficulty (SD) value to the ground truth characters, the performance indices are normalized with respect to the character SD and are therefore independent of the ground truth complexity. The evaluation provides an overall, objective, and comprehensive metric of the text segmentation capability of various algorithms aimed at performing this task.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Haralick, “Performance Characterization in Image Analysis—Thinning, a Case in Point”, Pattern Recognition Letters 13:5–12, 1992.

    Google Scholar 

  2. Lee, L. Lam, and C.Y. Suen, “Performance Evaluation of Skeletonization Algorithms for Document Image Processing”, In: Proc. of the first International Conference on Document Analysis and Recognition, Saint-Malo, France, pp 260–271, 1991.

    Google Scholar 

  3. Lam, and C.Y. Suen, “Evaluation of Thinning Algorithms from an OCR Viewpoint. In: Proc. of the second International Conference on Document Analysis and Recognition, Tsukuba, Japan, pp 287–290, 1993.

    Google Scholar 

  4. Jaisimha, R.M. Haralick, and D. Dori, “A Methodology for the Characterization of the Performance of Thinning Algorithms”, In: Proc. of the second International Conference on Document Analysis and Recognition, Tsukuba, Japan, pp 282–286, 1993.

    Google Scholar 

  5. Cordella and A. Marcelli, “An alternative Approach to the Performance Evaluation of Thinning Algorithms for Document Processing Applications”, In: Kasturi R, Tombre K (eds) Graphics Recognition — Methods and Applications (Lecture Notes in Computer Science, vol. 1072), Springer, Berlin, pp 13–22, 1996.

    Google Scholar 

  6. O. Hori, D.S. Doermann, “Quantitative Measurement of the Performance of Raster-to-Vector Conversion Algorithms”, In: Kasturi R, Tombre K (eds) Graphics Recognition — Methods and Applications (Lecture Notes in Computer Science, vol. 1072), Springer, Berlin, pp 57–68, 1996.

    Google Scholar 

  7. B. Kong, I.T. Phillips, R.M. Haralick, A. Prasad, R. Kasturi, “A Benchmark: Performance Evaluation of Dashed-Line Detection Algorithms”, In: Kasturi R, Tombre K (eds) Graphics Recognition — Methods and Applications (Lecture Notes in Computer Science, vol. 1072), Springer, Berlin, pp 270–285, 1996.

    Google Scholar 

  8. Liu W. and D. Dori, “A Protocol for Performance Evaluation of Line Detection Algorithms”, Machine Vision Applications, Special Issue on Performance Characterisitics of Vision Algorithms, 9(5):240–250, 1997.

    Google Scholar 

  9. L.A. Fletcher and R. Kasturi, “A Robust Algorithm for Textbox String Separation from Mixed Text/Graphics Images”, IEEE Trans. PAMI, 10(6):900–918., 1988

    Google Scholar 

  10. I. Chai and D. Dori, “Extraction of Text Boxes from Engineering Drawings”, Proc. SPIE/IS&T Symposium on Electronic Imaging Science and Technology, Conference on Character Recognition and Digitizer Technologies, San Jose (CA, USA), SPIE Vol. 1661, pp 38–49, 1992.

    Google Scholar 

  11. Gao J., Tang L. Liu W. and Tang Z., “Segmentation and Recognition of Dimension Texts in Engineering Drawings”, ICDAR'95, Montreal, Canada, pp 528–531, 1995.

    Google Scholar 

  12. D. Dori and Liu W., “Vector-Based Segmentation of Text Connected to Graphics in Engineering Drawings”, Advances in Structural and Syntactical Pattern Recognition, eds. P. Perner, P. Wang, and A. Rosenfeld, Lecture Notes in Computer Science, vol. [12], pp 322–331, Springer, 1996.

    Google Scholar 

  13. Liu W. and D. Dori, “Automated CAD Conversion with the Machine Drawing Understanding System”, Proc. DAS96, Malvern, PA, USA, October, pp 241—259, 1996.

    Google Scholar 

  14. http://graphics.nynexst.com/iapr-tc l0/contest.html

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Karl Tombre Atul K. Chhabra

Rights and permissions

Reprints and permissions

Copyright information

© 1998 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Wenyin, L., Dori, D. (1998). A proposed scheme for performance evaluation of graphics/text separation algorithms. In: Tombre, K., Chhabra, A.K. (eds) Graphics Recognition Algorithms and Systems. GREC 1997. Lecture Notes in Computer Science, vol 1389. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-64381-8_63

Download citation

  • DOI: https://doi.org/10.1007/3-540-64381-8_63

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-64381-4

  • Online ISBN: 978-3-540-69766-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics