Skip to main content

Sign Detection Based Text Localization in Mobile Device Captured Scene Images

  • Conference paper
  • First Online:
  • 838 Accesses

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 8357))

Abstract

Sign text is one of the most seen text types appearing in scene images. In this paper, we present a new sign text localization method for scene images captured by mobile device. The candidate characters are first localized by detecting closed boundaries in the image. Then, based on the properties of signboard, the convex regions that contain enough candidate characters are extracted and marked as sign regions. After removing the false positives using the proposed layer analysis, the candidate characters inside the detected sign regions are yielded as sign text. A sign text database with 241 images captured by a mobile device was used to evaluate our method. The experimental results demonstrate the validity of the proposed method.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Pavlidis, T.: Limitions of content-based image retrieval. In: Invited Plenary Talk at the 19th International Conference on Pattern Recognition (2008)

    Google Scholar 

  2. Hanjalic, A., Lienhart, R., Ma, W.Y., Smith, J.R.: The holy grail of multimedia information retrieval: so close or yet so far away? In: Proceedings of the IEEE, vol. 96, pp. 541–547, April 2008

    Google Scholar 

  3. Chen, D., Luettin, J., Shearer, K.: A survey of text detection and recognition in images and videos. Institute Dalle Molled’ Intelligence Perceptive (IDIAP) Research Report, August 2000

    Google Scholar 

  4. Jung, K., Kim, K.I., Jain, A.K.: Text information extraction in images and video: a survey. Pattern Recogn. 37(5), 977–997 (2004)

    Article  Google Scholar 

  5. Zhang, J., Kasturi, R.: Extraction of text objects in video documents: recent progress. In: Proceedings of International Workshop on Document Analysis and System, pp.5–17 (2008)

    Google Scholar 

  6. Shivakumara, P., Huang, W., Phan, T., Tan, C.L.: Accurate video text detection through classification of low and high contrast images. Pattern Recogn. 43(6), 2165–2185 (2010)

    Article  Google Scholar 

  7. Liu, Z., Sarkar, S.: Robust outdoor text detection using text intensity and shape features. In: Proceedings of International Conference on Pattern Recognition (2008)

    Google Scholar 

  8. Bai, H., Sun, J., Naoi, S., Katsuyam, Y., Hotta, Y., Fujimoto, K.: Video caption duration extraction. In: Proceedings of International Conference on Pattern Recognition (2008)

    Google Scholar 

  9. Subramanian, K., Natajajan, P., Decerbo, M., Castanon, D.: Character-stroke detection for text-localization and extraction. In: Proceedings of International Conference on Document Analysis and Recognition, pp. 33–37 (2007)

    Google Scholar 

  10. Hanif, S.M., Prevost, L.: Text detection and localization in complex scene images using constrained adaboost algorithm. In: Proceedings of International Conference on Document Analysis and Recognition, pp.1–5 (2009)

    Google Scholar 

  11. Pan, Y., Hou, X., Liu, C.: Text localization in natural scene images based on conditional random field. In: Proceedings of International Conference on Document Analysis and Recognition, pp. 5–10 (2009)

    Google Scholar 

  12. Tu, Z., Chen, X., Yuille, A.L., Zhu, S.C.: Image parsing: unifying segmentation, detection, and recognition. Int. J. Comput. Vis. 63(2), 113–140 (2005)

    Article  Google Scholar 

  13. Shahab, A., Shafait, F., Dengel, A., Uchida, S.: How salient is scene text? In: Proceedings of International Workshop on Document Analysis and System (2012)

    Google Scholar 

  14. Uchida, S., Shigeyoshi, Y., Kunishige, Y., Feng, Y.: A keypoint-based approach toward scenery character detection. In: Proceedings of International Conference on Document Analysis and Recognition, pp. 819–823 (2011)

    Google Scholar 

  15. Bay, H., Tuytelaars, T., Gool, L.: SURF: speeded up robust feature. In: Proceedings of European Conference on Computer Vision (2006)

    Google Scholar 

  16. Clark, P., Mirmehdi, M.: Location and recovery of text on oriented surfaces. In: SPIE Conference on Document Recognition and Retrieval, pp. 267–277 (2000)

    Google Scholar 

  17. Clark, P., Mirmehdi, M.: Recognising text in real scenes. Int. J. Doc. Anal. Recogn. 4(4), 243–257 (2002)

    Article  Google Scholar 

  18. Bouman, K.L., Abdollahian, G., Boutin, M., Delp, E.J.: A low complexity sign detection and text localization method for mobile applications. IEEE Trans. Multimed. 13(5), 922–934 (2011)

    Article  Google Scholar 

  19. Jafri, S.A.R., Boutin, M., Delp, E.J.: Automatic text area segmentation in natural images. In: Proceedings of International Conference on Image Processing, pp. 3196–3199 (2008)

    Google Scholar 

  20. Nock, R., Nielsen, F.: Statistical region merging. IEEE Trans. Pattern Anal. Mach. Intell. 24, 1452–1458 (2004)

    Article  Google Scholar 

  21. http://cobweb.ecn.purdue.edu/~ace/kbsigns/

Download references

Acknowledgment

The authors wish to thank K.L. Bouman, G. Abdollahian, M. Boutin, and E.J. Delp at Purdue University for proving us the database used in the paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jing Zhang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Zhang, J., Kasturi, R. (2014). Sign Detection Based Text Localization in Mobile Device Captured Scene Images. In: Iwamura, M., Shafait, F. (eds) Camera-Based Document Analysis and Recognition. CBDAR 2013. Lecture Notes in Computer Science(), vol 8357. Springer, Cham. https://doi.org/10.1007/978-3-319-05167-3_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-05167-3_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-05166-6

  • Online ISBN: 978-3-319-05167-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics