skip to main content
10.1145/2160125.2160135acmotherconferencesArticle/Chapter ViewAbstractPublication PagesahConference Proceedingsconference-collections
research-article

Stereo camera based wearable reading device

Authors Info & Claims
Published:08 March 2012Publication History

ABSTRACT

The ability to access textual information is crucial for visually impaired people in terms of achieving greater independence in their everyday life. Thus, there is a need for a mobile easy-to-use reading device, capable of dealing with the complexity of the outdoor environment. In this paper a wearable camera-based solution is presented, aiming at improving the performance of existing systems through the use of stereo vision. Specific aspects of the stereo matching problem in document images are discussed and an approach for its integration into the document processing procedure is introduced. We conclude with the presentation of experimental results from a prototype system, which demonstrate the practical benefits of the presented approach.

References

  1. M. Tanaka and H. Goto, Text-Tracking Wearable Camera System for Visually-Impaired People, Proceedings 19th International Conference on Pattern Recognition (ICPR2008), 2008.Google ScholarGoogle ScholarCross RefCross Ref
  2. Nobuo Ezaki, Marius Bulacu, Lambert Schomaker, Text Detection from Natural Scene Images: Towards a System for Visually Impaired Persons, ICPR, vol. 2, pp.683--686, 17th International Conference on Pattern Recognition (ICPR'04), 2004 Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Keefer R., Kakumanu P., Bourbakis N., A Wearable Document Reader for the Visually Impaired: Dewarping and Segmentation. International Journal on Artificial Intelligence Tools, 18, 3, 467--486, 2009Google ScholarGoogle Scholar
  4. Nikolaos G. Bourbakis, Tyflos: A Wearable System-Prototype for Assisting Visually Impaired, 12th WSEAS International Conference on SYSTEMS, Heraklion, Greece, pp. 21, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. G. Sainarayanan, On Intelligent Image Processing Methodologies Applied to Navigation Assistance for Visually Impaired, Ph. D. Thesis, University Malaysia Sabah, 2002.Google ScholarGoogle Scholar
  6. J.M. Saez, F. Escolano, A. Penalver, First steps towards stereo-based 6DOF SLAM for the visually impaired. In Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, San Diego, CA p. 23, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. G.C.Medioni and R. Nevatia, Segment-based Stereo Matching. In Proceedings of Image Understanding Workshop, pp.128--136, DARPA, June, 1983.Google ScholarGoogle Scholar
  8. Richard Hartley and Andrew Zisserman, Multiple View Geometry in computer vision. Cambridge University Press. pp. 32--33. ISBN 0-521-54051-8, 2003 Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. A. Ulges, C. H. Lampert, and T. M. Breuel, Document capture using stereo vision, in Proc. ACM Symposium on Document Engineering, pp.198--200, 2004 Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. A. Yamashita. A. Kawarago, T. Kaneko, K. T. Miura, Shape Recognition and Image Restoration for Non-Flat Surfaces of Documents with a Stereo Vision System, International Conference on Pattern Recognition, vol. 1, Cambridge, UK, pp. 482--485, 2004. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Brown MS, Seales WB Document restoration using 3D shape: a general deskewing algorithm for arbitrarily warped documents. In: Proc. ICCV, pp 367 374, 2001Google ScholarGoogle ScholarCross RefCross Ref
  12. J. Liang, D. F. DeMenthon, and D. Doermann. Flattening curved documents in images. In Proc. Computer Vision and Pattern Recognition, pages 338--345, June 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Z. Zhang, C. L. Tan, and L. Fan, Restoration of curved document images through 3D shape modeling. In International Conference on Computer Vision and Pattern Recognition (CVPR2004), pages 10--15, June 2004.Google ScholarGoogle ScholarCross RefCross Ref
  14. J.C. Wu, J. W. Hsieh and Y. S. Chen, Morphology-based Text Line Extraction, Machine Vision and Applications 19(3), Springer, pp. 1432--1769, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Fei Hao, Zhenjiang Miao, Ping Guo, and Zhan Xu, Real Time Multiple Object Tracking Using Tracking Matrix. In Proceedings of the 2009 International Conference on Computational Science and Engineering - Volume 02 (CSE '09), Vol. 2. IEEE Computer Society, Washington, DC, USA, 37--41, 2009 Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. P. Gupta, N. Vohra, S. Chaudhury, S. D. Joshi, Wavelet Based Page Segmentation, Proc. Indian Conf. on Computer Vision, Graphics and Image Processing, 20--22 Dec. 2000, Banglore, India, 2000.Google ScholarGoogle Scholar
  17. H. Choi and R. G. Baraniuk, Multiscale Document Segmentation Using Wavelet-Domain Hidden Markov Models, Proc. Int. Soc. Optical Eng./Soc. for Imaging, Science and Technology, 12th Ann. Int. Symp.-Electronic Imaging, 2000.Google ScholarGoogle Scholar
  18. Block M., Rojas R.: Local Contrast Segmentation to Binarize Images, The Third International Conference on Digital Society (ICDS 2009), IEEE Computer Society, ISBN:978-0-7695-3526-5, Vol.1, No.1, pp.294--299, Cancun/Mexiko, 2009 Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. C. Wu and G. Agam. Document image de-warping for text/graphics recognition. In Proc. of Joint IAPR 2002 and SPR 2002 Windsor, pages 348--357, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Lindner M., Block M., Rojas R.: Object Recognition Using Summed Features Classifier, In: 11th International Conference on Artificial Intelligence and Soft Computing (ICAISC 2012), published by Springer in the Lecture Notes in Artificial Intelligence series, Zakopane/Poland, 2012 Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. B. Ristic, S. Arulampalam, and N. Gordon, Beyond the Kalman Filter: Particle Filters for Tracking Applications. Norwell, MA: Artech House, 2004Google ScholarGoogle Scholar
  22. T.F.Smith and M. S. Waterman, Identification of Common Molecular Subsequences. In: Journal of Molecular Biology. 147, s. 195, 1981Google ScholarGoogle ScholarCross RefCross Ref
  23. C. H. Teh and R. T. Chin, On the detection of dominant points on digital curves, IEEE Trans. Pattern Anal. Machine Intel., vol. 11, no. 8, pp. 859--872, 1989 Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. C. Mei, S. Benhimane, E. Malis, and P. Rives. Efficient homographybased tracking and 3-d reconstruction for single-viewpoint sensors. IEEE Transactions on Robotics, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Amidror I. Scattered data interpolation methods for electronic imaging systems: a survey. Journal of Electronic Imaging. 2002,s. 176, 2002Google ScholarGoogle Scholar

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in
  • Published in

    cover image ACM Other conferences
    AH '12: Proceedings of the 3rd Augmented Human International Conference
    March 2012
    162 pages
    ISBN:9781450310772
    DOI:10.1145/2160125

    Copyright © 2012 ACM

    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 8 March 2012

    Permissions

    Request permissions about this article.

    Request Permissions

    Check for updates

    Qualifiers

    • research-article

    Acceptance Rates

    Overall Acceptance Rate121of306submissions,40%

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader