skip to main content
10.1145/3290589.3290604acmotherconferencesArticle/Chapter ViewAbstractPublication PagesssipConference Proceedingsconference-collections
research-article

Enhanced Stereovision Processing for Improved 3D Object Reconstruction

Authors Info & Claims
Published:12 October 2018Publication History

ABSTRACT

Whenever there is photogrammetry or computer vision, image processing techniques take place; since both of sciences depend on extract information from an image. Moreover, it is essential to apply these image processing techniques to obtain the depth information of the scene objects and then construct their 3D view. Researchers have been working in the stereovision technique to reconstruct a 3D object with different approaches, some were for specific applications, and others were improvements in the method itself.

In this paper, an enhanced stereo imaging technique is proposed to increase the accuracy in the 3D object construction. Starting from the image acquisition to the rectification process, then passing through stereo matcher between the two stereo images to produce a robust disparity map which is put into a refinement process for improvements. Finally, the depth view is constructed with a superior accuracy in comparison to the commonly applied stereo imaging approaches.

References

  1. W. Xiaoli, Y. Lei, W. Lirong and X. Jing, "Characteristic Point Match Algorithm Based on the SURF in Binocular Stereo Vision," 2012 Fifth International Conference on Intelligent Networks and Intelligent Systems, Tianjin, 2012, pp. 302--305. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. F. Bruno, G. Bianco, M. Muzzupappa, S. Barone, A.V. Razionale,"Experimentation of structured light and stereo vision for underwater 3D reconstruction", ISPRS Journal of Photogrammetry and Remote Sensing, Volume 66, Issue 4, 2011, pp 508--518Google ScholarGoogle ScholarCross RefCross Ref
  3. Y. Chen and P. Sun, "The research and practice of medical image 3D reconstruction platform," Proceedings 2014 IEEE International Conference on Security, Pattern Analysis, and Cybernetics (SPAC), Wuhan, 2014, pp. 305--308.Google ScholarGoogle Scholar
  4. Balakrishnan, G., Sainarayanan, G., Nagarajan, R., & SazaliYaacob, M. (2012). A Stereo Image Processing System for Visually Impaired.Google ScholarGoogle Scholar
  5. Kang, K., Ouyang, W., Li, H., & Wang, X. (2016). Object detection from video tubelets with convolutional neural networks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (pp. 817--825).Google ScholarGoogle ScholarCross RefCross Ref
  6. S. a. S.Udgirkar, "Object Detection System for Blind People," International Journal of Innovative Research in Computer and Communication Engineering, 2016.Google ScholarGoogle Scholar
  7. Zraqou, J. S., Alkhadour, W. M., & Siam, M. Z. (2017). Real-Time Objects Recognition Approach for Assisting Blind People.Google ScholarGoogle Scholar
  8. Huh, K., Park, J., Hwang, J., & Hong, D. (2008). A stereo vision-based obstacle detection system in vehicles. Optics and Lasers in Engineering, 46(2), 168--178.Google ScholarGoogle ScholarCross RefCross Ref
  9. Ko, E., & Ho, Y. S. (2016, December). Disparity Map estimation using semi-global matching based on image segmentation. In Signal and Information Processing Association Annual Summit and Conference (APSIPA), 2016 Asia-Pacific (pp. 1--4). IEEE.Google ScholarGoogle Scholar
  10. Baha, N., & Larabi, S. (2009). Neural disparity map estimation from stereo image. parameters, 6(7), 17--23.Google ScholarGoogle Scholar
  11. Krutikova, O., Sisojevs, A., & Kovalovs, M. (2017). Creation of a Depth Map from Stereo Images of Faces for 3D Model Reconstruction. Procedia Computer Science, 104, 452--459. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. D. Scharstein, middlebury, 16 Jan 2015. {Online}. Available: http://vision.middlebury.edu. {Accessed 14 Jan 2018}.Google ScholarGoogle Scholar
  13. Emgu.com. (2018). Emgu CV: OpenCV in .NET (C#, VB, C++ and more). {online} Available at: http://www.emgu.com/wiki/index.php/Main_Page {Accessed 17 Oct. 2017}.Google ScholarGoogle Scholar
  14. Boulos, M. N. K., & Robinson, L. R. (2009). Web GIS in practice VII: stereoscopic 3-D solutions for online maps and virtual globes.Google ScholarGoogle Scholar
  15. Kadaikar, A., Dauphin, G., & Mokraoui, A. (2015). Sequential block-based disparity map estimation algorithm for stereoscopic image coding. Signal Processing: Image Communication, 39, 159--172. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Obaidat, M. T. (2017). The Effect of Base to Focal Length Ratio on Stereo Rig Calibration Using a Planar Constraint Facility. Jordan Journal of Civil Engineering, 11(2).Google ScholarGoogle Scholar
  17. Ali, M., Shah, J. R., & Ahmed, M. (2003, December). 3D reconstruction and model acquisition of objects in real world scenes using stereo imagery. In Multi Topic Conference, 2003. INMIC 2003. 7th International (pp. 32--37). IEEE.Google ScholarGoogle ScholarCross RefCross Ref
  18. Kumar, M. S., & Avinash, N. (2014, January). Stereo Image Rectification Using Focal Length Adjustment. In Signal and Image Processing (ICSIP), 2014 Fifth International Conference on (pp. 241--249). IEEE. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Anon, (2018). {online} Available at: https://docs.opencv.org/2.4/doc/tutorials/calib3d/camera_calibration/camera_calibration.html. {Accessed 22 Feb. 2018}.Google ScholarGoogle Scholar
  20. S. Lalar, "An Efficient Stereo Vision Technique for Detecting Obstacles for Visually Impaired," in International Journal of Current Engineering and Technology, India, 2013.Google ScholarGoogle Scholar
  21. Long, T., Jiao, W., & Wang, W. (2011). Geometric rectification using feature points supplied by straight-lines. Procedia Environmental Sciences, 11, 200--207.Google ScholarGoogle ScholarCross RefCross Ref
  22. Scharstein, D., & Szeliski, R. (2002). A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. International journal of computer vision, 47(1--3), 7--42. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Kudryavtsev, A., Dembélé, S., & Piat, N. (2017). Stereo-image rectification for dense 3D reconstruction in scanning electron microscope. In Manipulation, Automation and Robotics at Small Scales (MARSS), 2017 International Conference on (pp. 1--6).Google ScholarGoogle Scholar
  24. Klaus, A., Sormann, M., & Karner, K. (2006, August). Segment-based stereo matching using belief propagation and a self-adapting dissimilarity measure. In Pattern Recognition, 2006. ICPR 2006. 18th International Conference on (Vol. 3, pp. 15--18). IEEE. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Gu, Z., Su, X., Liu, Y., & Zhang, Q. (2008). Local stereo matching with adaptive support-weight, rank transform and disparity calibration. Pattern Recognition Letters, 29(9), 1230--1235. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. VA, D., & Arunlal, S. L. (2013). Feature-based Stereo Correspondence Algorithm for the Robotic Arm Applications.Google ScholarGoogle Scholar
  27. Costa, P., Fernandes, H., Martins, P., Barroso, J., & Hadjileontiadis, L. J. (2012). Obstacle detection using stereo imaging to assist the navigation of visually impaired people. Procedia Computer Science, 14, 83--93.Google ScholarGoogle ScholarCross RefCross Ref
  28. G. S. Hong, M. S. Koo, A. Saha and B. G. Kim, "Efficient local stereo matching technique using weighted guided image filtering (WGIF)," 2016 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, 2016, pp. 484--485.Google ScholarGoogle Scholar
  29. Vision.middlebury.edu. (2018). vision.middlebury.edu. {online} Available at: http://vision.middlebury.edu.Google ScholarGoogle Scholar
  30. Zhang, C., Li, Z., Cheng, Y., Cai, R., Chao, H., & Rui, Y. (2015). Meshstereo: A global stereo model with mesh alignment regularization for view interpolation. In Proceedings of the IEEE International Conference on Computer Vision (pp. 2057--2065). Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Nahar, S., & Joshi, M. V. (2017). A learned sparseness and IGMRF-based regularization framework for dense disparity estimation using unsupervised feature learning. IPSJ Transactions on Computer Vision and Applications, 9(1), 2.Google ScholarGoogle ScholarCross RefCross Ref
  32. R. A. Jellal, M. Lange, B. Wassermann, A. Schilling and A. Zell, "LS-ELAS: Line segment based efficient large scale stereo matching," 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore, 2017, pp. 146--152.Google ScholarGoogle Scholar
  33. Anon, (2017). {online} Available at: https://www.cs.stevens.edu/~mordohai/public/LeGendre_SampledPhotoconsistencyStereo17.pdf. {Accessed 6 Mar. 2018}.Google ScholarGoogle Scholar
  34. Kitagawa, M., Shimizu, I., & Sara, R. (2017, May). High accuracy local stereo matching using DoG scale map. In Machine Vision Applications (MVA), 2017 Fifteenth IAPR International Conference on (pp. 258--261). IEEE.Google ScholarGoogle ScholarCross RefCross Ref
  35. Zhang, K., Li, J., Li, Y., Hu, W., Sun, L., & Yang, S. (2012). Binary stereo matching. Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012), 356--359.Google ScholarGoogle Scholar
  36. Shahbazi, M., Sohn, G., Théau, J., & Ménard, P. (2016). REVISITING INTRINSIC CURVES FOR EFFICIENT DENSE STEREO MATCHING. ISPRS Annals of Photogrammetry, Remote Sensing & Spatial Information Sciences, 3(3).Google ScholarGoogle Scholar
  37. "vision.middlebury," 27 March 2018. {Online}. Available: http://vision.middlebury.edu/stereo/eval3/.Google ScholarGoogle Scholar
  38. G. Forlani, Semi-Global techniques in Image Matching and Change Detection with applications to Civil and Environmental Engineering, Parma: SCUOLA DI DOTTORATO IN INGEGNERIA E ARCHITETTURA Dottorato di Ricerca in Ingegneria Civile, 2016.Google ScholarGoogle Scholar

Index Terms

  1. Enhanced Stereovision Processing for Improved 3D Object Reconstruction

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      SSIP '18: Proceedings of the 2018 International Conference on Sensors, Signal and Image Processing
      October 2018
      88 pages
      ISBN:9781450366205
      DOI:10.1145/3290589

      Copyright © 2018 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 12 October 2018

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited
    • Article Metrics

      • Downloads (Last 12 months)1
      • Downloads (Last 6 weeks)0

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader