Abstract
This paper presents the full VLSI implementation of adaptive multi-window matching method for depth sensing system on a chip (SoC) based on active infrared structured light, which estimates the 3D scene depth by matching randomized speckle patterns, akin to the Microsoft Kinect. We present a simple and efficient hardware structure for the adaptive multi-window block-matching-disparity estimation algorithm, which facilitates rapid generation of disparity maps in real-time. Then the disparity map is calculated to the depth value according to the triangulation principle. We have implemented these ideas in an end-to-end SoC using FPGA and demonstrate that our depth sensing SoC can ensure the matching accuracy and improve the details of depth maps, such as, small objects and the edge of objects.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Zhang, Z.: Microsoft kinect sensor and its effect. IEEE Multimedia 19(2), 4–10 (2012)
Harvent, J., Coudrin, B., Brèthes, L., Orteu, J.J., et al.: Multi-view dense 3D modelling of untextured objects from a moving projector-cameras system. Mach. Vis. Appl. 24(8), 1645–1659 (2013)
Rengier, F., Mehndiratta, A., Tengg-Kobligk, H.V., Zechmann, C.M., et al.: 3D printing based on imaging data: review of medical applications. Int. J. Comput. Assist. Radiol. Surg. 5(4), 335–341 (2010)
Nguyen, D.V., Kuhnert, L., Jiang, T., Kuhnert, K.D.: A novel approach of terrain classification for outdoor automobile navigation. In: 2011 IEEE International Conference on Computer Science and Automation Engineering (CSAE), pp. 609–616 (2011)
Goesele, M., Curless, B., Seitz, S.M.: Multi-view stereo revisited. In: IEEE Computer Society Conference on Computer Vision & Pattern Recognition, pp. 2402–2409 (2006)
Sarbolandi, H., Lefloch, D., Kolb, A.: Kinect range sensing: structured-light versus time-of-flight kinect. Comput. Vis. Image Underst. 139, 1–20 (2015)
Yao, H., Ge, C., Hua, G., Zheng, N.: The VLSI implementation of a high-resolution depth-sensing SoC based on active structured light. Mach. Vis. Appl. 26(4), 533–548 (2015)
Acknowledgment
Supposed by the project of National Natural Science Foundation of China under Grant Nos. 61571358.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Yao, H., Ge, C., Yang, L., Fu, Y., Xue, J. (2016). Adaptive Multi-window Matching Method for Depth Sensing SoC and Its VLSI Implementation. In: Chen, E., Gong, Y., Tie, Y. (eds) Advances in Multimedia Information Processing - PCM 2016. PCM 2016. Lecture Notes in Computer Science(), vol 9916. Springer, Cham. https://doi.org/10.1007/978-3-319-48890-5_42
Download citation
DOI: https://doi.org/10.1007/978-3-319-48890-5_42
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-48889-9
Online ISBN: 978-3-319-48890-5
eBook Packages: Computer ScienceComputer Science (R0)