Abstract
Reducing the number of images in fringe projection profilometry has emerged as a significant research focus. Traditional temporal phase unwrapping algorithms typically require an additional set of coding fringe or phase shift fringe images to determine the fringe order and facilitate phase unwrapping, in addition to the essential sinusoidal phase shift fringe for calculating the wrapped phase. In order to reduce the required number of fringe images and increase reconstruction speed, this paper proposes a three-dimensional (3D) reconstruction method inspired by spatial phase unwrapping. The proposed method is based on the N-step temporal phase unwrapping algorithm and can solve the wrapped phase and fringe order using only a set of sinusoidal phase shift fringe images. Our method achieves a further reduction in the required number of images without compromising reconstruction accuracy. In the calculation of the absolute phase, our proposed method only requires an N-step standard phase shift sinusoidal fringe image, eliminating the need for additional fringe images to determine the fringe order. Firstly, we employ the standard N-step phase shift algorithm to compute the wrapped phase and apply a mask for background removal. Next, we directly calculate the fringe order using the wrapped phase and mask and solve for the absolute phase based on the connected region labeling theorem. Our method achieves 3D reconstruction using a minimum of three fringe images, while maintaining reconstruction precision comparable to that of the traditional temporal phase unwrapping technique. As no additional fringe image is required to solve the fringe order, our method has the potential to achieve significantly faster reconstruction speed.
Similar content being viewed by others
Data availability
Data will be made available on reasonable request.
Change history
08 December 2023
A Correction to this paper has been published: https://doi.org/10.1007/s00371-023-03181-6
References
Marrugo, A.G., Gao, F., Zhang, S.: State-of-the-art active optical techniques for three-dimensional surface metrology: a review. J. Opt. Soc. Am. A 37, B60 (2020)
Gorthi, S.S., Rastogi, P.: Fringe projection techniques: Whither we are? Opt. Lasers Eng. 48, 133–140 (2010)
Wang, Z., Nguyen, D.A., Barnes, J.C.: Some practical considerations in fringe projection profilometry. Opt. Lasers Eng. 48, 218–225 (2010)
Zhang, S.: Absolute phase retrieval methods for digital fringe projection profilometry: a review. Opt. Lasers Eng. 107, 28–37 (2018)
Brown, G.M.: Overview of three-dimensional shape measurement using optical methods. Opt. Eng. 39, 10 (2000)
Ford, K., Myer, G., Hewett, T.: Reliability of landing 3D motion analysis. Med. Sci. Sports Exerc. 39, 2021–2028 (2007)
Zuo, C., Qian, J., Feng, S., Yin, W., Li, Y., Fan, P., Han, J., Qian, K., Chen, Q.: Deep learning in optical metrology: a review. Light: Sci. Appl. 11, 39 (2022)
Tu, Z., Huang, Z., Chen, Y., Kang, D., Bao, L., Yang, B., Yuan, J.: Consistent, 3D hand reconstruction in video via self-supervised learning. IEEE Trans. Pattern Anal. Mach. Intell. 45, 9469–9485 (2023)
Wu, Z., Guo, W., Li, Y., Liu, Y., Zhang, Q.: High-speed and high-efficiency three-dimensional shape measurement based on Gray-coded light. Photon. Res. 8, 819 (2020)
Zhang, S., Van Der Weide, D., Oliver, J.: Superfast phase-shifting method for 3-D shape measurement. Opt. Express 18, 9684–9689 (2010)
Zuo, C., Huang, L., Zhang, M., Chen, Q., Asundi, A.: Temporal phase unwrapping algorithms for fringe projection profilometry: a comparative review. Opt. Lasers Eng. 85, 84–103 (2016)
Ghiglia, D., Pritt, M.: Two-dimensional phase unwrapping: theory, algorithms, and software, Wiley (1998)
Ghiglia, D.C., Romero, L.A.: Robust two-dimensional weighted and unweighted phase unwrapping that uses fast transforms and iterative methods. J. Opt. Soc. Am. A 11, 107 (1994)
Huntley, J.M.: Noise-immune phase unwrapping algorithm. Appl. Opt. 28, 3268 (1989)
Su, X., Chen, W.: Reliability-guided phase unwrapping algorithm: a review. Opt. Lasers Eng. 42, 245–261 (2004)
Salvi, J., Fernandez, S., Pribanic, T., Llado, X.: A state of the art in structured light patterns for surface profilometry. Pattern Recogn. 43, 2666–2680 (2010)
Zhang, Q., Su, X., Xiang, L., Sun, X.: 3-D shape measurement based on complementary Gray-code light. Opt. Lasers Eng. 50, 574–579 (2012)
Creath, K.: Step height measurement using two-wavelength phase-shifting interferometry. Appl. Opt. 26, 2810 (1987)
Cheng, Y., Wyant, J.C.: Two-wavelength phase shifting interferometry. Appl. Opt. 23, 4539 (1984)
Wang, Y., Zhang, S.: Novel phase-coding method for absolute phase retrieval. Opt. Lett. 37, 2067 (2012)
Zheng, D., Da, F.: Phase coding method for absolute phase retrieval with a large number of codewords. Opt. Express 20, 24139 (2012)
Zhou, C., Liu, T., Si, S., Xu, J., Liu, Y., Lei, Z.: An improved stair phase encoding method for absolute phase retrieval. Opt. Lasers Eng. 66, 269–278 (2015)
Xing, Y., Quan, C., Tay, C.J.: A modified phase-coding method for absolute phase retrieval. Opt. Lasers Eng. 87, 97–102 (2016)
Wang, L., Chen, Y., Han, X., Fu, Y., Zhong, K., Jiang, G.: A 3D shape measurement method based on novel segmented quantization phase coding. Opt. Lasers Eng. 113, 62–70 (2019)
Huang, P.S., Zhang, S.: Fast three-step phase-shifting algorithm. Appl. Opt. 45, 5086 (2006)
Huang, P.S.: Trapezoidal phase-shifting method for three-dimensional shape measurement. Opt. Eng. 44, 123601 (2005)
Jia, P., Kofman, J., English, C., Deslauriers, A.: Two-step triangular phase- shifting method for 3-D object-shape measurement, (2005)
Jia, P., Kofman, J., English, C.: Intensity-ratio error compensation for triangular-pattern phase-shifting profilometry. J. Opt. Soc. Am. A, Opt. Image Sci. Vis. 24, 3150–3158 (2007)
Jia, P., Kofman, J., English, C.: Error compensation in two-step triangular-pattern phase-shifting profilometry. Opt. Lasers Eng. 46, 311–320 (2008)
Zuo, C., Chen, Q., Gu, G., Feng, S., Feng, F.: High-speed three-dimensional profilometry for multiple objects with complex shapes. Opt. Express 20, 19493 (2012)
Xu, J., Liu, S., Wan, A., Gao, B., Yi, Q., Zhao, D., Luo, R., Chen, K.: An absolute phase technique for 3D profile measurement using four-step structured light pattern. Opt. Lasers Eng. 50, 1274–1280 (2012)
Wang, F., Zeng, Z., Wang, L., Fu, Y., Jiang, G., Zhang, H.: A fast 3D shape measurement method based on sinusoidal and triangular fringe projection. J. Mod. Opt. 65, 136–144 (2018)
Zheng, D., Kemao, Q., Da, F., Seah, H.S.: Ternary Gray code-based phase unwrapping for 3D measurement using binary patterns with projector defocusing. Appl. Opt. 56, 3660 (2017)
Porras-Aguilar, R., Falaggis, K., Ramos-Garcia, R.: Optimum projection pattern generation for grey-level coded structured light illumination systems. Opt. Lasers Eng. 91, 242–256 (2017)
Cheng, N., Su, W.: Phase-shifting projected fringe profilometry using binary-encoded patterns. Photonics 8, 362 (2021)
Tabata, S., Maruyama, M., Watanabe, Y., Ishikawa, M.: Pixelwise phase unwrapping based on ordered periods phase shift. Sensors 19, 377 (2019)
He, X., Zheng, D., Kemao, Q., Christopoulos, G.: Quaternary gray-code phase unwrapping for binary fringe projection profilometry. Opt. Lasers Eng. 121, 358–368 (2019)
Wang, Y., Liu, L., Wu, J., Chen, X., Wang, Y.: Spatial binary coding method for stripe-wise phase unwrapping. Appl. Opt. 59, 4279 (2020)
Wang, L., Wang, W., Wang, X., Wang, X.: Three-dimensional measurement method based on a three-step phase-shifting fringe and a binary fringe. Appl. Opt. 61, 5320 (2022)
Sun, J., Chen, X., Wang, Q., Li, Z., Averbuch-Elor, H., Zhou, X., Snavely, N.: Neural 3d reconstruction in the wild. In: ACM SIGGRAPH 2022 Conference Proceedings, pp. 1–9 (2022)
Sayed, M., Gibson, J., Watson, J., Prisacariu, V., Firman, M., SimpleRecon, G. C.: 3D reconstruction without 3D convolutions. In: Avidan, S., Brostow, G., Cissé, M., Farinella, G. M., Hassner, T. (eds.) Cham: Springer Nature Switzerland; pp. 1–19 (2022)
Wen, Y., Li, S., Cheng, H., Su, X., Zhang, Q.: Universal calculation formula and calibration method in Fourier transform profilometry. Appl. Opt. 49, 6563 (2010)
Rajshekhar, G., Rastogi, P.: Fringe analysis: premise and perspectives. Opt. Lasers Eng. 50, iii–x (2012)
Reid, G.T.: Automatic fringe pattern analysis: a review. Opt. Lasers Eng. 7, 37–68 (1986)
Lin, C., Zheng, D., Kemao, Q., Han, J., Bai, L.: Spatial pattern-shifting method for complete two-wavelength fringe projection profilometry. Opt Lett 45, 3115–3118 (2020)
Acknowledgements
This work was supported by the National Natural Science Foundation of China (NSFC) (Grant no.51575388).
Author information
Authors and Affiliations
Contributions
Lin Wang: Conceptualization, Methodology, Software, Writing – original draft. Lina Yi: Methodology, Writing – review & editing. Yuetong Zhang: Visualization, Formal analysis. Xiaofang Wang: Investigation, Writing – review & editing. Wei Wang: Experimental setup, Experiment, review & editing. Xiangjun Wang: Resources, Project administration, Funding acquisition. Xuan Wang: Resources, Data curation, Formal analysis.
Corresponding author
Ethics declarations
Conflict of interest
Lin Wang declares that he has no conflict of interest. Lina Yi declares that she has no conflict of interest. Yuetong Zhang declares that he has no conflict of interest. Xiaofang Wang declares that she has no conflict of interest. Wei Wang declares that he has no conflict of interest. Xiangjun Wang declares that he has no conflict of interest. Xuan Wang declares that he has no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
The original online version of this article was revised: one author was missing
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Wang, L., Yi, L., Zhang, Y. et al. 3D reconstruction method based on N-step phase unwrapping. Vis Comput 40, 3601–3613 (2024). https://doi.org/10.1007/s00371-023-03054-y
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-023-03054-y