Skip to main content
SpringerLink
Log in

Material classification of polishing and convex surface objects based on photon accumulation point spread function (PAPSF) from imaging model of binocular pulsed time-of-flight camera

  • ORIGINAL PAPER
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

The classification of materials is a research hotspot. These methods generally focus on the classification of flat materials and do not consider the influence of polishing and convex surfaces. We develop a classification algorithm of polishing and convex surface objects, and derive the photon accumulation point spread function (PAPSF) of material from the imaging model of a binocular pulsed time-of-flight (ToF) camera as the classification feature, which consists of depth distortion, the indirect reflection photon cumulant and the indirect reflection photon cumulant. We design a one-versus-all support vector machine (SVM) classifier to classify materials of polishing and convex surfaces objects. We conduct classification experiments on four plastics and four metal materials with a similar appearance. Our method in flat and raw material classification has the same classification accuracy as the latest method based on a continuous-wave- modulation ToF camera, but also our method achieved accuracies of 91.0% in flat and polishing material classification, 93.0% in different convex surface and fixed polishing material classification, 91.5% in fixed convex surface and different polishing material classification and 90.2% in polishing and convex surface material classification.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22

Similar content being viewed by others

References

  1. Varma, M., Zisserman, A.: A statistical approach to texture classification from single images. Int. J. Comput. Vis. 62(1–2), 61–81 (2005)

    Article  Google Scholar 

  2. Varma, M., Zisserman, A.: A statistical approach to material classification using image patch exemplars. IEEE Trans. Pattern Anal. Mach. Intell. 31(11), 2032–2047 (2008)

    Article  Google Scholar 

  3. Salamati, N., Fredembach, C., Süsstrunk, S.: Material classification using color and NIR images. In: Color and Imaging Conference Society for Imaging Science and Technology, pp. 216–222 (2009)

  4. Orun, A.B., Alkis, A.: Material identification by surface reflection analysis in combination with bundle adjustment technique. Pattern Recogn. Lett. 24(9–10), 1589–1598 (2003)

    Article  MATH  Google Scholar 

  5. Sato, M., Yoshida, S., Olwal, A., Shi, B., Hiyama, A., Tanikawa, T., Hirose, M., Raskar, R.: Spectrans: versatile material classification for interaction with textureless, specular and transparent surfaces. In: ACM Conference on Human Factors in Computing Systems, pp. 2191–2200 (2015)

  6. Liu, C., Gu, J.: Discriminative illumination: Per-pixel classification of raw materials based on optimal projections of spectral brdf. IEEE Trans. Pattern Anal. Mach. Intell. 36(1), 86–98 (2013)

    Google Scholar 

  7. Wang, O., Gunawardane, P., Scher, S., Davis, J.: Material classification using BRDF slices. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 2805–2811 (2009)

  8. Jehle, M., Sommer, C., Jähne, B.: Learning of optimal illumination for material classification, Joint Pattern Recognition Symposium, pp. 563–572 (2010)

  9. Kadambi, A., Whyte, R., Bhandari, A., Streeter, L., Barsi, C., Dorrington, A., Raskar, R.: Coded time of flight cameras: sparse deconvolution to address multipath interference and recover time profiles. ACM Trans. Graph 32(6), 1–10 (2013)

    Article  Google Scholar 

  10. O’Toole, M., Heide, F., Xiao, L., Hullin, M.B., Heidrich, W., Kutulakos, K.N.: Temporal frequency probing for 5D transient analysis of global light transport. ACM Trans. Graph. 33(4), 1–11 (2014)

    Article  MATH  Google Scholar 

  11. Su, S., Heide, F., Swanson, R., Klein, J., Callenberg, C., Hullin, M., Heidrich, W.: Material classification using raw time-of-flight measurements. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3503–3511 (2016)

  12. Tanaka, K., Mukaigawa, Y., Funatomi, T., Kubo, H., Matsushita, Y., Yagi, Y.: Material classification using frequency-and depth-dependent time-of-flight distortion. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 79–88 (2017)

  13. Erickson, Z., Luskey, N., Chernova, S., Kemp, C.C.: Classification of household materials via spectroscopy. IEEE Robot. Autom. Lett. 4(2), 700–707 (2019)

    Article  Google Scholar 

  14. Horaud, R., Hansard, M., Evangelidis, G., Ménier, C.: An overview of depth cameras and range scanners based on time-of-flight technologies. Mach. Vis. Appl. 27(7), 1005–1020 (2016)

    Article  Google Scholar 

  15. Fukuda, M. A. M. H., Cao, L., Kuno, Y. K. Y.: 3D free-form object material identification by surface reflection analysis with a time-of-flight range sensor. In: 12th IAPR Conference on Machine Vision Applications, pp. 227–230 (2011)

  16. Foix, S., Alenya, G., Torras, C.: Lock-in time-of-flight (ToF) cameras: a survey. IEEE Sens. J. 11(9), 1917–1926 (2011)

    Article  Google Scholar 

  17. Zhang, J., Lang, S., Wu, Q., Liu, C.: Material recognition based on a pulsed time-of-flight camera. In: 2019 IEEE Symposium on Product Compliance Engineering-Asia (ISPCE-CN), pp. 1–8 (2019)

  18. Lang, S., Zhang, J., Cai, Y., et al.: Classification of materials using a pulsed time-of-flight camera. Mach. Vis. Appl. 32(30), 1–19 (2021)

    Google Scholar 

  19. Bhandari, A., Raskar, R.: Signal processing for time-of-flight imaging sensors: an introduction to inverse problems in computational 3-D imaging. IEEE Signal Process. Mag. 33(5), 45–58 (2016)

    Article  Google Scholar 

  20. Kajiya, J. T.: The rendering equation. In: Proceedings of the 13th Annual Conference on Computer Graphics and Interactive Techniques, pp. 143–150 (1986)

  21. Matusik, W.: A data-driven reflectance model. Ph. D., Massachusetts Institute of Technology, Cambridge (2003)

  22. Yang, L., Wang, B., Zhang, R., Zhou, H., Wang, R.: Analysis on location accuracy for the binocular stereo vision system. IEEE Photonics J. 10(1), 1–16 (2017)

    Google Scholar 

  23. Guo, X.: Three dimensional moment invariants under rigid transformation. In: International Conference on Computer Analysis of Images and Patterns, pp. 518–522 (1993)

  24. Fleck, M. M.: Perspective projection: the wrong imaging model, Department of Computer Science, University of Iowa, pp. 1–27 (1995)

  25. Kazhdan, M., Hoppe, H.: Screened poisson surface reconstruction. ACM Trans. Graphics (ToG) 32(3), 1–13 (2013)

    Article  MATH  Google Scholar 

  26. Scholkopf, B., Sung, K.K., Burges, C.J., Girosi, F., Niyogi, P., Poggio, T., Vapnik, V.: Comparing support vector machines with Gaussian kernels to radial basis function classifiers. IEEE Trans. Signal Process. 45(11), 2758–2765 (1997)

    Article  Google Scholar 

  27. Han, H., Wang, W. Y., Mao, B. H.: Borderline-SMOTE: a new over-sampling method in imbalanced data sets learning. In: International Conference on Intelligent Computing, pp. 878–887 (2005)

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China (Nos. 41606219, 41776186), the Scientific Research Project of Beijing Educational Committee (No. KM 201910005027), and the Rixin Foundation of Beijing University of Technology. The authors thank the anonymous referee for invaluable comments and suggestions.

Funding

This study was funded by the National Natural Science Foundation of China (Nos. 41606219, 41776186), the Scientific Research Project of Beijing Educational Committee (No. KM 201910005027), and the Rixin Foundation of Beijing University of Technology.

Author information

Authors and Affiliations

  1. Faculty of Information Technology, Beijing University of Technology, Beijing, 100124, People’s Republic of China

    Shinan Lang, Jizhong Zhang, Fangyi Chen, Yiheng Cai & Qiang Wu

Authors
  1. Shinan Lang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jizhong Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fangyi Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yiheng Cai
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Qiang Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yiheng Cai.

Ethics declarations

Ethical approval

This article does not contain any studies with human participants or animals performed by any of the authors.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lang, S., Zhang, J., Chen, F. et al. Material classification of polishing and convex surface objects based on photon accumulation point spread function (PAPSF) from imaging model of binocular pulsed time-of-flight camera. Machine Vision and Applications 34, 20 (2023). https://doi.org/10.1007/s00138-022-01366-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s00138-022-01366-y

Keywords

Search

Navigation