Skip to main content
SpringerLink
Log in
Book cover

Asian Conference on Computer Vision

ACCV 2016: Computer Vision – ACCV 2016 Workshops pp 236–247Cite as

A 3D Reconstruction Method with Color Reproduction from Multi-band and Multi-view Images

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 10117))

Abstract

The purpose of digital archiving is the accurate rendering of authenticated contents in terms of color and shape. This paper proposes a novel 3D reconstruction method with color reproduction from multi-band and multi-view images. The proposed method consists of 5 steps: (i) feature tracking of multi-band and multi-view images, (ii) sparse 3D reconstruction using Structure from Motion (SfM), (iii) mesh generation from the sparse 3D point clouds, (iv) dense 3D reconstruction and (v) color reproduction. We create multi-band and multi-view image datasets of Japanese dolls with Kimono for quantitative performance evaluation. Through a set of experiments using our datasets, we confirm that our proposed method exhibits efficient performance of reconstructing a high-quality 3D model from multi-band and multi-view images compared with conventional methods.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Notes

  1. 1.

    http://www.vision.caltech.edu/bouguetj/calib_doc/.

References

  1. Hardeberg, J.: Acquisition and Reproduction of Color Images: Colorimetric and Multispectral Approaches. Universal Publishers, Boca Raton (2001)

    Google Scholar 

  2. Szeliski, R.: Computer Vision: Algorithms and Applications. Springer-Verlag New York Inc., New York (2010)

    MATH  Google Scholar 

  3. Seitz, S.M., Curless, B., Diebel, J., Scharstein, D., Szeliski, R.: A comparison and evaluation of multi-views stereo reconstruction algorithms. In: Proceedings of the International Conference on Computer Vision and Pattern Recognition, pp. 519–528 (2006)

    Google Scholar 

  4. Strecha, C., von Hansen, W., Gool, L.V., Fua, P., Thoennessen, U.: On benchmarking camera calibration and multi-view stereo for high resolution imagery. In: Proceedings of the International Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)

    Google Scholar 

  5. Vrhel, M., Trussell, H.: Color correction using principal components. Color Res. Appl. 17, 328–338 (1992)

    Article  Google Scholar 

  6. Furukawa, Y., Curless, B., Seitz, S.M., Szeliski, R.: Towards internet-scale multi-view stereo. In: Proceedings of the International Conference on Computer Vision and Pattern Recognition, pp. 1434–1441 (2010)

    Google Scholar 

  7. Furukawa, Y., Ponce, J.: Accurate, dense, and robust multiview stereopsis. IEEE Trans. Pattern Anal. Mach. Intell. 32, 1362–1376 (2010)

    Article  Google Scholar 

  8. Wu, C., Liu, Y., Dai, Q., Wilburn, B.: Fusing multiview and photometric stereo for 3D reconstruction under uncalibrated illumination. IEEE Trans. Vis. Comput. Graph. 17, 1082–1095 (2011)

    Article  Google Scholar 

  9. Hartley, R., Zisserman, A.: Multiple View Geometry. Cambridge University Press, Cambridge (2004)

    Book  MATH  Google Scholar 

  10. Kuglin, C.D., Hines, D.C.: The phase correlation image alignment method. In: Proceedings of the International Conference on Cybernetics and Society, pp. 163–165 (1975)

    Google Scholar 

  11. Takita, K., Aoki, T., Sasaki, Y., Higuchi, T., Kobayashi, K.: High-accuracy subpixel image registration based on phase-only correlation. IEICE Trans. Fundam. E86-A, 1925–1934 (2003)

    Google Scholar 

  12. Tsuchida, M., Sakai, S., Ito, K., Kashino, K., Yamato, J., Aoki, T.: Efficient POC-based correspondence detection method for multi-channel images. In: Proceedings of Color and Imaging Conference, pp. 113–118 (2014)

    Google Scholar 

  13. Sakai, S., Ito, K., Aoki, T., Masuda, T., Unten, H.: An efficient image matching method for multi-view stereo. In: Lee, K.M., Matsushita, Y., Rehg, J.M., Hu, Z. (eds.) ACCV 2012. LNCS, vol. 7727, pp. 283–296. Springer, Heidelberg (2013). doi:10.1007/978-3-642-37447-0_22

    Chapter  Google Scholar 

  14. Takita, K., Muquit, M.A., Aoki, T., Higuchi, T.: A sub-pixel correspondence search for computer vision applications. IEICE Trans. Fundam. E87-A, 1913–1923 (2004)

    Google Scholar 

  15. Ishii, J., Sakai, S., Ito, K., Aoki, T., Yanagi, T., Ando, T.: 3D reconstruction of urban environments using in-vehicle fisheye camera. In: Proceedings of the IEEE International Conference on Image Processing, pp. 2145–2148 (2013)

    Google Scholar 

  16. Shi, J., Tomasi, C.: Good features to track. In: Proceedings of the International Conference on Computer Vision and Pattern Recognition, pp. 593–600 (1994)

    Google Scholar 

  17. Kneip, L., Scaramuzza, D., Siegwart, R.: A novel parametrization of the perspective-three-point problem for a direct computation of absolute camera position and orientation. In: Proceedings of the International Conference on Computer Vision and Pattern Recognition, pp. 2969–2976. IEEE (2011)

    Google Scholar 

  18. Nistér, D.: An efficient solution to the five-point relative pose problem. IEEE Trans. Pattern Anal. Mach. Intell. 26, 756–770 (2004)

    Article  Google Scholar 

  19. Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 381–395 (1981)

    Article  MathSciNet  Google Scholar 

  20. Labatut, P., Pons, J.P., Keriven, R.: Robust and efficient surface reconstruction from range data. Comput. Graph. Forum 28, 2275–2290 (2009)

    Article  Google Scholar 

  21. Havel, J., Herout, A.: Yet faster ray-triangle intersection (using SSE4). Trans. Vis. Comput. Graph. 16, 434–438 (2010)

    Article  Google Scholar 

  22. Ishii, J., Sakai, S., Ito, K., Aoki, T.: Wide-baseline stereo matching using ASIFT and POC. In: Proceedings of the IEEE International Conference on Image Processing, pp. 2977–2980 (2012)

    Google Scholar 

  23. Tsuchida, M., Sakai, S., Miura, M., Ito, K., Kawanishi, K., Kashino, K., Yamato, J., Aoki, T.: Stereo one-shot six-band camera system for accurate color reproduction. J. Electron. Imaging 23, 033025-1–033025-12 (2013)

    Google Scholar 

  24. Pratt, W.K., Mancill, C.E.: Spectral estimation techniques for the spectral calibration of a color image scanner. Appl. Opt. 15, 73–75 (1976)

    Article  Google Scholar 

  25. Wu, C.: VisualSFM: A Visual Structure from Motion System. http://homes.cs.washington.edu/~ccwu/vsfm/

  26. Jensen, R., Dahl, A., Vogiatzis, G., Tola, E., Anæs, H.: Large scale multi-view stereopsis evaluation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 406–413 (2014)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Graduate School of Information Sciences, Tohoku University, Sendai, 980-8579, Japan

    Shuya Ito, Koichi Ito & Takafumi Aoki

  2. NTT Communication Science Laboratories, Atsugi, 243-0198, Japan

    Masaru Tsuchida

Authors
  1. Shuya Ito
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Koichi Ito
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Takafumi Aoki
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Masaru Tsuchida
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Koichi Ito .

Editor information

Editors and Affiliations

  1. Institute of Information Science, Academia Sinica, Taipei, Taiwan

    Chu-Song Chen

  2. Tsinghua University, Beijing, China

    Jiwen Lu

  3. School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore, Singapore

    Kai-Kuang Ma

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Ito, S., Ito, K., Aoki, T., Tsuchida, M. (2017). A 3D Reconstruction Method with Color Reproduction from Multi-band and Multi-view Images. In: Chen, CS., Lu, J., Ma, KK. (eds) Computer Vision – ACCV 2016 Workshops. ACCV 2016. Lecture Notes in Computer Science(), vol 10117. Springer, Cham. https://doi.org/10.1007/978-3-319-54427-4_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-54427-4_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-54426-7

  • Online ISBN: 978-3-319-54427-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation