Abstract
Good radiometry of a 3D reconstruction is essential for digital conservation and versatile visualization of cultural heritage artifacts and sites. For large sites, “true” radiometry for the complete 3D point cloud is very expensive to obtain. We present a method that is capable to reconstruct the radiometric surface properties of an entire scene despite the fact that we only have access to the “true” radiometry of a small part of it. This is done in a two stage process: First, we transfer the radiometry to spatially corresponding parts of the scene, and second, we propagate these values to the entire scene using affinity information. We apply our method to 3D point clouds and 2D images, and show excellent quantitative and visually pleasing qualitative results. This approach can be of high value in many applications where users want to improve phototextured models towards high-quality yet affordable radiometry.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Mostegel, C., Rumpler, M., Fraundorfer, F., Bischof, H.: UAV-based autonomous image acquisition with multi-view stereo quality assurance by confidence prediction. In: Proceedings of CVPR Workshop (2016)
Agarwal, S., Furukawa, Y., Snavely, N., Simon, I., Curless, B., Seitz, S., Szeliski, R.: Building rome in a day. Commun. ACM 54, 105–111 (2011)
Rothermel, M., Wenzel, K., Fritsch, D., Haala, N.: SURE: photogrammetric surface reconstruction from imagery. In: Proceedings of LC3D Workshop (2012)
Furukawa, Y., Ponce, J.: Accurate, dense, and robust multiview stereopsis. IEEE Trans. Pattern Anal. Mach. Intell. 32, 1362–1376 (2010)
Reinhard, E., Adhikhmin, M., Gooch, B., Shirley, P.: Color transfer between images. IEEE Comput. Graph. Appl. 21, 34–41 (2001)
Ruderman, D.L., Cronin, T.W., Chiao, C.C.: Statistics of cone responses to natural images: implications for visual coding. J. Opt. Soc. Am. A 15, 2036–2045 (1998)
Pitié, F., Kokaram, A.C., Dahyot, R.: N-dimensional probablility density function transfer and its application to colour transfer. In: Proceedings of ICCV (2005)
Pitié, F., Kokaram, A.C., Dahyot, R.: Automated colour grading using colour distribution transfer. Comput. Vis. Image Underst. 107, 123–137 (2007)
Gonzalez, R.C., Woods, R.E.: Digital Image Processing, 3rd edn. Prentice-Hall Inc., Upper Saddle River (2006)
Rabin, J., Peyré, G., Delon, J., Bernot, M.: Wasserstein barycenter and its application to texture mixing. In: Bruckstein, A.M., Haar Romeny, B.M., Bronstein, A.M., Bronstein, M.M. (eds.) SSVM 2011. LNCS, vol. 6667, pp. 435–446. Springer, Heidelberg (2012). doi:10.1007/978-3-642-24785-9_37
Villani, C.: Topics in Optimal Transportation. Graduate Studies in Mathematics. American Mathematical Society, cop., Providence (2003)
Rubner, Y., Tomasi, C., Guibas, L.J.: A metric for distributions with applications to image databases. In: Proceedings of ICCV (1998)
Shirdhonkar, S., Jacobs, D.W.: Approximate earth mover’s distance in linear time. In: Proceedings of CVPR (2008)
Bottou, L.: Online algorithms and stochastic approximations. In: Saad, D. (ed.) Online Learning and Neural Networks. Cambridge University Press, Cambridge (1998). Revised, October 2012
Zhu, X., Ghahramani, Z.: Learning from labeled and unlabeled data with label propagation. Technical report (2002)
Höll, T., Pinz, A.: Cultural heritage acquisition: geometry-based radiometry in the wild. In: Proceedings of 3D Vision (3DV) (2015)
Gehler, P.V., Rother, C., Blake, A., Minka, T., Sharp, T.: Bayesian color constancy revisited. In: Proceedings of CVPR (2008)
Lynch, S.E., Drew, M.S., Finlayson, G.D.: Colour constancy from both sides of the shadow edge. In: Proceedings of ICCV Workshop (2013)
Wolf, S.: Color correction matrix for digital still and video imaging systems. Technical report TM-04-406, National Telecommunications and Information Administration, Washington D.C. (2003)
Wang, Z., Bovik, A.C., Sheikh, H.R., Simoncelli, E.P.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13, 600–612 (2004)
Acknowledgements
The research leading to these results was partly funded by the EC FP7 project 3D-PITOTI (ICT-2011-600545). The colourful painting in Sect. 4.2 is a 3D scan of a reproduction of a painting by August Macke. We thank ArcTron 3D GmbH (http://www.arctron.de) for providing us the data. We thank the Institute for Computer Graphics and Vision (ICG, TU Graz) for providing us the large-scale 3D reconstruction for our experiments in Sect. 4.1. We also thank MiBACT-SBA Lombardia and the Parco Archeologico Comunale di Seradina-Bedolina for permission to scan at Seradina I rock 12C. We appreciate the permission to use an academic license of the SURE software package [3] for dense 3D reconstruction.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Höll, T., Pinz, A. (2017). Radiometry Propagation to Large 3D Point Clouds from Sparsely Sampled Ground Truth. In: Chen, CS., Lu, J., Ma, KK. (eds) Computer Vision – ACCV 2016 Workshops. ACCV 2016. Lecture Notes in Computer Science(), vol 10117. Springer, Cham. https://doi.org/10.1007/978-3-319-54427-4_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-54427-4_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-54426-7
Online ISBN: 978-3-319-54427-4
eBook Packages: Computer ScienceComputer Science (R0)