Abstract
This paper presents an image-based method aimed at generating a mesh of high-order finite elements on a tubular structure. The method assumes that the object is immersed in a liquid with known refractive coefficients and the images are recorded by moving the camera on a circular path around the object. Both the refractive effects and the camera motion are taken into account by a modified bundle adjustment formulation, which allows for an accurate reconstruction even in the presence of the optical interface. A parametric surface is fitted onto the resulting point cloud by an iterative surface fitting algorithm. Finally, the resulting surface is discretized into a mesh of high-order hexahedral elements.
Similar content being viewed by others
References
Zhang, Y.J.: Image-Based Geometric Modeling and Mesh Generation, vol. 3. Springer, New York (2012)
Jordt-Sedlazeck, A., Koch, R.: Refractive structure-from-motion on underwater images. In: 2013 IEEE International Conference on Computer Vision (ICCV), pp. 57–64. IEEE (2013)
Chen, X., Yang, Y.-H.: Two-view camera housing parameters calibration for multi-layer flat refractive interface. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 524–531 (2014)
Kutulakos, K.N., Steger, E.: A theory of refractive and specular 3D shape by light-path triangulation. Int. J. Comput. Vis. 76(1), 13–29 (2008)
Qian, Y., Gong, M., Yang, Y.-H.: Stereo-based 3D reconstruction of dynamic fluid surfaces by global optimization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1269–1278 (2017)
Szabó, B.A., Düster, A., Rank, E.: The p-version of the finite element method. In: Stein E, de Borst R, Hughes TJR (eds) Encyclopedia of Computational Mechanics, chapter 5, vol. 1, pp. 119–139. Wiley (2004)
Wong, K.H., Chang, M.M.-Y.: 3D model reconstruction by constrained bundle adjustment. In: Proceedings of the 17th International Conference on Pattern Recognition, vol. 3, pp. 902–905. IEEE (2004)
Mulsow, C.: A flexible multi-media bundle approach. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 38, 472–477 (2010)
Belden, J.: Calibration of multi-camera systems with refractive interfaces. Exp. Fluids 54(2), 1463 (2013)
Pottmann, H., Leopoldseder, S.: A concept for parametric surface fitting which avoids the parametrization problem. Comput. Aided Geom. Des. 20(6), 343–362 (2003)
Sorger, C., Frischmann, F., Kollmannsberger, S., Rank, E.: Tum. geoframe: automated high-order hexahedral mesh generation for shell-like structures. Eng. Comput. 30(1), 41–56 (2014)
Hartley, R.I., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2004). ISBN: 0521540518
Triggs, B., McLauchlan, P.F., Hartley, R.I., Fitzgibbon, A.W.: Bundle adjustment—a modern synthesis. In: International workshop on vision algorithms, pp. 298–372. Springer (1999)
Glassner, A.S. (ed.): An Introduction to Ray Tracing. Academic Press Ltd., London (1989)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60(2), 91–110 (2004)
Moulon, P., Monasse, P., Marlet, R., et al.: Openmvg: an open multiple view geometry library. https://github.com/openMVG/openMVG
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24(6), 381–395 (1981)
Cazals, F., Pouget, M.: Estimating differential quantities using polynomial fitting of osculating jets. Comput. Aided Geom. Des. 22(2), 121–146 (2005)
Pottmann, H., Hofer, M.: Geometry of the squared distance function to curves and surfaces. In: Hege, H.-C., Polthier, K. (eds.) Visualization and Mathematics III, pp. 221–242. Springer, Berlin, Heidelberg (2003)
Bradski, G.: The OpenCV Library. Dr. Dobb’s Journal of Software Tools 2236121 (2000)
Yossef, O.E.: Experimental investigation of arteries’ mechanical properties: compressibility, passive and active responses. Master’s thesis, Department of Mechanical Engineering, Ben-Gurion University, Israel (2017)
Zhang, Z.: A flexible new technique for camera calibration. IEEE Trans. Pattern Anal. Mach. Intell. 22(11), 1330–1334 (2000)
Jiang, G., Tsui, H.-T., Quan, L., Zisserman, A.: Single axis geometry by fitting conics. In: European Conference on Computer Vision, pp. 537–550. Springer (2002)
Kumar, P., Miklavcic, S.J.: Integrated self-calibration of single axis motion for three-dimensional reconstruction of roots. IET Comput. Vis. 9(6), 850–856 (2015)
Ke, X., Sutton, M.A., Lessner, S.M., Yost, M.: Robust stereo vision and calibration methodology for accurate three-dimensional digital image correlation measurements on submerged objects. J. Strain Anal. Eng. Des. 43(8), 689–704 (2008)
Yamashita, A., Hayashimoto, E., Kaneko, T., Kawata, Y.: 3-D measurement of objects in a cylindrical glass water tank with a laser range finder. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, 2003. (IROS 2003). Proceedings. 2003, vol. 2, pp. 1578–1583. IEEE (2003)
Acknowledgements
The authors thank Mr. Avihai Uzan (Department of Mechanical Engineering, Ben Gurion University, Israel) for his assistance with the experiment in Sect. 3.3. The research was funded by the German-Israeli Foundation for Scientific Research and Development under Grant No. GIF-1189-89.2/2012. This support is gratefully acknowledged.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Kudela, L., Frischmann, F., Yossef, O.E. et al. Image-based mesh generation of tubular geometries under circular motion in refractive environments. Machine Vision and Applications 29, 719–733 (2018). https://doi.org/10.1007/s00138-018-0921-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00138-018-0921-3