Abstract
Vehicle is one of the important subjects studied in the domain of computer vision, autonomous driving and intelligent transportation system. 3D models of vehicles are used widely in the literature of vehicle categorization, pose estimation, detection, and tracking. However, previous work uses only a small set of 3D vehicle models either from CAD design or multi-view reconstruction, limiting their representation ability and performance. A feasible approach to acquire extensive 3D vehicle models is desired. In this paper, we are interested in 3D surface reconstruction of on-road vehicles from sparse point cloud captured by laser scanners equipped ubiquitously on autonomous driving platforms. We propose an innovative reconstruction pipeline and method, called TriSpaSurf, which could reconstruct unbroken and smooth surface robustly from just a single frame of noisy sparse point cloud. In the TriSpaSurf, triple-view 2D outlines are first fitted on the 2D points from the projection of 3D point cloud under each view, and then 2.5D surface reconstruction is carried out under the guidance from triple-view outlines. By projecting 3D point cloud onto 2D views, 2D outlines could be estimated robustly due to the reduced complexity and higher signal-to-noise ratio in 2D views, and could provide fairly stable and tight multi-view constraints for 3D surface reconstruction. The effectiveness of our method is verified on the KITTI and Sydney dataset.
H. Zheng–This is a student paper.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Krause, J., Stark, M., Deng, J., Fei-Fei, L.: 3D object representations for fine-grained categorization. In: Proceedings of the IEEE International Conference on Computer Vision Workshops, pp. 554–561 (2013)
Yang, L., Luo, P., Change Loy, C., Tang, X.: A large-scale car dataset for fine-grained categorization and verification. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3973–3981 (2015)
Stark, M., et al.: Fine-grained categorization for 3D scene understanding. Int. J. Robot. Res. 30(13), 1543–1552 (2011)
Lin, Y.-L., Morariu, V.I., Hsu, W., Davis, L.S.: Jointly optimizing 3D model fitting and fine-grained classification. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8692, pp. 466–480. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10593-2_31
Valev, K., Schumann, A., Sommer, L., Beyerer, J.: A systematic evaluation of recent deep learning architectures for fine-grained vehicle classification. arXiv preprint arXiv:1806.02987 (2018)
Hu, Q., Wang, H., Li, T., Shen, C.: Deep CNNs with spatially weighted pooling for fine-grained car recognition. IEEE Trans. Intell. Transp. Syst. 18(11), 3147–3156 (2017)
Ramnath, K., Sinha, S.N., Szeliski, R., Hsiao, E.: Car make and model recognition using 3D curve alignment. In: IEEE Winter Conference on Applications of Computer Vision, pp. 285–292 (2014)
Zia, M.Z., Stark, M., Schiele, B., Schindler, K.: Detailed 3D representations for object recognition and modeling. IEEE Trans. Pattern Anal. Mach. Intell. 35(11), 2608–2623 (2013)
Zeeshan Zia, M., Stark, M., Schindler, K.: Are cars just 3D boxes?–jointly estimating the 3D shape of multiple objects. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3678–3685 (2014)
Leotta, M.J., Mundy, J.L.: Vehicle surveillance with a generic, adaptive, 3D vehicle model. IEEE Trans. Pattern Anal. Mach. Intell. 33(7), 1457–1469 (2010)
Liebelt, J., Schmid, C.: Multi-view object class detection with a 3D geometric model. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1688–1695 (2010)
Zhang, Z., Tan, T., Huang, K., Wang, Y.: Three-dimensional deformable-model-based localization and recognition of road vehicles. IEEE Trans. Image Process. 21(1), 1–13 (2011)
Glasner, D., Galun, M., Alpert, S., Basri, R., Shakhnarovich, G.: Viewpoint-aware object detection and pose estimation. In: Proceedings of the IEEE Conference on Computer Vision, pp. 1275–1282 (2011)
Geiger, A., Lenz, P., Urtasun, R.: Are we ready for autonomous driving. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3354–3361 (2012)
Ozuysal, M., Lepetit, V., Fua, P.: Pose estimation for category specific multi-view object localization. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 778–785 (2009)
Li, Y., Gu, L., Kanade, T.: Robustly aligning a shape model and its application to car alignment of unknown pose. IEEE Trans. Pattern Anal. Mach. Intell. 33(9), 1860–1876 (2011)
Sun, Z., Bebis, G., Miller, R.: On-road vehicle detection: a review. IEEE Trans. Pattern Anal. Mach. Intell. 28(5), 694–711 (2006)
Sivaraman, S., Trivedi, M.M.: Looking at vehicles on the road: a survey of vision-based vehicle detection, tracking, and behavior analysis. IEEE Trans. Intell. Transp. Syst. 14(4), 1773–1795 (2013)
Newcombe, R.A., et al.: KinectFusion: real-time dense surface mapping and tracking. In: Proceedings of IEEE International Symposium on Mixed and Augmented Reality, pp. 127–136 (2011)
Kazhdan, M., Bolitho, M., Hoppe, H.: Poisson surface reconstruction. In: Proceedings of the Fourth Eurographics Symposium on Geometry Processing, pp. 61–71 (2006)
Kazhdan, M., Hoppe, H.: Screened poisson surface reconstruction. ACM Trans. Graph. (ToG) 32(3), 1–13 (2013)
Du, D.Z., Hwang, F.: Computing in Euclidean Geometry, pp. 193–233. World Scientific Publishing, Singapore (1995)
Amenta, N., Bern, M., Kamvysselis, M.: A new Voronoi-based surface reconstruction algorithm. In: Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, pp. 415–421 (1998)
Bernardini, F., Mittleman, J., Rushmeier, H., Silva, C., Taubin, G.: The ball-pivoting algorithm for surface reconstruction. IEEE Trans. Visual Comput. Graphics 5(4), 349–359 (1999)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Zheng, H., Di, H., Han, Y., Gong, J. (2020). TriSpaSurf: A Triple-View Outline Guided 3D Surface Reconstruction of Vehicles from Sparse Point Cloud. In: Peng, Y., et al. Pattern Recognition and Computer Vision. PRCV 2020. Lecture Notes in Computer Science(), vol 12305. Springer, Cham. https://doi.org/10.1007/978-3-030-60633-6_33
Download citation
DOI: https://doi.org/10.1007/978-3-030-60633-6_33
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-60632-9
Online ISBN: 978-3-030-60633-6
eBook Packages: Computer ScienceComputer Science (R0)