Abstract
This paper presents a novel way of shape structure analysis namely part detection, which provides the positions and categories of all potential parts for any input shape. Different from segmentation, part detection does not provide precise shape part boundaries, but rather gives the bounding boxes and semantic labels of shape parts. This is useful for applications like style discovery, retrieval, visualization, etc. Part detection is achieved by multi-view rendering in this paper. Firstly, our method renders 3D shape into images under different perspectives, and detects the potential parts (as boxes) in the images using Faster R-CNN. Then, each detection result votes for the visible vertices in its own box under the corresponding perspective. Finally, we select the vertices for each part category according to the voting result, and generate the bounding boxes. The performance of this approach on a database of 16 shape categories is demonstrated in the end of paper.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Attene, M., Biasotti, S., Mortara, M., Patanè, G., Spagnuolo, M., Falcidieno, B.: Computational methods for understanding 3D shapes. Comput. Graph. 30(3), 323–333 (2006)
Chang, A.X., Funkhouser, T., Guibas, L., Hanrahan, P., Huang, Q., Li, Z., Savarese, S., Savva, M., Song, S., Su, H., et al.: Shapenet: an information-rich 3D model repository. arXiv preprint arXiv:1512.03012 (2015)
Fish, N., Averkiou, M., van Kaick, O., Sorkine-Hornung, O., Cohen-Or, D., Mitra, N.J.: Meta-representation of shape families. ACM Trans. Graph. 33(4), 1–11 (2014)
Fu, H., Cohen-Or, D., Dror, G., Sheffer, A.: Upright orientation of man-made objects. ACM Trans. Graph. 27(3), 1 (2008)
Han, Z., Liu, Z., Han, J., Bu, S.: 3D shape creation by style transfer. Vis. Comput. 31, 1147–1161 (2014)
Makadia, A., Yumer, M.E.: Learning 3D part detection from sparsely labeled data. In: 2014 2nd International Conference on 3D Vision, pp. 311–318. IEEE, December 2014
Mitra, N., Wand, M., Zhang, H.R., Cohen-Or, D., Kim, V., Huang, Q.X.: Structure-aware shape processing. In: SIGGRAPH Asia 2013 Courses on - SA 2013, pp. 1–20. ACM Press, New York (2013)
Phong, B.T.: Illumination for computer generated pictures. Commun. ACM 18(6), 311–317 (1975)
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Cortes, C., Lawrence, N.D., Lee, D.D., Sugiyama, M., Garnett, R. (eds.) Advances in Neural Information Processing Systems 28, pp. 91–99. Curran Associates, Inc. (2015)
Su, H., Maji, S., Kalogerakis, E., Learned-Miller, E.: Multi-view convolutional neural networks for 3D shape recognition. In: 2015 IEEE International Conference on Computer Vision (ICCV), pp. 945–953. IEEE, December 2015
Yi, L., Kim, V.G., Ceylan, D., Shen, I.C., Yan, M., Su, H., Lu, C., Huang, Q., Sheffer, A., Guibas, L.: A scalable active framework for region annotation in 3D shape collections. In: SIGGRAPH Asia (2016)
Zheng, Y., Cohen-Or, D., Mitra, N.J.: Smart variations: functional substructures for part compatibility. Comput. Graph. Forum 32(2pt2), 195–204 (2013)
Acknowledgements
This work was supported by National High Technology Research and Development Program of China (No. 2007AA01Z334), National Natural Science Foundation of China (Nos. 61321491 and 61272219), Innovation Fund of State Key Laboratory for Novel Software Technology (Nos. ZZKT2013A12 and ZZKT2016A11), and Program for New Century Excellent Talents in University of China (NCET-04-04605).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Song, Y., Sun, Z., Song, M., Wu, Y. (2018). Part Detection for 3D Shapes via Multi-view Rendering. In: Zeng, B., Huang, Q., El Saddik, A., Li, H., Jiang, S., Fan, X. (eds) Advances in Multimedia Information Processing – PCM 2017. PCM 2017. Lecture Notes in Computer Science(), vol 10735. Springer, Cham. https://doi.org/10.1007/978-3-319-77380-3_59
Download citation
DOI: https://doi.org/10.1007/978-3-319-77380-3_59
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-77379-7
Online ISBN: 978-3-319-77380-3
eBook Packages: Computer ScienceComputer Science (R0)