Abstract
High-level geometry processing has been a hot topic in graphics community. The functionality analysis of 3D models is an essential issue in this area. Existing 3D models often exhibit both large intra-class and inter-class variations in shape geometry and topology, making the consistent analysis of functionality challenging. Traditional 3D shape analysis methods which rely on geometric shape descriptors can not obtain satisfying results on these 3D models. We develop a new 3D shape descriptor based on the interactions between 3D models and virtual human actions, which is called Action-Based 3D Descriptor (AB3D). Due to the implied semantic meanings of virtual human actions, we obtain encouraging results on consistent segmentation based on AB3D. Finally, we present a method for recognition and reconstruction of scanned 3D indoor scenes using our AB3D. Experiments show that AB3D is a promising shape descriptor toward functionality analysis of 3D shapes.







Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Mitra, N.J., Wand, M., Zhang, H., Cohen-Or, D., Bokeloh, M.: Structure-aware shape processing, In EUROGRAPHICS State-of-the-art Report (2013)
Chen, X., Golovinskiy, A., Funkhouser, T.: A benchmark for 3D mesh segmentation. ACM Trans. Graph. 28(3), 73 (2009)
Golovinskiy, A., Funkhouser, T.: Consistent segmentation of 3D models. Comput. Graph. 33(3), 262–269 (2009)
Xu, K., Zhang, H., Tagliasacchi, A., Liu, L., Li, G., Meng, M., Xiong, Y.: Partial intrinsic reflectional symmetry of 3D shapes. In: ACM Transactions on Graphics (TOG), vol. 28, p. 138. ACM (2009)
Attene, M., Robbiano, F., Spagnuolo, M., Falcidieno, B.: Characterization of 3D shape parts for semantic annotation. Comput. Aided Des. 41(10), 756–763 (2009)
Abacı, T., Vexo, F.: Bridging geometry and semantics for object manipulation and grasping. In: Proceedings of the 1st workshop towards Semantic Virtual Environments SVE05, pp. 110–119. ACM press (2005)
Bar-Aviv, E., Rivlin, E.: Functional 3D object classification using simulation of embodied agent. In: BMVC, pp. 307–316 (2006)
Grabner, H., Gall, J., Van Gool, L.: What makes a chair a chair? In: Computer Vision and Pattern Recognition (CVPR), 2011 IEEE Conference on, pp. 1529–1536 (2011)
Attene, M., Biasotti, S., Mortara, M., Patanè, G., Spagnuolo, M., Falcidieno, B.: Computational methods for understanding 3D shapes. Comput. Graph. 30(3), 323–333 (2006)
Biasotti, S., Falcidieno, B., Spagnuolo, M.: Extended reeb graphs for surface understanding and description. In: Borgefors, G., Nyström, I., Baja, G.S. (eds.) Discrete geometry for computer imagery. Lecture Notes in Computer Science, vol. 1953, pp. 185–197. Springer, Berlin (2000)
Mitra, N., Wand, M., Richard Zhang, H., Cohen-Or, D., Kim, V., Huang, Q.-X.: Structure-aware shape processing. In: SIGGRAPH Asia 2013 Courses, p. 1. ACM (2013)
Kim, V.G., Li, W., Mitra, N.J., Chaudhuri, S., DiVerdi, S., Funkhouser, T.: Learning part-based templates from large collections of 3D shapes. ACM Trans. Graph. 32(4), 70 (2013)
Kalogerakis, E., Hertzmann, A., Singh, K.: Learning 3D mesh segmentation and labeling. ACM Trans. Graph. 29(4), 102 (2010)
Wang, Y. Xu, K., Li, J., Zhang, H., Shamir, A., Liu, L., Cheng, Z., Xiong, Y.: Symmetry hierarchy of man-made objects. In: Computer Graphics Forum, vol. 30, pp. 287–296. Wiley Online, Library (2011)
Kai, X., Zhang, H., Cohen-Or, D., Chen, B.: Fit and diverse: set evolution for inspiring 3D shape galleries. ACM Trans. Graph. 31(4), 57 (2012)
Jiang, Y., Koppula, H., Saxena, A.: Hallucinated humans as the hidden context for labeling 3D scenes. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2993–3000 (2013)
Gupta, A., Davis, L.S.: Objects in action: an approach for combining action understanding and object perception. In: IEEE Conference on Computer Vision and Pattern Recognition, 2007 (CVPR’07), pp. 1–8 (2007)
Kai, X., Li, H., Zhang, H., Cohen-Or, D., Xiong, Y., Cheng, Z.-Q.: Style-content separation by anisotropic part scales. ACM Trans. Graph. 29(6), 184 (2010)
Hu, R., Fan, L., Liu, L.: Co-segmentation of 3D shapes via subspace clustering. In: Computer Graphics Forum, vol. 31, pp. 1703–1713. Wiley, New York (2012)
Sidi, O., van Kaick, O., Kleiman, Y., Zhang, H., Cohen-Or, D.: Unsupervised co-segmentation of a set of shapes via descriptor-space spectral clustering. In: ACM Transactions on Graphics (TOG). ACM, vol. 30, p. 126 (2011)
Reuter, M.: Hierarchical shape segmentation and registration via topological features of Laplace–Beltrami eigenfunctions. Int. J. Comput. Vis. 89(2–3), 287–308 (2010)
Silberman, N., Fergus, R.: Indoor scene segmentation using a structured light sensor. In: 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops), pp. 601–608 (2011)
Koppula, H.S., Anand, A., Joachims, T., Saxena, A.: Semantic labeling of 3D point clouds for indoor scenes. In: Advances in Neural Information Processing Systems, pp. 244–252 (2011)
Nan, L., Xie, K., Sharf, A.: A search-classify approach for cluttered indoor scene understanding. ACM Trans. Graph. 31(6), 137 (2012)
Poser pro 2010. http://poser.smithmicro.com/poserpro.html (2010)
Google 3D Warehouse. http://www.sketchup.google.com/3dwarehouse/ (2013)
Jones, M.W., Baerentzen, J.A., Sramek, M.: 3D distance fields: a survey of techniques and applications. IEEE Trans. Vis. Comput. Graph. 12(4), 581–599 (2006)
Gottschalk, S., Lin, M.C., Manocha, D.: Obbtree: a hierarchical structure for rapid interference detection. In: Proceedings of the 23rd annual conference on Computer graphics and interactive techniques. ACM, pp. 171–180 (1996)
Fu, H., Cohen-Or, D., Dror, G., Sheffer, A.: Upright orientation of man-made objects. ACM Trans. Graph. 27, 42 (2008)
Vladimir, V.: The nature of statistical learning theory. Springer, New York (2000)
Rifkin, R., Klautau, A.: In defense of one-vs-all classification. J. Mach. Learn. Res. 5, 101–141 (2004)
Cignoni, P., Corsini, M., Ranzuglia, G.: Meshlab: an open-source 3D mesh processing system. Ercim News 73, 45–46 (2008)
Shilane, P., Min, P., Kazhdan, M., Funkhouser, T.: The Princeton shape benchmark. In: Proceedings of Shape Modeling Applications, 2004, pp. 167–178 (2004)
Kazhdan, M., Funkhouser, T., Rusinkiewicz, S.: Rotation invariant spherical harmonic representation of 3D shape descriptors. In: Proceedings of the 2003 Eurographics/ACM SIGGRAPH symposium on Geometry processing. Eurographics Association, pp. 156–164 (2003)
Chen, D.Y., Tian, X.P., Shen, Y.T., Ouhyoung, M.: On visual similarity based 3D model retrieval. In: Computer graphics forum, vol. 22, pp. 223–232. Wiley, New York (2003)
Veltkamp, R.C., Giezeman, G.J.: Shrec10 track: large scale retrieval. In: 3DOR, pp. 63–69. Wiley, New York (2010)
Godil, A, Sun, X., Lian Z.: Visual similarity based 3D shape retrieval using bag-of-features. In: Shape Modeling International Conference (SMI), pp. 63–69 (2010)
Fukunaga, K., Narendra, P.M.: A branch and bound algorithm for computing k-nearest neighbors. IEEE Trans. Comput. 100(7), 750–753 (1975)
Chang, C.C., Lin, C.J.: Libsvm: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2(3), 27 (2011)
Zelnik-Manor, L., Perona, P.: Self-tuning spectral clustering. In: Advances in neural information processing systems, pp. 1601–1608 (2004)
Acknowledgments
The authors would like to thank the anonymous reviewers for their helpful comments. We also thank Yanzhen Wang for his comments for this work in the early stage, and Liangliang Nan for his source code of point cloud reconstruction.
Author information
Authors and Affiliations
Corresponding authors
Additional information
This work was partially supported by the Research Fund for the Doctoral Program of Higher Education of China (No. 20104307110003), The National Natural Science Foundation of China (No. 61379103, 61202333, 61303185) and China Postdoctoral Science Foundation (No. 2012M520392).
Rights and permissions
About this article
Cite this article
Xie, Z., Xiong, Y. & Xu, K. AB3D: action-based 3D descriptor for shape analysis. Vis Comput 30, 591–601 (2014). https://doi.org/10.1007/s00371-014-0980-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-014-0980-z