skip to main content
research-article

Semantic shape editing using deformation handles

Published: 27 July 2015 Publication History

Abstract

We propose a shape editing method where the user creates geometric deformations using a set of semantic attributes, thus avoiding the need for detailed geometric manipulations. In contrast to prior work, we focus on continuous deformations instead of discrete part substitutions. Our method provides a platform for quick design explorations and allows non-experts to produce semantically guided shape variations that are otherwise difficult to attain. We crowdsource a large set of pairwise comparisons between the semantic attributes and geometry and use this data to learn a continuous mapping from the semantic attributes to geometry. The resulting map enables simple and intuitive shape manipulations based solely on the learned attributes. We demonstrate our method on large datasets using two different user interaction modes and evaluate its usability with a set of user studies.

Supplementary Material

ZIP File (a86-yumer.zip)
Supplemental files
MP4 File (a86.mp4)

References

[1]
Allen, B., Curless, B., and Popović, Z. 2003. The space of human body shapes: reconstruction and parameterization from range scans. In ACM Trans. Graph., vol. 22, 587--594.
[2]
Averkiou, M., Kim, V. G., Zheng, Y., and Mitra, N. J. 2014. Shapesynth: Parameterizing model collections for coupled shape exploration and synthesis. In CGF, vol. 33(2), 125--134.
[3]
Blanz, V., and Vetter, T. 1999. A morphable model for the synthesis of 3d faces. In ACM SIGGRAPH, 187--194.
[4]
Bokeloh, M., Wand, M., Koltun, V., and Seidel, H.-P. 2011. Pattern-aware shape deformation using sliding dockers. In ACM Trans. Graph., vol. 30, 123.
[5]
Botsch, M., and Kobbelt, L. 2004. An intuitive framework for realtime modeling. ACM Trans. Graph. 23, 3, 630--634.
[6]
Botsch, M., and Sorkine, O. 2008. On linear variational surface deformation methods. IEEE TVCG 14, 1, 213--230.
[7]
Chaudhuri, S., Kalogerakis, E., Giguere, S., and Funkhouser, T. 2013. AttribIt: Content creation with semantic attributes. In ACM UIST, 193--202.
[8]
Cortes, C., and Vapnik, V. 1995. Support-vector networks. Machine Learning 20, 3, 273--297.
[9]
Deng, Z., and Neumann, U. 2008. Data-Driven 3D Facial Animation. Springer.
[10]
Freund, Y., Iyer, R., Schapire, R. E., and Singer, Y. 2003. An efficient boosting algorithm for combining p. The Journal of Machine Learning Research 4, 933--969.
[11]
Gal, R., Sorkine, O., Mitra, N. J., and Cohen-Or, D. 2009. iWires: an analyze-and-edit approach to shape manipulation. In ACM Trans. Graph., vol. 28, 33.
[12]
Golovinskiy, A., and Funkhouser, T. 2009. Consistent segmentation of 3D models. Computers & Graphics 33, 3, 262--269.
[13]
Kalogerakis, E., Chaudhuri, S., Koller, D., and Koltun, V. 2012. A probabilistic model for component-based shape synthesis. ACM Trans. Graph. 31, 4, 55.
[14]
Kittur, A., Chi, E. H., and Suh, B. 2008. Crowdsourcing user studies with Mechanical Turk. In ACM SIGCHI, 453--456.
[15]
Kovashka, A., Parikh, D., and Grauman, K. 2012. Whittlesearch: Image search with relative attribute feedback. In IEEE CVPR, 2973--2980.
[16]
Kraevoy, V., Sheffer, A., Shamir, A., and Cohen-Or, D. 2008. Non-homogeneous resizing of complex models. In ACM Trans. Graph., vol. 27, 111.
[17]
Laffont, P.-Y., Ren, Z., Tao, X., Qian, C., and Hays, J. 2014. Transient attributes for high-level understanding and editing of outdoor scenes. ACM Trans. Graph. 33, 4, 149.
[18]
Lewis, J., Pighin, F., and Anjyo, K. 2010. Scattered data interpolation and approximation for computer graphics. In ACM SIGGRAPH ASIA Courses.
[19]
Marks, J., Andalman, B., et al. 1997. Design galleries: A general approach to setting parameters for computer graphics and animation. In ACM SIGGRAPH, 389--400.
[20]
Mitra, N. J., Wand, M., Zhang, H., Cohen-Or, D., and Bokeloh, M. 2013. Structure-aware shape processing. In Eurographics STARs, 175--197.
[21]
O'Donovan, P., Lībeks, J., Agarwala, A., and Hertzmann, A. 2014. Exploratory font selection using crowdsourced attributes. ACM Trans. Graph. 33, 4, 92.
[22]
Orsborn, S., Cagan, J., and Boatwright, P. 2009. Quantifying aesthetic form preference in a utility function. Journal of Mechanical Design 131, 6, 061001.
[23]
Ovsjanikov, M., Li, W., Guibas, L., and Mitra, N. J. 2011. Exploration of continuous variability in collections of 3D shapes. ACM Trans. Graph. 30, 4, 33.
[24]
Parikh, D., and Grauman, K. 2011. Relative attributes. In IEEE Conference on Computer Vision, 503--510.
[25]
Roweis, S. T., and Saul, L. K. 2000. Nonlinear dimensionality reduction by locally linear embedding. Science 290, 2323--2326.
[26]
Schelling, T. C. 1980. The strategy of conflict. Harvard University Press.
[27]
Shepard, D. 1968. A two-dimensional interpolation function for irregularly-spaced data. In ACM Nat. Conf., 517--524.
[28]
Sidi, O., van Kaick, O., Kleiman, Y., Zhang, H., and Cohen-Or, D. 2011. Unsupervised co-segmentation of a set of shapes via descriptor-space spectral clustering. ACM Trans. Graph. 30, 6, 126.
[29]
Steel, R. G., Torrie, J. H., et al. 1960. Principles and procedures of statistics. Principles and procedures of statistics.
[30]
Tao, L., Yuan, L., and Sun, J. 2009. Skyfinder: attribute-based sky image search. In ACM Trans. Graph., vol. 28, 68.
[31]
Thode, H. C. 2002. Testing for normality, vol. 164. CRC Press.
[32]
van Kaick, O., Xu, K., Zhang, H., Wang, Y., Sun, S., Shamir, A., and Cohen-Or, D. 2013. Co-hierarchical analysis of shape structures. ACM Trans. Graph. 32, 4, 69.
[33]
Xu, K., Zhang, H., Cohen-Or, D., and Chen, B. 2012. Fit and diverse: Set evolution for inspiring 3D shape galleries. ACM Trans. Graph. 31, 4, 57.
[34]
Yuksel, S. E., Wilson, J. N., and Gader, P. D. 2012. Twenty years of mixture of experts. NNLS 23, 1177--1193.
[35]
Yumer, M. E., and Kara, L. B. 2012. Co-abstraction of shape collections. ACM Trans. Graph. 31(6), 166:1--166:11.
[36]
Yumer, M. E., and Kara, L. B. 2014. Co-constrained handles for deformation in shape collections. ACM Trans. Graph. 33(6), 187:1--187:11.
[37]
Yumer, M. E., Chun, W., and Makadia, A. 2014. Co-segmentation of textured 3D shapes with sparse annotations. In IEEE CVPR, 240--247.
[38]
Zheng, Y., Fu, H., Cohen-Or, D., Au, O. K.-C., and Tai, C.-L. 2011. Component-wise controllers for structure-preserving shape manipulation. In CGF, vol. 30, 563--572.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics
ACM Transactions on Graphics  Volume 34, Issue 4
August 2015
1307 pages
ISSN:0730-0301
EISSN:1557-7368
DOI:10.1145/2809654
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 July 2015
Published in TOG Volume 34, Issue 4

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. crowdsourcing
  2. semantic deformation
  3. semantic editing
  4. shape deformation
  5. shape sets

Qualifiers

  • Research-article

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)109
  • Downloads (Last 6 weeks)11
Reflects downloads up to 13 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2025)HybriDeformer: A hybrid deformation method for arbitrary 3D avatar controllingDisplays10.1016/j.displa.2024.10293687(102936)Online publication date: Apr-2025
  • (2024)Enhancing the Aesthetics of 3D Shapes via Reference-based EditingACM Transactions on Graphics10.1145/368795443:6(1-15)Online publication date: 19-Dec-2024
  • (2024)ParSEL: Parameterized Shape Editing with LanguageACM Transactions on Graphics10.1145/368792243:6(1-14)Online publication date: 19-Dec-2024
  • (2024)Semantic Shape Editing with Parametric Implicit TemplatesACM SIGGRAPH 2024 Conference Papers10.1145/3641519.3657421(1-11)Online publication date: 13-Jul-2024
  • (2024)SynthScribe: Deep Multimodal Tools for Synthesizer Sound Retrieval and ExplorationProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645158(51-65)Online publication date: 18-Mar-2024
  • (2024)PromptCharm: Text-to-Image Generation through Multi-modal Prompting and RefinementProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642803(1-21)Online publication date: 11-May-2024
  • (2024)Crowd-sourced Evaluation of Combat Animations2024 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR)10.1109/AIxVR59861.2024.00015(60-65)Online publication date: 17-Jan-2024
  • (2024)FusionDeformer: text-guided mesh deformation using diffusion modelsThe Visual Computer: International Journal of Computer Graphics10.1007/s00371-024-03463-740:7(4701-4712)Online publication date: 1-Jul-2024
  • (2024)Semantic Properties of Word Prompts Shape Design Outcomes: Understanding the Influence of Semantic Richness and SimilarityDesign Computing and Cognition’2410.1007/978-3-031-71922-6_16(241-258)Online publication date: 28-Sep-2024
  • (2024)Reconstructing Soft Robotic Touch via In‐Finger VisionAdvanced Intelligent Systems10.1002/aisy.2024000226:10Online publication date: 17-Jul-2024
  • Show More Cited By

View Options

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media