Skip to main content
Springer Nature Link
Log in

Sketch-based design for green geometry and image deformation

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

    We’re sorry, something doesn't seem to be working properly.

    Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.

Abstract

User interfaces have traditionally followed the WIMP (window, icon, menu, pointer) paradigm. Though functional and powerful, they are usually cumbersome for a novice user to design a complex model, requiring considerable expertise and effort. This paper presents a system for designing geometric models and image deformation with sketching curves, with the use of Green coordinates. In 3D modeling, the user first creates a 3D model by using a sketching interface, where a given 2D curve is interpreted as the projection of the 3D curve. The user can add, remove, and deform these control curves easily, as if working with a 2D line drawing. For a given set of curves, the system automatically identifies the topology and face embedding by applying graph rotation system. Green coordinates are then used to deform the generated models with detail-preserving property. Also, we have developed a sketch-based image-editing interface to deform image regions using Green coordinates. Hardware-assisted schemes are provided for both control shape deformation and the subsequent surface optimization, the experimental results demonstrate that 3D/2D deformations can be achieved in realtime.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Andreou I, Sgouros N (2007) Utilizing shape retrieval in sketch synthesis. Multimed Tools Appl 32:275–291

    Article  Google Scholar 

  2. Arts E (2007) SPORE. http://www.spore.com

  3. Autodesk (2008) 3DS MAX. http://www.autodesk.com/

  4. Autodesk (2008) MAYA. http://www.autodesk.com/

  5. Beier T, Neely S (1992) Feature-based image metamorphosis. In: SIGGRAPH ’92: proceedings of the 19th annual conference on Computer graphics and interactive techniques. ACM, New York, NY, USA, pp 35–42

    Chapter  Google Scholar 

  6. Bookstein FL (1989) Principal warps: thin-plate splines and the decomposition of deformations. IEEE Trans Pattern Anal Mach Intell 11(6):567–585

    Article  MATH  Google Scholar 

  7. Botsch M, Kobbelt L (2005) Real-time shape editing using radial basis functions. In: Computer graphics forum, pp 611–621

  8. Derose T, Meyer M (2006) Harmonic coordinates. Tech. rep., Pixar Animation Studios

  9. Duchamp T, Certain A, Derose A, Stuetzle W (1997) Hierarchical computation of pl harmonic embeddings. Tech. rep.

  10. Floater MS (2003) Mean value coordinates. Comput Aided Geom Des 20(1):19–27

    Article  MathSciNet  MATH  Google Scholar 

  11. Floater MS, Kós G, Reimers M (2005) Mean value coordinates in 3D. Comput Aided Geom Des 22(7):623–631

    Article  MATH  Google Scholar 

  12. George PL, Borouchaki H (1998) Delaunay triangulation and meshing. Hermes, Paris, France

  13. Guskov I, Sweldens W, Schröder P (1999) Multiresolution signal processing for meshes. In: SIGGRAPH ’99: proceedings of the 26th annual conference on Computer graphics and interactive techniques. ACM, New York, NY, USA, pp 325–334

    Chapter  Google Scholar 

  14. Huang J, Shi X, Liu X, Zhou K, Wei LY, Teng SH, Bao H, Guo B, Shum HY (2006) Subspace gradient domain mesh deformation. ACM Trans Graph 25(3):1126–1134

    Article  Google Scholar 

  15. Igarashi T, Hughes J (2003) Smooth meshes for sketch-based freeform modeling. In: Proceedings of the 2003 symposium on interactive 3D graphics, pp 139–142

  16. Igarashi T, Matsuoka S, Tanaka H (1999) Teddy: a sketching interface for 3d freeform design. In: Proceedings of ACM SIGGRAPH 1999. ACM, ACM Press/ACM SIGGRAPH, pp 409–416

  17. Igarashi T, Moscovich T, Hughes JF (2005) As-rigid-as-possible shape manipulation. In: SIGGRAPH ’05: ACM SIGGRAPH 2005 papers. ACM, New York, NY, USA, pp 1134–1141

    Chapter  Google Scholar 

  18. Joshi P, Meyer M, DeRose T, Green B, Sanocki T (2007) Harmonic coordinates for character articulation. In: SIGGRAPH ’07: ACM SIGGRAPH 2007 papers. ACM, New York, NY, USA, p 71

  19. Ju T, Schaefer S, Warren J (2005) Mean value coordinates for closed triangular meshes. In: SIGGRAPH ’05: ACM SIGGRAPH 2005 papers. ACM, New York, NY, USA, pp 561–566

    Chapter  Google Scholar 

  20. Ju T, Schaefer S, Warren J (2005) Mean value coordinates for closed triangular meshes. ACM Trans Graph 24(3):561–566

    Article  Google Scholar 

  21. Karpenko OA, Hughes JF (2006) Smoothsketch: 3D free-form shapes from complex sketches. ACM Trans Graph 25(3):589–598

    Article  Google Scholar 

  22. Karpenko OA, Hughes JF, Raskar R (2002) Free-form sketching with variational implicit surfaces. Comput Graph Forum 21(3):585–594

    Article  Google Scholar 

  23. Kobbelt L, Campagna S, Vorsatz J, Seidel HP (1998) Interactive multi-resolution modeling on arbitrary meshes. In: SIGGRAPH ’98: proceedings of the 25th annual conference on Computer graphics and interactive techniques. ACM, New York, NY, USA, pp 105–114

    Chapter  Google Scholar 

  24. Lipman Y, Levin D, Cohen-Or D (2008) Green coordinates. In: SIGGRAPH ’08: ACM SIGGRAPH 2008 papers. ACM, New York, NY, USA, pp 1–10

    Chapter  Google Scholar 

  25. Lipman Y, Sorkine O, Cohen-Or D, Levin D, Rössl C, Seidel HP (2004) Differential coordinates for interactive mesh editing. In: Proceedings of shape modeling international. IEEE Computer Society Press, Los Alamitos, CA, pp 181–190

    Google Scholar 

  26. MacCracken R, Joy KI (1996) Free-form deformations with lattices of arbitrary topology. In: SIGGRAPH ’96: proceedings of the 23rd annual conference on computer graphics and interactive techniques. ACM, New York, NY, USA, pp 181–188

    Chapter  Google Scholar 

  27. Meng W, Sheng B, Wang S, Sun H, Wu E (2009) Interactive image deformation using cage coordinates on gpu. In: VRCAI, pp 119–126

  28. Nealen A, Igarashi T, Sorkine O, Alexa M (2007) FiberMesh: designing freeform surfaces with 3D curves. ACM SIGGRAPH

  29. Schaefer S, McPhail T, Warren J (2006) Image deformation using moving least squares. In: SIGGRAPH ’06: ACM SIGGRAPH 2006 papers. ACM, New York, NY, USA, pp 533–540

    Chapter  Google Scholar 

  30. Sheng B, Li P, Sun H (2009) Image-based material restyling with fast non-local means filtering. In: ICIG, pp 841–846

  31. Sheng B, Wu E, Sun H (2008) Sketching freeform meshes using graph rotation functions. Vis Comput 24(7–9):745–752

    Article  Google Scholar 

  32. Shewchuk JR (1996) Triangle: engineering a 2D quality mesh generator and delaunay triangulator. In: First workshop on applied computational geometry. ACM Press, pp 124–133

  33. Sumner RW, Schmid J, Pauly M (2007) Embedded deformation for shape manipulation. In: SIGGRAPH ’07: ACM SIGGRAPH 2007 papers. ACM, New York, NY, USA, p 80

    Chapter  Google Scholar 

  34. Wan X, Jin X (2011) Data-driven facial expression synthesis via laplacian deformation. Multimed Tools Appl 1–15. doi:10.1007/s11042-010-0688-7

  35. Weng Y, Shi X, Bao H, Zhang J (2008) Sketching MLS image deformations on the GPU. Comput Graph Forum 27(7):1789–1796

    Article  Google Scholar 

  36. Yu H, Qin S, Sun G, Wright D (2011) On generating realistic avatars: dress in your own style. Multimed Tools Appl 1–18. doi:10.1007/s11042-011-0781-6

  37. Yu Y, Zhou K, Xu D, Shi X, Bao H, Guo B, Shum HY (2004) Mesh editing with poisson-based gradient field manipulation. In: SIGGRAPH ’04: ACM SIGGRAPH 2004 papers. ACM, New York, NY, USA, pp 644–651

    Chapter  Google Scholar 

  38. Zeleznik RC, Herndon KP, Hughes JF (1996) Sketch: an interface for sketching 3D scenes. In: Proceedings of ACM SIGGRAPH 1996. ACM Press, pp 163–170

  39. Zhou K, Huang J, Snyder J, Liu X, Bao H, Guo B, Shum HY (2005) Large mesh deformation using the volumetric graph laplacian. In: SIGGRAPH ’05: ACM SIGGRAPH 2005 papers. ACM, New York, NY, USA, pp 496–503

    Chapter  Google Scholar 

Download references

Acknowledgements

The authors would like to thank all reviewers for their helpful suggestions and constructive comments, which have significantly improved our paper. Many thanks to Shunbing Chen for implementing and testing many parts of our system, to Dr. Jin Huang (Zhejiang University) for useful discussions. The work is supported by National Basic Research Program of China (973 Program) No. 2009CB320802, 2011CB302200, National Natural Science Foundation of China No. 60833007,60873136, Beijing Natural Science Foundation (Content-Aware Image Synthesis and Its Applications, No. 4112061), French System@tic Paris-Region(CSDLProject) and ANR-NSFC No.60911130368, Hong Kong Research Grants Council grants 416007 and 415806.

Author information

Authors and Affiliations

  1. Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, China

    Bin Sheng

  2. Department of Computer Science and Engineering, The Chinese University of Hong Kong, Shatin, Hong Kong, China

    Bin Sheng

  3. Institute of Software, Chinese Academy of Sciences, LIAMA-NLPR, CAS Institute of Automation, Beijing, China

    Weiliang Meng

  4. The Chinese University of Hong Kong, Shatin, Hong Kong, China

    Hanqiu Sun

  5. Institute of Software, Chinese Academy of Sciences, Beijing, China

    Enhua Wu

  6. University of Macau, Macau, China

    Enhua Wu

Authors
  1. Bin Sheng
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Weiliang Meng
    View author publications

    You can also search for this author inPubMed Google Scholar

  3. Hanqiu Sun
    View author publications

    You can also search for this author inPubMed Google Scholar

  4. Enhua Wu
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Bin Sheng.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sheng, B., Meng, W., Sun, H. et al. Sketch-based design for green geometry and image deformation. Multimed Tools Appl 62, 581–599 (2013). https://doi.org/10.1007/s11042-011-0860-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-011-0860-8

Keywords