Skip to main content
SpringerLink
Log in

Image-based non-photorealistic rendering for realtime virtual sculpting

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

This paper discusses a real-time virtual sculpting system in a non-photorealistic manner. Up till now, a majority of researchers pursuing virtual sculpting have highlighted the physical fidelity of simulation, with approaches for realizing photorealism being principal specialized contributions. We aim at capitalizing on the strengths of non-photorealistic rendering with respect to aesthetics, expression and computing expense. By means of touch-enabled manipulation, the haptic interaction is conducted to form the deformable surfaces, and the edge extraction is employed to stress boundaries. Afterwards, we utilize anisotropic diffusion to lessen unimportant details as well as a fresh inverse Gaussian bilateral filter for spot removal. Processed in a spatiotemporal style, the non-photorealistic rendering works to maintain coherence in time. Moreover, the parallel realization of the system put forward on graphics hardware (GPU) guarantees real-time behavior.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Agusanto K, Li L, Chuangui Z, Sing N (2003) Photorealistic rendering for augmented reality using environment illumination. In: Proceedings of the 2nd IEEE/ACM international symposium on mixed and augmented reality, pp 208–216. IEEE Computer Society

  2. Brown M, Semelka R, Nishino T (2004) MRI: basic principles and applications. Med Phys 31:170

    Article  Google Scholar 

  3. Chen H, Sun H (2002) Real-time haptic sculpting in virtual volume space. In: Proceedings of the ACM symposium on virtual reality software and technology, pp 81–88. ACM, New York

    Book  Google Scholar 

  4. Chen J, Paris S, Durand F (2007) Real-time edge-aware image processing with the bilateral grid. ACM Trans Graph (TOG) 26 (3):103

    Article  Google Scholar 

  5. Collomosse J, Rowntree D, Hall P (2005) Stroke surfaces: temporally coherent artistic animations from video. IEEE Trans Vis Comput Graph 11 (5):540–549

    Article  Google Scholar 

  6. Dachille F (1999) Haptic sculpting of dynamic surfaces. In: Symposium on interactive 3 D graphics: proceedings of the 1999 symposium on interactive 3 D graphics. Association for Computing Machinery, Inc, One Astor Plaza, 1515 Broadway, New York

  7. Dachille Ix F, Qin H, Kaufman A (2001) A novel haptics-based interface and sculpting system for physics-based geometric design. Comput Aided Des 33 (5):403–420

    Article  Google Scholar 

  8. DeCarlo D, Santella A (2002) Stylization and abstraction of photographs. In: Proceedings of the 29th annual conference on computer graphics and interactive techniques, pp 769–776. ACM , New York

    Book  Google Scholar 

  9. Edwards J, Luecke G (1996) Physically based models for use in a force feedback virtual environment. In: Japan/USA symposium on flexible automation, pp 221–228

  10. Fischer J, Bartz D, Strasser W (2005) Reality tooning: fast non-photorealism for augmented video streams. In: Proceedings of the Fourth IEEE and ACM international symposium on mixed and augmented reality, 2005, pp 186–187

  11. Fischer J, Bartz D, Straßer W (2005) Stylized augmented reality for improved immersion. In: Proceedings of IEEE virtual reality (VR 2005), pp 195–202

  12. Fischler M, Firschein O (1987) Intelligence: the eye, the brain, and the computer. Addison-Wesley Pub. Co., Reading

  13. Gooch B, Reinhard E, Gooch A (2004) Human facial illustrations: creation and psychophysical evaluation. ACM Trans Graph (TOG) 23 (1):27–44

    Article  Google Scholar 

  14. Haeberli P (1990) Paint by numbers: abstract image representations. In: Proceedings of the 17th annual conference on computer graphics and interactive techniques, pp 207–214. ACM , New York

    Google Scholar 

  15. Haller M, Landerl F, Billinghurst M (2005) More sketchy, more ar, more fun! In: ACM SIGGRAPH 2005 Posters. ACM, p 34

  16. Higashi M, Aoki N, Kaneko T (2002) Application of haptic navigation to modify free-form surfaces through specified points and curves. J Comput Inf Sci Eng 2:265

    Article  Google Scholar 

  17. James D, Pai D (1999) ArtDefo: accurate real time deformable objects. In: Proceedings of the 26th annual conference on computer graphics and interactive techniques, pp 65–72. ACM Press/Addison-Wesley Publishing Co., New York

    Google Scholar 

  18. Kang H, Lee S, Chui CK (2009) Flow-based image abstraction. IEEE Trans Vis Comput Graph 15 (1):62–76

    Article  Google Scholar 

  19. Kozamernik F, Steinmann V, Sunna P, Wyckens E (2005) SAMVIQ: a new EBU methodology for video quality evaluations in multimedia. SMPTE Motion Imaging J 114 (4):152– 160

    Article  Google Scholar 

  20. Mark W, Randolph S, Finch M, Van Verth J (1996) Adding force feedback to graphics systems: issues and solutions. In: Proceedings of the 23rd annual conference on computer graphics and interactive techniques, pp 447–452. ACM, New York

    Google Scholar 

  21. McDonnell K, Qin H, Wlodarczyk R (2001) Virtual clay: a real-time sculpting system with haptic toolkits. In: Proceedings of the 2001 symposium on interactive 3D graphics, pp 179–190. ACM, New York

    Google Scholar 

  22. McMenemy K, Ferguson S (2007) A Hitchhikers guide to virtual reality. AK Peters, Ltd

  23. Meier B (1996) Painterly rendering for animation. In: Proceedings of the 23rd annual conference on computer graphics and interactive techniques, pp 477–484. ACM, New York

    Book  Google Scholar 

  24. Orzan A, Bousseau A, Barla P, Thollot J (2007) Structure-preserving manipulation of photographs. In: NPAR, pp 103–110

  25. Pham TQ, van Vliet LJ (2005) Separable bilateral filtering for fast video preprocessing

  26. Ruspini D, Kolarov K, Khatib O (1997) The haptic display of complex graphical environments. In: Proceedings of the 24th annual conference on computer graphics and interactive techniques, pp 345–352. ACM Press/Addison-Wesley Publishing Co., New York

    Book  Google Scholar 

  27. Strothotte T, Schlechtweg S (2002) Non-photorealistic computer graphics: modeling, rendering, and animation. Morgan Kaufmann

  28. Tomasi C, Manduchi R (1998) Bilateral filtering for gray and color images. In: Proceedings of the ICCV, pp 839–846

  29. Verlet L (1968) Computer experiments on classical fluids. ii. equilibrium correlation functions. Phys Rev 165 (1):201–14

    Article  Google Scholar 

  30. Wang J, Xu Y, Shum H, Cohen M (2004) Video tooning. In: International conference on computer graphics and interactive techniques, pp 574–583. ACM, New York

    Book  Google Scholar 

  31. Winnemöller H, Olsen S, Gooch B (2006) Real-time video abstraction. ACM Trans Graph (TOG) 25 (3):1221–1226

    Article  Google Scholar 

  32. Zhao H, Jin X, Shen J, Mao X, Feng J (2008) Real-time feature-aware video abstraction. Vis Comput 24 (7):727–734

    Article  Google Scholar 

  33. Zilles C, Salisbury J (1995) A constraint-based god-object method for haptic display. In: Proceedings of the international conference on intelligent robots and systems, pp 146–151

Download references

Acknowledgments

Thanks to our colleagues for participating program testing and helpful discussion. The authors would like to thank all reviewers for their helpful suggestions and constructive comments. The work is supported by the National Natural Science Foundation of China (No. 61202154,61133009), and the National Basic Research Project of China (No. 2011CB302203), in part by Shanghai Pujiang Program under Grant 13PJ1404500, in part by the Open Project Program of the National Laboratory of Pattern Recognition (Chinese Academy of Sciences), and in part by the Open Project Program of the State Key Laboratory of CAD&CG, Zhejiang University, under Grant A1401.

Author information

Authors and Affiliations

  1. The School of Information Science and Engineering, Southeast University, Nanjing, China

    Ping Lu

  2. ZTE Corporation, Shenzhen, China

    Ping Lu, Shengmei Luo & Xia Jia

  3. Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai, China

    Bin Sheng

  4. State Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, Beijing, China

    Bin Sheng

  5. Department of Computer and Information Science, Faculty of Science and Technology, University of Macau, Macau, China

    Wen Wu

Authors
  1. Ping Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Bin Sheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shengmei Luo
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xia Jia
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Wen Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Bin Sheng.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lu, P., Sheng, B., Luo, S. et al. Image-based non-photorealistic rendering for realtime virtual sculpting. Multimed Tools Appl 74, 9697–9714 (2015). https://doi.org/10.1007/s11042-014-2146-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-014-2146-4

Keywords

Search

Navigation