Skip to main content
Log in

Endpoint fusing method of online freehand-sketched polyhedrons

  • Original Article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

Endpoint fusing plays a crucial role in the process of sketch regularization and corrects the gestures from freehand-sketched strokes, which have the imprecise connections at the endpoints and inflection point of into some closed loops. This paper proposes a novel endpoint fusing method, based on a feature descriptor called angle distribution histogram, is specialized for online freehand-sketched polyhedrons. The method comprises four main phases. Firstly, parallelism correction is used to revise and recognize user’s inputting strokes according to the linearity distribution of gestures in the angle histogram. Then, the adaptive tolerance circles with variable coefficients are applied to determine which the endpoints should be joined together. Nextly settles the order of connecting endpoints in accordance with the coordinate system weight criteria. Finally, the session of endpoints connection is carried out and ends with a clean, crisp line drawing possessing perfect connections. This approach has been tested with various examples and compared with the other existing methods in an interactive prototype system of freehand sketching recognition-endpoint fusion to evaluate the regularization quality. The experimental results show that the proposed approach overcomes these limitations embedded within the existing sketching systems, in which only simply connect the endpoints without considering the contextual constraints in the sketch. The method can perfectly support the conceptual design based on online freehand-sketched polyhedrons and provide a foundation for the further 3D reconstruction of freehand-sketched polyhedrons.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Shouqian, S., Enwei, B., Heng, C., et al.: State of the art of research on computer aided conceptual design. China Mech. Eng. 10(6), 697–700 (1999)

    Google Scholar 

  2. Song, B.: Research on Computer Supported Intelligent Sketching Technology for Product Conceptual Design. Northwestern Polytechnical University, Xi’an (2003)

    Google Scholar 

  3. Hsu, W., Woon, I.M.Y.: Current research in the conceptual design of mechanical products. Comput. Aided Des. 30(5), 377–389 (1998)

    Article  Google Scholar 

  4. Ullman, D.G., Wood, S., Craig, D.: The importance of drawing in the mechanical design process. Comput. Graph. 14(2), 263–274 (1990)

    Article  Google Scholar 

  5. Li, B., Lu, Y., Godil, A., et al.: A comparison of methods for sketch-based 3D shape retrieval. Comput. Vis. Image Underst. 119(2), 57–80 (2014)

    Article  Google Scholar 

  6. Lladós, J., Kwon, Y.: Graphics Recognition, Recent Advances and Perspectives. GREC, Barcelona (2003)

    Google Scholar 

  7. Zeleznik, R.C., Herndon, K.P., Hughes, J.F.: SKETCH: an interface for sketching 3D scenes. In: ACM SIGGRAPH 2007 courses, p. 19. ACM (2007)

  8. Sutherland, I.E.:Sketch pad: a man-machine graphical communication system. In: Proceedings of the SHARE Design Automation Workshop, DAC 1964, pp. 6.329–6.346. ACM New York, NY, USA (1964)

  9. Kato, O., Iwase, H., Yoshida, M., et al.: Interactive hand-drawn diagram input system. In: Proceedings of IEEE Conference on Pattern Recognition and Image Processing (PRIP 82), pp. 544–549 (1982)

  10. Pavlidis, T., Van Wyk, C.J.: An automatic beautifier for drawings and illustrations. In: ACM SIGGRAPH Computer Graphics, vol. 19, pp. 225–234. ACM (1985)

  11. Igarashi, T., Matsuoka, S., Kawachiya, S., et al.: Interactive Beautification: A Technique for Rapid Geometric Design, vol. 263525, pp. 105–114. ACM, Banff (1997)

    Google Scholar 

  12. Igarashi, T., Kawachiya, S., Tanaka, H., et al.: Pegasus: A Drawing System for Rapid Geometric Design, vol. 286511, pp. 24–25. ACM, Los Angeles (1998)

    Google Scholar 

  13. Forsberg, A.S., Laviola, J.J., Zeleznik, R.C.: ErgoDesk: a framework for two- and three-dimensional interaction at the ActiveDesk. In: Proceedings of the Second International Immersive Projection Technology Workshop, pp. 11–12 (1998)

  14. Meyer, J.: EtchaPad—disposable sketch based interfaces. In: Conference Companion on Human Factors in Computing Systems, pp. 195–196. ACM (1996)

  15. Wang, S.-X., Gao, M.-T., Qi, L.-H.: Freehand Sketching interfaces: early processing for sketch recognition. In: Jacko, J. (ed.) Human-Computer Interaction Platforms and Techniques, pp. 161–170. Springer, Berlin (2007). https://doi.org/10.1007/978-3-540-73107-8_18

    Chapter  Google Scholar 

  16. Pusch, R., Samavati, F., Nasri, A., et al.: Improving the sketch-based interface. Vis. Comput. 23(9–11), 955–962 (2007)

    Article  Google Scholar 

  17. Zou, H., Lee, Y.: Constraint-based beautification and dimensioning of 3D polyhedral models reconstructed from 2D sketches. Comput. Aided Des. 39(11), 1025–1036 (2007)

    Article  Google Scholar 

  18. Jun-Wen, X.U., Liao, D.X., Wang, S.X., et al.: Recognition of on-line sketched electrical diagrams. Sci. Technol. Eng. 6, 034 (2007)

    Google Scholar 

  19. Zhang, S.H., Chen, T., Zhang, Y.F., et al.: Vectorizing cartoon animations. IEEE Trans. Vis. Comput. Graph. 15(4), 618–629 (2008)

    Article  Google Scholar 

  20. Ching, F.D.: Architecture: Form, Space, and Order. Wiley, New York (2014)

    Google Scholar 

  21. Li, B., Lu, Y., Godil, A., et al.: A comparison of methods for sketch-based 3D shape retrieval. Comput. Vis. Image Underst. 119(2), 57–80 (2013)

    Google Scholar 

  22. Wang, Y., Gao, M.: Completing imperfect line drawing of object. Sci. Technol. Eng. 7(7), 1482–1485 (2007)

    Google Scholar 

  23. Johnson, K., Chang, C., Lipson, H.: Neural network based reconstruction of a 3D object from a 2D wireframe (2010). arXiv:10072442

  24. Company, P., Plumed, R., Varley, P.A.C.: A fast approach for perceptually-based fitting strokes into elliptical arcs. Vis. Comput. 31(6–8), 775–785 (2015)

    Article  Google Scholar 

  25. Wang, S., Qin, S., Gao, M.: New Grouping and Fitting Methods for Interactive Overtraced Sketches. Springer, New York (2014)

    Book  Google Scholar 

  26. Wang, S., Yu, S.: Endpoint fusing of freehand 3D object sketch with Hidden-part-draw. In: 2009 IEEE 10th International Conference on Computer-Aided Industrial Design & Conceptual Design (2009)

  27. Durgun, F.B., Özgüç, B.: Architectural sketch recognition. Archit. Sci. Rev. 33(1), 3–16 (1990)

    Google Scholar 

  28. Sun, J., Jin, X., Peng, B., et al.: A method of fast on-line graphics recognition and regularization. Comput. Sci. 30(2), 172–176 (2003)

    Google Scholar 

  29. Shpitalni, M., Lipson, H.: Classification of sketch strokes and corner detection using conic sections and adaptive clustering. J. Mech. Des. 119(1), 131–135 (1997)

    Article  Google Scholar 

  30. Ku, D.C., Qin, S.-F., Wright, D.K.: Interpretation of overtracing freehand sketching for geometric shapes. In: Proceedings of the International Conference on Computer Graphics, Visualization and Computer Vision, pp. 263–270 (2006)

  31. Tsuchie, S.: Reconstruction of underlying curves with styling radius corners. Vis. Comput. 33(9), 1197–1210 (2017)

    Article  Google Scholar 

  32. Wang, S., Gao, M., Qi, L.: Endpoint fusing of hand-drawing 3D projection sketches. J. Comput. Aided Des. Comput. Graph. 21(1), 81–87 (2009)

    Google Scholar 

  33. Wang, S., Wang, G., Gao, M., et al.: Using fuzzy hybrid features to classify strokes in interactive sketches. Adv. Mech. Eng. 558(5), 561–566 (2013)

    Google Scholar 

  34. Wang, S., Zhang, Q., Wang, S., et al.: Segmentation of online sketching using velocity features. J. Northwest. Polytech. Univ. 34(2), 235–240 (2016)

    Google Scholar 

  35. Yuan, H., Lu, Z.: Reason the hidden elements based on connected edges to reconstruct 3D model from isometric drawing. J. Image Graph. 9(2), 178–183 (2004)

    Google Scholar 

  36. Ku, D.C., Qin, S.-F., Wright, D.K.: A sketching interface for 3D modeling of polyhedrons. In: Proceedings of the Eurographics Conference on Sketch-Based Interfaces and Modeling, pp. 83–90 (2006)

  37. Cheon, S.-U., Han, S.: A template-based reconstruction of plane-symmetric 3D models from freehand sketches. Comput. Aided Des. 40(9), 975–986 (2008)

    Article  Google Scholar 

  38. Tian, C., Masry, M., Lipson, H.: Physical sketching: reconstruction and analysis of 3D objects from freehand sketches. Comput. Aided Des. 41(3), 147–158 (2009)

    Article  Google Scholar 

  39. Jun, C., Tun, G.M., Guoding, C.: Creating model of planar body from line drawing under orthographically axonometric projection. J. Image Graph. 9(8), 972–977 (2004)

    Google Scholar 

  40. Wang, S., Yu, S.: Endpoint fusing of freehand 3D object sketch with Hidden-part-draw. In: 2009 CAID & CD 2009 IEEE 10th International Conference on Computer-Aided Industrial Design & Conceptual Design, pp. 586–590. IEEE

Download references

Acknowledgements

This work is partly supported by National Natural Science Foundation of China (Grant No. 51105310), Natural Science Basic Research Plan in Shaanxi Province of China (Grant No. 2016JM6054), the Programme of Introducing Talents of Discipline to Universities (111 Project) of China (Grant No. B13044), the Open Project Program of the State Key Lab of CAD&CG (Grant No. A1615) of Zhejiang University, and the Seed Foundation of Innovation and Creation for Graduate Students in Northwestern Polytechnical University (Grant No. Z2017106).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shuxia Wang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, S., Zhang, Q., Wang, S. et al. Endpoint fusing method of online freehand-sketched polyhedrons. Vis Comput 36, 291–303 (2020). https://doi.org/10.1007/s00371-018-1608-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-018-1608-5

Keywords

Navigation