Skip to main content
SpringerLink
Log in

Recovering solid geometric object from single line drawing image

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Many educational materials contain a lot of solid geometric figures. The solid geometric objects in these figures are usually drawn as 2D line drawings thus have lost their 3D information. This paper presents a method to recover the 3D information of the solid geometric object from single line drawing image taken from the geometric books, which would be used to help the users better present and understand the solid geometric object on their mobile devices. The main advantage of our method is the abilitYTo handle inaccurately processed sketches as opposed to the previous methods which require perfect line drawings as inputs. Our method consists of three main steps as follows. First, the sketch of the input line drawing image is automatically extracted and further represented as an undirected graph. Second, candidate 3D models from the pre-built 3D model database are found by graph similarity-based searching and sub-graph isomorphism matching. Third, for each candidate 3D model, the model parameters, the rotation and the translation aligning the model with the sketch are found by minimizing an objective function which is composed of the residuals between the vertices of the sketch and the 2D projections of the candidate model’s vertices, and an optimal reconstruction solution is further selected as the final result. Extensive experimental results demonstrate the effectiveness and robustness of our method for recovering the solid geometric object from single line drawing image.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Brown E, Wang PS (1996) Three-dimensional object recovery from two-dimensional images: a new approach. In: Photonics East’96. International Society for Optics and Photonics, pp 138–147

  2. Chen Y, Liu J, Tang X (2007) A divide-and-conquer approach to 3d object reconstruction from line drawings. In: IEEE 11th international conference on computer vision, 2007. ICCV 2007. IEEE, pp 1–8

  3. Cordella LP, Foggia P, Sansone C, Vento M (2004) A (sub) graph isomorphism algorithm for matching large graphs. IEEE Trans Pattern Anal Mach Intell 26(10):1367–1372

    Article  Google Scholar 

  4. Cordier F, Seo H, Melkemi M, Sapidis NS (2013) Inferring mirror symmetric 3d shapes from sketches. Comput Aided Des 45(2):301–311

    Article  MathSciNet  Google Scholar 

  5. Hartigan JA, Wong MA (1979) Algorithm as 136: a k-means clustering algorithm. Appl Stat 100– 108

  6. Leclerc YG, Fischler MA (1992) An optimization-based approach to the interpretation of single line drawings as 3d wire frames. Int J Comput Vis 9(2):113–136

    Article  Google Scholar 

  7. Lee YT, Fang F (2011) 3d reconstruction of polyhedral objects from single parallel projections using cubic corner. Comput Aided Des 43(8):1025–1034

    Article  Google Scholar 

  8. Lee YT, Fang F (2012) A new hybrid method for 3d object recovery from 2d drawings and its validation against the cubic corner method and the optimisation-based method. Comput Aided Des 44(11):1090–1102

    Article  Google Scholar 

  9. Lipson H, Shpitalni M (1996) Optimization-based reconstruction of a 3d object from a single freehand line drawing. Comput Aided Des 28(8):651–663

    Article  Google Scholar 

  10. Liu D, Wang Y, Tang Z, Li L, Gao L (2014) Automatic comic page image understanding based on edge segment analysis. In: Proc. SPIE 9021, document recognition and retrieval XXI, pp 90,210J–90,210J–12

  11. Liu J, Cao L, Li Z, Tang X (2008) Plane-based optimization for 3d object reconstruction from single line drawings. IEEE Trans Pattern Anal Mach Intell 30(2):315–327

    Article  Google Scholar 

  12. Liu J, Chen Y, Tang X (2011) Decomposition of complex line drawings with hidden lines for 3d planar-faced manifold object reconstruction. IEEE Trans Pattern Anal Mach Intell 33(1):3–15

    Article  Google Scholar 

  13. Liu J, Lee YT (2001) Graph-based method for face identification from a single 2d line drawing. IEEE Trans Pattern Anal Mach Intell 23(10):1106–1119

    Article  Google Scholar 

  14. Liu J, Lee YT, Cham WK (2002) Identifying faces in a 2d line drawing representing a manifold object. IEEE Trans Pattern Anal Mach Intell 24(12):1579–1593

    Article  Google Scholar 

  15. Liu J, Tang X (2005) Evolutionary search for faces from line drawings. IEEE Trans Pattern Anal Mach Intell 27(6):861–872

    Article  Google Scholar 

  16. Marill T (1991) Emulating the human interpretation of line-drawings as three-dimensional objects. Int J Comput Vis 6(2):147–161

    Article  Google Scholar 

  17. Otsu N (1975) A threshold selection method from gray-level histograms. Automatica 11(285–296):23–27

    Google Scholar 

  18. Shoji K, Kato K (2001) Toyama, F: 3-d interpretation of single line drawings based on entropy minimization principle. In: Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition, 2001. CVPR 2001, vol 2. IEEE, pp II–90

  19. Shpitalni M, Lipson H (1996) Identification of faces in a 2d line drawing projection of a wireframe object. IEEE Trans Pattern Anal Mach Intell 18(10):1000–1012

    Article  Google Scholar 

  20. Tian C, Masry M, Lipson H (2009) Physical sketching: reconstruction and analysis of 3d objects from freehand sketches. Comput Aided Des 41(3):147–158

    Article  Google Scholar 

  21. Xue T, Liu J, Tang X (2010) Object cut: complex 3d object reconstruction through line drawing separation. In: 2010 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 1149–1156

  22. Xue T, Liu J, Tang X (2012) Example-based 3d object reconstruction from line drawings. In: 2012 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 302–309

  23. Yang L, Liu J, Tang X (2013) Complex 3d general object reconstruction from line drawings. In: 2013 IEEE international conference on computer vision (ICCV), pp 1433–1440. doi:10.1109/ICCV.2013.181

  24. Zheng J, Wang Y, Tang Z (2015) Solid geometric object reconstruction from single line drawing image. In: International conference on computer graphics theory and applications (GRAPP 2015)

  25. Zheng W, Zou L, Lian X, Wang D, Zhao D (2015) Efficient graph similarity search over large graph databases. IEEE Trans Knowl Data Eng 27(4):964–978. doi:10.1109/TKDE.2014.2349924

    Article  Google Scholar 

  26. Zou C, Chen S, Fu H, Liu J (2014) Progressive 3d reconstruction of planar-faced manifold objects with drf-based line drawing decomposition. IEEE Trans Vis Comput Graph PP(99):1–1. doi:10.1109/TVCG.2014.2354039

    Article  Google Scholar 

  27. Zou C, Yang H, Liu J (2014) Separation of line drawings based on split faces for 3d object reconstruction. In: 2014 IEEE conference on computer vision and pattern recognition (CVPR), pp 692–699. doi:10.1109/CVPR.2014.94

Download references

Acknowledgments

We’d like to thank all the reviewers for providing encouraging and valuable comments to our work. This work is supported by National Natural Science Foundation of China under Grant 61300061 and Beijing Natural Science Foundation (4132033).

Author information

Authors and Affiliations

  1. Institute of Computer Science and Technology, Peking University, No.5 Yiheyuan Road, Haidian District, Beijing, 100871, China

    Jinxin Zheng, Yongtao Wang & Zhi Tang

Authors
  1. Jinxin Zheng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yongtao Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhi Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yongtao Wang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zheng, J., Wang, Y. & Tang, Z. Recovering solid geometric object from single line drawing image. Multimed Tools Appl 75, 10153–10174 (2016). https://doi.org/10.1007/s11042-015-2966-x

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-2966-x

Keywords

Search

Navigation