Abstract
Many educational materials contain a lot of solid geometric figures. The solid geometric objects in these figures are usually drawn as 2D line drawings thus have lost their 3D information. This paper presents a method to recover the 3D information of the solid geometric object from single line drawing image taken from the geometric books, which would be used to help the users better present and understand the solid geometric object on their mobile devices. The main advantage of our method is the abilitYTo handle inaccurately processed sketches as opposed to the previous methods which require perfect line drawings as inputs. Our method consists of three main steps as follows. First, the sketch of the input line drawing image is automatically extracted and further represented as an undirected graph. Second, candidate 3D models from the pre-built 3D model database are found by graph similarity-based searching and sub-graph isomorphism matching. Third, for each candidate 3D model, the model parameters, the rotation and the translation aligning the model with the sketch are found by minimizing an objective function which is composed of the residuals between the vertices of the sketch and the 2D projections of the candidate model’s vertices, and an optimal reconstruction solution is further selected as the final result. Extensive experimental results demonstrate the effectiveness and robustness of our method for recovering the solid geometric object from single line drawing image.














Similar content being viewed by others
References
Brown E, Wang PS (1996) Three-dimensional object recovery from two-dimensional images: a new approach. In: Photonics East’96. International Society for Optics and Photonics, pp 138–147
Chen Y, Liu J, Tang X (2007) A divide-and-conquer approach to 3d object reconstruction from line drawings. In: IEEE 11th international conference on computer vision, 2007. ICCV 2007. IEEE, pp 1–8
Cordella LP, Foggia P, Sansone C, Vento M (2004) A (sub) graph isomorphism algorithm for matching large graphs. IEEE Trans Pattern Anal Mach Intell 26(10):1367–1372
Cordier F, Seo H, Melkemi M, Sapidis NS (2013) Inferring mirror symmetric 3d shapes from sketches. Comput Aided Des 45(2):301–311
Hartigan JA, Wong MA (1979) Algorithm as 136: a k-means clustering algorithm. Appl Stat 100– 108
Leclerc YG, Fischler MA (1992) An optimization-based approach to the interpretation of single line drawings as 3d wire frames. Int J Comput Vis 9(2):113–136
Lee YT, Fang F (2011) 3d reconstruction of polyhedral objects from single parallel projections using cubic corner. Comput Aided Des 43(8):1025–1034
Lee YT, Fang F (2012) A new hybrid method for 3d object recovery from 2d drawings and its validation against the cubic corner method and the optimisation-based method. Comput Aided Des 44(11):1090–1102
Lipson H, Shpitalni M (1996) Optimization-based reconstruction of a 3d object from a single freehand line drawing. Comput Aided Des 28(8):651–663
Liu D, Wang Y, Tang Z, Li L, Gao L (2014) Automatic comic page image understanding based on edge segment analysis. In: Proc. SPIE 9021, document recognition and retrieval XXI, pp 90,210J–90,210J–12
Liu J, Cao L, Li Z, Tang X (2008) Plane-based optimization for 3d object reconstruction from single line drawings. IEEE Trans Pattern Anal Mach Intell 30(2):315–327
Liu J, Chen Y, Tang X (2011) Decomposition of complex line drawings with hidden lines for 3d planar-faced manifold object reconstruction. IEEE Trans Pattern Anal Mach Intell 33(1):3–15
Liu J, Lee YT (2001) Graph-based method for face identification from a single 2d line drawing. IEEE Trans Pattern Anal Mach Intell 23(10):1106–1119
Liu J, Lee YT, Cham WK (2002) Identifying faces in a 2d line drawing representing a manifold object. IEEE Trans Pattern Anal Mach Intell 24(12):1579–1593
Liu J, Tang X (2005) Evolutionary search for faces from line drawings. IEEE Trans Pattern Anal Mach Intell 27(6):861–872
Marill T (1991) Emulating the human interpretation of line-drawings as three-dimensional objects. Int J Comput Vis 6(2):147–161
Otsu N (1975) A threshold selection method from gray-level histograms. Automatica 11(285–296):23–27
Shoji K, Kato K (2001) Toyama, F: 3-d interpretation of single line drawings based on entropy minimization principle. In: Proceedings of the 2001 IEEE computer society conference on computer vision and pattern recognition, 2001. CVPR 2001, vol 2. IEEE, pp II–90
Shpitalni M, Lipson H (1996) Identification of faces in a 2d line drawing projection of a wireframe object. IEEE Trans Pattern Anal Mach Intell 18(10):1000–1012
Tian C, Masry M, Lipson H (2009) Physical sketching: reconstruction and analysis of 3d objects from freehand sketches. Comput Aided Des 41(3):147–158
Xue T, Liu J, Tang X (2010) Object cut: complex 3d object reconstruction through line drawing separation. In: 2010 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 1149–1156
Xue T, Liu J, Tang X (2012) Example-based 3d object reconstruction from line drawings. In: 2012 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 302–309
Yang L, Liu J, Tang X (2013) Complex 3d general object reconstruction from line drawings. In: 2013 IEEE international conference on computer vision (ICCV), pp 1433–1440. doi:10.1109/ICCV.2013.181
Zheng J, Wang Y, Tang Z (2015) Solid geometric object reconstruction from single line drawing image. In: International conference on computer graphics theory and applications (GRAPP 2015)
Zheng W, Zou L, Lian X, Wang D, Zhao D (2015) Efficient graph similarity search over large graph databases. IEEE Trans Knowl Data Eng 27(4):964–978. doi:10.1109/TKDE.2014.2349924
Zou C, Chen S, Fu H, Liu J (2014) Progressive 3d reconstruction of planar-faced manifold objects with drf-based line drawing decomposition. IEEE Trans Vis Comput Graph PP(99):1–1. doi:10.1109/TVCG.2014.2354039
Zou C, Yang H, Liu J (2014) Separation of line drawings based on split faces for 3d object reconstruction. In: 2014 IEEE conference on computer vision and pattern recognition (CVPR), pp 692–699. doi:10.1109/CVPR.2014.94
Acknowledgments
We’d like to thank all the reviewers for providing encouraging and valuable comments to our work. This work is supported by National Natural Science Foundation of China under Grant 61300061 and Beijing Natural Science Foundation (4132033).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zheng, J., Wang, Y. & Tang, Z. Recovering solid geometric object from single line drawing image. Multimed Tools Appl 75, 10153–10174 (2016). https://doi.org/10.1007/s11042-015-2966-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-015-2966-x