Skip to main content

Advertisement

Springer Nature Link
Log in

A relative 3D scan and construction for face using meshing algorithm

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Three-dimensional object construction has seen a great deal of activity in the past decade, as has been pointed out in recent surveys, with the advancement of technology and easy availability of the depth sensors the 3D scanning technology has taken off. A wide range of commercial sensors such as Intel RealSense, Microsoft Kinect are being widely used for real time 3D capturing. Efficient 3D face scanning is one of the important areas of 3D scanning. 3D printer compatible texture supported scanning has a wide range of commercial applications. Such methods are also being used for 3D avatars and characterizations for games. Even though several commercial grade applications are available, most of the techniques suffer from background and light variations. Therefore an efficient face scanning technique is of extreme importance. In this paper we propose a 3D face scanning method based on Intel RealSense technology that combines 3D face detection, background segmentation and 3D mesh mapping to produce realistic 3D face model along with texture export. Further the models then can be manipulated using any 3D editing software along with texture and wireframe manipulation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Graph 1
Graph 2
Fig. 21
Graph 3

Similar content being viewed by others

References

  1. Alyüz SN, Dibeklioğlu H, Çeliktutan O, Gökberk B, Sankur B, Akarun L (2008) Bosphorus database for 3D face analysis. The First COST 2101 Workshop on Biometrics and Identity Management (BIOID 2008), Roskilde University, Denmark, 7–9 May 2008

  2. Chen X-C, Sheng Y, Wang Y-J (2007) Research on 3D shape reconstruction using uneven defocusing model. IEEE International Conference on Mechatronics and Automation (ICMA), pp 2326–2331

  3. Cheng S, Zafeiriou S, Asthana A, Pantic M (2014) 3D facial geometric features for constrained local model. IEEE International Conference on Image Processing (ICIP), pp 1425–1429, October 2014

  4. Dame A, Prisacariu VA, Ren CY, Reid I (2013) Dense reconstruction using 3D object shape priors. In: The proceedings of the IEEE conference on computer vision and pattern recognition, pp 1288–1295

  5. Daribo I, Florencio D, Cheung G (2014) Arbitrarily shaped motion prediction for depth video compression using arithmetic edge coding. IEEE Trans Image Process 23(11):4696–4708

    Article  MathSciNet  MATH  Google Scholar 

  6. Dinc S, Sigdel M, Dinc I, Sigdel MS, Fahimi F, Aygun RS (2014) Depth-color image registration for 3D surface texture construction using kinect camera system. In: IEEE SOUTHEASTCON, pp 1–6

  7. Fehn C (2004) Depth-image-based rendering (DIBR), compression, and transmission for a new approach on 3D-TV. International Society for Optics and Photonics Electronic Imaging, pp 93–104

  8. Gadkari D (2004) Image quality analysis using GLCM. Electronic Theses and Dissertations, Paper 187

  9. Herrera JL, del-Blanco, CR, Garcıa N (2015) Edge-based depth gradient refinement for 2D to 3D learned prior conversion. An IEEE 3DTV-conference: the true vision-capture, transmission and display of 3D video (3DTV-CON), pp 1–4

  10. Hwang J et al (2012) 3D face modeling using the multi-deformable method. Sensors 12(10):12870–12889

    Article  Google Scholar 

  11. Ionescu D, Suse V, Gadea C, Solomon B, Ionescu B, Islam S (2013) A new infrared 3d camera for gesture control. IEEE International conference on Instrumentation and Measurement Technology Conference (I2MTC), pp 629–634

  12. Kaneko M, Hasegawa T, Yamauchi Y, Yamashita T, Fujiyoshi H, Murase H (2015) Fast 3D edge detection by using decision tree from depth image. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp 1314–1319

  13. Kemelmacher-Shlizerman I, Basri R (2011) 3D face reconstruction from a single image using a single reference face shape. IEEE Trans Pattern Anal Mach Intell 33(2):394–405

    Article  Google Scholar 

  14. Lopez-de-Teruel PE, Ruiz A, Fernandez L (2006) Efficient monocular 3D reconstruction from segments for visual navigation in structured environments. IEEE 18th International Conference on Pattern Recognition (ICPR 2006), pp 143–146

  15. Manap NA, Soraghan JJ, Petropoulakis L (2013) Depth image layers separation (DILS) algorithm of image view synthesis based on stereo vision. IEEE International Conference on Signal and Image Processing Applications (ICSIPA), pp 61–66

  16. Park A, Kim J (2012) GPU accelerated view synthesis from multiple RGB-D images. 19th IEEE International Conference on Image Processing (ICIP), pp 573–576

  17. Poon G, Yeung Y-Y, Pang W-M (2014) Enabling 3D online shopping with affordable depth scanned models. IEEE International Conference on Smart Computing (SMARTCOMP), pp 150–155

  18. Ranipa KR, Joshi MV (2011) A practical approach for depth estimation and image restoration using defocus cue. IEEE International Workshop on Machine Learning for Signal Processing (MLSP), pp 1–6

  19. Swash MR, Aggoun A, Abdulfatah O, Li B, Fernandez JC, Alazawi E, Tsekleves E (2013) Pre-processing of holoscopic 3D image for autostereoscopic 3D displays. IEEE International Conference on 3D Imaging (IC3D), pp 1–5

  20. Wang D, Liu J, Ren Y, Ge C, Liu W, Li Y (2012) Depth propagation based on depth consistency. IEEE International Conference on Wireless Communications & Signal Processing (WCSP), pp 1–6

  21. Wang Z, Grochulla M, Thormahlen T, Seidel H-P (2013) 3D face template registration using normal maps. 2013 International Conference on 3DTV-Conference, IEEE

  22. Wu Z, Li J, Hu J, Deng W (2015) Pose-invariant face recognition using 3d multi-depth generic elastic models. 11th IEEE international conference and workshops on automatic Face and Gesture Recognition (FG), vol. 1, pp 1–6

  23. Xu X, Po L-M, Cheung K-W, Ng K-H, Wong K-M, Ting C-W (2012) Watershed and random walks based depth estimation for semi-automatic 2D to 3D image conversion. IEEE International Conference on Signal Processing, Communication and Computing (ICSPCC), pp 84–87

  24. Xu X, Po L-M, Cheung C-H, Feng L, Cheung K-W, Ting C-W, Ng K-H (2014) Adaptive block truncation filter for MVC depth image enhancement. IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp 544–548

  25. Zhang L, Tam WJ (2005) Stereoscopic image generation based on depth images for 3D TV. IEEE Trans Broadcast 51(2):191–199

    Article  Google Scholar 

  26. Zhang L, Chen T, Sun H, Zhao Z, Jin X, Huang J (2014) The image depth estimation based on multi-scale texture features and least-square method. 12th IEEE International Conference on Signal Processing (ICSP), pp. 816–820

  27. Zhou Y, Guo H, Fu R, Liang G, Wang C, Wu X (2015) 3D reconstruction based on light field information. IEEE International Conference on Information and Automation, pp 976–981

  28. Zujovic J, Pappas TN, Neuhoff DL (2013) Structural texture similarity metrics for image analysis and retrieval. IEEE Transactions on Image Processing, vol. 22, no. 7, July 2013

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science, Dr P G Halakatti Post Graduate Centre, “Vachana Sangama”, Rani Channamma University, Toravi, Vijayapur, 586108, Karnataka, India

    Dayanand G. Savakar

  2. Department of Computer Science & Engineering, BLDEA’s V. P. Dr. P. G. H. College of Engineering & Technology, Vijayapur, 586103, Karnataka, India

    Ravi Hosur

Authors
  1. Dayanand G. Savakar
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Ravi Hosur
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Dayanand G. Savakar.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Savakar, D.G., Hosur, R. A relative 3D scan and construction for face using meshing algorithm. Multimed Tools Appl 77, 25253–25273 (2018). https://doi.org/10.1007/s11042-018-5783-1

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-018-5783-1

Keywords