Skip to main content
SpringerLink
Log in

Self-adaptive morphable model based collaborative multi-view 3d face reconstruction in visual sensor network

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

3D face reconstruction is an efficient method for pedestrian recognition in non-cooperative environment because of its outstanding performance in robust face recognition for uncontrolled pose and illumination changes. Visual sensor network is widely used in target surveillance as powerful unattended distributed measurement systems. This paper proposes a collaborative multi-view non-cooperative 3D face reconstruction method in visual sensor network. A peer-to-peer paradigm-based visual sensor network is employed for distributed pedestrian tracking and optimal face image acquisition. Gaussian probability distribution-based multi-view data fusion is used for target localization, and kalman filter is applied for target tracking. A lightweight face image quality evaluation method is presented to search optimal face images. A self-adaptive morphable model is designed for multiview 3D face reconstruction. To adjust the self-adaptive morphable model, the optimal face images and their poses estimation are used. Cooperative chaotic particle swarm optimization is employed for parameters optimization of the self-adaptive morphable model. Experimental results on real data show that the proposed method can acquire optimal face images and achieve non-cooperative 3D reconstruction efficiently.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. (2005) The BJUT-3D Large-scale Chinese Face Database. Technical report, The Multimedia and Intelligent Software Technology Beijing Municipal Key Laboratory in Beijing University of Technology

  2. Blanz V, Vetter T (1999) A morphable model for the synthesis of 3D faces. In: Proceedings of the 26th annual conference on Computer graphics and interactive techniques, pp 187–194

  3. Cho Y, Lim SO, Yang HS (2010) Collaborative occupancy reasoning in visual sensor network for scalable smart video surveillance. IEEE Trans Consum Electron 56 (3):1997–2003

    Article  Google Scholar 

  4. Choi J, Medioni GG, Lin Y, et al. (2010) 3D Face Reconstruction Using a Single or Multiple Views. In: International Conference on Pattern Recognition (ICPR), pp 3959–3962.

  5. Chouvatut V, Madarasmi S (2013) Tuceryan M, 3D face and motion estimation from sparse points using adaptive bracketed minimization. Multimedia Tools and Applications 63(2):569–589

    Article  Google Scholar 

  6. Cootes TF, Edwards GJ, Taylor CJ (2001) Active appearance models. IEEE Trans Pattern Anal Mach Intell 23(6):681–685

    Article  Google Scholar 

  7. Cootes TF, Wheeler GV, Walker KN, et al. (2002) View-based active appearance models. Image Vis Comput 20(9):657–664

    Article  Google Scholar 

  8. Costa DG, Guedes LA (2013) Exploiting the sensing relevancies of source nodes for optimizations in visual sensor networks. Multimedia tools and applications 64(3):549–579

    Article  Google Scholar 

  9. Ding C, Song B, Morye A, et al. (2012) Collaborative sensing in a distributed PTZ camera network. IEEE Trans Image Process 21(7):3282–3295

    Article  MathSciNet  Google Scholar 

  10. Heath K, Guibas L (2007) Facenet: Tracking people and acquiring canonical face images in a wireless camera sensor network. In: First ACM/IEEE International Conference on Distributed Smart Cameras, pp 117–124

  11. Heo J, Savvides M (2012) Gender and ethnicity specific generic elastic models from a single 2d image for novel 2d pose face synthesis and recognition. IEEE Trans Pattern Anal Mach Intell 34(12):2341–2350

    Article  Google Scholar 

  12. Huang C, Ding X, Fang C (2012) Pose robust face tracking by combining view-based AAMs and temporal filters. Comput Vis Image Underst 116(7):777–792

    Article  Google Scholar 

  13. Kemelmacher-Shlizerman I, Basri R (2011) 3d face reconstruction from a single image using a single reference face shape. IEEE Trans Pattern Anal Mach Intell 33 (2):394–405

    Article  Google Scholar 

  14. Lee YJ, Lee SJ, Park KR, et al. (2012) Single view-based 3D face reconstruction robust to self-occlusion. EURASIP Journal on Advances in Signal Processing 2012 (1):1–20

    Article  Google Scholar 

  15. Lian FL, Lin YC, Kuo CT, et al. (2013) Voting-based motion estimation for real-time video transmission in networked mobile camera systems. IEEE Trans Ind Inf 9(1):172–180

    Article  Google Scholar 

  16. Liu P, Reale M, Yin L (2012) 3D head pose estimation based on scene flow and generic head model. In: IEEE International Conference on Multimedia and Expo, pp 794–799

  17. Medeiros H, Park J, Kak AC (2008) Distributed object tracking using a cluster-based kalman filter in wireless camera networks. IEEE J Sel Top Sign Process 2(4):448–463

    Article  Google Scholar 

  18. Medioni G, Choi J, Kuo C.H., et al. (2009) Identifying noncooperative subjects at a distance using face images and inferred three-dimensional face models. IEEE Trans Syst Man Cybern Part A Syst Humans 39(1):12–24

    Article  Google Scholar 

  19. Ming Y, Ruan Q, Li X (2010) 3D face reconstruction using a single 2D face image. In: International Conference on Educational and Information Technology, pp V3-32-V3-36

  20. Nam Y, Hong S (2012) Optimal placement of multiple visual sensors considering space coverage and cost constraints. Multimedia Tools and Applications 73:129–150

    Article  Google Scholar 

  21. Park SW, Heo J, Savvides M (2008) 3D face reconstruction from a single 2D face image. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, pp 1–8

  22. Park U, Choi HC, Jain AK, et al. (2013) Face tracking and recognition at a distance: A coaxial and concentric PTZ camera system. IEEE Trans Inf Forensics Secur 8(10):1665–1677

    Article  Google Scholar 

  23. Parupati S, Bakkannagari R, Sankar S, et al. (2011) Collaborative acquisition of multi-view face images in real-time using a wireless camera network. In: 2011 Fifth ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC), pp 1–6

  24. Song B, Kamal AT, Soto C et al. (2010) Tracking and activity recognition through consensus in distributed camera networks. IEEE Trans Image Process 19 (10):2564–2579

    Article  MathSciNet  Google Scholar 

  25. Wang X, Liang W, Zhang L (2010) Morphable face reconstruction with multiple views. In: 2nd International Conference on Intelligent Human-Machine Systems and Cybernetics, vol 2, pp 250–253

  26. Wang X, Wang S (2007) Collaborative signal processing for target tracking in distributed wireless sensor networks. J Parallel and Distrib Comput 67(5):501–515

    Article  MATH  Google Scholar 

  27. Wang X, Wang S, Bi D (2009) Distributed visual-target-surveillance system in wireless sensor networks. IEEE Trans Syst Man Cybern Part B Cybern 39(5):1134–1146

    Article  Google Scholar 

  28. Wang Y, Velipasalar S, Gursoy MC (2012) Distributed wide-area multi-object tracking with non-overlapping camera views. Multimedia Tools and Applications 73:7–39

    Article  Google Scholar 

  29. Wu J, Wang X, Sun X et al. (2014) Pure harmonics extracting from time-varying power signal based on improved empirical mode decomposition. Measurement 49:216–225

    Article  Google Scholar 

  30. Zivkovic Z (2004) Improved adaptive Gaussian mixture model for background subtraction. In: 17th International Conference on Pattern Recognition, vol 2, pp 28–31

Download references

Author information

Authors and Affiliations

  1. State Key Laboratory of Precision Measurement Technology and Instrument, Department of Precision Instrument, Tsinghua University, Beijng, 100084, China

    Kuicheng Lin, Xue Wang & Yuqi Tan

Authors
  1. Kuicheng Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xue Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yuqi Tan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xue Wang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Lin, K., Wang, X. & Tan, Y. Self-adaptive morphable model based collaborative multi-view 3d face reconstruction in visual sensor network. Multimed Tools Appl 75, 11469–11491 (2016). https://doi.org/10.1007/s11042-015-2864-2

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-015-2864-2

Keywords

Search

Navigation