Skip to main content
SpringerLink
Log in

Eye Gaze Correction for Video Conferencing Using Kinect v2

  • Conference paper
  • First Online:
Advances in Multimedia Information Processing -- PCM 2015 (PCM 2015)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 9315))

Included in the following conference series:

Abstract

In video conferencing, eye gaze correction is beneficial for effective communication. In this era, video conferencing at homes using laptops is straightforward. In this paper, we propose an eye gaze correction method with a low-cost simple setup using Kinect v2. Our method detects an ellipse that connects edge points of the face after identifying several feature points within the face using Kinect v2 SDK. Then, we apply a 3D affine transform that allows eye gaze correction using camera space points that are acquired from depth information. Thus, in the preprocessing step, an ellipse model should be extracted when the user gazes the camera and display, respectively. Also, we fill holes that are caused by the affine transform using color inpainting. As a result, we produced a natural eye gaze-corrected image in real-time.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Kuster, C., Popa, T., Bazin, J.C., Gotsman, C., Gross, M.: Gaze correction for home video conferencing. ACM Trans. Graphics 31(6), 1–6 (2012)

    Article  Google Scholar 

  2. Tan, K.H., Robinson, I.N., Culbertson, B., Apostolopoulos, J.: ConnectBoard: Enabling Genuine Eye Contact and Accurate Gaze in Remote Collaboration. IEEE Trans. Multimedia 13(3), 466–473 (2011)

    Article  Google Scholar 

  3. http://www.microsoftstore.com/store/mssg/en_SG/pdp/Kinect-for-Windows-v2-Sensor/productID.299057000

  4. Fitzgibbon, A.W., Fisher, R.B.: A Buyer’s guide to conic fitting. In: Proceedings of the British Machine Vision Conference (BMVC), Birmingham, England, vol. 2, pp. 513–522 (1995)

    Google Scholar 

  5. http://docs.opencv.org/modules/imgproc/doc/structural_analysis_and_shape_descriptors.html?highlight=fitellipse#fitellipse

  6. http://docs.opencv.org/modules/core/doc/drawing_functions.html?highlight=ellipse#ellipse

  7. Telea, A.: An image inpainting technique based on the fast marching method. J. Graphics, GPU, Game Tools 9(1), 25–36 (2004)

    Google Scholar 

Download references

Acknowledgement

This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT & Future Planning (No. 2011-0030079)

Author information

Authors and Affiliations

  1. School of Information and Communications, Gwangju Institute of Science and Technology (GIST), 123 Cheomdangwagi-ro, Buk-gu, Gwangju, 500-712, Republic of Korea

    Eunsang Ko, Woo-Seok Jang & Yo-Sung Ho

Authors
  1. Eunsang Ko
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Woo-Seok Jang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yo-Sung Ho
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yo-Sung Ho .

Editor information

Editors and Affiliations

  1. Gwangju Institute of Science and Technology, Gwangju, Korea (Republic of)

    Yo-Sung Ho

  2. Chinese Academy of Sciences, Institute of Automation, Beijing, China

    Jitao Sang

  3. KAIST, Daejeon, Korea (Republic of)

    Yong Man Ro

  4. KAIST, Daejeon, Korea (Republic of)

    Junmo Kim

  5. College of Computer Science, Zhejiang University, Hangzhou, China

    Fei Wu

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Ko, E., Jang, WS., Ho, YS. (2015). Eye Gaze Correction for Video Conferencing Using Kinect v2. In: Ho, YS., Sang, J., Ro, Y., Kim, J., Wu, F. (eds) Advances in Multimedia Information Processing -- PCM 2015. PCM 2015. Lecture Notes in Computer Science(), vol 9315. Springer, Cham. https://doi.org/10.1007/978-3-319-24078-7_58

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-24078-7_58

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-24077-0

  • Online ISBN: 978-3-319-24078-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation