Skip to main content
SpringerLink
Log in

Head- and Eye-Tracking Solutions for Autostereoscopic and Holographic 3D Displays

  • Reference work entry
Handbook of Visual Display Technology

Abstract

Head- and eye-tracked 3D display systems provide glass-free 3D experience while offering a free movement of the observer within the tracking range. In either autostereoscopic or holographic 3D displays, eye-tracking systems are used for following left and right eye position of the observer in real time. Knowing the exact eye positions, the 3D display system provides the proper perspective views to the display user. For autostereoscopic displays these are left and right 2D stereo sub-images, whereas for holographic displays these are left and right holographic 3D reconstruction, respectively. For angular separation of the particular views, special optical light–steering devices are employed. Thus, a fast eye tracking combined with smooth light steering ensures a complete 3D visualization for the user at any time over a wide viewing range.

In this chapter, we first discuss general aspects of video-based eye tracking for their application in 3D displays and present implementations of real-time eye-tracking systems in autostereoscopic and holographic 3D displays. Then an implementation of an eye-tracking system is discussed in detail including the actual hardware and software solutions and achieved performance. Commercially available solutions for eye tracking are evaluated in terms of their specifications and suitability for tracked 3D displays and compared with our system. We then continue with a general description of the optical system required for providing the designated views of a 3D display. Finally, we conclude with a brief summary and offer a perspective on possible future developments of tracked 3D displays.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 899.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Abbreviations

API:

Application Programming Interface

ASD:

Autostereoscopic Display

CPU:

Central Processing Unit

DSP:

Digital Signal Processor

ET:

Eye Tracking

EWOD:

Electrowetting on Dielectrics

FD:

Face Detection

FOV:

Field of View

FPGA:

Field-Programmable Gate Array

HAL:

Hardware Abstraction Layer

IR:

Infrared

LVDS:

Low-Voltage Differential Signaling

MC:

Master Control

OEM:

Original Equipment Manufacturer

PC:

Personal Computer

PCA:

Principal Component Analysis

PHY:

Physical Layer of Ethernet

RAM:

Random-Access Memory

ROI:

Region-Of-Interest

SDK:

Software Development Kit

SRIO:

Serial Variant of RapidIO

SL:

Support Layer

SVM:

Support Vector Machine

VW:

Viewing Window

References

  1. ST4-02: “3D Display Technology Family Tree.” Available from 3D@Home Consortium at http://www.3dathome.org/steering-st4.aspx

  2. Hoffman DM, Girshick AR, Akeley K, Banks MS (2008) Vergence-accommodation conflicts hinder visual performance and cause visual fatigue. J Vis 8:1–30

    Article  Google Scholar 

  3. Reichelt S, Häussler R, Fütterer G, Leister N (2010) Depth cues in human visual perception and their realization in 3D displays. In: Javidi B, Son J-Y (eds) Three-dimensional imaging, visualization, and display 2010 and display technologies and applications for defense, security, and avionics IV, Proc SPIE 7690, 76900B. doi:10.1117/12.850094

    Google Scholar 

  4. Kalman R (1960) A new approach to linear filtering and prediction problems. J Basic Eng Citeseer 82:35–45

    Article  Google Scholar 

  5. Cortes C, Vapnik V (1995) Support-vector networks. Mach Learn, Springer 20:273–297

    Google Scholar 

  6. Lyons M, Budynek J, Akamatsu S (1999) Automatic classification of single facial images. IEEE Trans Pattern Anal Mach Intell 21:1357–1362

    Article  Google Scholar 

  7. Jolliffe I (2002) Principal component analysis. Springer, New York

    MATH  Google Scholar 

  8. Sobel I, Feldman G (1973) A 3x3 isotropic gradient operator for image processing. Presented at a talk at the Stanford Artificial Project in 1968. Unpublished but often cited, org. in Pattern Classification and Scene Analysis, Duda R and Hart P. John Wiley & Sons Inc, New York, pp 271–272

    Google Scholar 

  9. Canny J (1986) A computational approach to edge detection. IEEE Trans Pattern Anal Mach Intell 8(6):679–698

    Article  Google Scholar 

  10. Viola P, Jones M (2004) Robust real-time face detection. Int J Comput Vis Springer 57:137–154

    Article  Google Scholar 

  11. Morimoto C, Koons D, Amir A, Flickner M (2000) Pupil detection and tracking using multiple light sources. Image Vis Comput, Elsevier 18:331–335

    Google Scholar 

  12. http://www.imagelabs.com/pdf/CameraLink5.pdf

  13. Stolle H, Olaya J-C, Buschbeck S, Sahm H, Schwerdtner A (2008) Technical solutions for a full-resolution autostereoscopic 2D/3D display technology. In: Stereoscopic displays and applications XIX, SPIE, vol 6803, 68030Q

    Google Scholar 

  14. Reichelt S, Häussler R, Leister N, Fütterer G, Stolle H, Schwerdtner A (2010) Holographic 3-D displays - electro-holography within the grasp of commercialization. In: Costa N, Cartaxo A (eds) Advances in lasers and electro optics. ISBN: 978-953-307-088-9, INTECH. http://sciyo.com/articles/show/title/holographic-3-d-displays-electro-holography-within-the-grasp-of-commercialization, pp 683–710

  15. Zschau E, Missbach R, Schwerdtner A, Stolle H (2010) Generation, encoding, and presentation of content on holographic displays in real time. In: Three-dimensional imaging, visualization, and display 2010 and display technologies and applications for defense, security, and avionics IV, SPIE, vol 7690, 76900E

    Google Scholar 

  16. McManamon PF, Bos PJ, Escuti MJ, Heikenfeld J, Serati S, Xie H, Watson EA (2009) A review of phased array steering for narrow-band electrooptical systems. Proc IEEE 97:1078–1096

    Article  Google Scholar 

  17. Stockley J, Serati S (2004) Advances in liquid crystal beam steering, SPIE, vol 5550, pp 32–39

    Google Scholar 

  18. Valley P, Mathine DL, Dodge MR, Schwiegerling J, Peyman G, Peyghambarian N (2010) Tunable-focus flat liquid-crystal diffractive lens. Opt Lett OSA 35:336–338

    Google Scholar 

  19. Beni G, Hackwood S, Jackel JL (1982) Continuous electrowetting effect. Applied Physics Letters, AIP 40:912–914

    Article  Google Scholar 

  20. Berge B, Peseux J (2000) Variable focal lens controlled by an external voltage: an application of electrowetting. Eur Phys J E 3:159–163

    Article  Google Scholar 

  21. Kuiper S, Hendriks BHW, Hayes RA, Feenstra BJ, Baken JME, Javidi B, Psaltis D (eds) (2005) Electrowetting-based optics. In: Optical information systems III, SPIE, vol 5908, 59080R

    Google Scholar 

  22. Smith NR, Abeysinghe DC, Haus JW, Heikenfeld J (2006) Agile wide-angle beam steering with electrowetting microprisms. Opt Express OSA 14:6557–6563

    Article  Google Scholar 

  23. Zhai S (2003) What's in the eyes for attentive input. Commun ACM, ACM 46:34–39

    Article  Google Scholar 

  24. Holliman NS (2004) Mapping perceived depth to regions of interest in stereoscopic images. In: Stereoscopic displays and virtual reality systems XI, vol 5291. SPIE, Bellingham, pp 117–128

    Google Scholar 

Further Reading

  • Chen Y-S, Su C-H, Chen J-H, Chen C-S, Hung Y-P, Fuh C-S (2001) Video-based eye tracking for autostereoscopic displays. Opt Eng, SPIE, 40:2726–2734

    Google Scholar 

  • Cristianini N (2000) An introduction to support vector machines and other kernel-based learning methods, 1st edn. Cambridge University Press, Cambridge, ISBN: 978-0521780193

    Google Scholar 

  • Davies ER (2005) Machine vision: theory, algorithms, practicalities (Signal processing and its applications), 3rd edn. Elsevier, Amsterdam. ISBN: 978-0122060939

    Google Scholar 

  • Duchowski A (2007) Eye tracking methodology, theory and practice, 2nd edn. Springer, London, ISBN: 978-1-84628-608-7

    Google Scholar 

  • Haro A, Flickner M, Essa I (2000) Detecting and tracking eyes by using their physiological properties, dynamics, and appearance. CVPR 2000:1163–1168

    Google Scholar 

  • Hartley R, Zisserman A (2003) Multiple view geometry in computer vision. Cambridge University Press, Cambridge

    Google Scholar 

  • Klette R, Schluns K, Koschan A (1998) Computer vision: three-dimensional data from images, 1st edn. Springer, Singapore, ISBN: 978-9813083714

    Google Scholar 

  • Okano F, Javidi B (2001) Three-dimensional television, video, and display technologies. Springer, Berlin-Heidelberg

    Google Scholar 

  • Parker JR (1996) Algorithms for image processing and computer vision, 1st edn. John Wiley & Sons, New York. ISBN: 978-0471140566

    Google Scholar 

  • Surman P, Sexton I, Hopf K, Bates R, Lee W (2006) Head tracked 3D Displays. In: Gunsel B, Jain A, Tekalp A, Sankur B (eds) Multimedia content representation, classification and security, vol 4105. Springer, Berlin/Heidelberg, pp 769–776

    Chapter  Google Scholar 

  • The Computer Vision Homepage, http://www.cs.cmu.edu/~cil/vision.html

  • The Face Detection Homepage, http://www.facedetection.com/

  • Yang M-H (2001) Face detection and gesture recognition for human-computer interaction (Kluwer International Series in Video Computing). Springer, Berlin. ISBN: 978-0792374091

    Google Scholar 

  • Zhiwei Zhu, Qiang Ji (April 2005) Robust real-time eye detection and tracking under variable lighting conditions and various face orientations. Comput Vis Image Understanding 98(1):124–154

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. SeeReal Technologies GmbH, Sudhausweg 5, Dresden, D-01099, Germany

    Enrico Zschau & Stephan Reichelt

Authors
  1. Enrico Zschau
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Stephan Reichelt
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Enrico Zschau .

Editor information

Editors and Affiliations

  1. Industrial Technology Research Institute, Hsinchu, Taiwan

    Janglin Chen

  2. Nottingham Trent University, Nottingham, UK

    Wayne Cranton

  3. Veritas et Visus, Texas, USA

    Mark Fihn

Rights and permissions

Reprints and permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this entry

Cite this entry

Zschau, E., Reichelt, S. (2012). Head- and Eye-Tracking Solutions for Autostereoscopic and Holographic 3D Displays. In: Chen, J., Cranton, W., Fihn, M. (eds) Handbook of Visual Display Technology. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-79567-4_114

Download citation

Publish with us

Policies and ethics

Search

Navigation