Skip to main content
Springer Nature Link
Log in

Tracking for augmented reality on wearable computers

  • Published:
Virtual Reality Aims and scope Submit manuscript

Abstract

Wearable computers afford a degree of mobility that makes tracking for augmented reality difficult. This paper presents a novel object-centric tracking architecture for presenting augmented reality media in spatial relationships to objects, regardless of the objects' positions or motions in the world. The advance this system provides is the ability to sense and integrate new features into its tracking database, thereby extending the tracking region automatically. A “lazy evaluation” of the structure from motion problem uses images obtained from a single calibrated moving camera and applies recursive filtering to identify and estimate the 3D positions of new features. We evaluate the performance of two filters; a classic Extended Kalman Filter (EKF) and a filter based on a Recursive-Average of Covariances (RAC). Some implementation issues and results are discussed in conclusion.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Starner T, Mann S, Rhodes B, Levine J, Healey J, Kirsh D, Picard R, Pentland A. Augmented reality through wearable computing. Presence: Teleoperator and Virtual Environments 1997; 6:386–398

    Google Scholar 

  2. Neumann U, Majoros A. Cognitive, performance, and systems issues for augmented reality applications in manufacturing and maintenance. Proceedings of IEEE VRAIS 1998; 4–11

  3. Sutherland I. A head-mounted three-dimensional display. Fall Joint Computer Conference 1968; 757–775

  4. Foxlin E. Inertial head-tracker sensor fusion by a complementary separate-bias Kalman filter. Proceedings of VRAIS 1996; 184–194

  5. Ghazisadedy M, Adamczyk D, Sandlin DJ, Kenyon RV, DeFanti TA. Ultrasonic calibration of a magnetic tracker in a virtual reality space, Proceedings of VRAIS 1995; 179–188

  6. Kim D, Richards SW, Caudell T P. An optical tracker for augmented reality and wearable computers. Proceedings of VRAIS 1997; 146–150

  7. Meyer K, Applewhite HL, Biocca FA. A survey of position trackers. Presence: Teleoperator and Virtual Environments 1992; 1:173–200

    Google Scholar 

  8. Sowizral H, Barnes J. Tracking position and orientation in a large volume. Proceedings of IEEE VRAIS 1993; 132–139

  9. State A, Hirota G, Chen DT, Garrett B, Livingston M. Superior augmented reality registration by integrating landmark tracking and magnetic tracking. Proceedings of Siggraph96. Computer Graphics 1996; 429–438

  10. Ward M, Azuma R, Bennett R, Gottschalk S, Fuchs H. A demonstrated optical tracker with scalable work area for head-mounted display systems. Proceedings of the Symposium on Interactive 3D Graphics 1992; 43–52

  11. Weich G, Bishop G. SCMT: Incremental tracking with incomplete information. Proceedings of Siggraph '97, Computer Graphics. 1997; 333–344

  12. Klinker G, Ahlers K, Breem D, Chevalier P, Crampton C, Greer D, Koller D, Kramer A, Rose E, Tuceryan M, Whitaker R. Confluence of computer vision and interactive graphics for augmented reality. Presence: Teleoperator and Virtual Environments 1997; 6:433–451

    Google Scholar 

  13. Feiner S, Webster A, Krueger T III, MacIntyre M, Keller E. Architectural anatomy. Presence: Teleoperator and Virtual Environments 1995; 4:318–325

    Google Scholar 

  14. Feiner S, Macintyre B, Seligmann D. Knowledge-based augmented reality. Communications of the ACM 1993; 36(7):52–62

    Google Scholar 

  15. Wells W, Kikinis R, Altobelli D, Ettinger G, Lorensen W, Cline H, Gleason PL, Jolesz F. Video registration using fiducials for surgical enhanced reality. Engineering in Medicine and Biology, IEEE 1993

  16. Bajura M, Fuchs H, Ohbuchi R. Merging virtual reality with the real world: seeing ultrasound imagery within the patient. Computer Graphics, Proceedings of Siggraph 1992; 203–210

  17. Caudell TP, Mizell DM. Augmented reality: an application of heads-up display technology to manual manufacturing processes. Proceedings of the Hawaii international Conference on Systems Sciences 1992; 659–669

  18. Natonek E, Zimmerman Th, Fluckiger L. Model based vision as feedback for virtual reality robotics environments. Proceedings of VRAIS 1995; 110–117

  19. Neumann U, Cho Y. A self-tracking augmented reality system. Proceedings of ACM Virtual Reality Software and Technology 1996; 109–115

  20. Rekimoto J. NaviCam: a magnifying glass approach to augmented reality. Presence: Teleoperator and Virtual Environments 1997; 6:399–412

    Google Scholar 

  21. Sharma R, Molineros J. Computer vision-based augmented reality for guiding manual assembly. Presence: Teleoperator and Virtual Environments 1997; 6:292–317

    Google Scholar 

  22. Uenohara M, Kanade T. Vision-based object registration for real-time image overlay. Proceedings of Computer Vision, Virtual Reality, and Robotics in Medicine 1995; 13–22

  23. Kutulakos K, Vallino J. Affine object representations for calibration-free augmented reality. Proceedings of VRAIS 1996; 25–36

  24. Mellor JP. Enhanced reality visualization in a surgical environment. Master's thesis, Department of Electrical Engineering, MIT 1995

  25. Neumann U, Park J. Extendable object-centric tracking for augmented reality. Proceedings of IEEE VRAIS 1998; 148–155

  26. Huang TS, Netravali AN. Motion and structure from feature correspondences: a review. Proceedings of the IEEE 1994; 82:252–268

    Google Scholar 

  27. Fischler MA, Bolles RC. Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Graphics and image Processing 1981, 24:381–395

    Google Scholar 

  28. Ganapathy S. Real-time motion tracking using a single camera. AT&T Bell Labs Tech Report November 1984; 11358-841105-21-TM

  29. Horaud R, Conio B, Leboulleux O. An analytic solution for the perspective 4-point problem. Computer Vision. Graphics, and Image Processing 1989; 47:33–43

    Google Scholar 

  30. Azarbayejani A, Pentland A. Recursive estimation of motion, structure, and focal length. IEEE Transactions on Pattern Analysis and Machine Intelligence 1995; 17(6)

  31. Broida TJ, Chandrashekhar S, Chellappa R. Recursive estimation from a monocular image sequence. IEEE Transactions on Aerospace and Electronic Systems 1990; 26:639–655

    Google Scholar 

  32. Soatto S, Persona P. Recursive 3D visual motion estimation using subspace constraints. California Institute of Technology, Technical report CIT-CDS 94005. February 1994

  33. lu S-L, Rogovin KW. Registering perspective contours with 3D objects without correspondence, using orthogonal polynomials. Proceedings of VRAIS 1996; 37–44

  34. Eagle Eye, Kinetic Sciences. http://www.kinetic.bc.ca/eagle_eye.html

  35. Tremeau A, Borel N. A region growing and merging algorithm to color segmentation. Pattem Recognition 1997; 30:1191–1203

    Google Scholar 

  36. Mendel JM. Lessons in estimation theory for signal processing, communications, and control. Englewood Cliffs, NJ: Prentice-Hall 1995

Download references

Author information

Authors and Affiliations

  1. Computer Science Department, Integrated Media Systems Center, University of Southern California, 00000, CA, USA

    U. Neumann & J. Park

Authors
  1. U. Neumann
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. J. Park
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to U. Neumann.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Neumann, U., Park, J. Tracking for augmented reality on wearable computers. Virtual Reality 3, 167–175 (1998). https://doi.org/10.1007/BF01408559

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01408559

Keywords