Skip to main content
SpringerLink
Log in

Visual registration for unprepared augmented reality environments

  • Original Article
  • Published:
Personal and Ubiquitous Computing Aims and scope Submit manuscript

Abstract

Despite the increasing sophistication of augmented reality (AR) tracking technology, tracking in unprepared environments still remains an enormous challenge according to a recent survey. Most current systems are based on a calculation of the optical flow between the current and previous frames to adjust the label position. Here we present two alternative algorithms based on geometrical image constraints. The first is based on epipolar geometry and provides a general description of the constraints on image flow between two static scenes. The second is based on the calculation of a homography relationship between the current frame and a stored representation of the scene. A homography can exactly describe the image motion when the scene is planar, or when the camera movement is a pure rotation, and provides a good approximation when these conditions are nearly met. We assess all three styles of algorithms with a number of criteria including robustness, speed and accuracy. We demonstrate two real-time AR systems here, which are based on the estimation of homography. One is an outdoor geographical labelling/overlaying system, and the other is an AR Pacman game application.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1.
Fig. 2a–c.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.
Fig. 7.
Fig. 8.
Fig. 9.
Fig. 10.
Fig. 11.
Fig. 12.
Fig. 13.
Fig. 14.
Fig. 15.
Fig. 16a,b.
Fig. 17a–e.

Similar content being viewed by others

References

  1. Azuma R et al. (2001) Recent advances in augmented reality. IEEE Comp Graph Appl 21:34–37

    Google Scholar 

  2. Neumann U, You S, Cho Y, Lee J and Park J (1999) Natural feature tracking for augmented reality. IEEE Trans Multi 1(1):53–64

    Google Scholar 

  3. Jiang B, You S and Neumann U (2000) Camera tracking for augmented reality media. In: Proceedings of the IEEE International Conference Multimedia Expo 2000, IEEE Computer Society Press, Los Alamitos, pp 1637–1640

  4. Park J, Jiang B and Neumann U (1999) Vision-based pose computation: robust and accurate augmented reality tracking. In: Proceedings of the IEEE International Workshop on Augmented Reality, San Francisco, CA, 19–20 October 1999

  5. Neumann U, You S, Cho Y, Lee J and Park J (1999) Augmented reality tracking in natural environments. In: Proceedings of the IEEE International Symposium on Mixed Realities, Tokyo, Japan, January 1999

  6. Billinghurst M, Kato H and Poupyrev I (2001) The magic book: an interface that moves seamlessly between reality and virtuality. IEEE Comp Graph Appl 21:6–8

    Google Scholar 

  7. Kato H, Billinghurst M (1999) Marker tracking and HMD calibration for a video based augmented reality conferencing system. In: Proceedings of the International Workshop on Augmented Reality (IWAR 1999) IEEE Computer Society Press, Los Alamitos, CA, pp 85–94

  8. Satoh K, Anabuki M, Yamamoto H and Tamura H (2001) A hybrid registration method for outdoor augmented reality. In: Proceedings of the 2nd IEEE and ACM International Symposium of Augmented Reality (ISAR'01), New York, NY, 29–30 October 2001

  9. Azuma R, Lee JW, Jiang B, Park J, You S and Neumann U (1999) Tracking in unprepared environments for augmented reality systems. IEEE Comp Graph 23:787–793

    Google Scholar 

  10. You S, Neumann U and Azuma R (1999) Hybrid inertial and vision tracking for augmented reality registration. In: Proceedings of IEEE Virtual Reality '99, Houston, TX, 13–17 March 1999

  11. Harris CJ, Stephens M (1988) A combined corner and edge detector. In: Proceedings of the 4th Alvey Vision Conference, Manchester, UK, 31 August– 2 September 1988

  12. Fischler MA, Bolles RC (1987) Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. In: Fischler MA, Firschein O (eds) Readings in computer vision: issues, problems, principles and paradigms, Morgan Kaufmann, Los Altos, CA

  13. Hartley R, Zisserman A (2000) Multiple view geometry in computer vision. Cambridge University Press, Cambridge, UK

  14. Simon G, Fitzgibbon AW and Zisserman A (2000) Markerless tracking using planar structures in the scene. In: Proceedings of the International Symposium on Augmented Reality (ISAR 2000), Munich, Germany, 5–6 October 2000

  15. Handeykey Corporation (2003). www.handykey.com. Cited September 2003

  16. You S, Neumann U and Azuma R (1999) Orientation tracking for outdoor augmented reality registration. IEEE Comp Graph Appl 19:36–42

    Google Scholar 

  17. Kumar KG, Cheok AD and Prince S (2002) Micro-accelerometer based hardware interfaces for wearable computer mixed reality applications. In: Proceedings of the 6th International Symposium on Wearable Computers (ISWC 2002), Seattle, WA, October 2002

Download references

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering, National University of Singapore, 117576, Singapore, Singapore

    Ke Xu, Simon J. D. Prince, Adrian David Cheok, Yan Qiu & Krishnamoorthy Ganesh Kumar

Authors
  1. Ke Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Simon J. D. Prince
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Adrian David Cheok
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yan Qiu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Krishnamoorthy Ganesh Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Adrian David Cheok.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Xu, K., Prince, S.J.D., Cheok, A.D. et al. Visual registration for unprepared augmented reality environments. Pers Ubiquit Comput 7, 287–298 (2003). https://doi.org/10.1007/s00779-003-0241-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00779-003-0241-z

Keywords

Search

Navigation