Abstract
The popularity of smartphones equipped with GPS and geomagnetic sensors has spurred mobile application developer interest in augmented reality (AR), which presents highly contexualized, spatially relevant information that enhances user knowledge of their immediate surroundings. AR applications typically mesh relevant information with user views of the physical world. Prior research has focused on interfaces built with custom hardware, but a smartphone equipped with GPS, a camera, and a geomagnetic sensor is an attractive alternative to traditional solutions. These devices can be programmed to present context-sensitive information to users without needing custom hardware.
This paper examines three key challenges facing AR developers on mobile devices and presents solutions applicable to modern mobile platforms, such as Apple’s iPhone and Google Android-based smartphones. First, we investigate methods of filtering raw sensor data and present an algorithm that eliminates sensor noise. Second, we explore the process of implementing a “magic lens” interaction metaphor by overlaying perspective-rendered graphics on the device’s camera using OpenGL and UIKit. Third, we provide an efficient technique for fetching and caching geographically tagged points of interest from a server.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Wagner, D., Pintaric, T., Ledermann, F., Schmalstieg, D.: Towards massively multi-user augmented reality on handheld devices. In: Gellersen, H.-W., Want, R., Schmidt, A. (eds.) PERVASIVE 2005. LNCS, vol. 3468, pp. 208–219. Springer, Heidelberg (2005)
Azuma, R.: A survey of augmented reality. Presence 6, 355–385 (1995)
Kirkley, S.: Creating next generation blended learning environments using mixed reality, video games and simulations. Tech. Trends 49(3), 42–53 (2004)
Huang, J.-Y., Tung, M.-C., Keh, H.-C., Wu, J.-J., Lee, K.-H., Tsai, C.-H.: A 3d campus on the internet — a networked mixed reality environment, pp. 282–298 (2009)
Schall, G., Mendez, E., Kruijff, E., Veas, E., Junghanns, S., Reitinger, B., Schmalstieg, D.: Handheld augmented reality for underground infrastructure visualization. Personal Ubiquitous Comput. 13(4), 281–291 (2009)
Wagner, D.: Multiple target detection and tracking with guaranteed framerates on mobile phones. In: ISMAR 2009 (2009)
Mohring, M., Lessig, C., Bimber, O.: Video see-through ar on consumer cell-phones. In: Proceedings of the 3rd IEEE/ACM International Symposium on Mixed and Augmented Reality, ISMAR 2004, pp. 252–253. IEEE Computer Society, Washington (2004)
Schmalstieg, D., Wagner, D.: Experiences with handheld augmented reality. In: Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2007, pp. 1–13. IEEE Computer Society, Washington (2007)
Zhou, Z., Karlekar, J., Hii, D., Schneider, M., Lu, W., Wittkopf, S.: Robust pose estimation for outdoor mixed reality with sensor fusion. In: Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III, UAHCI 2009, pp. 281–289. Springer, Heidelberg (2009)
Schmalstieg, D., Wagner, D.: Mobile phones as a platform for augmented reality. In: IEEE VR 2008 Workshop on Software Engineering and Architectures for Realtime Interactive Systems, pp. 43–44. Shaker Publishing, NY (2009), http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.144.6950
Bier, E.A., Stone, M.C., Pier, K., Buxton, W., Derose, T.D.: Toolglass and magic lenses: The see-through interface, pp. 73–80. ACM Press, New York (1993)
Looser, J.: Ar magic lenses: Addressing the challenge of focus and context in augmented reality. Master’s thesis, University of Canterbury (2007)
Perritaz, D., Salzmann, C., Gillet, D., Naef, O., Bapst, J., Barras, F., Mugellini, E., Abou Khaled, O.: 6th sense— toward a generic framework for end-to-end adaptive wearable augmented reality, pp. 280–310 (2009)
Savitzky, A., Golay, M.J.E.: Smoothing and differentiation of data by simplified least squares procedures. Analytical Chemistry 36(8), 1627–1639 (1964), http://dx.doi.org/10.1021/ac60214a047
Rabiner, L.R.: Theory and Application of Digital Signal Processing. Prentice-Hall, Inc., Englewood Cliffs (1975)
Takacs, G., Chandrasekhar, V., Gelfand, N., Xiong, Y., Chen, W.-C., Bismpigiannis, T., Grzeszczuk, R., Pulli, K., Girod, B.: Outdoors augmented reality on mobile phone using loxel-based visual feature organization. In: Proceeding of the 1st ACM International Conference on Multimedia Information Retrieval, MIR 2008, pp. 427–434. ACM, New York (2008)
Harada, T., Mori, T., Sato, T.: Development of a tiny orientation estimation device to operate under motion and magnetic disturbance. Int. J. Rob. Res. 26(6), 547–559 (2007)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Gotow, J.B., Zienkiewicz, K., White, J., Schmidt, D.C. (2010). Addressing Challenges with Augmented Reality Applications on Smartphones. In: Cai, Y., Magedanz, T., Li, M., Xia, J., Giannelli, C. (eds) Mobile Wireless Middleware, Operating Systems, and Applications. MOBILWARE 2010. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 48. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17758-3_10
Download citation
DOI: https://doi.org/10.1007/978-3-642-17758-3_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-17757-6
Online ISBN: 978-3-642-17758-3
eBook Packages: Computer ScienceComputer Science (R0)