Abstract
This paper presents a novel pointing device that measures pointing location changes using a Nintendo Wiimote and a FireWire camera. The goal is allowing users to control the cursor on a computer screen through waving the device in mid air. The core of the proposed technique is a real-time image alignment module that estimates the pointing location of the device based on visual input. Image alignments are performed using a modified inverse compositional algorithm, which runs at 92 fps on GPUs. To improve the robustness of image alignment results, we propose using gyroscopic measures to provide a rough alignment. The experiment results show that the proposed hybrid pointing device delivers more precise controls than the ones using gyroscopic or visual information only.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Asif Manzoor, M., Farooq, M., Ali Shah, S., Ali Shah, A., Ullah, S., Bais, A., Hassan, G., Yahya, K.: Real time image registration based on feature tracking using a digital signal processor. In: Proceedings of Int. Conf. on Emerging Technologies, pp. 155–158 (October 2010)
Baker, S., Matthews, I.: Equivalence and efficiency of image alignment algorithms. In: Proceedings of the 2001 IEEE Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 1090–1097 (December 2001)
Baker, S., Matthews, I.: Lucas-kanade 20 years on: A unifying framework. Int. J. Comput. Vision 56, 221–255 (2004)
Baudisch, P., Sinclair, M., Wilson, A.: Soap: a pointing device that works in mid-air. In: Proceedings of ACM Sym. on User Interface Software and Technology, pp. 43–46. ACM, New York (2006)
Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (surf). Comput. Vis. Image Underst. 110, 346–359 (2008)
Brooks, R., Arbel, T.: Generalizing inverse compositional image alignment. In: Proceedings of Int. Conf. on Pattern Recognition, pp. 1200–1203. IEEE Computer Society, Washington, DC (2006)
Brown, M., Lowe, D.G.: Recognising panoramas. In: Proceedings of Int. Conf. on Computer Vision, p. 1218. IEEE Computer Society, Washington, DC (2003)
Brown, M., Szeliski, R., Winder, S.: Multi-image matching using multi-scale oriented patches. In: Proceedings of IEEE Conf. on Computer Vision and Pattern Recognition, pp. 510–517. IEEE Computer Society, Washington, DC (2005)
Lovegrove, S., Davison, A.J.: Real-Time Spherical Mosaicing Using Whole Image Alignment. In: Daniilidis, K. (ed.) ECCV 2010, Part III. LNCS, vol. 6313, pp. 73–86. Springer, Heidelberg (2010)
Lowe, D.G.: Object recognition from local scale-invariant features. In: Proceedings of Int. Conf. on Computer Vision, pp. 1150–1157. IEEE Computer Society, Washington, DC (1999)
Martinez, C., Mejias, L., Campoy, P.: A multi-resolution image alignment technique based on direct methods for pose estimation of aerial vehicles. In: Digital Image Computing: Techniques and Applications. Sheraton Noosa Resort & Spa, Sunshine Coast, QLD (2011)
Szeliski, R.: Image Alignment and Stitching: A Tutorial. Foundations and Trends in Computer Graphics and Vision Series. Now Publishers (2006)
Szeliski, R., Shum, H.Y.: Creating full view panoramic image mosaics and environment maps. In: Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1997, pp. 251–258. ACM Press/Addison-Wesley Publishing Co., New York (1997)
Wilson, A., Shafer, S.: Xwand: Ui for intelligent spaces. In: Proceedings of SIGCHI Conf. on Human Factors in Computing Systems, pp. 545–552. ACM, New York (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zheng, J., Gong, M. (2012). Real-Time Image Alignment for a Gyro-visual Hybrid Pointing Device. In: Campilho, A., Kamel, M. (eds) Image Analysis and Recognition. ICIAR 2012. Lecture Notes in Computer Science, vol 7324. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-31295-3_21
Download citation
DOI: https://doi.org/10.1007/978-3-642-31295-3_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-31294-6
Online ISBN: 978-3-642-31295-3
eBook Packages: Computer ScienceComputer Science (R0)