Skip to main content
SpringerLink
Log in

Exertion interfaces for computer videogames using smartphones as input controllers

  • Regular Paper
  • Published:
Multimedia Systems Aims and scope Submit manuscript

Abstract

As mobile phones become smarter and include a wider and more powerful array of sensory components, the opportunity to leverage those capabilities in contexts other than telephony grows. We have in particular identified those sensory capabilities as key components for modern user interfaces that can detect movement, actions and intentions to enrich human-computer interaction in a natural way. In this work, we present research around using smartphones as input controllers in the context of exertion videogames. We propose a conceptual framework that identifies the core elements of such interfaces, regardless of the underlying technological platforms, and provides a design pattern for their integration into existing videogames without having to change the game’s source code. We present a proof of concept implementation for the framework, with two smartphone input controllers, which using a soft button and accelerometer data, interface to a target-shooting exertion game played while exercising on a stationary bicycle. We present findings from a user experience evaluation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

References

  1. Vossen, D.: The nature and classification of games. Avante 10(1), 75 (2004)

    MathSciNet  Google Scholar 

  2. Wikipedia: Exergames. http://en.wikipedia.org/wiki/Exergaming Accessed October 2011

  3. Hoysniemi, J.: International survey on the Dance Dance Revolution game. Comput. Entertain. 4, 2, Article 8 (April 2006)

  4. Wikipedia: Wii Consol. http://en.wikipedia.org/wiki/Wii. Retrieved April 2011-04-25

  5. Schreiber, M., Wilamowitz-Moellendorff, M., Bruder, R.: New Interaction Concepts by Using the Wii Remote. In: Julie A. Jacko (ed.) Proceedings of the 13th International Conference on Human–Computer Interaction. Part II: Novel Interaction Methods and Techniques, pp. 261–270. Springer-Verlag, Berlin ( 2009)

  6. EyeToy Kinetics. http://en.wikipedia.org/wiki/EyeToy:_Kinetic. Retrieved April 2011

  7. Microsoft Kinect. http://en.wikipedia.org/wiki/Microsoft_Kinect. Retrieved April 2011

  8. “Toronto Hospital Using Kinect To Help Surgeons Call Up Images During Operations” http://www.seriousgamessource.com/item.php?story=33598

  9. Mueller, F., Agamanolis, S.: “Exertion interfaces”, Proc. ACM CHI extended abstracts on Human factors in computing systems, pp. 3957–3960. New York (2008)

  10. Berkovsky, S., Bhandari, D., Kimani, S., Colineau, N., Paris, C.:“Designing games to motivate physical activity”, In: Proc. ACM International Conference on Persuasive Technology. pp. 1–4. NY, USA (2009)

  11. MacLellan, G., Baillie, L., Granat M.: “The application of a physical activity and location measurement system to public health interventions to promote physical activity”. In: Proc. ACM International Conference on Pervasive Technologies Related to Assistive Environments, pp. 1–8. USA (2009)

  12. Stanley, K.G., Livingston, L., Bandurka, A., Kapiszka, R., Mandryk, R.L.: PiNiZoRo: a GPS-based exercise game for families. In Proceedings of the International Academic Conference on the Future of Game Design and Technology (Futureplay ‘10), pp. 243–246. ACM, USA (2010)

  13. Mokka, S., Väätänen, A., Heinilä, J., Välkkynen, P.: Fitness computer game with a bodily user interface. In Proceedings of the second international conference on Entertainment computing (ICEC ‘03). pp. 1–3. Carnegie Mellon University, USA (2003)

  14. Mueller, F., Gibbs, M.R., Vetere, F.: Taxonomy of exertion games. In: Proceedings of the 20th Australasian Conference on Computer-Human Interaction: Designing for Habitus and Habitat (OZCHI ‘08), pp. 263–266. ACM, New York (2008)

  15. Falaki, H., Mahajan, R., Kandula, S., Lymberopoulos, D., Govindan, R., Estrin, D.: Diversity in smartphone usage. In Proceedings of the 8th international conference on Mobile systems, applications, and services (MobiSys ‘10), pp. 179–194. ACM, New York (2010)

  16. Kimbler, K.: App store strategies for service providers. In proceeding of the 14th International Conference on Intelligence in Next Generation Networks (ICIN) (2010)

  17. Boring, S., Jurmu, M., Butz, A.: Scroll, tilt or move it: using mobile phones to continuously control pointers on large public displays. In Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7 (OZCHI ‘09), pp. 161–168. ACM, New York (2009)

  18. Scheible, J., Ojala, T., Coulton, P.: MobiToss: a novel gesture based interface for creating and sharing mobile multimedia art on large public displays. In: Proceeding of the 16th ACM international conference on Multimedia (MM ‘08), pp. 957–960. ACM, New York (2008)

  19. Kray, C., Nesbitt, D., Dawson, J., Rohs, M.: User-defined gestures for connecting mobile phones, public displays, and tabletops. In Proceedings of the 12th international conference on Human computer interaction with mobile devices and services (MobileHCI ‘10), pp. 239–248. ACM, New York (2010)

  20. Gilbertson, P., Coulton, P., Chehimi, F., Vajk, T.: Using “tilt” as an interface to control “no-button” 3-D mobile games. Comput. Entertain. 6, 3, Article 38 p. 13. (November 2008)

    Google Scholar 

  21. Kiili, K., Merilampi, S.: Developing engaging exergames with simple motion detection. In: Proceedings of the 14th International Academic MindTrek Conference: Envisioning Future Media Environments (MindTrek ‘10). pp. 103–110. ACM, New York (2010)

  22. Mottola, L., Murphy, A.L., Picco, G.P.: Pervasive games in a mote-enabled virtual world using tuple space middleware. In: Proceedings of 5th ACM SIGCOMM workshop on Network and system support for games (NetGames ‘06) (2006)

  23. Vajk, T., Bamford, W., Coulton, P., and Edwards, R.: Using a mobile phone as a “Wii-like” controller for playing games on a large public display, Int. J. Comput. Games Technol. 2008, 6. Article ID 539078 (2008)

  24. Likert, R.: A technique for the measurement of attitudes. Arch. Psychol. 140, 1–55 (1932)

    Google Scholar 

  25. “MEMS & Sensors for Smartphones”. Yole Development. Market report (2011)

  26. “Mobile Device User Interfaces. Touchscreens, Software, Accelerometers, Haptics, and Sensors”. ABI Research. Technology Market Report (2010)

  27. Dumas, J.: Usability Testing Methods: Subjective Measures: Part II—Measuring Attitudes and Opinions. October issue of Common Ground, The newsletter of the Usability Professionals’ Association, 4–8 (1998)

  28. Silva J.M., El Saddik A.: “An adaptive Game-Based exercising framework”. In: Proceeding of the International Conference on Virtual Environments, Human-Computer Interfaces and Measurement Systems (VECIMS2011). 1–6 (2011)

  29. Henrysson, A., Ollila, M., Billinghurst, M.: Mobile phone based AR scene assembly. In Proceedings of the 4th international conference on Mobile and ubiquitous multimedia (MUM ‘05) pp. 95–102. ACM, New York (2005)

Download references

Author information

Authors and Affiliations

  1. School of Information Technology and Engineering, University of Ottawa, Ottawa, Canada

    Juan M. Silva & Abdulmotaleb El Saddik

Authors
  1. Juan M. Silva
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Abdulmotaleb El Saddik
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Juan M. Silva.

Appendices

Appendix 1. Questionnaire

For each one of the following statements, please mark the option below that closest reflects your level of agreement with the statement.

1.

Fire with the button located in the smartphone was easy to do

Strongly disagree

Disagree

Neutral

Agree

Strongly agree

[ ]

[ ]

[ ]

[ ]

[ ]

2.

I did not perceive any delay when shooting with the fire button application

Strongly disagree

Disagree

Neutral

Agree

Strongly agree

[ ]

[ ]

[ ]

[ ]

[ ]

3.

I had difficulty hitting the targets because the fire button application was non-responsive

Strongly disagree

Disagree

Neutral

Agree

Strongly agree

[ ]

[ ]

[ ]

[ ]

[ ]

4.

Changing directions of the crosshair by tilting my body on top of the bike was easy

Strongly disagree

Disagree

Neutral

Agree

Strongly agree

[ ]

[ ]

[ ]

[ ]

[ ]

5.

I did not perceived delays when changing directions by tilting my body

Strongly disagree

Disagree

Neutral

Agree

Strongly agree

[ ]

[ ]

[ ]

[ ]

[ ]

6.

I had difficulty hitting the targets because the tilt application would not recognize my change in body position

Strongly disagree

Disagree

Neutral

Agree

Strongly agree

[ ]

[ ]

[ ]

[ ]

[ ]

7.

I felt comfortable interacting with the game by means of the smartphone controllers

Strongly disagree

Disagree

Neutral

Agree

Strongly agree

[ ]

[ ]

[ ]

[ ]

[ ]

8.

Playing the game using smartphone controllers felt natural and I was able to focus on playing the game

Strongly disagree

Disagree

Neutral

Agree

Strongly agree

[ ]

[ ]

[ ]

[ ]

[ ]

9.

If I wanted to use an exercise bike on a regular basis I would rather use this exergame with the smartphone controllers, instead of a traditional bike

Strongly disagree

Disagree

Neutral

Agree

Strongly agree

[ ]

[ ]

[ ]

[ ]

[ ]

10.

The whole experience with the exergame and smartphone controllers was awkward and I would generally avoid using it for my exercising

Strongly disagree

Disagree

Neutral

Agree

Strongly agree

[ ]

[ ]

[ ]

[ ]

[ ]

Appendix 2. Interview questions

  1. 1.

    How easy was it for you to fire and change directions using the smartphone application?

  2. 2.

    Is there anything that you think that may have prevented you from having a better performance on the game?

  3. 3.

    How fun was it to use the smartphone interfaces to interact with the game?

  4. 4.

    Would you consider using an application like this for doing your exercising?

  5. 5.

    Do you have any suggestions as how to improve or enhance the gaming experience?

Rights and permissions

Reprints and permissions

About this article

Cite this article

Silva, J.M., El Saddik, A. Exertion interfaces for computer videogames using smartphones as input controllers. Multimedia Systems 19, 289–302 (2013). https://doi.org/10.1007/s00530-012-0268-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00530-012-0268-y

Keywords

Search

Navigation