research-article

Automating UI tests for mobile applications with formal gesture descriptions

Authors:

Volker GruhnAuthors Info & Claims

MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services

Pages 213 - 222

https://doi.org/10.1145/2628363.2628391

Published: 23 September 2014 Publication History

Abstract

Touch- and gesture-based interfaces are common in applications for mobile devices. By evolving into mass market products, smartphones and tablets created an increased need for specialized software engineering methods. To ensure high quality applications, constant and efficient testing is crucial in software development. However, testing mobile applications is still cumbersome, time-consuming and error-prone. One reason is the devices' focus on touch-based interaction - gestures cannot be easily incorporated into automated application tests. We present an extension to the popular Calabash testing framework solving this problem by allowing to describe gestures with a formal language in tests scripts.

References

[1]

Amalfitano, D., Fasolino, A. R., Tramontana, P., De Carmine, S., and Memon, A. M. Using GUI Ripping for Automated Testing of Android Applications. In Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering, ASE 2012, ACM (New York, NY, USA, 2012), 258--261.

Digital Library

[2]

Android Developer Network. Android GestureLibraries. http://developer.android.com/reference/android/gesture/GestureLibraries.html {accessed 2014-02-15}.

[3]

Anthony, L., Vatavu, R.-D., and Wobbrock, J. O. Understanding the Consistency of Users' Pen and Finger Stroke Gesture Articulation. In Proceedings of Graphics Interface 2013, GI '13, Canadian Information Processing Society (Toronto, Ont., Canada, Canada, 2013), 87--94.

Digital Library

[4]

Anthony, L., and Wobbrock, J. O. A Lightweight Multistroke Recognizer for User Interface Prototypes. In Proceedings of Graphics Interface 2010, GI '10, Canadian Information Processing Society (Toronto, Ont., Canada, Canada, 2010), 245--252.

Digital Library

[5]

Bo, J., Xiang, L., and Xiaopeng, G. MobileTest: A Tool Supporting Automatic Black Box Test for Software on Smart Mobile Devices. In AST '07: Proceedings of the Second International Workshop on Automation of Software Test, IEEE Computer Society (Washington, DC, USA, 2007), 8.

Digital Library

[6]

Choi, W., Necula, G., and Sen, K. Guided GUI Testing of Android Apps with Minimal Restart and Approximate Learning. In Proceedings of the 2013 ACM SIGPLAN International Conference on Object Oriented Programming Systems Languages & Applications, OOPSLA '13, ACM (New York, NY, USA, 2013), 623--640.

Digital Library

[7]

Echtler, F., and Butz, A. GISpL: Gestures Made Easy. In Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction, TEI '12, 233--240.

Digital Library

[8]

Galbally, J., Plamondon, R., Fierrez, J., and Ortega-Garcia, J. Synthetic On-Line Signature Generation. Part I: Methodology and Algorithms. Pattern Recognition 45, 7 (2012), 2610--2621.

Digital Library

[9]

Haller, K. Mobile Testing. SIGSOFT Softw. Eng. Notes 38, 6 (Nov. 2013), 1--8.

Digital Library

[10]

Hou, Y., Chen, R., and Du, Z. Automated GUI Testing for J2ME Software Based on FSM. In SCALCOM-EMBEDDEDCOM '09: Proceedings of the 2009 International Conference on Scalable Computing and Communications; Eighth International Conference on Embedded Computing, IEEE Computer Society (Washington, DC, USA, 2009), 341--346.

Digital Library

[11]

Hu, C., and Neamtiu, I. Automating GUI Testing for Android Applications. In Proceedings of the 6th International Workshop on Automation of Software Test, AST '11, ACM (New York, NY, USA, 2011), 77--83.

Digital Library

[12]

Kaasila, J., Ferreira, D., Kostakos, V., and Ojala, T. Testdroid: Automated Remote UI Testing on Android. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia, MUM '12, ACM (New York, NY, USA, 2012), 28:1--28:4.

Digital Library

[13]

Kammer, D., Henkens, D., Henzen, C., and Groh, R. Gesture Formalization for Multitouch. Software: Practice and Experience (2013).

[14]

Kammer, D., Wojdziak, J., Keck, M., Groh, R., and Taranko, S. Towards a Formalization of Multi-Touch Gestures. In Proceedings of ITS'10, 49.

Digital Library

[15]

Khandkar, S. H., Sohan, S. M., Sillito, J., and Maurer, F. Tool Support for Testing Complex Multi-Touch Gestures. In ACM International Conference on Interactive Tabletops and Surfaces, ITS '10, ACM (New York, NY, USA, 2010), 59--68.

Digital Library

[16]

Kin, K., Hartmann, B., DeRose, T., and Agrawala, M. Proton++: A Customizable Declarative Multitouch Framework. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology, UIST '12, 477--486.

Digital Library

[17]

Kin, K., Hartmann, B., DeRose, T., and Agrawala, M. Proton: Multitouch Gestures As Regular Expressions. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI '12, 2885--2894.

Digital Library

[18]

She, S., Sivapalan, S., and Warren, I. Hermes: A Tool for Testing Mobile Device Applications. In ASWEC '09: Proceedings of the 2009 Australian Software Engineering Conference, IEEE Computer Society (Washington, DC, USA, 2009), 121--130.

Digital Library

[19]

Tassey, G. The Economic Impacts of Inadequate Infrastructure for Software Testing. Tech. rep., National Institute of Standards and Technology, 2002.

[20]

Vatavu, R.-D., Anthony, L., and Wobbrock, J. O. Gestures As Point Clouds: A $P Recognizer for User Interface Prototypes. In Proceedings of the 14th ACM International Conference on Multimodal Interaction, ICMI '12, ACM (New York, NY, USA, 2012), 273--280.

Digital Library

[21]

Wobbrock, J. O., Wilson, A. D., and Li, Y. Gestures Without Libraries, Toolkits or Training: A $1 Recognizer for User Interface Prototypes. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology, UIST '07, ACM (New York, NY, USA, 2007), 159--168.

Digital Library

[22]

Wynne, M., and Hellesoy, A. The Cucumber Book: Behaviour-Driven Development for Testers and Developers. Pragmatic Bookshelf, 2012.

Digital Library

Cited By

Bachert MHesenius M(2024)Towards a Framework for Evaluating Synthetic Surface GesturesCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3661327(22-30)Online publication date: 24-Jun-2024
https://dl.acm.org/doi/10.1145/3660515.3661327
Severin BWerger OHesenius M(2023)Not What I was Trained for – Out-of-Distribution-Tests for Interactive AIsEngineering Interactive Computer Systems. EICS 2023 International Workshops and Doctoral Consortium10.1007/978-3-031-59235-5_12(127-147)Online publication date: 27-Jun-2023
https://dl.acm.org/doi/10.1007/978-3-031-59235-5_12
Börsting IHeikamp MHesenius MKoop WGruhn V(2022)Software Engineering for Augmented Reality - A Research AgendaProceedings of the ACM on Human-Computer Interaction10.1145/35322056:EICS(1-34)Online publication date: 17-Jun-2022
https://dl.acm.org/doi/10.1145/3532205
Show More Cited By

Index Terms

Automating UI tests for mobile applications with formal gesture descriptions
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Investigation on test effort estimation of mobile applications: Systematic literature review and survey
Abstract Context
In the last few years, the exigency of mobile devices has proliferated to prodigious heights. The process of developing the mobile software/application proceeds amidst testing phase to verify the correctness of the ...
Automating PBX System Testing

Private communication networks provide their customers with supplementary services that often have relations or dependencies to old, already-tested services. In the past these services were tested manually on terminal devices. This kind of testing is ...
Towards automating testing of communicational B3G applications
Mobility '06: Proceedings of the 3rd international conference on Mobile technology, applications & systems

Mobile phones and laptop users are enjoying the fast and seamless Internet access provided by 3rd generation (3G) mobile technology, which allows the use of applications such as email, WWW, office tools, messaging, and communicating on the move. In the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services

September 2014

664 pages

ISBN:9781450330046

DOI:10.1145/2628363

Conference Chairs:
Aaron Quigley
University of St. Andrews, UK
,
Sara Diamond
OCAD University, Canada
,
Program Chairs:
Pourang Irani
University of Manitoba, Canada
,
Sriram Subramanian
University of Bristol, UK

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 September 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MobileHCI '14

Sponsor:

SIGCHI

MobileHCI '14: 16th International Conference on Human-Computer Interaction with Mobile Devices and Services

September 23 - 26, 2014

ON, Toronto, Canada

Acceptance Rates

MobileHCI '14 Paper Acceptance Rate 35 of 124 submissions, 28%;

Overall Acceptance Rate 202 of 906 submissions, 22%

Upcoming Conference

MobileHCI '25

Sponsor:
sigchi

27th International Conference on Mobile Human-Computer Interaction

September 22 - 26, 2025

Sharm El-Sheikh , Egypt

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
641
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)2

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Bachert MHesenius M(2024)Towards a Framework for Evaluating Synthetic Surface GesturesCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3661327(22-30)Online publication date: 24-Jun-2024
https://dl.acm.org/doi/10.1145/3660515.3661327
Severin BWerger OHesenius M(2023)Not What I was Trained for – Out-of-Distribution-Tests for Interactive AIsEngineering Interactive Computer Systems. EICS 2023 International Workshops and Doctoral Consortium10.1007/978-3-031-59235-5_12(127-147)Online publication date: 27-Jun-2023
https://dl.acm.org/doi/10.1007/978-3-031-59235-5_12
Börsting IHeikamp MHesenius MKoop WGruhn V(2022)Software Engineering for Augmented Reality - A Research AgendaProceedings of the ACM on Human-Computer Interaction10.1145/35322056:EICS(1-34)Online publication date: 17-Jun-2022
https://dl.acm.org/doi/10.1145/3532205
Li QZeng HPeng ZMa X(2021)Understanding Players’ Interaction Patterns with Mobile Game App UI via VisualizationsProceedings of the Ninth International Symposium of Chinese CHI10.1145/3490355.3490357(9-21)Online publication date: 16-Oct-2021
https://dl.acm.org/doi/10.1145/3490355.3490357
Hesenius MGruhn V(2019)GestureCardsProceedings of the ACM on Human-Computer Interaction10.1145/33311643:EICS(1-35)Online publication date: 13-Jun-2019
https://dl.acm.org/doi/10.1145/3331164
Tramontana PAmalfitano DAmatucci NFasolino A(2019)Automated functional testing of mobile applicationsSoftware Quality Journal10.1007/s11219-018-9418-627:1(149-201)Online publication date: 1-Mar-2019
https://dl.acm.org/doi/10.1007/s11219-018-9418-6
Rubinov KBaresi L(2018)What Are We Missing When Testing Our Android Apps?Computer10.1109/MC.2018.214102451:4(60-68)Online publication date: Apr-2018
https://doi.org/10.1109/MC.2018.2141024
Meftah LGomez MRouvoy RChrisment IRosu GDi Penta MNguyen T(2017)ANDROFLEET: testing WiFi peer-to-peer mobile apps in the largeProceedings of the 32nd IEEE/ACM International Conference on Automated Software Engineering10.5555/3155562.3155686(961-966)Online publication date: 30-Oct-2017
https://dl.acm.org/doi/10.5555/3155562.3155686
Hesenius MSternal SGruhn VCampos JNunes N(2017)A multi-touch-recognizer for gesturecardsProceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3102113.3102132(75-80)Online publication date: 26-Jun-2017
https://dl.acm.org/doi/10.1145/3102113.3102132
Parra OEspana SPanach J(2017)Extending and validating gestUI using technical action research2017 11th International Conference on Research Challenges in Information Science (RCIS)10.1109/RCIS.2017.7956558(341-352)Online publication date: May-2017
https://doi.org/10.1109/RCIS.2017.7956558
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten