Article

Towards the perfect infrastructure for usability testing on mobile devices

Authors:

Rudy Schusteritsch,

Carolyn Y. Wei,

Mark LaRosaAuthors Info & Claims

CHI EA '07: CHI '07 Extended Abstracts on Human Factors in Computing Systems

Pages 1839 - 1844

https://doi.org/10.1145/1240866.1240908

Published: 28 April 2007 Publication History

Get Access

Abstract

In this paper, we describe various setups that allow usability professionals to conduct effective user studies on mobile devices. We describe the factors relevant when building a solution for mobile device observation and the various designs we worked with in the Google user experience research environment as we iterated to meet changing study needs. We highlight several systems that can successfully be used in an industry environment, including a novel setup that is fully portable, can be used in a usability lab as well as in the field, accommodates a large variety of different mobile devices, and allows for live observation by product teams around the world.

References

[1]

Worldwide cellular connections pass 2.5 billion http://www.ovum.com/go/content/c,377,66726

Google Scholar

[2]

International Telecommunication Union. ICT Statistics Database. http://www.itu.int/ITU--D/icteye/Indicators/Indicators.aspx

Google Scholar

[3]

mobileways.de Remote S60. http://mobileways.de/M/1/3/0/

Google Scholar

[4]

Schusteritsch, R., Rao, S., and Rodden, K. Mobile Search with Text Messages. In CHI 2005 Extended Abstracts, ACM Press (2005), 1777--1780.

Digital Library

Google Scholar

[5]

Weiss, S. Handheld Usability. Wiley, Chichester, England, 2002.

Digital Library

Google Scholar

[6]

Noldus Mobile Device Camera http://www.noldus.com/site/doc200402054

Google Scholar

[7]

Roto, V., Oulasvirta, A., Haikarainen, T., Kuorelahti, J., Lehmuskallio, H., and Nyyssönen, T. Examining Mobile Phone Use in the Wild With QuasiExperimentation. HIIT, Helsinki, Finland, 2004. http://www.hiit.fi/publications/pub_files/hiit2004--1.pdf

Google Scholar

[8]

Oulasvirta, A. The fragmentation of attention in mobile interaction, and what to do with it. Interactions 12, 6 (2005). http://doi.acm.org/10.1145/1096554.1096555

Digital Library

Google Scholar

[9]

AVerMedia Surveillance Solutions. http://www.aver.com/security.html

Google Scholar

[10]

Shuttle Computer Inc. http://www.shuttle.com

Google Scholar

[11]

PY Software Active WebCam. http://www.pysoft.com

Google Scholar

Cited By

View all

Bernal-Cárdenas CCooper NHavranek MMoran KChaparro OPoshyvanyk DMarcus A(2023)Translating Video Recordings of Complex Mobile App UI Gestures into Replayable ScenariosIEEE Transactions on Software Engineering10.1109/TSE.2022.319227949:4(1782-1803)Online publication date: 1-Apr-2023
https://doi.org/10.1109/TSE.2022.3192279
Copche RSouza MVillanes IDurelli VEler MDias-Neto AEndo A(2021)Exploratory testing of apps with opportunity mapsProceedings of the XX Brazilian Symposium on Software Quality10.1145/3493244.3493248(1-10)Online publication date: 8-Nov-2021
https://dl.acm.org/doi/10.1145/3493244.3493248
Bernal-Cárdenas CCooper NMoran KChaparro OMarcus APoshyvanyk DRothermel GBae D(2020)Translating video recordings of mobile app usages into replayable scenariosProceedings of the ACM/IEEE 42nd International Conference on Software Engineering10.1145/3377811.3380328(309-321)Online publication date: 27-Jun-2020
https://dl.acm.org/doi/10.1145/3377811.3380328
Show More Cited By

Index Terms

Towards the perfect infrastructure for usability testing on mobile devices
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
  2. Interaction design
    1. Interaction design process and methods
      1. Interface design prototyping

Recommendations

Usability testing of mobile devices: a comparison of three approaches
INTERACT'05: Proceedings of the 2005 IFIP TC13 international conference on Human-Computer Interaction

This paper describes a study that compares the results of usability testing of mobile interfaces based on three different evaluation approaches: (i) using a computer-based mobile phone emulator inside the laboratory (ii) using a mobile phone inside the ...
Usability Guidelines for Mobile Devices: Length of Hyperlinks
14th IFIP TC 13 International Conference on Human-Computer Interaction --- INTERACT 2013 - Volume 8120

The use of mobile devices is increasing in recent years, and their characteristics are different from those of computers keyboard and screen size, interaction method, etc., so it is important to specifically study the usability of these devices. This ...
Usability risk level evaluation for physical user interface of mobile phone

The mobile phone has become an indispensable device in everyday life. However, many usability problems were generated by the multi-functionality of mobile phones. There was an important increase on the user interface (UI) design and usability. With the ...

Comments

Information & Contributors

Information

Published In

CHI EA '07: CHI '07 Extended Abstracts on Human Factors in Computing Systems

April 2007

1286 pages

ISBN:9781595936424

DOI:10.1145/1240866

Conference Chair:
Mary Beth Rosson
The Pennsylvania State University, USA
,
Program Chair:
David Gilmore
Intel, USA

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 April 2007

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

CHI07

Sponsor:

CHI07: CHI Conference on Human Factors in Computing Systems

April 28 - May 3, 2007

CA, San Jose, USA

Acceptance Rates

CHI EA '07 Paper Acceptance Rate 212 of 582 submissions, 36%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

23
Total Citations
View Citations
1,780
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)1

Reflects downloads up to 08 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Bernal-Cárdenas CCooper NHavranek MMoran KChaparro OPoshyvanyk DMarcus A(2023)Translating Video Recordings of Complex Mobile App UI Gestures into Replayable ScenariosIEEE Transactions on Software Engineering10.1109/TSE.2022.319227949:4(1782-1803)Online publication date: 1-Apr-2023
https://doi.org/10.1109/TSE.2022.3192279
Copche RSouza MVillanes IDurelli VEler MDias-Neto AEndo A(2021)Exploratory testing of apps with opportunity mapsProceedings of the XX Brazilian Symposium on Software Quality10.1145/3493244.3493248(1-10)Online publication date: 8-Nov-2021
https://dl.acm.org/doi/10.1145/3493244.3493248
Bernal-Cárdenas CCooper NMoran KChaparro OMarcus APoshyvanyk DRothermel GBae D(2020)Translating video recordings of mobile app usages into replayable scenariosProceedings of the ACM/IEEE 42nd International Conference on Software Engineering10.1145/3377811.3380328(309-321)Online publication date: 27-Jun-2020
https://dl.acm.org/doi/10.1145/3377811.3380328
Inal Y(2019)Heuristic-based user interface evaluation of the mobile centralized doctor appointment systemThe Electronic Library10.1108/EL-06-2018-0114Online publication date: 11-Jan-2019
https://doi.org/10.1108/EL-06-2018-0114
Sandvig J(2018)Mobilization Techniques Utilized by Leading Global E-Commerce SitesMobile Commerce10.4018/978-1-5225-2599-8.ch028(532-548)Online publication date: 2018
https://doi.org/10.4018/978-1-5225-2599-8.ch028
Sagar KSaha A(2017)A systematic review of software usability studiesInternational Journal of Information Technology10.1007/s41870-017-0048-1Online publication date: 11-Dec-2017
https://doi.org/10.1007/s41870-017-0048-1
Sandvig J(2016)Mobilization Techniques Utilized by Leading Global E-Commerce SitesInternational Journal of E-Business Research10.4018/IJEBR.201604010112:2(1-16)Online publication date: 1-Apr-2016
https://dl.acm.org/doi/10.4018/IJEBR.2016040101
Oh JLee SLee UKaye JDruin ALampe CMorris DHourcade J(2016)How to Report App Feedback?Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems10.1145/2851581.2892368(3173-3180)Online publication date: 7-May-2016
https://dl.acm.org/doi/10.1145/2851581.2892368
Schubert RWelch GDaher SRaij A(2016)HuSISIEEE Computer Graphics and Applications10.1109/MCG.2016.11436:6(26-36)Online publication date: 1-Nov-2016
https://dl.acm.org/doi/10.1109/MCG.2016.114
McMillan DMcGregor MBrown BBoring SRukzio EGellersen HHinckley K(2015)From in the wild to in vivoProceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services10.1145/2785830.2785883(494-503)Online publication date: 24-Aug-2015
https://dl.acm.org/doi/10.1145/2785830.2785883
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Usability testing of mobile devices: a comparison of three approaches

Usability Guidelines for Mobile Devices: Length of Hyperlinks

Usability risk level evaluation for physical user interface of mobile phone

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations