research-article

Evaluating User Experience under Location Quality Variations: A Framework for in-the-wild Studies

Authors:

Champika Ranasinghe,

Max Pfeiffer,

Sven Heitmann,

Christian KrayAuthors Info & Claims

MobileHCI '19: Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services

Article No.: 45, Pages 1 - 6

https://doi.org/10.1145/3338286.3344392

Published: 01 October 2019 Publication History

Get Access

Abstract

While lab-based approaches to evaluation of location-based services (LBSs) allow faster, cost-effective and less complicated evaluation of many aspects, they are limited in evaluating certain aspects, especially the ones related to usability and user experience (UX). Variations in the location information quality can negatively affect location-based UX. Lab-based evaluations are limited in factoring users' actual context, which includes location quality variations into the evaluation process. Therefore, to evaluate actual location-based UX, we need to evaluate LBSs in-the-wild with users under variations in the quality of location information. Currently, there is a lack of standard tools, methods, and frameworks for this purpose. Motivated by this factor, in this paper, we describe the Location Uncertainty Injection Framework (LUIF) for evaluating mobile LBSs in-the-wild with users under location quality variations. We also present the results of a study conducted to gain initial feedback on the potential use cases of the framework.

References

[1]

Carla Bezerra, Rossana Andrade, Rainara Maia Santos, Mourad Abed, Káthia Marçal de Oliveira, José Maria Monteiro, Ismayle Santos, and Houcine Ezzedine. 2014. Challenges for usability testing in ubiquitous systems. In Proceedings of the 26th Conference on l'Interaction Homme-Machine. ACM, 183--188.

Digital Library

Google Scholar

[2]

Sunny Consolvo and Miriam Walker. 2003. Using the experience sampling method to evaluate ubicomp applications. IEEE Pervasive Computing 2, 2 (2003), 24--31.

Digital Library

Google Scholar

[3]

John F Kelley. 1984. An iterative design methodology for user-friendly natural language office information applications. ACM Transactions on Information Systems (TOIS) 2, 1 (1984), 26--41.

Digital Library

Google Scholar

[4]

Wajeh Addin Mohsen, Chuanqi Tao, Qian-mu Li, and Jerry Gao. 2017. A Viewpoint on Location-Based Mobile Apps Testing. In IEEE International Conference on Big Data Computing Service and Applications. IEEE, 305--312.

Crossref

Google Scholar

[5]

Steve Neely, Graeme Stevenson, Christian Kray, Ingrid Mulder, Kay Connelly, and Katie A Siek. 2008. Evaluating pervasive and ubiquitous systems. IEEE Pervasive Computing 7, 3 (2008).

Google Scholar

[6]

Champika Ranasinghe, Sven Heitmann, Albert Hamzin, Max Pfeiffer, and Christian Kray. 2018a. Pedestrian navigation and GPS deteriorations: user behavior and adaptation strategies. In Proceedings of the 30th Australian Conference on Computer-Human Interaction. ACM, 266--277.

Digital Library

Google Scholar

[7]

Champika Ranasinghe and Christian Kray. 2018. Location Information Quality: A Review. Sensors 18, 11 (2018), 3999.

Crossref

Google Scholar

[8]

Champika Ranasinghe, Jakub Krukar, and Christian Kray. 2018b. Visualizing Location Uncertainty on Mobile Devices: Cross-Cultural Differences in Perceptions and Preferences. PACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 1 (2018), 30.

Digital Library

Google Scholar

[9]

Champika Ranasinghe, Nicholas Schiestel, and Christian Kray. 2019. Visualising Location Uncertainty to Support Navigation under Degraded GPS Signals:a Comparison Study. In 21st International Conference on Human-Computer Interaction with Mobile Devices and Services - MobileHCI 2019. ACM, 2019.

Google Scholar

[10]

Anand Ranganathan, Jalal Al-Muhtadi, Shiva Chetan, Roy Campbell, and M Dennis Mickunas. 2004. Middlewhere: a middleware for location awareness in ubiquitous computing applications. In Proceedings of the 5th ACM/IFIP/USENIX international conference on Middleware. Springer-Verlag New York, Inc., 397--416.

Digital Library

Google Scholar

[11]

Anna Ståhlbröst, Annika Sällström, and Marita Holst. 2009. User evaluations in the wild: experiences from mobile living labs. In Mobile Living Labs 09: Workshop at MobileHCI09 15/09/2009-18/09/2009. 7--10.

Google Scholar

[12]

Kaisa Väänänen-Vainio-Mattila, Thomas Olsson, and Jonna Häkkilä. 2015. Towards deeper understanding of user experience with ubiquitous computing systems: systematic literature review and design framework. In IFIP Conference on Human-Computer Interaction. Springer, 384--401.

Digital Library

Google Scholar

Cited By

View all

Saini AVan Den Hoven EMueller F(2024)PneuExtensio: Designing Pneumatic-based Bodily Extensions to Facilitate Embodiment across Everyday Life ExperiencesCompanion Publication of the 2024 ACM Designing Interactive Systems Conference10.1145/3656156.3665136(19-23)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3656156.3665136
Saini APatibanda ROverdevest NVan Den Hoven EMueller FCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)PneuMa: Designing Pneumatic Bodily Extensions for Supporting Movement in Everyday LifeProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633349(1-16)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633349

Index Terms

Evaluating User Experience under Location Quality Variations: A Framework for in-the-wild Studies
1. Human-centered computing

Recommendations

Modeling location-based social network data with area attraction and neighborhood competition

Modeling user check-in behavior helps us gain useful insights about venues as well as the users visiting them. These insights are important in urban planning and recommender system applications. Since check-in behavior is the result of multiple factors, ...
Exploring playfulness in user experience of personal mobile products
OZCHI '10: Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction

User experience (UX) has been under extensive research in recent years. However, current UX models do not address in detail what the users' experiences are when they are interacting with products. In our research, this question is explored by evaluating ...
The experience of interactive storytelling: comparing “fahrenheit” with “façade”
ICEC'11: Proceedings of the 10th international conference on Entertainment Computing

At the intersection of multimedia, artificial intelligence, and gaming technology, new visions of future entertainment media arise that approximate the “Holodeck” ® idea of interactive storytelling. We report exploratory experiments on the user ...

Comments

Information & Contributors

Information

Published In

MobileHCI '19: Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services

October 2019

646 pages

ISBN:9781450368254

DOI:10.1145/3338286

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2019

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

MobileHCI '19

Sponsor:

SIGCHI

MobileHCI '19: 21st International Conference on Human-Computer Interaction with Mobile Devices and Services

October 1 - 4, 2019

Taipei, Taiwan

Acceptance Rates

Overall Acceptance Rate 202 of 906 submissions, 22%

Upcoming Conference

MobileHCI '25

Sponsor:
sigchi

27th International Conference on Mobile Human-Computer Interaction

September 22 - 26, 2025

Sharm El-Sheikh , Egypt

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
176
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Saini AVan Den Hoven EMueller F(2024)PneuExtensio: Designing Pneumatic-based Bodily Extensions to Facilitate Embodiment across Everyday Life ExperiencesCompanion Publication of the 2024 ACM Designing Interactive Systems Conference10.1145/3656156.3665136(19-23)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3656156.3665136
Saini APatibanda ROverdevest NVan Den Hoven EMueller FCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)PneuMa: Designing Pneumatic Bodily Extensions for Supporting Movement in Everyday LifeProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633349(1-16)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633349

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Modeling location-based social network data with area attraction and neighborhood competition

Exploring playfulness in user experience of personal mobile products

The experience of interactive storytelling: comparing “fahrenheit” with “façade”

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations