Skip to main content
SpringerLink
Log in
Book cover

International Conference on Human-Computer Interaction

HCII 2021: HCI International 2021 - Posters pp 49–54Cite as

App Analysis with a Larger Than Usual Number of Usability Experts

  • Conference paper
  • First Online:

  • 2192 Accesses

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1419))

Abstract

Mobile app development and usage is booming in India; however, it is still in the early stages of adoption especially among the rural farming community. This research attempted to identify the usability problems of a selected agricultural mobile app, NaPanta, developed for Indian farmers. A twofold method was used to understand the usability and functionality of the app. Phase-1: the app was reviewed by experts (n = 18) using cognitive walkthrough and heuristic evaluation for usability and performance analyses. Phase-2: field studies with real users (n = 53) were conducted to compare and validate findings from the low-cost usability studies of phase-1. This paper discusses methods and findings of phase-1.

A mixed-methods approach was used to perform qualitative and quantitative data analysis. Thematic analysis and descriptive and inferential statistics were calculated. A total of 90 usability problems within 25 themes and two overarching categories were found. Lack of search functionality and lack of consistency topped the list.

This study also contributes to usability research by providing interesting insights on the number of experts required to identify most of the usability problems in comparison to the magic number 5. Results indicate our study required more than 5 participants to find 80% of the problems.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. NaPanta-Agriculture Crop Management App for Farmer - Apps on Google Play, https://play.google.com/store/apps/details?id=com.napanta.farmer.app. Accessed 17 Mar 2021

  2. Patel, H., Patel, D.: Survey of android apps for the agriculture sector. Int. J. Inf. Sci. Tech. 6(1–2), 61–67 (2016)

    Google Scholar 

  3. Rana, S., Sontakki, B.S.: Mobile based agro advisory services (MAAS) in India: an assessment of their effectiveness. Hyderabad, India, 2017 (Report No. 234) (2017). Retrieved from ICAR- National Academy of Agricultural Research Management website. http://eprints.naarm.org.in/234/

  4. Blackmon, M., Polson, P., Kitajima, M., Lewis, C.: Cognitive walkthrough for the Web. In: Proceedings of CHI, pp. 463–470 (2002)

    Google Scholar 

  5. Nielsen, J., Molich, R.: Heuristic evaluation of user interfaces. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 249–256. ACM (1990)

    Google Scholar 

  6. Nielsen, J.: Usability Engineering. Academic Press Inc., Cambridge (1994)

    MATH  Google Scholar 

  7. Gerhardt-Powals, J.: Cognitive engineering principles for enhancing human-computer performance. Int. J. Hum.-Comput. Interact. 8(2), 189–211 (1996)

    Article  Google Scholar 

  8. Weinschenk, S., Barker, D.T.: Designing Effective Speech Interfaces, vol. 1. Wiley, New York (2000)

    Google Scholar 

  9. Inostroza, R., Rusu, C., Roncagliolo, S., Rusu, V., Collazos, C.A.: Developing SMASH: a set of smartphone’ usability heuristics. Comput. Stand. Interfaces 43, 40–52 (2016)

    Article  Google Scholar 

  10. Turner, C.W., Lewis, J.R., Nielsen, J.: Determining usability test sample size. Int. Encycl. Ergon. Hum. Factors 3(2), 3084–3088 (2006)

    Google Scholar 

  11. Lindgaard, G., Chattratichart, J.: Usability testing: what have we overlooked? In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1415–1424 (2007)

    Google Scholar 

  12. Alroobaea, R., Mayhew, P.J.: How many participants are really enough for usability studies? In: 2014 Science and Information Conference, pp. 48–56. IEEE (2014)

    Google Scholar 

  13. Demir, F., Parraci, W.: The more complex the less success in online library services: evaluating the user experience for international students. Issues Trends Educ. Technol. 6(2) (2018)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Illinois Informatics Institute, University of Illinois at Urbana-Champaign, Champaign, IL, USA

    Siva Ratna Kumari Narisetti & Michael Twidale

  2. School of Information Sciences, University of Illinois at Urbana-Champaign, Champaign, IL, USA

    Michael Twidale

Authors
  1. Siva Ratna Kumari Narisetti
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Michael Twidale
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Siva Ratna Kumari Narisetti .

Editor information

Editors and Affiliations

  1. University of Crete and Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Constantine Stephanidis

  2. Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Margherita Antona

  3. Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Stavroula Ntoa

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Narisetti, S.R.K., Twidale, M. (2021). App Analysis with a Larger Than Usual Number of Usability Experts. In: Stephanidis, C., Antona, M., Ntoa, S. (eds) HCI International 2021 - Posters. HCII 2021. Communications in Computer and Information Science, vol 1419. Springer, Cham. https://doi.org/10.1007/978-3-030-78635-9_7

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-78635-9_7

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-78634-2

  • Online ISBN: 978-3-030-78635-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation