skip to main content
10.1145/3613372.3613376acmotherconferencesArticle/Chapter ViewAbstractPublication PagessbesConference Proceedingsconference-collections
research-article

UIProtoCheck: A Checklist for Semantic Inspection of User Interface Prototypes

Published:25 September 2023Publication History

ABSTRACT

User interface prototypes are widely used in software development to facilitate customer communication and explore ideas, especially in agile development teams. In addition, they often guide subsequent stages of the development process, such as coding, testing, and training. Given their effect on the software development cycle, UI prototypes must be included in quality assurance activities such as inspections. Existing UI inspection approaches aim to detect mainly usability problems and are designed to inspect implemented software. However, development costs could be reduced by early detection of design defects if prototypes were reviewed against software requirements before implementation. For this reason, we developed UIProtoCheck, a comprehensive checklist to inspect UI prototypes semantically according to the software requirements. To evaluate it, we conducted a study where 12 participants used our checklist to inspect three UI prototypes based on a given scenario. The results showed that teams with the best results achieved 67% effectiveness in identifying semantic errors previously included in the prototypes. These promising initial results indicate that UIProtoCheck can support the semantic inspection of UI prototypes.

References

  1. Gloria Baños Díaz and Claudia María del Pilar Zapata Del Río. 2018. A Proposal of Usability Heuristics Oriented to E-Banking Websites. In Design, User Experience, and Usability: Theory and Practice, Aaron Marcus and Wentao Wang (Eds.). Springer International Publishing, Cham, 327–345.Google ScholarGoogle Scholar
  2. Muhammad Salman Bashir and Amjad Farooq. 2019. EUHSA: Extending Usability Heuristics for Smartphone Application. IEEE Access 7 (2019), 100838–100859. https://doi.org/10.1109/ACCESS.2019.2923720Google ScholarGoogle ScholarCross RefCross Ref
  3. Elizabeth Bjarnason, Franz Lang, and Alexander Mjöberg. 2021. A Model of Software Prototyping based on a Systematic Map. In Proceedings of the 15th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM). 1–11.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Lin Chou Cheng. 2016. The mobile app usability inspection (MAUi) framework as a guide for minimal viable product (MVP) testing in lean development cycle. In Proceedings of the 2nd international conference in hci and ux indonesia 2016. 1–11.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Yuri Chernak. 1996. A statistical approach to the inspection checklist formal synthesis and improvement. IEEE Transactions on Software Engineering 22, 12 (1996), 866–874.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Gretchen T. De Macedo, Awdren Fontão, and Bruno Gadelha. 2022. Prototyping in Software Quality Assurance: A Survey With Software Practitioners. In Proceedings of the XXI Brazilian Symposium on Software Quality. 1–10.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Rafael Maiani de Mello, Rebeca Campos Motta, and Guilherme Horta Travassos. 2016. A checklist-based inspection technique for business process models. In Business Process Management Forum: BPM Forum 2016, Rio de Janeiro, Brazil, September 18-22, 2016, Proceedings 14. Springer, 108–123.Google ScholarGoogle ScholarCross RefCross Ref
  8. Clarisse Sieckenius De Souza, Carla Faria Leitão, Raquel Oliveira Prates, and Elton José Da Silva. 2006. The semiotic inspection method. In Proceedings of VII Brazilian symposium on Human factors in computing systems. 148–157.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Steven Dow, Julie Fortuna, Dan Schwartz, Beth Altringer, Daniel Schwartz, and Scott Klemmer. 2011. Prototyping dynamics: sharing multiple designs improves exploration, group rapport, and results. In Proceedings of the SIGCHI conference on human factors in computing systems. 2807–2816.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Tasha Hollingsed and David G. Novick. 2007. Usability Inspection Methods after 15 Years of Research and Practice. In Proceedings of the 25th Annual ACM International Conference on Design of Communication (El Paso, Texas, USA) (SIGDOC ’07). Association for Computing Machinery, New York, NY, USA, 249–255. https://doi.org/10.1145/1297144.1297200Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Oliver Laitenberger, Colin Atkinson, Maud Schlich, and Khaled El Emam. 2000. An experimental comparison of reading techniques for defect detection in UML design documents. Journal of Systems and Software 53, 2 (2000), 183–204.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Jevgeni Marenkov, Tarmo Robal, and Ahto Kalja. 2016. A study on immediate automatic usability evaluation of web application user interfaces. In Databases and Information Systems: 12th International Baltic Conference, DB&IS 2016, Riga, Latvia, July 4-6, 2016, Proceedings 12. Springer, 257–271.Google ScholarGoogle ScholarCross RefCross Ref
  13. Jakob Nielsen. 1994. Heuristic evaluation. Usability Inspection Mehods (1994).Google ScholarGoogle Scholar
  14. C. Sauer, D.R. Jeffery, L. Land, and P. Yetton. 2000. The effectiveness of software development technical reviews: a behaviorally motivated program of research. IEEE Transactions on Software Engineering 26, 1 (2000), 1–14. https://doi.org/10.1109/32.825763Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Andrew Sears. 1997. Heuristic walkthroughs: Finding the problems without the noise. International journal of human-computer interaction 9, 3 (1997), 213–234.Google ScholarGoogle ScholarCross RefCross Ref
  16. Forrest Shull, Ioana Rus, and Victor Basili. 2000. How perspective-based reading can improve requirements inspections. Computer 33, 7 (2000), 73–79.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Forrest Shull and Carolyn Seaman. 2008. Inspecting the history of inspections: An example of evidence-based technology diffusion. IEEE software 25, 1 (2008), 88–90.Google ScholarGoogle Scholar
  18. J. C. Silva, J. Creissac, and J. Saraiva. 2010. GUI inspection from source code analysis. Electronic Communications of the EASST 33 (2010). www.scopus.com Cited By :8.Google ScholarGoogle Scholar
  19. Rick Spencer. 2000. The streamlined cognitive walkthrough method, working around social constraints encountered in a software development company. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. 353–359.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Thomas Thelin, Per Runeson, Claes Wohlin, Thomas Olsson, and Carina Andersson. 2004. Evaluation of usage-based reading—conclusions after three experiments. Empirical Software Engineering 9 (2004), 77–110.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Natasha M. C. Valentim and Tayana Conte. 2014. Improving a Usability Inspection Technique Based on Quantitative and Qualitative Analysis. In 2014 Brazilian Symposium on Software Engineering. 171–180. https://doi.org/10.1109/SBES.2014.23Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Cathleen Wharton. 1994. The cognitive walkthrough method: A practitioner’s guide. Usability Inspection Methods, New York (1994), 105–140.Google ScholarGoogle Scholar
  23. Chauncey Wilson. 2013. User interface inspection methods: a user-centered design method. Newnes.Google ScholarGoogle Scholar
  24. Alexandros Yeratziotis and Panayiotis Zaphiris. 2018. A Heuristic Evaluation for Deaf Web User Experience (HE4DWUX). International Journal of Human–Computer Interaction 34, 3 (2018), 195–217. https://doi.org/10.1080/10447318.2017.1339940 arXiv:https://doi.org/10.1080/10447318.2017.1339940Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. UIProtoCheck: A Checklist for Semantic Inspection of User Interface Prototypes

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Other conferences
        SBES '23: Proceedings of the XXXVII Brazilian Symposium on Software Engineering
        September 2023
        570 pages
        ISBN:9798400707872
        DOI:10.1145/3613372

        Copyright © 2023 ACM

        Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 25 September 2023

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed limited

        Acceptance Rates

        Overall Acceptance Rate147of427submissions,34%
      • Article Metrics

        • Downloads (Last 12 months)22
        • Downloads (Last 6 weeks)2

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      HTML Format

      View this article in HTML Format .

      View HTML Format