Felipe Santos
Sérgio Soares
ABSTRACT
Effective assessments are essential for producing reliable results, which, in turn, facilitate a deeper understanding of the subject under investigation. For researchers in the field of Software Engineering (SE), robust assessment strategies play a pivotal role in advancing existing technologies and gauging the suitability of emerging ones. In today’s interconnected world, characterized by the proliferation of smart cities, creating a comprehensive usability assessment plan for smart city applications has posed a unique challenge, primarily due to the multifaceted nature of this paradigm. Aims: The primary objective of this study is to develop and introduce a tool that aids evaluators, mainly novices in usability, in crafting a comprehensive usability assessment plan for smart city applications. This tool aims to encompass all essential elements necessary for a thorough evaluation of the usability of such applications. Method: The instrument is a checklist designed in conformity with experimental best practices and based on experts’ experience in planning and conducting assessments. It was evaluated by experts in assessment planning and has been undergoing a case study of a middleware platform for smart city application development. Results: The use of the instrument aids in the planning of usability assessments of smart city applications, therefore contributing to adapting the usability assessment to the context of a smart city. Conclusions: Even though it is not possible to determine the success of the assessment by using the checklist on its planning, the instrument seeks to encompass the relevant usability points and guide the assessment toward the smart city aspect of the application.
- Vito Albino, Umberto Berardi, and Rosa Dangelico. 2015. Smart Cities: Definitions, Dimensions, Performance, and Initiatives. Journal of Urban Technology 22 (02 2015), 2015. https://doi.org/10.1080/10630732.2014.942092Google Scholar
Cross Ref
- Rodrigo L. A. Almeida, Rossana M. C. Andrade, Ticianne G. R. Darin, and Joseane O. V. Paiva. 2020. CHASE: checklist to assess user experience in IoT environments. In Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering: New Ideas and Emerging Results. ACM, Seoul South Korea, 41–44. https://doi.org/10.1145/3377816.3381737Google ScholarDigital Library
- Maria Abadia Alves, Ricardo Cunha Dias, and Paulo Castro Seixas. 2019. Smart Cities no Brasil e em Portugal : o estado da arte. (2019), 1–15. https://doi.org/10.1590/2175-3369.011.Google ScholarCross Ref
- Alexandre Aragão, Lucas Machado, Nathyane Moreno, Davi Viana, Francisco Silva, Tércio Sousa, Luis Rivero, Ariel Teles, Arlindo F. Da Conceição, and Inaldo Costa. 2020. Evoluindo uma aplicação para Cidades Inteligentes através de Avaliação de Métricas de Qualidade e Usabilidade. iSys - Brazilian Journal of Information Systems 13, 3 (June 2020), 55–81. https://doi.org/10.5753/isys.2020.795Google ScholarCross Ref
- Victor R Basili. 2007. Engineering Research 1 The Experimental Discipline in Software Engineering. Empirical Software Engineering (2007), 33–37.Google Scholar
- Carla Bezerra, Rossana M. C. Andrade, Rainara Maia Santos, Mourad Abed, Káthia Marçal de Oliveira, José Maria Monteiro, Ismayle Santos, and Houcine Ezzedine. 2014. Challenges for usability testing in ubiquitous systems. In Proceedings of the 26th Conference on l’Interaction Homme-Machine(IHM ’14). Association for Computing Machinery, New York, NY, USA, 183–188. https://doi.org/10.1145/2670444.2670468Google ScholarDigital Library
- John Brooke. 1995. SUS : A quick and dirty usability scale SUS - A quick and dirty usability scale. November 1995 (1995).Google Scholar
- Ignasi Capdevila. 2015. Smart city or smart citizens ? The Barcelona case.November (2015). https://doi.org/10.1108/JSMA-03-2015-0030Google ScholarCross Ref
- Rainara Maia Carvalho, Rossana Maria de Castro Andrade, Káthia Marçal de Oliveira, Ismayle de Sousa Santos, and Carla Ilane Moreira Bezerra. 2017. Quality characteristics and measures for human–computer interaction evaluation in ubiquitous systems. Software Quality Journal 25, 3 (Sept. 2017), 743–795. https://doi.org/10.1007/s11219-016-9320-zGoogle ScholarDigital Library
- Junho Choi. 2022. Enablers and inhibitors of smart city service adoption: A dual‑factor approach based on the technology acceptance model. Telematics and Informatics 75 (2022), 101911. https://doi.org/10.1016/j.tele.2022.101911Google ScholarDigital Library
- Hafedh Chourabi, Taewoo Nam, Shawn Walker, J. Ramon Gil-Garcia, Sehl Mellouli, Karine Nahon, Theresa A. Pardo, and Hans Jochen Scholl. 2012. Understanding Smart Cities: An Integrative Framework. In 2012 45th Hawaii International Conference on System Sciences. 2289–2297. https://doi.org/10.1109/HICSS.2012.615Google ScholarDigital Library
- Phillip Crosby. 1979. Quality Is Free: The Art of Making Quality Certain.Google Scholar
- Renata Paola Dameri. 2013. Searching for Smart City definition: a comprehensive proposal. INTERNATIONAL JOURNAL OF COMPUTERS & TECHNOLOGY 11, 5 (Oct 2013), 2544–2551. https://doi.org/10.24297/ijct.v11i5.1142Google ScholarCross Ref
- X. Ferre, N. Juristo, H. Windl, and L. Constantine. 2001. Usability basics for software developers. IEEE Software 18, 1 (2001), 22–29. https://doi.org/10.1109/52.903160Google ScholarDigital Library
- Liliane Fonseca. 2016. An instrument for reviewing the completeness of experimental plans for controlled experiments using human subjects in software engineering. (2016).Google Scholar
- Francisco A. A. Gomes, Paulo A. L. Rego, Lincoln Rocha, Jose N. de Souza, and Fernando Trinta. 2017. CAOS: A Context Acquisition and Offloading System. In 2017 IEEE 41st Annual Computer Software and Applications Conference (COMPSAC). IEEE, Turin, 957–966. https://doi.org/10.1109/COMPSAC.2017.80Google ScholarCross Ref
- P. Harper and Kent Norman. 1993. Improving user satisfaction: The questionnaire for user interaction satisfaction version 5.5. (1993).Google Scholar
- C. Harrison, B. Eckman, R. Hamilton, P. Hartswick, J. Kalagnanam, J. Paraszczak, and P. Williams. 2010. Foundations for Smarter Cities. IBM Journal of Research and Development 54, 4 (Jul 2010), 1–16. https://doi.org/10.1147/JRD.2010.2048257Google ScholarDigital Library
- Martin Host and Per Runeson. 2007. Checklists for Software Engineering Case Study Research. In First International Symposium on Empirical Software Engineering and Measurement (ESEM 2007). 479–481. https://doi.org/10.1109/ESEM.2007.46Google ScholarDigital Library
- International Organization for Standardization (ISO). 2011. ISO/IEC 25010:2011 Systems and software engineering – Systems and software Quality Requirements and Evaluation (SQuaRE) – System and software quality models. ISO Standard.Google Scholar
- ISO 9241-210:2010 2010. Ergonomics of human-system interaction — Part 210: Human-centred design for interactive systems. Standard. International Organization for Standardization.Google Scholar
- Ankur Joshi, Saket Kale, Satish Chandel, and D. Pal. 2015. Likert Scale: Explored and Explained. British Journal of Applied Science & Technology 7, 4 (Jan 2015), 396–403. https://doi.org/10.9734/BJAST/2015/14975Google ScholarCross Ref
- Jurek Kirakowski. 1995. The Use of Questionnaire methods for Usability Assessment Background notes on the SUMI questionnaire. Measures & Methods for Quality of Use (1995), 115–130.Google Scholar
- Fabio Kon and Eduardo Zambom. 2016. Cidades Inteligentes: Tecnologias, Aplicações, Iniciativas e Desafios. In Jornadas de Atualização em Informática 2016 (1 ed.), Jose Carlos Maldonado, Jose Viterbo, Marcio Delamaro, and Sabrina Marczak (Eds.). SBC, 13–60. https://doi.org/10.5753/sbc.6.1Google ScholarCross Ref
- Weng Marc Lim, Satish Kumar, Sanjeev Verma, and Rijul Chaturvedi. 2022. Alexa, what do we know about conversational commerce ? Insights from a systematic literature review. Psychology & Marketing 39, 6 (2022), 1129–1155. https://doi.org/10.1002/mar.21654Google ScholarCross Ref
- C. Molloy and M. Iqbal. 2010. Improving data-center efficiency for a Smarter Planet. IBM Journal of Research and Development 54, 4 (July 2010), 1–8. https://doi.org/10.1147/JRD.2010.2050539Google ScholarDigital Library
- Luca Mora, Roberto Bolici, and Mark Deakin. 2017. The First Two Decades of Smart-City Research : A Bibliometric Analysis The First Two Decades of Smart-City Research : A Bibliometric. Journal of Urban Technology 0, 0 (2017), 1–25. https://doi.org/10.1080/10630732.2017.1285123Google ScholarCross Ref
- Jakob Nielsen. 1994. Usability Engineering.Google Scholar
- Department of Economic and Social Affairs. 2018. World Urbanization Prospects. https://population.un.org/wup/publications/Files/WUP2018-Report.pdfGoogle Scholar
- Claire Rowland, Elizabeth Goodman, Martin Charlier, Ann Light, and Alfred Lui. 2015. Designing connected products: UX for the consumer Internet of things (first edition ed.). O’Reilly, Sebastopol.Google Scholar
- Per Runeson, Martin Host, Austen Rainer, and Bjorn Regnell. 2012. Case study research in software engineering. John Wiley and Sons, Nashville, TN.Google Scholar
- Ahmed Shuhaiber and Ibrahim Mashal. 2019. Technology in Society Understanding users ’ acceptance of smart homes. Technology in Society 58, March 2018 (2019), 101110. https://doi.org/10.1016/j.techsoc.2019.01.003Google ScholarCross Ref
- Daniel L Stufflebeam. 2000. GUIDELINES FOR DEVELOPING EVALUATION CHECKLISTS: THE CHECKLISTS DEVELOPMENT CHECKLIST (CDC). https://wmich.edu/sites/default/files/attachments/u350/2014/guidelines_cdc.pdfGoogle Scholar
- Noah Stupak, Nicholas DiFonzo, Andrew J. Younge, and Christopher Homan. 2010. SOCIALSENSE: Graphical user interface design considerations for social network experiment software. Computers in Human Behavior 26, 3 (May 2010), 365–370. https://doi.org/10.1016/j.chb.2009.11.007Google ScholarDigital Library
- David Travis. 2013. The 1-page usability test plan. https://www.userfocus.co.uk/articles/usability_test_plan_dashboard.htmlGoogle Scholar
- Carmen Zannier, Grigori Melnik, and Frank Maurer. 2006. On the success of empirical studies in the international conference on software engineering. In Proceedings of the 28th international conference on Software engineering. ACM, Shanghai China, 341–350. https://doi.org/10.1145/1134285.1134333Google ScholarDigital Library
Index Terms
- Usabivalid Tool: Evaluating usability of Smart City applications
Recommendations
Smart City Applications: A Survey
ICIST '19: Proceedings of the 9th International Conference on Information Systems and TechnologiesThe rapid growth of the population in urban cities creates a challenge and problems. Therefore, the smart city concept is utilized to solve the challenges in urban cities by providing a good livable environment for the citizens. This paper presents a ...
Enabling the smart city: the progress of u-city in Korea
ICUIMC '12: Proceedings of the 6th International Conference on Ubiquitous Information Management and CommunicationUbiquitous technologies are becoming an increasing part of people's lives. Issues and challenges for the development of such technologies not only encompass a broad spectrum of applications and services but also involve the envisioning of new policies ...
Smart city data analysis
DATA '18: Proceedings of the First International Conference on Data Science, E-learning and Information SystemsSmart City is one of the vital issues in the next coming years as it is estimated that more number of people will be migrating towards city and by 2040 cities is populated by 70% of the world's population. This will give raise to the city management ...
Comments