skip to main content
10.1145/1852786.1852826acmconferencesArticle/Chapter ViewAbstractPublication PagesesemConference Proceedingsconference-collections
research-article

Usability evaluation of multi-device/platform user interfaces generated by model-driven engineering

Published: 16 September 2010 Publication History

Abstract

Nowadays several Computer-Aided Software Engineering environments exploit Model-Driven Engineering (MDE) techniques in order to generate a single user interface for a given computing platform or multi-platform user interfaces for several computing platforms simultaneously. Therefore, there is a need to assess the usability of those generated user interfaces, either taken in isolation or compared to each other. This paper describes an MDE approach that generates multi-platform graphical user interfaces (e.g., desktop, web) that will be subject to an exploratory controlled experiment. The usability of user interfaces generated for the two mentioned platforms and used on multiple display devices (i.e., standard size, large, and small screens) has been examined in terms of satisfaction, effectiveness and efficiency. An experiment with a factorial design for repeated measures was conducted for 31 participants, i.e., postgraduate students and professors selected by convenience sampling. The data were collected with the help of questionnaires and forms and were analyzed using parametric and non-parametric tests such as ANOVA with repeated measures and Friedman's test, respectively. Efficiency was significantly better in large screens than in small ones as well as in the desktop platform rather than in the web platform, with a confidence level of 95%. The experiment also suggests that satisfaction tends to be better in standard size screens than in small ones. The results suggest that the tested MDE approach should incorporate enhancements in its multi-device/platform user interface generation process in order to improve its generated usability.

References

[1]
S. Abrahão, E. Iborra, and J. Vanderdonckt. Usability Evaluation of User Interfaces Generated with a Model-Driven Architecture Tool. In E. Law, E. Hvannberg, and G. Cockton, editors, Maturing Usability: Quality in Software, Interaction and Value, volume 10 of HCI Series, pages 3--32. Springer, London, 2008.
[2]
V. R. Basili, G. Caldiera, and H. D. Rombach. The Goal Question Metric Approach. In Encyclopedia of Software Engineering. John Wiley, 1994.
[3]
N. Bevan. International standards for HCI and usability. Int. J. Hum.-Comput. Stud, 55(4):533--552, 2001.
[4]
R. D. Bock. Multivariate Statistical Methods in Behavioural Research. McGraw-Hil, New York, 1975.
[5]
C. Chesta, F. Paternò, and C. Santoro. Methods and Tools for Designing and Developing Usable Multi-Platform Interactive Applications. PsychNology Journal 2, 1:123--139, 2004.
[6]
J. Eisenstein, J. Vanderdonckt, and A. Puerta. Applying model-based techniques to the development of UIs for mobile computers. In IUI '0l: Proceedings of the 6th International Conference on Intelligent User Interfaces, pages 69--76. ACM Press, New York, NY, USA, January 14--17, 2001.
[7]
N. E. Fenton and S. L. Pfleeger. Software Metrics: A Rigorous and Practical Approach. PWS Publishing Co., Boston, MA, USA, 1998.
[8]
B. Glaser and A. Strauss. The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine Transaction, 1967.
[9]
J. Helms, K. Luyten, J. Vermeulen, M. Abrams, and J. Vanderdonckt. Human-Centered Engineering with the User Interface Markup Language. In A. Seffah, J. Vanderdonckt, and M. Desmarais, editors, Human-Centered Software Engineering, volume 7 of HCI Series, pages 141--173. Springer, London, 2009.
[10]
International Organization for Standardization. ISO 9241--11: Ergonomie requirements for office work with visual display terminals (VDTs) - Part 9: Guidance on usability, 1998.
[11]
International Organization for Standardization. ISO/IEC 9126-1:2001 Software engineering - Product quality -- Part 1: Quality model, 2001.
[12]
R. E. Kirk. Experimental design: procedures for the behavioural sciences. Brooks/Cole, Pacific Grove, Calif, 2nd edition, 1982.
[13]
J. R. Lewis. IBM computer usability satisfaction questionnaires: psychometric evaluation and instructions for use. Int. J. Hum.-Comput. Interact., 7(l):57--78, 1995.
[14]
R. Likert. A technique for the measurement of attitudes. Archives of Psychology, 22(140): 1--55, 1932.
[15]
Q. Limbourg, J. Vanderdonckt, B. Michotte, L. Bouillon, and V. López-Jaquero. USIXML: A Language Supporting Multi-path Development of User Interfaces. In R. Bastide, P. A. Palanque, and J. Roth, editors, Proc. of 9th IFIP Working Conference on Engineering for Human-Computer Interaction jointly with 11th Int. Workshop on Design, Specification, and Verification of Interactive Systems, EHCI-DSVIS 2004 (Hamburg, July 11--13, 2004), volume 3425 of Lecture Notes in Computer Science, pages 200--220. Springer-Verlag, Berlin, 2005.
[16]
B. MacKay, C. R. Watters, and J. Duffy. Web page transformation when switching devices. In Mobile Human-Computer Interaction - Mobile HCI 2004, 6th International Symposium, Glasgow, UK, September 13--16, 2004, volume 3160 of Lecture Notes in Computer Science, pages 228--239. Springer, 2004.
[17]
S. J. Mellor, S. Kendall, A. Uhl, and D. Weise. MDA Distilled: Principles of Model-Driven Architecture. Addison Wesley Longman Publishing Co., Inc., Redwood City, CA, USA, 2004.
[18]
P. J. Molina, S. Meliá, and O. Pastor. Just-UI: A User Interface Specification Model. In C. Kolski and J. Vanderdonckt, editors, Computer-Aided Design of User Interfaces III, Proc. of the 4th Int. Conf. on Computer-Aided Design of User Interfaces, CADUI 2002, (Valenciennes, France, May 15--17, 2002), pages 63--74. Kluwer, 2002.
[19]
G. Mori, F. Paternò, and C. Santoro. Design and Development of Multidevice User Interfaces through Multiple Logical Descriptions. IEEE Trans. Software Eng., 30(8):507--520, 2004.
[20]
O. Pastor and J. C. Molina. Model-Driven Architecture in Practice: A Software Production Environment Based on Conceptual Modeling. Springer-Verlag New York, Inc., Secaucus, NJ, USA, 2007.
[21]
J. Vanderdonckt. Model-Driven Engineering of User Interfaces: Promises, Successes, and Failures. In S. Buraga and I. Juvina, editors, Proc. of 5th Annual Romanian Conf. on Human-Computer Interaction ROCHI'2008, (Iasi, 18--19 September 2008), pages 1--10. Matrix ROM, Bucarest, 2008.
[22]
C. Wohlin, P. Runeson, M. Host, M. C. Ohlsson, B. Regnell, and A. Wesslén. Experimentation in Software Engineering: An Introduction, volume 6 of International Series in Software Engineering. Springer, 2000.

Cited By

View all
  • (2024)Engineering Touchscreen Input for 3-Way Displays: Taxonomy, Datasets, and ClassificationCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3661331(57-65)Online publication date: 24-Jun-2024
  • (2024)Managing Customizable User Interface for Web Application Product Lines using Delta ModelingProceedings of the 18th International Working Conference on Variability Modelling of Software-Intensive Systems10.1145/3634713.3634721(61-70)Online publication date: 7-Feb-2024
  • (2023)The Guizmo Framework for Generating Final User Interfaces from WireframesCompanion Proceedings of the 2023 ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3596454.3597189(82-84)Online publication date: 27-Jun-2023
  • Show More Cited By

Index Terms

  1. Usability evaluation of multi-device/platform user interfaces generated by model-driven engineering

                            Recommendations

                            Comments

                            Information & Contributors

                            Information

                            Published In

                            cover image ACM Conferences
                            ESEM '10: Proceedings of the 2010 ACM-IEEE International Symposium on Empirical Software Engineering and Measurement
                            September 2010
                            423 pages
                            ISBN:9781450300391
                            DOI:10.1145/1852786
                            Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

                            Sponsors

                            Publisher

                            Association for Computing Machinery

                            New York, NY, United States

                            Publication History

                            Published: 16 September 2010

                            Permissions

                            Request permissions for this article.

                            Check for updates

                            Author Tags

                            1. effectiveness
                            2. efficiency
                            3. interaction with small and large screens
                            4. model-driven engineering
                            5. multi-device interface
                            6. multi-platform interface
                            7. satisfaction
                            8. usability evaluation

                            Qualifiers

                            • Research-article

                            Funding Sources

                            Conference

                            ESEM '10
                            Sponsor:

                            Acceptance Rates

                            ESEM '10 Paper Acceptance Rate 30 of 102 submissions, 29%;
                            Overall Acceptance Rate 130 of 594 submissions, 22%

                            Contributors

                            Other Metrics

                            Bibliometrics & Citations

                            Bibliometrics

                            Article Metrics

                            • Downloads (Last 12 months)29
                            • Downloads (Last 6 weeks)5
                            Reflects downloads up to 08 Feb 2025

                            Other Metrics

                            Citations

                            Cited By

                            View all
                            • (2024)Engineering Touchscreen Input for 3-Way Displays: Taxonomy, Datasets, and ClassificationCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3661331(57-65)Online publication date: 24-Jun-2024
                            • (2024)Managing Customizable User Interface for Web Application Product Lines using Delta ModelingProceedings of the 18th International Working Conference on Variability Modelling of Software-Intensive Systems10.1145/3634713.3634721(61-70)Online publication date: 7-Feb-2024
                            • (2023)The Guizmo Framework for Generating Final User Interfaces from WireframesCompanion Proceedings of the 2023 ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3596454.3597189(82-84)Online publication date: 27-Jun-2023
                            • (2022)Applications of Human-Computer Interaction in Health PsychologyJournal of Digital Art & Humanities10.33847/2712-8148.3.1_53:1(36-57)Online publication date: 29-Jun-2022
                            • (2022)A Study on User Experience of Smart Glasses for Higher Education Students2022 17th Iberian Conference on Information Systems and Technologies (CISTI)10.23919/CISTI54924.2022.9820326(1-6)Online publication date: 22-Jun-2022
                            • (2022)SnappView, a Software Development Kit for Supporting End-user Mobile Interface ReviewProceedings of the ACM on Human-Computer Interaction10.1145/35345276:EICS(1-38)Online publication date: 17-Jun-2022
                            • (2022)GesFabri: Exploring Affordances and Experience of Textile Interfaces for Gesture-based InteractionProceedings of the ACM on Human-Computer Interaction10.1145/35345226:EICS(1-23)Online publication date: 17-Jun-2022
                            • (2022)Formal Verification of Graphical Properties of Interactive SystemsProceedings of the ACM on Human-Computer Interaction10.1145/35345216:EICS(1-30)Online publication date: 17-Jun-2022
                            • (2022)What do Researchers Need when Implementing Novel Interaction Techniques?Proceedings of the ACM on Human-Computer Interaction10.1145/35322096:EICS(1-30)Online publication date: 17-Jun-2022
                            • (2022)Designing Guided User Tasks in VR Embodied ExperiencesProceedings of the ACM on Human-Computer Interaction10.1145/35322086:EICS(1-24)Online publication date: 17-Jun-2022
                            • Show More Cited By

                            View Options

                            Login options

                            View options

                            PDF

                            View or Download as a PDF file.

                            PDF

                            eReader

                            View online with eReader.

                            eReader

                            Figures

                            Tables

                            Media

                            Share

                            Share

                            Share this Publication link

                            Share on social media