Glívia Angélica Rodrigues Barbosa
Raquel Oliveira Prates
ABSTRACT
Human-Computer Integration (HInt) is an emerging paradigm in the Human-Computer Interaction (HCI) area, which characterizes the relationship between humans and technologies as a partnership. This paradigm offers new challenges for the HCI area, including demands for reviewing and proposing theories and methods to consolidate and evolve HInt within HCI. Thus, this paper presents an analysis of the applicability and a proposal for extending the Semiotic Engineering ontology and concepts to characterize HInt. As contributions, our results are useful to: (1) advance in the consolidation and evolution of HInt as a new HCI paradigm; and (2) stimulate other initiatives and contributions grounded in Semiotic Engineering for HCI with a lens on HInt.
- Mohammed Alharbi and Shihong Huang. 2020. A Survey of Incorporating Affective Computing for Human-System Co-Adaptation. In Proceedings of the 2020 The 2nd World Symposium on Software Engineering (Chengdu, China) (WSSE 2020). Association for Computing Machinery, New York, NY, USA, 72--79. Google Scholar
Digital Library
- Josh Andres, m.c. schraefel, Nathan Semertzidis, Brahmi Dwivedi, Yutika C. Kulwe, Juerg von Kaenel, and Florian Floyd Mueller. 2020. Introducing Peripheral Awareness as a Neurological State for Human-Computer Integration. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--13. Google ScholarDigital Library
- Glívia A. R. Barbosa, Raquel O. Prates, Ulisses da S. Fernandes, and Natália S. Santos. 2021. Extending Interaction to Human-Computer Integration: What Do We Already Know and What Do We Need to Explore?. In Proceedings of the XX Brazilian Symposium on Human Factors in Computing Systems (Virtual Event, Brazil) (IHC '21). Association for Computing Machinery, New York, NY, USA, Article 23, 7 pages. Google ScholarDigital Library
- Glívia A. R. Barbosa, Raquel O. Prates, Ulisses da S. Fernandes, and Natália S. Santos. 2022. O presente e o futuro da Integração Humano-Computador como extensão da Interação: Uma Revisão Sistemática da Literatura. Technical Report RT.DCC.002/2022. Departamento de Ciência da Computação, Universidade Federal de Minas Gerais, Belo Horizonte, MG. 42 pages.Google Scholar
- Lauren M. Britton and Bryan Semaan. 2017. Manifesting the Cyborg through Techno-Body Modification: From Human-Computer Interaction to Integration. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 2499--2510. Google ScholarDigital Library
- Bruno Azevedo Chagas. 2020. Metacommunication and Appropriation in the Design of the Interactive Internet of Things. Ph.D. Dissertation. PUC-Rio.Google Scholar
- Bruno A. Chagas, David F. Redmiles, and Clarisse S. de Souza. 2018. Observed Appropriation of IoT Technology: A Semiotic Account. In Proceedings of the 17th Brazilian Symposium on Human Factors in Computing Systems (Belém, Brazil) (IHC 2018). Association for Computing Machinery, New York, NY, USA, Article 33, 10 pages. Google ScholarDigital Library
- Bruno A Chagas, David F Redmiles, and Clarisse S de Souza. 2019. Signs of Appropriation: A Semiotic Account of Breakdowns with IoT Technology. Journal on Interactive Systems 10, 2 (2019), 3--19.Google ScholarCross Ref
- Bruno Santana da Silva and Simone Diniz Junqueira Barbosa. 2007. Designing human-computer interaction with MoLIC diagrams-a practical guide. Technical Report 12/07. PUC-Rio, Rio de Janeiro. 12 pages. ISSN: 0103-9741.Google Scholar
- Clarisse Sieckenius de Souza. 2005. The semiotic engineering of human-computer interaction. MIT press.Google Scholar
- Clarisse Sieckenius de Souza and Carla Faria Leitão. 2009. Semiotic engineering methods for scientific research in HCI. Synthesis Lectures on Human-Centered Informatics 2, 1 (2009), 1--122.Google ScholarCross Ref
- Andreas Dengel, Laurence Devillers, and Laura Maria Schaal. 2021. Augmented Human and Human-Machine Co-evolution: Efficiency and Ethics. Reflections on Artificial Intelligence for Humanity (2021), 203--227. Google ScholarCross Ref
- Umer Farooq and Jonathan Grudin. 2016. Human-Computer Integration. Interactions 23, 6 (Oct. 2016), 26--32. Google ScholarDigital Library
- Verena Fuchsberger. 2019. The Future's Hybrid Nature. Interactions 26, 4 (June 2019), 26--31. Google ScholarDigital Library
- Miriam Gil, Manoli Albert, Joan Fons, and Vicente Pelechano. 2020. Engineering human-in-the-loop interactions in cyber-physical systems. Information and Software Technology 126 (2020), 106349. Google ScholarCross Ref
- Jeffrey C. F. Ho. 2018. Computer as Partner: A Critique Perspective of Interaction Design for Social Sustainability. In Proceedings of the Sixth International Symposium of Chinese CHI (Montreal, QC, Canada) (ChineseCHI '18). Association for Computing Machinery, New York, NY, USA, 95--99. Google ScholarDigital Library
- Sang-won Leigh, Harpreet Sareen, Hsin-Liu (Cindy) Kao, Xin Liu, and Pattie Maes. 2017. Body-Borne Computers as Extensions of Self. Computers 6, 1 (2017). Google ScholarCross Ref
- Zhuying Li, Rakesh Patibanda, Felix Brandmueller, Wei Wang, Kyle Berean, Stefan Greuter, and Florian 'Floyd' Mueller. 2018. The Guts Game: Towards Designing Ingestible Games. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (Melbourne, VIC, Australia) (CHI PLAY '18). Association for Computing Machinery, New York, NY, USA, 271--283. Google ScholarDigital Library
- Rodrigo de A. Maués and Simone Diniz Junqueira Barbosa. 2013. Cross-Communicability: Evaluating the Meta-communication of Cross-Platform Applications. In Human-Computer Interaction - INTERACT 2013, Paula Kotzé, Gary Marsden, Gitte Lindgaard, Janet Wesson, and Marco Winckler (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 241--258.Google Scholar
- Rodrigo de A. Maués and Simone Diniz Junqueira Barbosa. 2014. Reflections on the Cross-Platform Semiotic Inspection Method. In Human-Computer Interaction. Theories, Methods, and Tools, Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 533--544.Google Scholar
- Florian Mueller, Pattie Maes, and Jonathan Grudin. 2019. Human-Computer Integration (Dagstuhl Seminar 18322). Dagstuhl Reports 8, 8 (2019), 18--47. Google ScholarCross Ref
- Florian Floyd Mueller, Pedro Lopes, Paul Strohmeier, Wendy Ju, Caitlyn Seim, Martin Weigel, Suranga Nanayakkara, Marianna Obrist, Zhuying Li, Joseph Delfa, Jun Nishida, Elizabeth M. Gerber, Dag Svanaes, Jonathan Grudin, Stefan Greuter, Kai Kunze, Thomas Erickson, Steven Greenspan, Masahiko Inami, Joe Marshall, Harald Reiterer, Katrin Wolf, Jochen Meyer, Thecla Schiphorst, Dakuo Wang, and Pattie Maes. 2020. Next Steps for Human-Computer Integration. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1--15. Google ScholarDigital Library
- Jasmin Niess and Paweł W. Woźniak. 2020. Embracing Companion Technologies. In Proceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society (Tallinn, Estonia) (NordiCHI '20). Association for Computing Machinery, New York, NY, USA, Article 31, 11 pages. Google ScholarDigital Library
- Erica R. Oliveira, Luiz C. S. Luz, and Raquel O. Prates. 2008. Aplicação Semi-Estruturada Do MéTodo de Inspeção SemióTica: Estudo de Caso Para o DomíNio Educacional. In Proceedings of the VIII Brazilian Symposium on Human Factors in Computing Systems (Porto Alegre, RS, Brazil) (IHC '08). Sociedade Brasileira de Computação, BRA, 50--59.Google Scholar
- Charles Sanders Peirce Peirce and Charles Sanders Peirce. 1992. The essential Peirce, volume 1: Selected philosophical writings?(1867--1893). Vol. 1. Indiana University Press.Google Scholar
- Raquel Oliveira Prates and Clarisse Sieckenius de Souza. 1998. Towards a semiotic environment for supporting the development of multi-user interfaces.. In CRIWG, Vol. 98. 15pp.Google Scholar
- Raquel O Prates, Clarisse S de Souza, and Simone DJ Barbosa. 2000. Methods and tools: a method for evaluating the communicability of user interfaces. interactions 7, 1 (2000), 31--38.Google Scholar
- Soraia Reis and Raquel O. Prates. 2011. Applicability of the Semiotic Inspection Method: A Systematic Literature Review. In Proceedings of the 10th Brazilian Symposium on Human Factors in Computing Systems and the 5th Latin American Conference on Human-Computer Interaction (Porto de Galinhas, Pernambuco, Brazil) (IHC+CLIHC '11). Brazilian Computer Society, Porto Alegre, BRA, 177--186.Google Scholar
- Samsung. 2022. Solução Samsung Galaxy Fit2. Retrieved May 27, 2022 from https://www.samsung.com/br/watches/galaxy-fit/galaxy-fit2-black-sm-r220nzkazto/Google Scholar
- Chairs Constantine Stephanidis, Gavriel Salvendy, Members of the Group Margherita Antona, Jessie Y. C. Chen, Jianming Dong, Vincent G. Duffy, Xiaowen Fang, Cali Fidopiastis, Gino Fragomeni, Limin Paul Fu, Yinni Guo, Don Harris, Andri Ioannou, Kyeong ah (Kate) Jeong, Shin'ichi Konomi, Heidi Krömker, Masaaki Kurosu, James R. Lewis, Aaron Marcus, Gabriele Meiselwitz, Abbas Moallem, Hirohiko Mori, Fiona Fui-Hoon Nah, Stavroula Ntoa, Pei-Luen Patrick Rau, Dylan Schmorrow, Keng Siau, Norbert Streitz, Wentao Wang, Sakae Yamamoto, Panayiotis Zaphiris, and Jia Zhou. 2019. Seven HCI Grand Challenges. International Journal of Human-Computer Interaction 35, 14 (2019), 1229--1269. arXiv:https://doi.org/10.1080/10447318.2019.1619259 Google ScholarCross Ref
Index Terms
- Extending the ontology, metacommunication and communicability of semiotic engineering to the emerging paradigm of human-computer integration (HInt)
Recommendations
Extending Interaction to Human-Computer Integration: What do we already know and what do we need to explore?
IHC '21: Proceedings of the XX Brazilian Symposium on Human Factors in Computing SystemsThe main goal of this paper is to characterize the concept and emerging paradigm of Human-Computer Integration (HInt) in terms of its definition, its relationship with HCI, as well as its opportunities and challenges for HCI. To achieve this goal, we ...
Metacommunication and semiotic engineering: insights from a study with mediated HCI
DUXU'13: Proceedings of the Second international conference on Design, User Experience, and Usability: design philosophy, methods, and tools - Volume Part ISemiotic perspectives on HCI take human-computer interaction as a special case of computer-mediated human communication. Through the interface, systems designers communicate to users their design vision as well as how the system can or should be used ...
Semiotic approaches to user interface design
CHI EA '00: CHI '00 Extended Abstracts on Human Factors in Computing SystemsHartson (1998) has pointed out that although people have studied interfaces and applied theories (mostly cognitive psychology) to them, and that the majority of the guidelines and principles applied have arisen mostly out of practice than theory. He ...
Comments