skip to main content
10.1145/3702038.3702104acmotherconferencesArticle/Chapter ViewAbstractPublication PagesihcConference Proceedingsconference-collections
research-article

Reflections on the Applicability of the Semiotic Engineering Ontology Extended to the HInt Paradigm

Published: 18 December 2024 Publication History

Resumo

Human-Computer Integration (HInt) is a new paradigm that expands the focus of the HCI field to encompass the new relationship of partnership between humans and autonomous technologies. As HInt is an emerging paradigm, the concepts and ontology of Semiotic Engineering Theory have been extended to cover HInt as a special case of HCI. This paper aims to present the results of an evaluation of the applicability and utility of the Semiotic Engineering extension to HInt. In order to conduct the evaluation, an elective undergraduate course on HInt was offered at Federal University of Minas Gerais. The researchers analyzed the material generated by the students’ as part of their activities understanding and applying the concepts of the extended Semiotic Engineering theory. The analysis focused on understanding students use and perception of the theory in defining, exploring, and explaining HInt. As contributions, we present insights and reflections on the benefits and limits of the extension of the Semiotic Engineering theoretical framework to support the study, design and evaluation of HInt.

References

[1]
Josh Andres, Julian de Hoog, e Florian ’Floyd’ Mueller. 2018. "I Had Super-Powers When EBike Riding" Towards Understanding the Design of Integrated Exertion. In Proceedings of the 2018 Annual Symposium on Computer-Human Interaction in Play (Melbourne, VIC, Australia) (CHI PLAY ’18). Association for Computing Machinery, New York, NY, USA, 19–31.
[2]
Josh Andres, Tuomas Kari, Juerg von Kaenel, e Florian ’Floyd’ Mueller. 2019. "Co-Riding With My EBike to Get Green Lights". In Proceedings of the 2019 on Designing Interactive Systems Conference (San Diego, CA, USA) (DIS ’19). Association for Computing Machinery, New York, NY, USA, 1251–1263.
[3]
Josh Andres, m.c. schraefel, Nathan Semertzidis, Brahmi Dwivedi, Yutika C. Kulwe, Juerg von Kaenel, e Florian Floyd Mueller. 2020. Introducing Peripheral Awareness as a Neurological State for Human-Computer Integration. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–13.
[4]
Josh Andres, Nathan Semertzidis, Zhuying Li, Yan Wang, e Florian Floyd Mueller. 2023. Integrated Exertion—Understanding the Design of Human–Computer Integration in an Exertion Context. ACM Trans. Comput.-Hum. Interact. 29, 6, Article 55 (jan 2023), 28 pages.
[5]
Glívia A. R. Barbosa, Ulisses da S. Fernandes, Natália S. Santos, e Raquel O. Prates. 2023. Human-Computer Integration as an Extension of Interaction: Understanding Its State-of-the-Art and the Next Challenges. International Journal of Human–Computer Interaction 40, 11 (2023), 2761–2780. arXiv:
[6]
Glívia A. R. Barbosa and e Raquel O. Prates. 2022. Estendendo a IHC para HInt à Luz da Engenharia Semiótica. In Anais Estendidos do XXI Simpósio Brasileiro de Fatores Humanos em Sistemas Computacionais - Workshop de Teses e Dissertações em IHC (WTD-IHC) (Diamantina). SBC, Porto Alegre, RS, Brasil, 166–174.
[7]
Glívia A. R. Barbosa and e Raquel O. Prates. 2022. Extending the Ontology, Metacommunication and Communicability of Semiotic Engineering to the Emerging Paradigm of Human-Computer Integration (HInt). In Proceedings of the 21st Brazilian Symposium on Human Factors in Computing Systems (Diamantina, Brazil) (IHC’22). Association for Computing Machinery, New York, NY, USA, Article 17, 11 pages.
[8]
Glívia A. R. Barbosa and e Raquel O. Prates. 2023. Evoluir é preciso: Movendo da Interação para a Integração Humano-Computador. In Anais Estendidos do XXII Simpósio Brasileiro de Fatores Humanos em Sistemas Computacionais - Minicurso (Maceió/AL). SBC, Porto Alegre, RS, Brasil, 1–8.
[9]
Glívia A. R. Barbosa, Raquel O. Prates, Ulisses da S. Fernandes, e Natália S. Santos. 2021. Extending Interaction to Human-Computer Integration: What Do We Already Know and What Do We Need to Explore?. In Proceedings of the XX Brazilian Symposium on Human Factors in Computing Systems (Virtual Event, Brazil) (IHC’21). Association for Computing Machinery, New York, NY, USA, Article 23, 7 pages.
[10]
Gabriel Diniz Junqueira Barbosa, José Luiz Nunes, Clarisse Sieckenius De Souza, e Simone Diniz Junqueira Barbosa. 2024. Investigating the Extended Metacommunication Template: How a semiotic tool may encourage reflective ethical practice in the development of machine learning systems. In Proceedings of the XXII Brazilian Symposium on Human Factors in Computing Systems (Maceió, Brazil) (IHC ’23). Association for Computing Machinery, New York, NY, USA, Article 58, 12 pages.
[11]
Simone Diniz Junqueira Barbosa, Gabriel Diniz Junqueira Barbosa, Clarisse Sieckenius de Souza, e Carla Faria Leitão. 2021. A Semiotics-based epistemic tool to reason about ethical issues in digital technology design and development. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency (Virtual Event, Canada) (FAccT ’21). Association for Computing Machinery, New York, NY, USA, 363–374.
[12]
Simone Diniz Junqueira Barbosa, Bruno Santana da Silva, Milene Selbach Silveira, Isabela Gasparini, Ticianne Darin, e Gabriel Diniz Junqueira Barbosa. 2021. Interação humano-computador e experiência do usuario. Auto publicação.
[13]
Virginia Braun and e Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77–101.
[14]
John M Carroll. 2003. HCI models, theories, and frameworks: Toward a multidisciplinary science. Elsevier.
[15]
Bruno Azevedo Chagas. 2020. Metacommunication and Appropriation in the Design of the Interactive Internet of Things. Ph. D. Dissertation. PUC-Rio.
[16]
Bruno A. Chagas, David F. Redmiles, e Clarisse S. de Souza. 2018. Observed Appropriation of IoT Technology: A Semiotic Account. In Proceedings of the 17th Brazilian Symposium on Human Factors in Computing Systems (Belém, Brazil) (IHC 2018). Association for Computing Machinery, New York, NY, USA, Article 33, 10 pages.
[17]
Bruno A Chagas, David F Redmiles, e Clarisse S de Souza. 2019. Signs of Appropriation: A Semiotic Account of Breakdowns with IoT Technology. Journal on Interactive Systems 10, 2 (2019), 3–19.
[18]
Bruno Santana da Silva and e Simone Diniz Junqueira Barbosa. 2007. Designing human-computer interaction with MoLIC diagrams–a practical guide. Technical Report 12/07. PUC-Rio, Rio de Janeiro. 12 pages. ISSN: 0103-9741.
[19]
Valdemar Danry, Pat Pataranutaporn, Florian Mueller, Pattie Maes, e Sang-won Leigh. 2022. On Eliciting a Sense of Self When Integrating with Computers. In Augmented Humans 2022 (Kashiwa, Chiba, Japan) (AHs 2022). Association for Computing Machinery, New York, NY, USA, 68–81.
[20]
Clarisse Sieckenius de Souza. 2005. The semiotic engineering of human-computer interaction. MIT press.
[21]
Clarisse Sieckenius de Souza and e Carla Faria Leitão. 2009. Semiotic Engineering Methods for Scientific Research in HCI. Synthesis Lectures on Human-Centered Informatics 2, 1 (2009), 1–122.
[22]
Clarisse Sieckenius de Souza, Carla Faria Leitão, Raquel Oliveira Prates, Sílvia Amélia Bim, e Elton José da Silva. 2010. Can inspection methods generate valid new knowledge in HCI? The case of semiotic inspection. International Journal of Human-Computer Studies 68, 1-2 (2010), 22–40.
[23]
Umer Farooq and e Jonathan Grudin. 2016. Human-Computer Integration. Interactions 23, 6 (Oct. 2016), 26–32.
[24]
Miriam Gil, Manoli Albert, Joan Fons, e Vicente Pelechano. 2019. Designing human-in-the-loop autonomous Cyber-Physical Systems. International Journal of Human-Computer Studies 130 (2019), 21–39.
[25]
Miriam Gil, Manoli Albert, Joan Fons, e Vicente Pelechano. 2020. Engineering human-in-the-loop interactions in cyber-physical systems. Information and Software Technology 126 (2020), 106349.
[26]
Carla Faria Leitão and e Raquel O Prates. 2017. A Aplicação de Métodos Qualitativos em Computação. In Jornadas de Atualização em Informática 2017. 43–90.
[27]
Rodrigo de A. Maués and e Simone Diniz Junqueira Barbosa. 2013. Cross-Communicability: Evaluating the Meta-communication of Cross-Platform Applications. In Human-Computer Interaction – INTERACT 2013, Paula Kotzé, Gary Marsden, Gitte Lindgaard, Janet Wesson, e Marco Winckler (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 241–258.
[28]
Rodrigo de A. Maués and e Simone Diniz Junqueira Barbosa. 2014. Reflections on the Cross-Platform Semiotic Inspection Method. In Human-Computer Interaction. Theories, Methods, and Tools, Masaaki Kurosu (Ed.). Springer International Publishing, Cham, 533–544.
[29]
Florian Floyd Mueller, Pedro Lopes, Josh Andres, Richard Byrne, Nathan Semertzidis, Zhuying Li, Jarrod Knibbe, e Stefan Greuter. 2021. Towards understanding the design of bodily integration. International Journal of Human-Computer Studies 152 (2021), 102643.
[30]
Florian Floyd Mueller, Pedro Lopes, Paul Strohmeier, Wendy Ju, Caitlyn Seim, Martin Weigel, Suranga Nanayakkara, Marianna Obrist, Zhuying Li, Joseph Delfa, Jun Nishida, Elizabeth M. Gerber, Dag Svanaes, Jonathan Grudin, Stefan Greuter, Kai Kunze, Thomas Erickson, Steven Greenspan, Masahiko Inami, Joe Marshall, Harald Reiterer, Katrin Wolf, Jochen Meyer, Thecla Schiphorst, Dakuo Wang, e Pattie Maes. 2020. Next Steps for Human-Computer Integration. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 1–15.
[31]
Florian Floyd Mueller, Nathan Semertzidis, Josh Andres, Martin Weigel, Suranga Nanayakkara, Rakesh Patibanda, Zhuying Li, Paul Strohmeier, Jarrod Knibbe, Stefan Greuter, Marianna Obrist, Pattie Maes, Dakuo Wang, Katrin Wolf, Liz Gerber, Joe Marshall, Kai Kunze, Jonathan Grudin, Harald Reiterer, e Richard Byrne. 2022. Human–Computer Integration: Towards Integrating the Human Body with the Computational Machine. Foundations and Trends® in Human-Computer Interaction 16, 1 (2022), 1–64.
[32]
Ana Maria Nicolaci-da Costa, Carla Faria Leitão, e Daniela Romão-Dias. 2004. Como conhecer usuários através do Método de Explicitação do Discurso Subjacente (MEDS). VI Simpósio Brasileiro sobre Fatores Humanos em Sistemas Computacionais, IHC (2004), 47–56.
[33]
Erica R. Oliveira, Luiz C. S. Luz, e Raquel O. Prates. 2008. Aplicação Semi-Estruturada Do MéTodo de Inspeção SemióTica: Estudo de Caso Para o DomíNio Educacional. In Proceedings of the VIII Brazilian Symposium on Human Factors in Computing Systems (Porto Alegre, RS, Brazil) (IHC ’08). Sociedade Brasileira de Computação, BRA, 50–59.
[34]
Charles Sanders Peirce Peirce and e Charles Sanders Peirce. 1992. The essential Peirce, volume 1: Selected philosophical writings?(1867–1893). Vol. 1. Indiana University Press.
[35]
Raquel Oliveira Prates. 2017. An Overview of Semiotic Engineering Epistemic Tools for the Design of Collaborative Systems. Conversations Around Semiotic Engineering (2017), 81–99.
[36]
Raquel Oliveira Prates and e Simone Diniz Junqueira Barbosa. 2007. Introdução à teoria e prática da interação humano computador fundamentada na engenharia semiótica. Jornadas de Atualizações em informática (2007), 263–326.
[37]
Raquel Oliveira Prates and e Clarisse Sieckenius de Souza. 1998. Towards a semiotic environment for supporting the development of multi-user interfaces. In CRIWG, Vol. 98. 15pp.
[38]
Chairs Constantine Stephanidis, Gavriel Salvendy, Members of the Group Margherita Antona, Jessie Y. C. Chen, Jianming Dong, Vincent G. Duffy, Xiaowen Fang, Cali Fidopiastis, Gino Fragomeni, Limin Paul Fu, Yinni Guo, Don Harris, Andri Ioannou, Kyeong ah (Kate) Jeong, Shin’ichi Konomi, Heidi Krömker, Masaaki Kurosu, James R. Lewis, Aaron Marcus, Gabriele Meiselwitz, Abbas Moallem, Hirohiko Mori, Fiona Fui-Hoon Nah, Stavroula Ntoa, Pei-Luen Patrick Rau, Dylan Schmorrow, Keng Siau, Norbert Streitz, Wentao Wang, Sakae Yamamoto, Panayiotis Zaphiris, e Jia Zhou. 2019. Seven HCI Grand Challenges. International Journal of Human–Computer Interaction 35, 14 (2019), 1229–1269. arXiv:

Index Terms

  1. Reflections on the Applicability of the Semiotic Engineering Ontology Extended to the HInt Paradigm

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    IHC '24: Proceedings of the XXIII Brazilian Symposium on Human Factors in Computing Systems
    October 2024
    1070 pages
    ISBN:9798400712241
    DOI:10.1145/3702038
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 18 December 2024

    Check for updates

    Author Tags

    1. Human-Computer Integration
    2. HInt
    3. Semiotic Engineering
    4. Ontology

    Qualifiers

    • Research-article

    Conference

    IHC 2024

    Acceptance Rates

    Overall Acceptance Rate 331 of 973 submissions, 34%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 9
      Total Downloads
    • Downloads (Last 12 months)9
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 19 Feb 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Full Text

    View this article in Full Text.

    Full Text

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media