Skip to main content
SpringerLink
Log in

Exploring the Reciprocal Emotional Interaction Between Humans and Affective Technology Through Design Fictions and “Speculative Entanglement”

  • Conference paper
  • First Online:
Collaboration Technologies and Social Computing (CollabTech 2023)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 14199))

  • 320 Accesses

Abstract

This paper explores how emotion recognition technology is perceived, understood, felt, and reimagined through a set of design fiction processes by making and re-making arrangements of complex relationships between technologies, practices, emotions, and everyday lives. Emotion plays a crucial part in how we interact with the world: it is ephemeral, contingent, and contextual. Technologies capturing human emotions trace how we feel from almost all perspectives of our lives. To start with our explorations, we first write design fiction and take them to workshops as a probe into complex relationships between emotion recognition and our everyday lives. Participants work in teams to create design fiction prototypes that expand and respond to the fictional worldbuilding. By analyzing how the entanglements of emotion recognition technology in human lives are carried through and transformed among multiple design fiction processes, we contribute to a set of design processes that uses design fiction as a probe for the next speculation, in this case, reconfigure emotional recognition among humans and technology in design fiction workshops.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 49.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 64.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Abaskohi, A., et al.: Persian Emotion Detection using ParsBERT and Imbalanced Data Handling Approaches (2022). http://arxiv.org/abs/2211.08029

  2. Ashforth, B.E., Humphrey, R.H.: Emotional labor in service roles: the influence of identity. Acad. Manage. Rev. 18(1), 88–115 (1993). https://doi.org/10.2307/258824

    Article  Google Scholar 

  3. Barrett, L.F., et al.: Emotional expressions reconsidered: challenges to inferring emotion from human facial movements. Psychol. Sci. Public Interest. 20(1), 1–68 (2019). https://doi.org/10.1177/1529100619832930

    Article  Google Scholar 

  4. Barrett, L.F.: How Emotions are Made: The Secret Life of the Brain. Houghton Mifflin Harcourt, Boston, MA (2017)

    Google Scholar 

  5. Blythe, M.: Research fiction: storytelling, plot and design. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 5400–5411 Association for Computing Machinery, New York, NY, USA (2017). https://doi.org/10.1145/3025453.3026023

  6. Cheon, E., et al.: I beg to differ: soft conflicts in collaborative design using design fictions. In: Proceedings of the 2019 on Designing Interactive Systems Conference, pp. 201–214 Association for Computing Machinery, New York, NY, USA (2019). https://doi.org/10.1145/3322276.3322350

  7. Cowie, R., et al.: Emotion recognition in human-computer interaction. IEEE Signal Process. Mag. 18(1), 32–80 (2001). https://doi.org/10.1109/79.911197

    Article  Google Scholar 

  8. Dunne, A., Raby, F.: Speculative Everything: Design, Fiction, and Social Dreaming. The MIT Press (2013)

    Google Scholar 

  9. Elsden, C., et al.: On speculative enactments. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 5386–5399 Association for Computing Machinery, New York, NY, USA (2017). https://doi.org/10.1145/3025453.3025503

  10. Hochschild, A.R.: The Managed Heart: Commercialization of Human Feeling. University of California Press (2012)

    Google Scholar 

  11. Lee, M., et al.: Where is Vincent? Expanding our emotional selves with AI. In: 4th Conference Conversational User Interfaces, pp. 1–11 (2022). https://doi.org/10.1145/3543829.3543835

  12. Loi, D., et al.: Co-designing AI futures: integrating AI ethics, social computing, and design. In: Companion Publication of the 2019 on Designing Interactive Systems Conference 2019 Companion, pp. 381–384 Association for Computing Machinery, New York, NY, USA (2019). https://doi.org/10.1145/3301019.3320000

  13. Markussen, T., Knutz, E.: The poetics of design fiction. In: Proceedings of the 6th International Conference on Designing Pleasurable Products and Interfaces, pp. 231–240 Association for Computing Machinery, New York, NY, USA (2013). https://doi.org/10.1145/2513506.2513531

  14. McStay, A.: Emotional AI and EdTech: serving the public good? Learn. Media Technol. 45(3), 270–283 (2020). https://doi.org/10.1080/17439884.2020.1686016

    Article  Google Scholar 

  15. McStay, A.: Emotional AI: The Rise of Empathic Media (2018). https://doi.org/10.4135/9781526451293

  16. Noortman, R., et al.: HawkEye - deploying a design fiction probe. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–14 Association for Computing Machinery, New York, NY, USA (2019). https://doi.org/10.1145/3290605.3300652

  17. Orlikowski, W.J.: Sociomaterial practices: exploring technology at work. Organ. Stud. 28(9), 1435–1448 (2007). https://doi.org/10.1177/0170840607081138

    Article  Google Scholar 

  18. Parkinson, B.: Emotional stylists: strategies of expressive management among trainee hairdressers. Cogn. Emot. (2008). https://doi.org/10.1080/02699939108411051

    Article  Google Scholar 

  19. Raval, N., Dourish, P.: Standing out from the crowd: emotional labor, body labor, and temporal labor in ridesharing. In: Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, pp. 97–107 ACM, San Francisco California USA (2016). https://doi.org/10.1145/2818048.2820026

  20. Roemmich, K., Andalibi, N.: Data subjects’ conceptualizations of and attitudes toward automatic emotion recognition-enabled wellbeing interventions on social media. In: Proceedings of the ACM Human-Computer Interaction, vol. 5, CSCW2, 308:1–308:34 (2021). https://doi.org/10.1145/3476049

  21. Schulte, B.F., et al.: Homes for life: a design fiction probe. In: Proceedings of the 9th Nordic Conference on Human-Computer Interaction, pp. 1–10 Association for Computing Machinery, New York, NY, USA (2016). https://doi.org/10.1145/2971485.2993925

  22. Sharma, S., et al.: From mild to wild: reimagining friendships and romance in the time of pandemic using design fiction. In: Designing Interactive Systems Conference 2021, pp. 64–77 Association for Computing Machinery, New York, NY, USA (2021). https://doi.org/10.1145/3461778.3462110

  23. Shimo, S.: Risks of bias in AI-based emotional analysis technology from diversity perspectives. In: 2020 IEEE International Symposium on Technology and Society ISTAS, pp. 66–68 (2020). https://doi.org/10.1109/ISTAS50296.2020.9462168

  24. Simeone, A.L., et al.: Immersive speculative enactments: bringing future scenarios and technology to life using virtual reality. In: Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, pp. 1–20 Association for Computing Machinery, New York, NY, USA (2022). https://doi.org/10.1145/3491102.3517492

  25. Stark, L., Hoey, J.: The ethics of emotion in artificial intelligence systems. In: Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency, pp. 782–793 Association for Computing Machinery, New York, NY, USA (2021). https://doi.org/10.1145/3442188.3445939

  26. Tanenbaum, T.J.: Design fictional interactions: why HCI should care about stories. Interactions 21(5), 22–23 (2014). https://doi.org/10.1145/2648414

    Article  Google Scholar 

  27. Wei, W., et al.: Emotion recognition based on weighted fusion strategy of multichannel physiological signals. Comput. Intell. Neurosci. 2018, 5296523 (2018). https://doi.org/10.1155/2018/5296523

    Article  Google Scholar 

  28. Yan, H., et al.: Automatic detection of eating disorder-related social media posts that could benefit from a mental health intervention. Int. J. Eat. Disord. 52(10), 1150–1156 (2019). https://doi.org/10.1002/eat.23148

    Article  Google Scholar 

  29. Yang, Q., et al.: Re-examining whether, why, and how human-ai interaction is uniquely difficult to design. In: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–13 Association for Computing Machinery, New York, NY, USA (2020). https://doi.org/10.1145/3313831.3376301

  30. Constructing Grounded Theory: A practical guide through qualitative analysis Kathy Charmaz Constructing Grounded Theory: A practical guide through qualitative analysis Sage 224 £19.99 0761973532 0761973532 [Formula: see text]. Nurse Res. 13, 4, 84 (2006). https://doi.org/10.7748/nr.13.4.84.s4

  31. Into the Unknown: Speculating the Future of AI – Medium. https://medium.com/into-the-unknown-speculate-the-future-of-ai. Accessed 17 April 2023

Download references

Author information

Authors and Affiliations

  1. Department of Communication and Technology, National Yang-Ming Chiao Tung University, Hsinchu, Taiwan

    Hong Yang & Ying-Yu Chen

  2. Graduate Program in Digital Content and Technologies, National Chengchi University, Taipei, Taiwan

    Ching-Yang Lin

  3. College of Planning and Design, National Cheng Kung University, Tainan, Taiwan

    Chung-Ching Huang

Authors
  1. Hong Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ching-Yang Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chung-Ching Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ying-Yu Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ying-Yu Chen .

Editor information

Editors and Affiliations

  1. Ritsumeikan University, Shiga, Japan

    Hideyuki Takada

  2. Kyoto University of Advanced Science, Kyoto, Japan

    D. Moritz Marutschke

  3. Universidad de Los Andes, Las Condes, RM - Santiago, Chile

    Claudio Alvarez

  4. University of Tsukuba, Tsukuba, Japan

    Tomoo Inoue

  5. Ritsumeikan University, Ibaraki, Japan

    Yugo Hayashi

  6. Pompeu Fabra University, Barcelona, Spain

    Davinia Hernandez-Leo

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Yang, H., Lin, CY., Huang, CC., Chen, YY. (2023). Exploring the Reciprocal Emotional Interaction Between Humans and Affective Technology Through Design Fictions and “Speculative Entanglement”. In: Takada, H., Marutschke, D.M., Alvarez, C., Inoue, T., Hayashi, Y., Hernandez-Leo, D. (eds) Collaboration Technologies and Social Computing. CollabTech 2023. Lecture Notes in Computer Science, vol 14199. Springer, Cham. https://doi.org/10.1007/978-3-031-42141-9_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-42141-9_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-42140-2

  • Online ISBN: 978-3-031-42141-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation