skip to main content
10.1145/2971485.2971547acmotherconferencesArticle/Chapter ViewAbstractPublication PagesnordichiConference Proceedingsconference-collections
research-article

Designing for Tangible Affective Interaction

Published: 23 October 2016 Publication History

Abstract

In this paper, four interactional modes of pervasive affective sensing are identified: in situ intentional, retrospective, automatic, and reconstructive. These modes are used to discuss and highlight the challenges of designing pervasive affective sensing systems for mental health care applications. We also present the design of the Grasp platform, which consists of a hand-held, tangible stone-like object with accompanying peripherals. This device is equipped with a force sensor that registers squeezes, includes capabilities for wireless transmission of data, and comes with a crib for initiating the wireless connection and data transfer. In addition, the platform includes an app on a tablet that can render squeezes in real time or visualize the data from a given time period. In this paper, we focus mainly on the design of the tangible interaction and address the challenges of designing for in situ tangible affective interaction.

References

[1]
Arthern, J., and Madill, A. How do transitional objects work?: the therapist's view. British Journal of Medical Psychology, 72 (1999), 1--21.
[2]
Balaam, M., Fitzpatrick, G., Good, J., and Luckin, R. Exploring affective technologies for the classroom with the subtle stone. In Proc. CHI '10, ACM Press (New York, NY, USA, 2010), 1623--1632.
[3]
Boehner, K., DePaula, R., Dourish, P., and Sengers, P. Affect: from information to interaction. In Proc. Critical Computing, ACM Press (New York, NY, USA, 2005), 59--68.
[4]
Brown, B., Reeves, S., and Sherwood, S. Into the wild: challenges and opportunities for field trial methods. In Proc. SIGCHI '11, ACM Press (New York, NY, USA, 2011), 1657--1666.
[5]
Empatica wristband. https://www.empatica.com/e4-wristband.
[6]
Fallman, D. Design-oriented human-computer interaction. In Proc. SIGCHI '03, ACM Press (New York, NY, USA, 2003), 225--232.
[7]
Fuentes, C., Rodríguez, I., and Herskovic, V. EmoBall: a study on a tangible interface to self-report emotional information considering digital competences. Springer International Publishing, Cham, 2015, 189--200.
[8]
Gaggioli, A., Pioggia, G., Tartarisco, G., Baldus, G., Corda, D., Cipresso, P., and Riva, G. A mobile data collection platform for mental health research. Personal and Ubiquitous Computing 17, 2 (2013), 241--251.
[9]
Gravenhorst, F., Muaremi, A., Bardram, J., Grünerbl, A., Mayora, O., Wurzer, G., Frost, M., Osmani, V., Arnrich, B., Lukowicz, P., and Tröster, G. Mobile phones as medical devices in mental disorder treatment: an overview. Personal and Ubiquitous Computing 19, 2 (Feb. 2015), 335--353.
[10]
Herstad, J., and Holone, H. Making sense of co-creative tangibles through the concept of familiarity. In Proc. NordiCHI '12, ACM (New York, NY, USA, 2012), 89--98.
[11]
Höök, K., Ståhl, A., Sundström, P., and Laaksolaahti, J. Interactional empowerment. In Proc. CHI '08, ACM (New York, NY, USA, 2008), 647--656.
[12]
Hutchinson, H., Mackay, W., Westerlund, B., Bederson, B. B., Druin, A., Plaisant, C., Beaudouin-Lafon, M., Conversy, S., Evans, H., Hansen, H., Roussel, N., and Eiderbäck, B. Technology probes: inspiring design for and with families. In Proc. SIGCHI '03, ACM (New York, NY, USA, 2003), 17--24.
[13]
Kalnikaite, V., Sellen, A., Whittaker, S., and Kirk, D. Now let me see where i was: understanding how lifelogs mediate memory. In Proc. SIGCHI '10, ACM (New York, NY, USA, 2010), 2045--2054.
[14]
Kanjo, E., Al-Husain, L., and Chamberlain, A. Emotions in context: examining pervasive affective sensing systems, applications, and analyses. Personal and Ubiquitous Computing 19, 7 (2015), 1197--1212.
[15]
Krøger, E., Guribye, F., and Gjøsæter, T. Logging and visualizing affective interaction for mental health therapy. In Proc. NOKOBIT '15, vol. 23 (2015).
[16]
LiKamWa, R., Liu, Y., Lane, N. D., and Zhong, L. Moodscope: building a mood sensor from smartphone usage patterns. In Proc. MOBISYS '13, ACM Press (New York, NY, USA, 2013), 389--402.
[17]
Lowe, S. A. Monitoring human health behaviour in one's living environment: a technological review. Medical Engineering and Physics 36, 2 (2014), 147--168.
[18]
MacLean, D., Roseway, A., and Czerwinski, M. Moodwings: a wearable biofeedback device for real-time stress intervention. In Proc. PETRA '13, ACM (New York, NY, USA, 2013), 66:1--66:8.
[19]
Mauss, I. B., and Robinson, M. D. Measures of emotion: a review. Cognition and Emotion 23, 2 (2009), 209--237.
[20]
Morris, E. M., Kathawala, Q., Leen, K. T., Gorenstein, E. E., Guilak, F., Labhard, M., and Deleeuw, W. Mobile therapy: case study evaluations of a cell phone application for emotional self-awareness. Journal of Medical Internet Research 12, 2 (Apr 2010), e10.
[21]
Niforatos, E., and Karapanos, E. Emosnaps: a mobile application for emotion recall from facial expressions. Personal and Ubiquitous Computing 19, 2 (2015), 425--444.
[22]
Optimism. http://www.findingoptimism.com/.
[23]
Scollon, C. N., Kim-Prieto, C., and Diener, E. Experience sampling: promises and pitfalls, strength and weaknesses. Journal of Happiness Studies 4, 1 (2003), 5--34.
[24]
Shelton, D. J., and Kirwan, C. B. A possible negative influence of depression on the ability to overcome memory interference. Behavioural Brain Research 256 (2013), 20--26.
[25]
Shiffman, S., Stone, A. A., and Hufford, M. R. Ecological momentary assessment. Annual Review of Clinical Psychology 4 (2008), 1--32.
[26]
Ståhl, A., Höök, K., Svensson, M., Taylor, A. S., and Combetto, M. Experiencing the affective diary. Personal and Ubiquitous Computing 13, 5 (June 2009), 365--378.
[27]
Sundström, P., Ståhl, A., and Höök, K. In situ informants exploring an emotional mobile messaging system in their everyday practice. International Journal of Human-Computer Studies 65, 4 (Apr. 2007), 388--403.
[28]
Vallgårda, A. Giving form to computational things: developing a practice of interaction design. In Personal and Ubiquitous Computing, no. 18 (2013), 577--592.
[29]
Vanderloock, K., Vanden Abeele, V., Suykens, J. A., and Geurts, L. The skweezee system: enabling the design and the programming of squeeze interactions. In Proc. UIST, ACM Press (2013), 521--530.
[30]
Zimmerman, J., Forlizzi, J., and Evenson, S. Research through design as a method for interaction design research in hci. In Proc. SIGCHI '07, ACM Press (2007), 493--502.

Cited By

View all
  • (2024)Tangible Interactions for Pain Assessment in Palliative CareProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685336(1-15)Online publication date: 13-Oct-2024
  • (2024)Tangible Affect: A Literature Review of Tangible Interactive Systems Addressing Human Core Affect, Emotions and MoodsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661608(424-440)Online publication date: 1-Jul-2024
  • (2024)Squeezable Interface for Emotion Regulation in Work EnvironmentsProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3635256(1-7)Online publication date: 11-Feb-2024
  • Show More Cited By

Index Terms

  1. Designing for Tangible Affective Interaction

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer Interaction
    October 2016
    1045 pages
    ISBN:9781450347631
    DOI:10.1145/2971485
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    In-Cooperation

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 23 October 2016

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Tangible interaction
    2. affective interaction
    3. pervasive affective sensing

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    NordiCHI '16

    Acceptance Rates

    NordiCHI '16 Paper Acceptance Rate 58 of 231 submissions, 25%;
    Overall Acceptance Rate 379 of 1,572 submissions, 24%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)102
    • Downloads (Last 6 weeks)7
    Reflects downloads up to 17 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Tangible Interactions for Pain Assessment in Palliative CareProceedings of the 13th Nordic Conference on Human-Computer Interaction10.1145/3679318.3685336(1-15)Online publication date: 13-Oct-2024
    • (2024)Tangible Affect: A Literature Review of Tangible Interactive Systems Addressing Human Core Affect, Emotions and MoodsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661608(424-440)Online publication date: 1-Jul-2024
    • (2024)Squeezable Interface for Emotion Regulation in Work EnvironmentsProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3635256(1-7)Online publication date: 11-Feb-2024
    • (2023)Affect Recognition in Hand-Object Interaction Using Object-Sensed Tactile and Kinematic DataIEEE Transactions on Haptics10.1109/TOH.2022.323064316:1(112-117)Online publication date: 1-Jan-2023
    • (2022)Extended reality for mental health: Current trends and future challengesFrontiers in Computer Science10.3389/fcomp.2022.10343074Online publication date: 18-Nov-2022
    • (2022)Theoretically-Defined vs. User-Defined Squeeze GesturesProceedings of the ACM on Human-Computer Interaction10.1145/35678056:ISS(73-102)Online publication date: 14-Nov-2022
    • (2022)Tangible Self-Report Devices: Accuracy and Resolution of Participant InputProceedings of the Sixteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3490149.3501309(1-14)Online publication date: 13-Feb-2022
    • (2022)Development of a Robot-assisted Online Pain Communication System using a Squeezable Tangible User Interface *2022 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)10.1109/RO-MAN53752.2022.9900863(185-191)Online publication date: 29-Aug-2022
    • (2021)Multimodal Emotion Recognition of Hand-Object InteractionProceedings of the 26th International Conference on Intelligent User Interfaces10.1145/3397481.3450636(351-355)Online publication date: 14-Apr-2021
    • (2020)Motiis: Fostering Parents’ Awareness of their Adolescents Emotional Experiences during GamingProceedings of the 11th Nordic Conference on Human-Computer Interaction: Shaping Experiences, Shaping Society10.1145/3419249.3420173(1-11)Online publication date: 25-Oct-2020
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media