skip to main content
10.1145/2531602.2531634acmconferencesArticle/Chapter ViewAbstractPublication PagescscwConference Proceedingsconference-collections
research-article

Towards a questionnaire for measuring affective benefits and costs of communication technologies

Published: 15 February 2014 Publication History

Abstract

As CSCW creates and investigates technologies for social communication, it is important to understand the emotional benefits and costs of these systems. We propose the Affec-tive Benefits and Costs of Communication Technologies (ABCCT) questionnaire to supplement traditional qualita-tive methods of understanding communication media. We discuss the pilots of this survey with 45 children and 110 adults measuring the inter-item reliability of this instru-ment. We present the results of interviews with 14 children and 14 adults, which help confirm that the ABCCT measures the same constructs that may emerge through interview investigations. Finally, we demonstrate that the ABCCT is sensitive enough to discriminate between differ-ent communication technologies and has shown promise in some of its early adoption. Though the ABCCT is not with-out limitations, it may provide a way to compare technolo-gies in field deployments, draw findings across investiga-tions, and quantify the impact of specific design decisions.

References

[1]
Ames, M.G., Go, J., Kaye, J., and Spasojevic, M. Making Love in the Network Closet: The Benefits and Work of Family Videochat. Proc. of CSCW, (2010), 145--154.
[2]
Ballagas, R., Kaye, J. 'Jofish,' Ames, M., Go, J., and Raffle, H. Family communication: phone conversations with children. Proc. of IDC, ACM (2009), 321--324.
[3]
Bel, D.T. van, Smolders, K.C.H.J., IJsselsteijn, W.A., and Kort, Y.A.W. de. Social connectedness: concept and measurement. International Conference on Intelligent Environments, IOS Press (2011), 67--74.
[4]
Bell, A. Designing and testing questionnaires for children. Journal of Research in Nursing 12, 5 (2007), 461--469.
[5]
Bonner, J.V.H. Adding critical sensibilities to domestic communication technologies. Intl J of Human Computer Studies 67, 2 (2009), 215--221.
[6]
Borgers, N. and Hox, J.J. Reliability of Responses in Questionnaire Research with Children. International Conference on Logic and Methodology, (2000).
[7]
Brown, B., Reeves, S., and Sherwood, S. Into the Wild: Challenges and Opportunities for Field Trial Methods. Proc. of CHI, (2011), 1657--1666.
[8]
Caughlin, J.P. and Petronio, S. Privacy in Families. In Handbook of Family Communication. Lawrence Erlbaum Associates, Mahwah, NJ, 2004, 379--412.
[9]
Dalsgaard, T., Skov, M.B., Stougaard, M., and Thomassen, B. Mediated intimacy in families: understanding the relation between children and parents. Proc. of IDC, ACM (2006), 145--152.
[10]
Dalsgaard, T., Skov, M.B., and Thomassen, B.R. eKiss: Sharing Experiences in Families Through a Picture Blog. Proc. of British HCI, (2007), 67--75.
[11]
Feltham, F., Vetere, F., and Wensveen, S. Designing tangible artefacts for playful interactions and dialogues. Designing Pleasurable Products and Interfaces, ACM (2007), 61--75.
[12]
Fitness, J. and Duffield, J. Emotion and Communication in Families. In Handbook of Family Communication. Lawrence Erlbaum Associates, Mahwah, NJ, 2004, 473--494.
[13]
Gardner, K.A. and Cutrona, C.E. Social Support Communication in Families. In Handbook of Family Communication. Lawrence Erlbaum Associates, Mahwah, NJ, 2004, 495--512.
[14]
Grinter, R.E., Palen, L., and Eldridge, M. Chatting with teenagers: Considering the place of chat technologies in teen life. ACM ToCHI 13, 4 (2006), 423--447.
[15]
Harms, C. and Biocca, F. Internal consistency and reliability of the networked minds social presence measure. (2004), 246--246.
[16]
Hassenzahl, M., Burmester, M., and Koller, F. AttrakDiff : Ein Fragebogen zur Messung wahrgenommener hedonischer und pragmatischer Qualität. Mensch & Computer: Interaktion in Bewegung, (2003), 187--196.
[17]
Hindus, D., Mainwaring, S.D., Leduc, N., Hagström, A.E., and Bayley, O. Casablanca: designing social communication devices for the home. Proc. of CHI, (2001), 325--332.
[18]
Howard, S., Kjeldskov, J., Skov, M., Garnoes, K., and Grünberger, O. Negotiating presence-in-absence: contact, content and context. Proc. of CHI, (2006), 909--912.
[19]
IJsselsteijn, W., Van Baren, J., Markopoulos, P., Romero, N., and de Ruyter, B. Measuring Affective Benefits and Costs of Mediated Awareness: Development and Validation of the ABC-Questionnaire. In Awareness Systems. 2009, 473--488.
[20]
Kaye, J. "Jofish," Levitt, M.K., Nevins, J., Golden, J., and Schmidt, V. Communicating intimacy one bit at a time. Proc. of CHI, ACM Press (2005), 1529--1529.
[21]
Kennedy, T.L.M., Smith, A., Wells, A.T., and Wellman, B. "Networked Families." Pew Internet & American Life Project Report. Washington, D.C., 2008.
[22]
Khan, J.V., Markopoulos, P., Eggen, B., and Metaxas, G. Evaluation of a pervasive awareness system designed for busy parents. Pervasive and Mobile Computing 6, 5 (2010), 537--558.
[23]
Khan, V.-J. and Markopoulos, P. Busy families' awareness needs. Intl J of Human Computer Studies 67, 2 (2009), 139--153.
[24]
Lindley, S.E., Harper, R., and Sellen, A. Designing a technological playground: a field study of the emergence of play in household messaging. Proc. of CHI, ACM (2010), 2351--2360.
[25]
Markopoulos, P., Read, J.C., MacFarlane, S., and Hoysniemi, J. Evaluating Children's Interactive Products: Principles and Practices for Interaction Designers. Morgan Kaufmann, Amsterdam, 2008.
[26]
Mynatt, E., Rowan, J., Jacobs, A., and Craighill, S. Digital family portraits: supporting peace of mind for extended family members. Proc. of CHI, ACM Press (2001), 333--340.
[27]
Neustaedter, C., Brush, A., and McDonald, D.W. Designing for Families. Ext. Abst. of CSCW, (2008).
[28]
Noller, P. and Feeney, J.A. Studying Family Communication: multiple methods and multiple sources. In Handbook of Family Communication. Lawrence Erlbaum Associates, Mahwah, NJ, 2004, 31--50.
[29]
Nunnally, J. and Bernstein, I. Psychometic Theory. McGraw-Hill, 1994.
[30]
Olivier, P. and Wallace, J. Digital technologies and the emotional family. Intl J of Human Computer Studies 67, 2 (2009), 204--214.
[31]
Pang, C.E., Neustaedter, C., Riecke, B.E., Oduor, E., and Hillman, S. Technology preferences and routines for sharing health information during the treatment of a chronic illness. Proc. of CHI, (2013), 1759--1768.
[32]
Petersen, M.G. Squeeze: designing for playful experiences among co-located people in homes. Ext. Abst. of CHI, ACM (2007), 2609--2614.
[33]
Pierce, G.R. Quality of Relationships Inventory: Assessing the Interpersonal Context of Social Support. Commun. of Social Support, (1991), 246--266.
[34]
Raffle, H., Ballagas, R., Revelle, G., et al. Family Story Play: Reading with Young Children (and Elmo) Over a Distance. Proc. of CHI, ACM (2010).
[35]
Raffle, H., Revelle, G., Mori, K., et al. Hello, is Grandma there? Let's Read! StoryVisit: Family Video Chat and Connected E-Books. Proc. of CHI, (2011), 1195--1204.
[36]
Romero, N., van Baren, J., Markopoulos, P., de Ruyter, B., and IJsselsteijn, W. Addressing Interpersonal Communication Needs through Ubiquitous Connectivity: Home and Away. Ambient Intelligence, (2003), 419--429.
[37]
Romero, N., Markopoulos, P., van Baren, J., de Ruyter, B., IJsselsteijn, W., and Farshchian, B. Connecting the family with awareness systems. Personal and Ubiquitous Computing 11, 4 (2007), 299--312.
[38]
Rowan, J. and Mynatt, E.D. Digital Family Portrait Field Trial: Support for Aging in Place. Proc. of CHI, ACM (2005), 521--530.
[39]
Saslis-Lagoudakis, G., Cheverst, K., Dix, A., Fitton, D., and Rouncefield, M. Hermes@Home: supporting awareness and intimacy between distant family members. Proc. of OZCHI, ACM (2006), 23--30.
[40]
Seidman, I. Interviewing as Qualitative Research: A Guide for Researchers in Education And the Social Sciences. Teachers College Press, New York, 1998.
[41]
Sellen, A., Harper, R., Eardley, R., et al. HomeNote: Supporting Situated Messaging in the Home. Proc. of CSCW, (2006), 383--392.
[42]
Short, J., Williams, E., and Christie, B. The social psychology of telecommunications. Wiley, London, 1976.
[43]
Strong, R. and Gaver, W.W. Feather, Scent, and Shaker: Supporting Simple Intimacy. Proc. of CSCW, (1996).
[44]
Tee, K., Brush, A.J., and Inkpen, K.M. Exploring communication and sharing between extended families. Intl J of Human Computer Studies 67, 2 (2009), 128--138.
[45]
Teh, J.K.S., Cheok, A.D., Peiris, R.L., Choi, Y., Thuong, V., and Lai, S. Huggy Pajama: a mobile parent and child hugging communication system. Proc. of IDC, (2008), 250--257.
[46]
Thompson, E.R. Development and Validation of an Internationally Reliable Short-Form of the Positive and Negative Affect Schedule (PANAS). Journal of CrossCultural Psychology 38, 2 (2007), 227--242.
[47]
Tollmar, K., Junestrand, S., Torgny, O., Boyarski, D., and Kellogg, W.A. Virtually living together. Proc. of DIS, (2000), 83--91.
[48]
Tsui, K., Desai, M., and Yanco, H. Towards measuring the quality of interaction: Communication through telepresence robots. Proc. Workshop on Performance Metrics for Intelligent Systems, ACM (2012).
[49]
Vetere, F., Davis, H., Gibbs, M., and Howard, S. The Magic Box and Collage: Responding to the challenge of distributed intergenerational play. Intl J of Human Computer Studies 67, 2 (2009), 165--178.
[50]
Vetere, F., Gibbs, M.R., Kjeldskov, J., et al. Mediating intimacy: designing technologies to support strong-tie relationships. Proc. of CHI, ACM (2005), 471--480.
[51]
Visser, T., Dadlani, P., van Bel, D., and Yarosh, S. Designing and Evaluating Affective Aspects of Sociable Media to Support Social Connectedness. Ext. Abst. of CHI, (2010), 4437--4440.
[52]
Yarosh, S. and Abowd, G.D. Mediated Parent-Child Contact in Work-Separated Families. Proc. of CHI, ACM (2011), 1185--1194.
[53]
Yarosh, S., Chew, Y.C., and Abowd, G.D. Supporting Parent-Child Communication in Divorced Families. Intl J of Human Computer Studies 67, 2 (2009), 192--203.
[54]
Yarosh, S., Inkpen, K.M., and Brush, A. Video playdate: toward free play across distance. Proc. of CHI, (2010), 1251--1260.
[55]
Yarosh, S. and Markopoulos, P. Design of an instrument for the evaluation of communication technologies with children. Proc. of IDC, ACM (2010), 266--269.
[56]
Yarosh, S., Tang, A., Mokashi, S., and Abowd, G. "Almost Touching:" Parent - Child Remote Communication Using the ShareTable System. (2013), 181--192.

Cited By

View all
  • (2024)The Subversive AI Acceptance Scale (SAIA-8): A Scale to Measure User Acceptance of AI-Generated, Privacy-Enhancing Image ModificationsProceedings of the ACM on Human-Computer Interaction10.1145/36410248:CSCW1(1-43)Online publication date: 26-Apr-2024
  • (2024)Is Your Family Ready for VR? Ethical Concerns and Considerations in Children's VR UsageProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655804(436-454)Online publication date: 17-Jun-2024
  • (2024)ChiParCo and ParChiCo: Connecting Children and Parents Remotely With Tailored Tangible Communication ToolsProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655803(424-435)Online publication date: 17-Jun-2024
  • Show More Cited By

Index Terms

  1. Towards a questionnaire for measuring affective benefits and costs of communication technologies

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CSCW '14: Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing
    February 2014
    1600 pages
    ISBN:9781450325400
    DOI:10.1145/2531602
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 15 February 2014

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. affect
    2. cmc
    3. communication
    4. evaluation.
    5. questionnaire

    Qualifiers

    • Research-article

    Conference

    CSCW'14
    Sponsor:
    CSCW'14: Computer Supported Cooperative Work
    February 15 - 19, 2014
    Maryland, Baltimore, USA

    Upcoming Conference

    CSCW '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)124
    • Downloads (Last 6 weeks)14
    Reflects downloads up to 20 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)The Subversive AI Acceptance Scale (SAIA-8): A Scale to Measure User Acceptance of AI-Generated, Privacy-Enhancing Image ModificationsProceedings of the ACM on Human-Computer Interaction10.1145/36410248:CSCW1(1-43)Online publication date: 26-Apr-2024
    • (2024)Is Your Family Ready for VR? Ethical Concerns and Considerations in Children's VR UsageProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655804(436-454)Online publication date: 17-Jun-2024
    • (2024)ChiParCo and ParChiCo: Connecting Children and Parents Remotely With Tailored Tangible Communication ToolsProceedings of the 23rd Annual ACM Interaction Design and Children Conference10.1145/3628516.3655803(424-435)Online publication date: 17-Jun-2024
    • (2024) Adolescents' belonging in post‐divorce families: Examining residential and digital contact with mothers and fathers Journal of Research on Adolescence10.1111/jora.1292034:2(568-583)Online publication date: 20-Feb-2024
    • (2024)Enhancing social interaction in nursing homes through public tabletop displays: A field study of R2SGeriatric Nursing10.1016/j.gerinurse.2024.10.00660(384-398)Online publication date: Nov-2024
    • (2023)On the Potential of Mediation Chatbots for Mitigating Multiparty Privacy Conflicts - A Wizard-of-Oz StudyProceedings of the ACM on Human-Computer Interaction10.1145/35796187:CSCW1(1-33)Online publication date: 16-Apr-2023
    • (2023)Remote Wavelength: Design and Evaluation of a System for Social Connectedness Through Distributed Tabletop GameplayProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581142(1-19)Online publication date: 19-Apr-2023
    • (2023)Sharing Speaker Heart Rate with the Audience Elicits Empathy and Increases PersuasionPersuasive Technology10.1007/978-3-031-30933-5_1(3-21)Online publication date: 19-Apr-2023
    • (2022)Nomopobia and phubbing: examining affective smartphone communication and family cohesion among youthsBehaviour & Information Technology10.1080/0144929X.2022.211127242:13(2126-2140)Online publication date: 6-Sep-2022
    • (2022)Adolescents’ Post-Divorce Sense of BelongingEuropean Psychologist10.1027/1016-9040/a00044427:4(277-290)Online publication date: Oct-2022
    • Show More Cited By

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media