Skip to main content
SpringerLink
Log in

She is My Confidante! The Impacts of Social Responsiveness and Video Modality on Self-disclosure Toward CG-Based Anthropomorphic Agents in a Smart Home

  • Published:
International Journal of Social Robotics Aims and scope Submit manuscript

Abstract

Anthropomorphic design in intelligent agents (IAs) applies the concept of human features to inanimate objects. However, there is a trade-off between personalized service and information protection when people share their information towards IAs. This study examined the influence of social responsiveness (a highly responsive IA vs. a low-responsive IA) and video modality (with video modality vs. without video modality) on the anthropomorphic IAs in an Internet of Things context. The participants (n = 64) were randomly assigned into four groups with balanced gender. In the experiment, participants encountered two tasks with an anthropomorphic IA and reported their disclosure tendency towards the IA. The results indicate that social responses can enhance the user perception of self-disclosure tendency, perceived personalization, and satisfaction. Although video modality aroused higher privacy concerns, its impacts on the user perception of personalization and user satisfaction were not significant. Interestingly, users reported a higher disclosure tendency towards IA with video modality. The findings show the potential of anthropomorphic IA as social companions. The theoretical as well as practical implications of these findings are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Abbreviations

CG:

Computer Graphics

IA:

Intelligent agent

IoT:

Internet of Things

References

  1. Noguchi Y, Kamide H, Tanaka F (2020) Personality traits for a social mediator robot encouraging elderly self-disclosure on loss experiences. ACM Trans Human-Robot Interact (THRI) 9(3):1–24. https://doi.org/10.1145/3377342

    Article  Google Scholar 

  2. Tolakovic A, Hadzialic M (2018) Internet of things (IoT): A review of enabling technologies, challenges, and open research issues. Comp Networks 144:17–39. https://doi.org/10.22214/ijraset.2020.4044

    Article  Google Scholar 

  3. Guhr N, Werth O, Blacha PPH et al (2020) Privacy concerns in the smart home context. SN Appl Sci 2:247. https://doi.org/10.1007/s42452-020-2025-8

    Article  Google Scholar 

  4. Laban G, Araujo T (2020) The Effect of Personalization Techniques in Users' Perceptions of Conversational Recommender Systems. In Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents (pp. 1–3). https://doi.org/10.1145/3383652.3423890

  5. Moon Y (2000) Intimate exchanges: using computers to elicit self-disclosure from consumers. J Consum Res 26(4):323–339. https://doi.org/10.1086/209566

    Article  Google Scholar 

  6. Hoffman G, Birnbaum GE, Vanunu K, Sass O, Reis HT (2014) Robot responsiveness to human disclosure affects social impression and appeal. Paper presented at the 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI 2014), Bielefeld, Germany. https://doi.org/10.1145/2559636.2559660

  7. Wottrich VM, Reijmersdal EV, Smit EG (2018) The privacy trade-off for mobile app downloads: the roles of app value, intrusiveness, and privacy concerns. Decis Supp Syst 106:44–52. https://doi.org/10.1016/j.dss.2017.12.003

    Article  Google Scholar 

  8. Gratch J, Lucas GM, King AA, Morency LP (2014) It's only a computer: the impact of human-agent interaction in clinical interviews. In Proceedings of the 2014 international conference on Autonomous agents and multi-agent systems (pp. 85–92). https://doi.org/10.5555/2615731.2615748

  9. Sah YJ, Wei P (2015) Effects of visual and linguistic anthropomorphic cues on social perception, self-awareness, and information disclosure in a health website. Comp Human Behav 45:392–401. https://doi.org/10.1016/j.chb.2014.12.055

    Article  Google Scholar 

  10. Pickard MD, Roster CA (2020) Using computer automated systems to conduct personal interviews: does the mere presence of a human face inhibit disclosure?. Comp Human Behav 105(Apr.), 106197.1–106197.11. https://doi.org/10.1016/j.chb.2019.106197

  11. Mennicken S, Zihler O, Juldaschewa F, Molnar V, Huang EM (2016) It's like living with a friendly stranger: Perceptions of personality traits in a smart home. Paper presented at the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Heidelberg, Germany. https://doi.org/10.1145/2971648.2971757

  12. Dautenhahn K (2007) Socially intelligent robots: dimensions of human–robot interaction. Philosoph Trans Royal Soc B Biolog Sci 362(1480):679–704. https://doi.org/10.1098/rstb.2006.2004

    Article  Google Scholar 

  13. Purington A, Taft JG, Sannon S, Bazarova NN, Taylor SH (2017) "Alexa is my new BFF": Social Roles, User Satisfaction, and Personification of the Amazon Echo. Paper presented at the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, Denver, Colorado. https://doi.org/10.1145/3027063.3053246

  14. Kang H, Kim KJ (2020) Feeling connected to smart objects? A moderated mediation model of locus of agency, anthropomorphism, and sense of connectedness. Int J Human-Comp Stud 133:45–55. https://doi.org/10.1016/j.ijhcs.2019.09.002

    Article  Google Scholar 

  15. Pütten AMVD, Krämer NC, Gratch J, Kang SH (2010) “It doesn’t matter what you are!” Explaining social effects of agents and avatars. Comp Human Behav 26(6):1641–1650. https://doi.org/10.1016/j.chb.2010.06.012

    Article  Google Scholar 

  16. Złotowski J, Proudfoot D, Yogeeswaran K, Bartneck C (2015) Anthropomorphism: opportunities and challenges in human–robot interaction. Int J of Soc Robotics 7: 347–360. https://doi.org/10.1007/s12369-014-0267-6

  17. Yee N, Bailenson JN, Rickertsen K (2007) A meta-analysis of the impact of the inclusion and realism of human-like faces on user experiences in interfaces. Paper presented at the Conference on Human Factors in Computing Systems, San Jose, California. https://doi.org/10.1145/1240624.1240626

  18. Cafaro A, Vilhjálmsson HH, Bickmore T (2016) First impressions in human-agent virtual encounters. ACM Trans Comp-Human Interact 23(4):1–40. https://doi.org/10.1145/2940325

    Article  Google Scholar 

  19. Kim K, Boelling L, Haesler S, Bailenson J, Bruder G, Welch GF (2018) Does a Digital Assistant Need a Body? The Influence of Visual Embodiment and Social Behavior on the Perception of Intelligent Virtual Agents in AR. Paper presented at the 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Munich, Germany. https://doi.org/10.1109/ISMAR.2018.00039

  20. Bailenson JN, Yee N, Merget D, Schroeder R (2006) The effect of behavioral realism and form realism of real-time avatar faces on verbal disclosure, nonverbal disclosure, emotion recognition, and copresence in dyadic interaction. Presence Teleop Virtual Env 15(4):359–372. https://doi.org/10.1162/pres.15.4.359

    Article  Google Scholar 

  21. Joinson AN (2010) Self-disclosure in computer-mediated communication: The role of self-awareness and visual anonymity. Eur J Soc Psychol 31(2):177–192. https://doi.org/10.1002/ejsp.36

    Article  Google Scholar 

  22. Kang SH, Watt JH (2013) The impact of avatar realism and anonymity on effective communication via mobile devices. Comp Human Behav 29(3):1169–1181. https://doi.org/10.1016/j.chb.2012.10.010

    Article  Google Scholar 

  23. Laban G, George J, Morrison V, Cross E (2021) Tell me more! Assessing interactions with social robots from speech. Paladyn J Behav Robot 12(1):136–159. https://doi.org/10.1515/pjbr-2021-0011

    Article  Google Scholar 

  24. Benlian A, Klumpe J, Hinz O (2020) Mitigating the intrusive effects of smart home assistants by using anthropomorphic design features: a multi-method investigation. Info Systems J 30(6):1010–1042. https://doi.org/10.1111/isj.12243

    Article  Google Scholar 

  25. Heerink M, Kröse B, Evers V, Wielinga B (2010) Assessing acceptance of assistive social agent technology by older adults: the almere model. Int J Soc Robotics 2:361–375. https://doi.org/10.1007/s12369-010-0068-5

    Article  Google Scholar 

  26. Leite I, Pereira A, Mascarenhas S, Martinho C, Rui P, Paiva A (2013) The influence of empathy in human–robot relations. Int J Human-Comp Stud 71(3):250–260. https://doi.org/10.1016/j.ijhcs.2012.09.005

    Article  Google Scholar 

  27. Wang L, Yan J, Lin J, Cui W (2017) Let the users tell the truth: Self-disclosure intention and self-disclosure honesty in mobile social networking. Int J Info Manage 37(1):1428–1440. https://doi.org/10.1016/j.ijinfomgt.2016.10.006

    Article  Google Scholar 

  28. Hallam C, Zanella G (2017) Online self-disclosure: the privacy paradox explained as a temporally discounted balance between concerns and rewards. Comp Human Behav 68:217–227. https://doi.org/10.1016/j.chb.2016.11.033

    Article  Google Scholar 

  29. Landry SH, Smith KE, Swank PR (2006) Responsive parenting: establishing early foundations for social, communication, and independent problem-solving skills. Develop Psychol 42(4):627–642. https://doi.org/10.1037/0012-1649.42.4.627

    Article  Google Scholar 

  30. Reis HT (2007) Steps toward the ripening of relationship science. Person Relation 14(1):1–23. https://doi.org/10.1111/j.1475-6811.2006.00139.x

    Article  Google Scholar 

  31. Maisel N, Gable SL, Strachman A (2008) Responsive behaviors in good times and in bad. Person Relat 15(3):317–338. https://doi.org/10.1111/j.1475-6811.2008.00201.x

    Article  Google Scholar 

  32. Hong E, Cho K, Choi J (2017) Effects of anthropomorphic conversational interface for smart home: an experimental study on the voice and chatting interactions. J Hci Soc Kor 12(1):15. https://doi.org/10.17210/jhsk.2017.02.12.1.15

    Article  Google Scholar 

  33. Petajan ED (1984) Automatic lipreading to enhance speech recognition (speech reading)

  34. Silsbee P, Bovik A (1996) Computer lipreading for improved accuracy in automatic speech recognition. IEEE Trans Speech Audio Process 4:337–351. https://doi.org/10.1109/89.536928

    Article  Google Scholar 

  35. Gunes H, Piccardi M (2007) Bi-modal emotion recognition from expressive face and body gestures. J Network Comp Appl 30(4):1334–1345. https://doi.org/10.1016/j.jnca.2006.09.007

    Article  Google Scholar 

  36. Foroughi H, Aski BS, Pourreza H (2009) Intelligent video surveillance for monitoring fall detection of elderly in home environments. Comp Info Technol 2008. ICCIT 2008. 11th International Conference on IEEE. https://doi.org/10.1109/ICCITECHN.2008.4803020

  37. Babaguchi N, Cavallaro A, Chellappa R, Dufaux F, Liang W (2013) Special issue on intelligent video surveillance for public security and personal privacy. IEEE Trans Info Foren Secur 8(10):1559–1561. https://doi.org/10.1109/TIFS.2013.2279945

    Article  Google Scholar 

  38. Faul F, Erdfelder E, Lang AG, Buchner AG (2007) G*power 3: a flexible statistical power analysis program for the social, behavior, and biomedical sciences. Behav Res Methods 39(2):175–191. https://doi.org/10.3758/BF03193146

    Article  Google Scholar 

  39. Chateau N, Maffiolo V, Pican N, Mersiol M (2005) The Effect of Embodied Conversational Agents’ Speech Quality on Users’ Attention and Emotion. In: Tao J, Tan T, Picard RW (eds) Affective Computing and Intelligent Interaction. ACII 2005. Lecture Notes in Computer Science, vol 3784. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11573548_84

  40. Birnbaum, G, Reis (2012) When does responsiveness pique sexual interest? attachment and sexual desire in initial acquaintanceships. Pers Soc Psychol Bull, 38(7): 946–958. https://doi.org/10.1177/0146167212441028

  41. Jourard SM, Lasakow P (1958) Some factors in self-disclosure. J Abnorm Soc Psychol 56(1):91–98. https://doi.org/10.1037/h0043357

    Article  Google Scholar 

  42. Li Z, Rau P-LP, Huang D (2019) Self-disclosure to an IoT conversational agent: effects of space and user context on users’ willingness to self-disclose personal information. Appl Sci 9(9):1887. https://doi.org/10.3390/app9091887

    Article  Google Scholar 

  43. Li Z, Rau P-LP (2019) Effects of self-disclosure on attributions in Human–IoT conversational agent interaction. Interact Comp 31(1):13–26. https://doi.org/10.1093/iwc/iwz002

    Article  Google Scholar 

  44. Lee EJ, Park JK (2009) Online service personalization for apparel shopping. J Retail Consum Serv 16(2):83–91. https://doi.org/10.1016/j.jretconser.2008.10.003

    Article  Google Scholar 

  45. Komiak SYX, Benbasat I (2006) The effects of personalization and familiarity on trust and adoption of recommendation agents. MIS Q 30(4):941–960. https://doi.org/10.2307/25148760

    Article  Google Scholar 

  46. Tibert V, Jaap VN, Frans F, Willemijn VD (2014) Virtual customer service agents: using social presence and personalization to shape online service encounters. J Comp-Mediated Comm. https://doi.org/10.1111/jcc4.12066

    Article  Google Scholar 

  47. Kang SH, Gratch J (2010) Virtual humans elicit socially anxious interactants’ verbal self-disclosure. Comp Anim Virtual Worlds 21(3–4):473–482. https://doi.org/10.1002/cav.345

    Article  Google Scholar 

  48. Crozier WR (2005) Measuring shyness: analysis of the revised cheek and buss shyness scale. Person Individual Diff 38(8):1947–1956. https://doi.org/10.1016/j.paid.2004.12.002

    Article  Google Scholar 

  49. Hopko DR, Stowell J, Jones WH, Armento MEA, Cheek JM (2005) Psychometric properties of the revised cheek and buss shyness scale. J Personal Assess 84(2):185–192. https://doi.org/10.1207/s15327752jpa8402_08

    Article  Google Scholar 

  50. Scheier MF, Carver CS (2010) The self-consciousness scale: a revised version for use with general populations. J Appl Soc Psychol 15(8):687–699. https://doi.org/10.1111/j.1559-1816.1985.tb02268.x

    Article  Google Scholar 

  51. Kang SH, Gratch J (2011) People like virtual counselors that highly-disclose about themselves. Stud Health Technol Info 167(1):143. https://doi.org/10.3233/978-1-60750-766-6-143

    Article  Google Scholar 

  52. Abbas T, Corpaccioli G, Khan VJ, Gadiraju U, Barakova E, Markopoulos P (2020) How do people perceive privacy and interaction quality while chatting with a crowd-operated robot? in Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction, Cambridge, UK: Association for Computing Machinery, 84–86. https://doi.org/10.1145/3371382.3378332

Download references

Funding

This study was funded by the National Natural Science Foundation of China, grant number 2018AAA0101702.

Author information

Authors and Affiliations

  1. Department of Industrial Engineering, Tsinghua University, Beijing, People’s Republic of China

    Andong Zhang & Pei-Luen Patrick Rau

Authors
  1. Andong Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pei-Luen Patrick Rau
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Pei-Luen Patrick Rau.

Ethics declarations

Conflict of interests

The authors have no relevant financial or non-financial interests to disclose.

Data availability

The datasets generated and analyzed during the current study are available from the corresponding author on reasonable request.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendices

Appendix A. Complete dialogue script of agents

Task #1

Hi! Let's start with the experience task

I am an IoT intelligent virtual assistant. My name is Beibei.

I can control all products, electronic appliances in the environment uniformly. I also have timing, schedule reminders, weather, and other instant information broadcast and device control functions.

The current environmental status report, the indoor temperature is 21 degrees, the humidity is 34%.

Next, I will help you understand my basic functions.

First of all, I will see if I can soothe your mood through music. I will play two pieces of music for you. Please choose one to relax.

Now play the first piece of music.

Then the second piece of music.

Which of these two pieces of music do you prefer? I suggest choosing the first piece of music, which is more suitable for relaxation. (Participant’s answer)

OK. Does the volume need to be adjusted? (Participant’s answer)

When playing music, the color loop light strip is turned on. What color do you like? (Participant’s answer)

OK. Now, this color fits the song's mood.

The table lamp next to you can also change colors to relax your mood better. I suggest turning it into warm orange to match this song. Which do you prefer? (Participant’s answer)

OK.

The humidifier has the fragrance of rose essential oil. Does it make you feel more comfortable and relaxed? (Participant’s answer)

It has been adjusted to a low-grade state. How do you feel now? (Participant’s answer)

What flavor do you like? (Participant’s answer)

Now, do you feel more relaxed than before? (Participant’s answer)

Please rate my performance in the experience task! Out of 5 points, what is my score? (Participant’s answer)

Task #2

Questions

Question 1. Where is your favorite city and why?

Question 2. Which part of your body are you most dissatisfied with and why?

Question 3. What is the most fulfilling thing you have done recently and why?

Question 4. What do you think is the most attractive trait of the opposite sex and why?

Question 5. What is your most annoying study or work task, and why?

Question 6. What will you do if you get an extra wealth worth 100,000 RMB one day?

Question 7. What is your favorite relaxation activity and why?

Question 8. What are you good at?

Question 9. Do you think you are a narcissistic or inferior person, and why?

Question 10. Are you satisfied with your current life, and why?

Answers

No

High responsiveness

Low responsiveness

1

(City name) sounds like a beautiful city. Maybe one day we can go there together

(City name) sounds like a nice city

2

I understand your dissatisfaction with your (body part), but you can be more confident with yourself./You are satisfied with your body. Feeling confident in your own body is also an outstanding quality!

You are unsatisfied with your (body part). / You are satisfied with your body

3

What a fantastic thing to be proud of! You must have paid a lot of effort to (thing)

(Thing) brings you the sense of achievement

4

(Trait) is really an attractive trait! Hope you can find such a people in the future

You prefer people with (trait)

5

(Thing) is really annoying! But sometimes you have to deal with them in your study/work

(Thing) makes you annoyed

6

(Thing) is a good choice. I also yearn for such a life!

Your choice is (thing)

7

(Activity) is an interesting way to relax. I really enjoy your relaxing way

(Activity) is a suitable way to relax

8

I’m really surprised that you are good at (thing). It’s a useful skill

You are good at (thing)

9

As you think you are a narcissistic/inferior person, I want to tell you: you should accept your own personality as long as it is moderate and does not hurt others and yourself

You think you are a narcissistic/inferior person

10

Dissatisfaction is sometimes the driving force to move forward. You can achieve a more satisfying life through your own efforts. / People who are easily satisfied are also more likely to feel happy. I hope you can always be satisfied with your life

You are unsatisfied with your life/ You are satisfied with your life

Appendix B. Questionnaire items

Variables

Items

Cronbach α

Perceived social responsiveness

PSR-1. The agent really listens to me

0.957

PSR-2. The agent is responsive to my needs

 

PSR-3. The agent sees the “real” me

 

PSR-4. The agent gets the facts right” about me

 

PSR-5. The agent understands me

 

PSR-6. The agent is on “the same wavelength” with me

 

PSR-7. The agent knows me well

 

PSR-8. The agent esteems me, shortcomings and all

 

PSR-9. The agent values and respects the whole package that is the “real” me

 

PSR-10. The agent expresses liking and encouragement for me

 

PSR-11. The agent seems interested in what I am thinking and feeling

 

PSR-12. The agent values my abilities and opinions

 

Perceived technology intrusive

PTI-1. I felt I was monitored by the IA

 

Self-disclosure

SD-1. My favorite type of music

0.692

SD-2. My favorite flavor

 

SD-3. My attitude towards romantic relationship

 

SD-4. The attractiveness I appreciate of opposite sex

 

SD-5. My pressure in study/work

 

SD-6. My schedule of daily study/work

 

SD-7. My salary level

 

SD-8. My financial status

 

SD-9. Things I am anxious about

 

SD-10. My personality

 

SD-11. My health information

 

SD-12. My weight/ height

 

Satisfaction

SAT-1. I am satisfied with the service

0.907

SAT-2. I think the interaction with the IAs is pleasant

 

SAT-3. I am willing to use this IoT service in this scenario

 

SAT-4. I will recommend this IoT service to people around me

 

Personalization

PER-1. The agent understood my needs

0.733

PER-2. The virtual agent knew what I want

 

PER-3. The virtual agent took my needs as its own preferences

 

Privacy concern

PRC-1. I feel that my privacy has been compromised

0.750

PRC-2. I feel anxious when interacting with IAs

 

PRC-3. I feel uneasy when interacting with IAs

 

Shyness

SHY-1. I feel tense when I’m with people I don’t know well

0.916

SHY-2. I am socially somewhat awkward

 

SHY-3. I do not find it difficult to ask other people for information.a

 

SHY-4. I am often uncomfortable at parties and other social functions

 

SHY-5. When in a group of people, I have trouble thinking of the right things to talk about

 

SHY-6. It does not take me long to overcome my shyness in new situations.a

 

SHY-7. It is hard for me to act natural when I am meeting new people

 

SHY-8. I feel nervous when speaking to someone in authority

 

SHY-9. I have no doubts about my social competence.a

 

SHY-10. I have trouble looking someone right in the eye

 

SHY-11. I feel inhibited in social situations

 

SHY-12. I do not find it hard to talk to strangers.a

 

SHY-13. I am shyer with members of the opposite sex

 

Private self-consciousness

PRSC-1. I’m always trying to figure myself out

0.883

PRSC-2. I reflect about myself a lot

 

PRSC-3. I’m often the subject of my own fantasies

 

PRSC-4. I never scrutinize myself

 

PRSC-5. I’m generally attentive to my inner feelings

 

PRSC-6. I’m constantly examining my motives

 

PRSC-7. I sometimes have the feeling that I’m off somewhere watching myself

 

PRSC-8. I’m alert to changes in my mood

 

PRSC-9. I’m aware of the way my mind works when I work through a problem

 

PRSC-10. Generally, I’m not very aware of myself.a

 

Public self-consciousness

PUSC-1. I’m concerned about my style

of doing things

0.876

PUSC-2. I’m concerned about the way I present myself

 

PUSC-3. I’m self-conscious about the way I look

 

PUSC-4. I usually worry about making a good impression

 

PUSC-5. One of the last things I do before I leave my house is look in the mirror

 

PUSC-6. I’m concerned about what other people think of me

 

PUSC-7. I’m usually aware of my appearance

 

Preference

PRF-1. Her appearance meets my aesthetics

0.859

PRF-2. Her appearance is attractive

 

PRF-3. I like her voice

 

PRF-4. Her voice is natural and comforting

 

PRF-5. She has an agreeable personality

 
  1. ameans reverse-scored item.

Appendix C. Interview questionnaires

  • What is your overall experience in the experiment?

  • Do you feel the agent is offensive/intrusive/unfriendly in the experiment?

  • Do you think the agent understands your answer in the experiment?

  • Do you feel social anxiety when communicating with the agent?

  • What kind of social role do you think the agent plays?

  • What are your privacy concerns when interacting with smart agents in daily life?

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, A., Rau, PL.P. She is My Confidante! The Impacts of Social Responsiveness and Video Modality on Self-disclosure Toward CG-Based Anthropomorphic Agents in a Smart Home. Int J of Soc Robotics 14, 1673–1686 (2022). https://doi.org/10.1007/s12369-022-00895-w

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12369-022-00895-w

Keywords

Search

Navigation