Carlos Henrique Araujo de Aguiar
Zezhi Guo
ABSTRACT
During the pandemic, many people have found themselves physically isolated from each other for long periods. As a consequence, online communication tools have become the primary mean for social interaction among people in quarantine. However, texts and other chatting tools do not adequately transmit the complex emotions hidden behind them. Without the stimulation of sensations from face-to-face communications, people hinder their ability to observe others’ emotions and feelings effectively. In this work, we propose a system that aims to improve emotional communication. We present Touch—a combination of a social media app and a wearable device that can receive and display multi-sensory feedback, including light, digital display, vibrations, and tactile interaction to transfer emotions. While the app encourages interaction between users through virtual spaces, the wearable device further enriches people's communication by offering another means to express emotions not afforded by virtual interactions. Together, these two elements of the Touch project offer a sounding solution to the problem of misunderstanding in communication.
- A. S. Alaqra and A. Kitkowska, “Impact of Intrinsic Factors and COVID-19 Pandemic on the Use of Technology,” in Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama Japan, May 2021, pp. 1–7. doi: 10.1145/3411763.3451669.Google Scholar
Digital Library
- W. Wang , “On the Transition of Social Interaction from In-Person to Online: Predicting Changes in Social Media Usage of College Students during the COVID-19 Pandemic based on Pre-COVID-19 On-Campus Colocation,” in Proceedings of the 2021 International Conference on Multimodal Interaction, Montréal QC Canada, Oct. 2021, pp. 425–434. doi: 10.1145/3462244.3479888.Google ScholarDigital Library
- J. Deshmukh, R. P. Subbanarasimha, P. Bassin, V. S. Bitra, S. Srinivasa, and A. Sharma, “An Interactive Simulator for COVID-19 Trend Analysis,” in 8th ACM IKDD CODS and 26th COMAD, Bangalore India, Jan. 2021, pp. 385–389. doi: 10.1145/3430984.3430989.Google ScholarDigital Library
- R. De Michele, “Benefits, drawbacks and psychological impact of online lectures during quarantine due to Covid-19 pandemic,” in Proceedings of the 6th EAI International Conference on Smart Objects and Technologies for Social Good, Antwerp Belgium, Sep. 2020, pp. 257–260. doi: 10.1145/3411170.3411265.Google ScholarDigital Library
- M. A. brooke auxier, “Social Media Use in 2021.” [Online]. Available: https://www.pewresearch.org/internet/2021/04/07/social-media-use-in-2021/Google Scholar
- M. M. H. Pollmann, T. J. Norman, and E. E. Crockett, “A daily-diary study on the effects of face-to-face communication, texting, and their interplay on understanding and relationship satisfaction,” Comput. Hum. Behav. Rep., vol. 3, p. 100088, Jan. 2021, doi: 10.1016/j.chbr.2021.100088.Google ScholarCross Ref
- J. Alman, J. R. Wang, and H. Yu, “Cell-probe lower bounds from online communication complexity,” in Proceedings of the 50th Annual ACM SIGACT Symposium on Theory of Computing, Los Angeles CA USA, Jun. 2018, pp. 1003–1012. doi: 10.1145/3188745.3188862.Google ScholarDigital Library
- Z. Chen , “Emoji-powered Sentiment and Emotion Detection from Software Developers’ Communication Data,” ACM Trans. Softw. Eng. Methodol., vol. 30, no. 2, pp. 1–48, Apr. 2021, doi: 10.1145/3424308.Google ScholarDigital Library
- K. Kirkpatrick, “Natural language misunderstanding,” Commun. ACM, vol. 63, no. 11, pp. 17–18, Oct. 2020, doi: 10.1145/3422600.Google ScholarDigital Library
- H. Lim, D. Cosley, and S. R. Fussell, “Understanding Cross-lingual Pragmatic Misunderstandings in Email Communication,” Proc. ACM Hum.-Comput. Interact., vol. 6, no. CSCW1, pp. 1–32, Mar. 2022, doi: 10.1145/3512976.Google ScholarDigital Library
- N. Marsden, “Attitudes towards online communication: an exploratory factor analysis,” in Proceedings of the 2013 annual conference on Computers and people research - SIGMIS-CPR ’13, Cincinnati, Ohio, USA, 2013, p. 147. doi: 10.1145/2487294.2487326.Google ScholarDigital Library
- J.-E. Pelet and P. Papadopoulou, Eds., User Behavior in Ubiquitous Online Environments: IGI Global, 2014. doi: 10.4018/978-1-4666-4566-0.Google ScholarCross Ref
- M. J. Faris and K. R. Moore, “Emerging scholars and social media use: a pilot study of risk,” Commun. Des. Q., vol. 4, no. 2, pp. 52–63, Mar. 2017, doi: 10.1145/3068698.3068703.Google ScholarDigital Library
- J. Lee and G. Kim, “Social media user classification: based on social capital expectation, susceptibility, and compulsion loop,” in Proceedings of the International Conference on Electronic Commerce, Pangyo Seongnam Republic of Korea, Aug. 2017, pp. 1–3. doi: 10.1145/3154943.3154963.Google ScholarDigital Library
- I. G. Sarmiento , “Does social media use improve or worsen adolescents’ internalizing behaviors?: Conclusions from a systematic narrative review,” in Proceedings of the Technology, Mind, and Society, Washington DC USA, Apr. 2018, pp. 1–2. doi: 10.1145/3183654.3183699.Google ScholarDigital Library
- S. Mendu , “A Framework for Understanding the Relationship between Social Media Discourse and Mental Health,” Proc. ACM Hum.-Comput. Interact., vol. 4, no. CSCW2, pp. 1–23, Oct. 2020, doi: 10.1145/3415215.Google ScholarDigital Library
- J. Ma, “A Meta-Analysis of Social Media Usage with Stress, Anxiety, and Depression,” in 2021 the 3rd International Conference on Intelligent Medicine and Health, Macau China, Aug. 2021, pp. 125–129. doi: 10.1145/3484377.3487041.Google ScholarDigital Library
- K. K. Aldous, J. An, and B. J. Jansen, “Measuring 9 Emotions of News Posts from 8 News Organizations across 4 Social Media Platforms for 8 Months,” ACM Trans. Soc. Comput., vol. 4, no. 4, pp. 1–31, Dec. 2021, doi: 10.1145/3516491.Google ScholarDigital Library
- B. Martin and B. M. Hanington, Universal methods of design: 100 ways to research complex problems, develop innovative ideas, and design effective solutions, Digital ed. Beverly, MA: Rockport Publishers, 2012.Google Scholar
- W. Wu, L. Chen, and Q. Yang, “Inferring Students’ Sense of Community from Their Communication Behavior in Online Courses,” in Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization, Bratislava Slovakia, Jul. 2017, pp. 238–246. doi: 10.1145/3079628.3079678.Google ScholarDigital Library
- M. R. Hovde, “Effective user experience in online technical communication courses: employing multiple methods within organizational contexts to assess usability,” in Proceedings of the 33rd Annual International Conference on the Design of Communication, Limerick Ireland, Jul. 2015, pp. 1–5. doi: 10.1145/2775441.2775453.Google ScholarDigital Library
- U. Pfeil and P. Zaphiris, “Patterns of empathy in online communication,” in Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, San Jose California USA, Apr. 2007, pp. 919–928. doi: 10.1145/1240624.1240763.Google ScholarDigital Library
- C.-H. Tsai, X. Gui, Y. Kou, and J. M. Carroll, “With Help from Afar: Cross-Local Communication in an Online COVID-19 Pandemic Community,” Proc. ACM Hum.-Comput. Interact., vol. 5, no. CSCW2, pp. 1–24, Oct. 2021, doi: 10.1145/3476062.Google ScholarDigital Library
- Y. Heshmat and C. Neustaedter, “Family and Friend Communication over Distance in Canada During the COVID-19 Pandemic,” in Designing Interactive Systems Conference 2021, Virtual Event USA, Jun. 2021, pp. 1–14. doi: 10.1145/3461778.3462022.Google ScholarDigital Library
- H. Ray, R. Kuber, and A. J. Aviv, “Investigating older adults’ adoption and usage of online conferencing tools during COVID-19,” in Proceedings of the 19th International Web for All Conference, Lyon France, Apr. 2022, pp. 1–11. doi: 10.1145/3493612.3520447.Google ScholarDigital Library
- B. Barros Pena, R. E. Clarke, L. E. Holmquist, and J. Vines, “Circumspect Users: Older Adults as Critical Adopters and Resistors of Technology,” in Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, Yokohama Japan, May 2021, pp. 1–14. doi: 10.1145/3411764.3445128.Google ScholarDigital Library
- M. Felt, D. Dumitrica, and R. Teruelle, “Social Media Obstacles in Grassroots Civic Mobilizations,” in Proceedings of the 9th International Conference on Social Media and Society, Copenhagen Denmark, Jul. 2018, pp. 71–81. doi: 10.1145/3217804.3217899.Google ScholarDigital Library
Index Terms
- TOUCH: A Multi-sensory Communication System that Communicates Emotions
Recommendations
Emotion Evoked by Texture and Application to Emotional Communication
CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing SystemsThe tactile sense is direct and intuitive, and considered appropriate for communicating emotional information. It is expected that emotional communication will be richer when including the use of the tactile sense. This study focuses on textures as ...
Touch+: Expanding Touch Input Vocabulary using a Smartphone and a Smartwatch
CHI EA '15: Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing SystemsIn this video, we present a new interaction technique, called Touch+, which expands touch input vocabulary by using both mobile devices and wrist-worn devices. This technique enables to recognize twisting, rolling, and lifting of a finger while it is ...
Emotion Explorers & Zen: AI System and Voice Assistant for Exploring Emotions and Cultivating Compassion
IDC '23: Proceedings of the 22nd Annual ACM Interaction Design and Children ConferenceEmotion Explorers is an AI system that assists 6-11-year-old children to understand emotions, aims to have a long-lasting impact on children's emotional behaviors, and creates a compassionate, connected, safe environment. The system can be integrated ...
Comments