skip to main content
research-article
Public Access

Social-Emotional-Sensory Design Map for Affective Computing Informed by Neurodivergent Experiences

Published: 22 April 2021 Publication History

Abstract

One of the grand challenges of artificial intelligence and affective computing is for technology to become emotionally-aware and thus, more human-like. Modeling human emotions is particularly complicated when we consider the lived experiences of people who are on the autism spectrum. To understand the emotional experiences of autistic adults and their attitudes towards common representations of emotions, we deployed a context study as the first phase of a Grounded Design research project. Based on community observations and interviews, this work contributes empirical evidence of how the emotional experiences of autistic adults are entangled with social interactions as well as the processing of sensory inputs. We learned that (1) the emotional experiences of autistic adults are embodied and co-constructed within the context of physical environments, social relationships, and technology use, and (2) conventional approaches to visually representing emotion in affective education and computing systems fail to accurately represent the experiences and perceptions of autistic adults. We contribute a social-emotional-sensory design map to guide designers in creating more diverse and nuanced affective computing interfaces that are enriched by accounting for neurodivergent users.

References

[1]
Meryl Alper. 2018. Inclusive sensory ethnography: Studying new media and neurodiversity in everyday life. New Media & Society 20, 10: 3560--3579. https://doi.org/10.1177/1461444818755394
[2]
American Psychiatric Association. 2013. Diagnostic and Statistical Manual of Mental Disorders (5th ed.).
[3]
Nazanin Andalibi and Justin Buss. 2020. The Human in Emotion Recognition on Social Media: Attitudes, Outcomes, Risks. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 16. https://doi.org/10.1145/3313831.3376680
[4]
Simon Baron-Cohen, Emma Ashwin, Chris Ashwin, Teresa Tavassoli, and Bhismadev Chakrabarti. 2009. Talent in autism: hyper-systemizing, hyper-attention to detail and sensory hypersensitivity. Philosophical Transactions of the Royal Society B: Biological Sciences 364, 1522: 1377--1383. https://doi.org/10.1098/rstb.2008.0337
[5]
Lisa Feldman Barrett. 2017. How Emotions Are Made: The Secret Life of the Brain. Mariner Books.
[6]
Karin Barron. 1999. Ethics in qualitative social research on marginalized groups. Scandinavian Journal of Disability Research 1, 1: 38--49. https://doi.org/10.1080/15017419909510736
[7]
Laura Benton, Asimina Vasalou, Rilla Khaled, Hilary Johnson, and Daniel Gooch. 2014. Diversity for design: a framework for involving neurodiverse children in the technology design process. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 3747--3756. https://doi.org/10.1145/2556288.2557244
[8]
Mariana Aparicio Betancourt, Laura S. Dethorne, Karrie Karahalios, and Jennifer G. Kim. 2017. Skin Conductance as an In Situ Marker for Emotional Arousal in Children with Neurodevelopmental Communication Impairments: Methodological Considerations and Clinical Implications. ACM Transactions on Accessible Computing 9, 3: 1--29. https://doi.org/10.1145/3035536
[9]
LouAnne E. Boyd, Alejandro Rangel, Helen Tomimbang, Andrea Conejo-Toledo, Kanika Patel, Monica Tentori, and Gillian R. Hayes. 2016. SayWAT: Augmenting Face-to-Face Conversations for Adults with Autism. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16, 4872--4883. https://doi.org/10.1145/2858036.2858215
[10]
Maria Brincker and Elizabeth B. Torres. 2013. Noise from the periphery in autism. Frontiers in Integrative Neuroscience 7. https://doi.org/10.3389/fnint.2013.00034
[11]
Audrey F. Burgess and Steven E. Gutstein. 2007. Quality of Life for People with Autism: Raising the Standard for Evaluating Successful Outcomes. Child and Adolescent Mental Health 12, 2: 80--86. https://doi.org/10.1111/j.1475--3588.2006.00432.x
[12]
Moira Burke, Robert Kraut, and Diane Williams. 2010. Social Use of Computer-Mediated Communication by Adults on the Autism Spectrum. In Proceedings of the ACM Conference on Computer Supported Cooperative Work (CSCW '10) (CSCW '10), 425--434. https://doi.org/10.1145/1718918.1718991
[13]
M. Catherine Cappadocia, Jonathan A. Weiss, and Debra Pepler. 2012. Bullying Experiences Among Children and Youth with Autism Spectrum Disorders. J Autism Dev Disord 42: 266--277.
[14]
Stuart K Card, Jock D Muckinlay, and George G Robertson. 1990. The Design Space of Input Devices. ACM CHI '90: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems: 117--124.
[15]
Elizabeth J. Carter, Jennifer Hyde, Diane L. Williams, and Jessica K. Hodgins. 2016. Investigating the Influence of Avatar Facial Characteristics on the Social Behaviors of Children with Autism. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16, 140--151. https://doi.org/10.1145/2858036.2858345
[16]
K. Conallen and P. Reed. 2017. Children with autism spectrum disorder: teaching conversation involving feelings about events. Journal of Intellectual Disability Research 61, 3: 279--291. https://doi.org/10.1111/jir.12339
[17]
Joyce Davidson and Michael Orsini. 2010. The place of emotions in critical autism studies. Emotion, Space and Society 3, 2: 131--133. https://doi.org/10.1016/j.emospa.2010.10.005
[18]
Richard J. Davidson, Klaus R. Scherer, and H. Hill Goldsmith (eds.). 2002. Handbook of Affective Sciences. Oxford University Press.
[19]
Hanne De Jaegher. 2013. Embodiment and sense-making in autism. Frontiers in Integrative Neuroscience 7. https://doi.org/10.3389/fnint.2013.00015
[20]
Sarah Dettmer, Richard L. Simpson, Brenda Smith Myles, and Jennifer B. Ganz. 2000. The use of visual supports to facilitate transitions of students with autism. Focus on Autism and Other Developmental Disabilities 15, 3: 163--169.
[21]
Vailt Dieter. 1996. Interoception.
[22]
Paul Dourish. 2006. Implications for design. In Proceedings of the SIGCHI conference on Human Factors in computing systems, 541--550.
[23]
Paul Ekman. 1999. Basic Emotions. In Handbook of Cognition and Emotion. John Wiley & Sons Ltd, 45--60.
[24]
Mike Elgan. 2019. What happens when cars get emotional? Fast Company. Retrieved September 10, 2020 from https://www.fastcompany.com/90368804/emotion-sensing-cars-promise-to-make-our-roads-much-safer
[25]
Laura L. Ellingson. 2017. Speaking Of/For Bodies: Embodying Representation. In Embodiment in Qualitative Research. Routledge, 167--187.
[26]
Angela Fessl, Verónica Rivera-Pelayo, Viktoria Pammer, and Simone Braun. 2012. Mood tracking in virtual meetings. 21st century learning for 21st century skills: 377--382.
[27]
Klaus Fiedler and Susanne Beier. 2013. Affect and Cognitive Processes in Educational Contexts. In International Handbook of Emotions in Education. Routledge. https://doi.org/10.4324/9780203148211.ch3
[28]
Peter Francis, Sandrine Balbo, and Lucy Firth. 2009. Towards co-design with users who have autism spectrum disorders. Universal Access in the Information Society 8, 3: 123--135. https://doi.org/10.1007/s10209-008-0143-y
[29]
Katharina S. Goerlich. 2018. The Multifaceted Nature of Alexithymia -- A Neuroscientific Perspective. Frontiers in Psychology 9: 1614. https://doi.org/10.3389/fpsyg.2018.01614
[30]
Matthew S. Goodwin, Stephen S. Intille, Wayne F. Velicer, and June Groden. 2008. Sensor-enabled detection of stereotypical motor movements in persons with autism spectrum disorder. In Proceedings of the 7th international conference on Interaction design and children, 109--112.
[31]
Ouriel Grynszpan, Jean-Claude Martin, and Jacqueline Nadel. 2005. Human computer interfaces for autism: assessing the influence of task assignment and output modalities. 1419--1422. https://doi.org/10.1145/1056808.1056931
[32]
Ouriel Grynszpan, Patrice L. Weiss, Fernando Perez-Diaz, and Eynat Gal. 2014. Innovative technology-based interventions for autism spectrum disorders: a meta-analysis. Autism 18, 4: 346--361.
[33]
Jennifer Fong Ha and Nancy Longnecker. 2010. Doctor-Patient Communication: A Review. The Ochsner Journal 10, 1: 38--43.
[34]
David Hankerson, Andrea R. Marshall, Jennifer Booker, Houda El Mimouni, Imani Walker, and Jennifer A. Rode. 2016. Does Technology Have Race? In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems - CHI EA '16, 473--486. https://doi.org/10.1145/2851581.2892578
[35]
Gillian R. Hayes, V. Erick Custodio, Oliver L. Haimson, Kathy Nguyen, Kathryn E. Ringland, Rachel Rose Ulgado, Aaron Waterhouse, and Rachel Weiner. 2015. Mobile video modeling for employment interviews for individuals with autism. Journal of Vocational Rehabilitation 43, 3: 275--287. https://doi.org/10.3233/JVR-150775
[36]
Gillian R. Hayes, Sen Hirano, Gabriela Marcu, Mohamad Monibi, David H. Nguyen, and Michael Yeganyan. 2010. Interactive visual supports for children with autism. Personal and Ubiquitous Computing 14, 7: 663--680. https://doi.org/10.1007/s00779-010-0294--8
[37]
Hwajung Hong, Jennifer G. Kim, Gregory D. Abowd, and Rosa I. Arriaga. 2012. SocialMirror: motivating young adults with autism to practice life skills in a social world. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work, 41--42. https://doi.org/10.1145/2141512.2141533
[38]
Daniel W. Hoover. 2015. The Effects of Psychological Trauma on Children with Autism Spectrum Disorders: a Research Review. Review Journal of Autism and Developmental Disorders 2, 3: 287--299. https://doi.org/10.1007/s40489-015-0052-y
[39]
Ayanna Howard, Cha Zhang, and Eric Horvitz. 2017. Addressing bias in machine learning algorithms: A pilot study on emotion recognition for intelligent systems. In 2017 IEEE Workshop on Advanced Robotics and its Social Impacts (ARSO), 1--7. https://doi.org/10.1109/ARSO.2017.8025197
[40]
Grace Iarocci and John McDonald. 2006. Sensory Integration and the Perceptual Experience of Persons with Autism. Journal of Autism and Developmental Disorders 36, 1: 77--90. https://doi.org/10.1007/s10803-005-0044--3
[41]
Emily M. Istvan, Rose E. Nevill, and Micah O. Mazurek. 2020. Sensory over-responsivity, repetitive behavior, and emotional functioning in boys with and without autism spectrum disorder. Research in Autism Spectrum Disorders 75: 101573. https://doi.org/10.1016/j.rasd.2020.101573
[42]
Myounghoon Jeon. 2017. Emotions in Driving. In Emotions and Affect in Human Factors and Human-Computer Interaction. Elsevier.
[43]
R. E. Kaliouby, R. Picard, and S. Baron-Cohen. 2006. Affective Computing and Autism. Annals of the New York Academy of Sciences 1093, 1: 228--248. https://doi.org/10.1196/annals.1382.016
[44]
Harmanpreet Kaur, Alex C. Williams, Daniel McDuff, Mary Czerwinski, Jaime Teevan, and Shamsi T. Iqbal. 2020. Optimizing for Happiness and Productivity: Modeling Opportune Moments for Transitions and Breaks at Work. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1--15. https://doi.org/10.1145/3313831.3376817
[45]
Connor Morrow Kerns, Craig J. Newschaffer, and Steven J. Berkowitz. 2015. Traumatic Childhood Events and Autism Spectrum Disorder. Journal of Autism and Developmental Disorders 45, 11: 3475--3486. https://doi.org/10.1007/s10803-015--2392-y
[46]
Os Keyes. 2018. The Misgendering Machines: Trans/HCI Implications of Automatic Gender Recognition. Proceedings of the ACM on Human-Computer Interaction 2(CSCW), CSCW: 1--22. https://doi.org/10.1145/3274357
[47]
M. Mary Konstantareas and Kelly Stewart. 2006. Affect Regulation and Temperament in Children with Autism Spectrum Disorder. Journal of Autism and Developmental Disorders 36, 2: 143--154. https://doi.org/10.1007/s10803-005-0051--4
[48]
Adam D. I. Kramer, Jamie E. Guillory, and Jeffrey T. Hancock. 2014. Experimental evidence of massive-scale emotional contagion through social networks. Proceedings of the National Academy of Sciences 111, 24: 8788--8790. https://doi.org/10.1073/pnas.1320040111
[49]
Leah Kuypers. 2011. Zones of Regulation. Think Social Publishing.
[50]
Minha Lee, Sander Ackermans, Nena van As, Hanwen Chang, Enzo Lucas, and Wijnand IJsselsteijn. 2019. Caring for Vincent: A Chatbot for Self-Compassion. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19, 1--13. https://doi.org/10.1145/3290605.3300932
[51]
Changchun Liu, Karla Conn, Nilanjan Sarkar, and Wendy Stone. 2008. Physiology-based affect recognition for computer-assisted intervention of children with Autism Spectrum Disorder. International Journal of Human-Computer Studies 66, 9: 662--677. https://doi.org/10.1016/j.ijhsc.2008.04.003
[52]
David Matsumoto and Hyi Sung Hwang. 2011. Reading facial expressions of emotion. American Psychological Association. Retrieved May 27, 2020 from https://www.apa.org/science/about/psa/2011/05/facial-expressions
[53]
David Matsumoto, D Keltner, M.N. Shiota, M.G. Frank, and M. O'Sullivan. 2008. What's in a face? Facial expressions as signals of discrete emotions. In Handbook of emotions (3rd ed.), M. Lewis, J.M. Haviland and L. Feldman Barrett (eds.). Guilford Press, New York, 211--234.
[54]
Carla A. Mazefsky and Susan W. White. 2014. Emotion Regulation. Child and Adolescent Psychiatric Clinics of North America 23, 1: 15--24. https://doi.org/10.1016/j.chc.2013.07.002
[55]
Micah O. Mazurek and Christopher R. Engelhardt. 2013. Video game use and problem behaviors in boys with autism spectrum disorders. Research in Autism Spectrum Disorders 7, 2: 316--324. https://doi.org/10.1016/j.rasd.2012.09.008
[56]
Daniel McDuff, Amy Karlson, Ashish Kapoor, Asta Roseway, and Mary Czerwinski. 2012. AffectAura: an intelligent system for emotional memory. In CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 849--858. https://doi.org/10.1145/2207676.2208525
[57]
Helena M. Mentis, Madhu Reddy, and Mary Beth Rosson. 2013. Concealment of Emotion in an Emergency Room: Expanding Design for Emotion Awareness. Computer Supported Cooperative Work (CSCW) 22, 1: 33--63. https://doi.org/10.1007/s10606-012--9174--2
[58]
Microsoft. Emotion Class Microsoft.Azure.CognitiveServices.Vision.Face.Models) - Azure for .NET Developers. Retrieved September 19, 2020 from https://docs.microsoft.com/en-us/dotnet/api/microsoft.azure.cognitiveservices.vision.face.models.emotion
[59]
Bosiljka Milosavljevic, Virginia Carter Leno, Emily Simonoff, Gillian Baird, Andrew Pickles, Catherine R. G. Jones, Catherine Erskine, Tony Charman, and Francesca Happé. 2016. Alexithymia in Adolescents with Autism Spectrum Disorder: Its Relationship to Internalising Difficulties, Sensory Modulation and Social Cognition. Journal of Autism and Developmental Disorders 46, 4: 1354--1367. https://doi.org/10.1007/s10803-015--2670--8
[60]
Robert R. Morris, Kareem Kouddous, Rohan Kshirsagar, and Stephen M. Schueller. 2018. Towards an Artificially Empathic Conversational Agent for Mental Health Applications: System Design and User Perceptions. Journal of Medical Internet Research 20, 6: e10148. https://doi.org/10.2196/10148
[61]
Christina Nicolaidis, Dora Raymaker, Katherine McDonald, Sebastian Dern, Elesia Ashkenazy, Cody Boisclair, Scott Robertson, and Amanda Baggs. 2011. Collaboration Strategies in Nontraditional Community-Based Participatory Research Partnerships: Lessons From an Academic--Community Partnership With Autistic Self-Advocates. Progress in Community Health Partnerships: Research, Education, and Action 5, 2: 143--150. https://doi.org/10.1353/cpr.2011.0022
[62]
Charles-Edouard Notredame, M. Morgiève, F. Morel, S. Berrouiguet, J. Azé, and G. Vaiva. 2019. Distress, Suicidality, and Affective Disorders at the Time of Social Networks. Current Psychiatry Reports 21, 10: 98. https://doi.org/10.1007/s11920-019--1087-z
[63]
L. Nummenmaa, E. Glerean, R. Hari, and J. K. Hietanen. 2014. Bodily maps of emotions. Proceedings of the National Academy of Sciences 111, 2: 646--651. https://doi.org/10.1073/pnas.1321664111
[64]
Kathleen O'Leary, Arpita Bhattacharya, Sean A. Munson, Jacob O. Wobbrock, and Wanda Pratt. 2017. Design Opportunities for Mental Health Peer Support Technologies. In Proceedings of the ACM on Human-Computer Interaction, CSCW, 1470--1484. https://doi.org/10.1145/2998181.2998349
[65]
John W. Payton, Dana M. Wardlaw, Patricia A. Graczyk, Michelle R. Bloodworth, Carolyn J. Tompsett, and Roger P. Weissberg. 2000. Social and Emotional Learning: A Framework for Promoting Mental Health and Reducing Risk Behavior in Children and Youth. Journal of School Health 70, 5: 179--185. https://doi.org/10.1111/j.1746--1561.2000.tb06468.x
[66]
R. W. Picard. 1995. Affective Computing. M.I.T. Media Laboratory Perceptual Computing Section Technical Report No. 321.
[67]
Rosalind W. Picard. 2000. Affective Computing. MIT Press.
[68]
Jonathan Posner, James A. Russell, and Bradley S. Peterson. 2005. The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology. Development and Psychopathology 17, 03. https://doi.org/10.1017/S0954579405050340
[69]
Shaila M. Rao and Brenda Gagie. 2006. Learning through Seeing and Doing: Visual Supports for Children with Autism. TEACHING Exceptional Children 38, 6: 26--33. https://doi.org/10.1177/004005990603800604
[70]
Kathryn E. Ringland. 2019. A Place to Play: The (Dis)Abled Embodied Experience for Autistic Children in Online Spaces. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19, 1--14. https://doi.org/10.1145/3290605.3300518
[71]
Kathryn E. Ringland, LouAnne Boyd, Heather Faucett, Amanda L.L. Cullen, and Gillian R. Hayes. 2017. Making in Minecraft: A Means of Self-Expression for Youth with Autism. In Proceedings of the 2017 Conference on Interaction Design and Children, 340--345. https://doi.org/10.1145/3078072.3079749
[72]
Kathryn E. Ringland, Christine T. Wolf, LouAnne E. Boyd, Mark S. Baldwin, and Gillian R. Hayes. 2016. Would You Be Mine: Appropriating Minecraft as an Assistive Technology for Youth with Autism. 33--41. https://doi.org/10.1145/2982142.2982172
[73]
Danielle Ropar and David Peebles. 2007. Sorting Preference in Children with Autism: The Dominance of Concrete Features. Journal of Autism and Developmental Disorders 37, 2: 270--280. https://doi.org/10.1007/s10803-006-0166--2
[74]
James A. Russell. 1980. A circumplex model of affect. Journal of Personality and Social Psychology 39, 6: 1161--1178. https://doi.org/10.1037/h0077714
[75]
James A. Russell. 2003. Core affect and the psychological construction of emotion. Psychological Review 110, 1: 145--172. https://doi.org/10.1037/0033--295X.110.1.145
[76]
Carolyn Saarni. 1999. The Development of Emotional Competence. Guilford Press.
[77]
Johnny Saldaña. 2013. The coding manual for qualitative researchers. SAGE, Los Angeles.
[78]
Roseann C. Schaaf, Teal W. Benevides, Donna Kelly, and Zoe Mailloux-Maggio. 2012. Occupational therapy and sensory integration for children with autism: a feasibility, safety, acceptability and fidelity study. Autism 16, 3: 321--327. https://doi.org/10.1177/1362361311435157
[79]
Morgan Klaus Scheuerman, Jacob M. Paul, and Jed R. Brubaker. 2019. How Computers See Gender: An Evaluation of Gender Classification in Commercial Facial Analysis Services. Proceedings of the ACM on Human-Computer Interaction 3, CSCW: 1--33. https://doi.org/10.1145/3359246
[80]
Donald A. Schon. 1990. Educating the Reflective Practitioner: Toward a New Design for Teaching and Learning in the Professions. Jossey-Bass, San Francisco.
[81]
Phoebe Sengers, Kirsten Boehner, Michael Mateas, and Geri Gay. 2008. The Disenchantment of Affect. Personal Ubiquitous Comput. 12, 5: 347--358. https://doi.org/10.1007/s00779-007-0161--4
[82]
Sentio Solutions Inc. 2020. Feel Program. Retrieved May 27, 2020 from https://www.myfeel.co/feel-program
[83]
Will Simm, Maria Angela Ferrario, Adrian Gradinar, and Jon Whittle. 2014. Prototyping "clasp": implications for designing digital technology for and with adults with autism. In Proceedings of the 2014 conference on Designing interactive systems, 345--354. https://doi.org/10.1145/2598510.2600880
[84]
Kenneth J. Smith. 2017. Achieving a better understanding of adult autism. Counseling Today. Retrieved May 27, 2020 from https://ct.counseling.org/2017/09/achieving-better-understanding-adult-autism/
[85]
Jaime Snyder. 2020. Visualizing Biological Rhythms: A Critical Visual Analysis of Mental Health in Flux. Proc of the 2020 Designing Interactive Systems Conference (DIS ?20).
[86]
Jaime Snyder, Mark Matthews, Jacqueline Chien, Pamara F. Chang, Emily Sun, Saeed Abdullah, and Geri Gay. 2015. MoodLight: Exploring Personal and Social Implications of Ambient Display of Biosensor Data. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15), 143--153. https://doi.org/10.1145/2675133.2675191
[87]
Jaime Snyder, Elizabeth Murnane, Caitie Lustig, and Stephen Voida. 2019. Visually Encoding the Lived Experience of Bipolar Disorder. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19, 1--14. https://doi.org/10.1145/3290605.3300363
[88]
Katta Spiel, Christopher Frauenberger, Os Keyes, and Geraldine Fitzpatrick. 2019. Agency of Autistic Children in Technology Research-A Critical Literature Review. ACM Transactions on Computer-Human Interaction 26, 6: 1--40. https://doi.org/10.1145/3344919
[89]
Hanna Steffenburg, Suzanne Steffenburg, Christopher Gillberg, and Eva Billstedt. 2018. Children with autism spectrum disorders and selective mutism. Neuropsychiatric Disease and Treatment Volume 14: 1163--1169. https://doi.org/10.2147/NDT.S154966
[90]
Katie Headrick Taylor, Lori Takeuchi, and Reed Stevens. 2018. Mapping the daily media round: novel methods for understanding families' mobile technology use. Learning, Media and Technology 43, 1: 70--84. https://doi.org/10.1080/17439884.2017.1391286
[91]
Mirko Uljarevic and Antonia Hamilton. 2013. Recognition of Emotions in Autism: A Formal Meta-Analysis. Journal of Autism and Developmental Disorders 43, 7: 1517--1526. https://doi.org/10.1007/s10803-012--1695--5
[92]
Rafael Wamper, Severin Klingler, Barbara Solenthaler, Victor R Schinazi, and Markus Gross. 2020. Affective State Prediction Based on Semi-Supervised Learning from Smartphone Touch Data. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, 1--13.
[93]
Peter Washington, Dennis Wall, Catalin Voss, Aaron Kline, Nick Haber, Jena Daniels, Azar Fazel, Titas De, Carl Feinstein, and Terry Winograd. 2017. SuperpowerGlass: A Wearable Aid for the At-Home Therapy of Children with Autism. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3: 1--22. https://doi.org/10.1145/3130977
[94]
Chih-Hung Wu, Yueh-Min Huang, and Jan-Pan Hwang. 2016. Review of affective computing in education/learning: Trends and challenges: Advancements and trends of affective computing research. British Journal of Educational Technology 47, 6: 1304--1323. https://doi.org/10.1111/bjet.12324
[95]
Volker Wulf, Volkmar Pipek, Dave Randall, Markus Rohde, Kjeld Schmidt, and Gunnar Stevens (eds.). 2018. Socio-Informatics?: A Practice-Based Perspective on the Design and Use of IT Artifacts. Oxford University Press, Oxford, United Kingdom.
[96]
Annuska Zolyomi, Andrew Begel, Jennifer Frances Waldern, John Tang, Michael Barnett, Edward Cutrell, Daniel McDuff, Sean Andrist, and Meredith Ringel Morris. 2019. Managing Stress: The Needs of Autistic Adults in Video Calling. Proceedings of the ACM on Human-Computer Interaction 3, CSCW: 1--29. https://doi.org/10.1145/3359236
[97]
2017. Simple Steps to Teach Teens with Autism Spectrum Disorder (ASD) to Effectively Communicate Emotions -- Part One | The Heritage Community. Retrieved September 20, 2020 from https://www.heritagertc.org/simple-steps-teach-teens-autism-spectrum-disorder-asd-effectively-communicate-emotions-part-one/
[98]
Features list | Cloud Vision API. Google Cloud. Retrieved September 19, 2020 from https://cloud.google.com/vision/docs/features-list
[99]
Report: Amazon Working on Human Emotion-Detecting Wearable. PCMAG. Retrieved September 19, 2020 from https://www.pcmag.com/news/report-amazon-working-on-human-emotion-detecting-wearable
[100]
Academic Autism Spectrum Partnership in Research and Education (AASPIRE). Retrieved June 1, 2020 from https://aaspire.org/
[101]
Brain Works. App Store. Retrieved September 10, 2020 from https://apps.apple.com/us/app/brain-works/id524997517

Cited By

View all
  • (2025)Inclusive indoor comfort of neurodivergent individuals diagnosed before adulthood: A comprehensive study on thermal, acoustic, visual and air quality domainsBuilding and Environment10.1016/j.buildenv.2024.112254267(112254)Online publication date: Jan-2025
  • (2024)Assessing the Relationship Between Digital Trail Making Test Performance and IT Task Performance: Empirical StudyJMIR Human Factors10.2196/4999211(e49992)Online publication date: 14-Jun-2024
  • (2024)U.S. Job-Seekers' Organizational Justice Perceptions of Emotion AI-Enabled InterviewsProceedings of the ACM on Human-Computer Interaction10.1145/36869938:CSCW2(1-42)Online publication date: 8-Nov-2024
  • Show More Cited By

Index Terms

  1. Social-Emotional-Sensory Design Map for Affective Computing Informed by Neurodivergent Experiences

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image Proceedings of the ACM on Human-Computer Interaction
    Proceedings of the ACM on Human-Computer Interaction  Volume 5, Issue CSCW1
    CSCW
    April 2021
    5016 pages
    EISSN:2573-0142
    DOI:10.1145/3460939
    Issue’s Table of Contents
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 22 April 2021
    Published in PACMHCI Volume 5, Issue CSCW1

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. accessibility
    2. autism
    3. emotions
    4. interpersonal communication
    5. social-emotional learning

    Qualifiers

    • Research-article

    Funding Sources

    • U.S. National Science Foundation

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)648
    • Downloads (Last 6 weeks)90
    Reflects downloads up to 19 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2025)Inclusive indoor comfort of neurodivergent individuals diagnosed before adulthood: A comprehensive study on thermal, acoustic, visual and air quality domainsBuilding and Environment10.1016/j.buildenv.2024.112254267(112254)Online publication date: Jan-2025
    • (2024)Assessing the Relationship Between Digital Trail Making Test Performance and IT Task Performance: Empirical StudyJMIR Human Factors10.2196/4999211(e49992)Online publication date: 14-Jun-2024
    • (2024)U.S. Job-Seekers' Organizational Justice Perceptions of Emotion AI-Enabled InterviewsProceedings of the ACM on Human-Computer Interaction10.1145/36869938:CSCW2(1-42)Online publication date: 8-Nov-2024
    • (2024)Emotion AI Use in U.S. Mental Healthcare: Potentially Unjust and Techno-SolutionistProceedings of the ACM on Human-Computer Interaction10.1145/36373248:CSCW1(1-46)Online publication date: 26-Apr-2024
    • (2024)Are Robots Ready to Deliver Autism Inclusion?: A Critical ReviewProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642798(1-18)Online publication date: 11-May-2024
    • (2024)An Emotion Translator: Speculative Design By Neurodiverse DyadsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642210(1-18)Online publication date: 11-May-2024
    • (2024)The Nose Knows: Using Thermal Imaging to Approximate Children's Engagement with RobotsCompanion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction10.1145/3610978.3640726(669-673)Online publication date: 11-Mar-2024
    • (2024)The impact of visual and auditory distractions on the performance of neurodiverse students in virtual reality (VR) environmentsVirtual Reality10.1007/s10055-023-00933-628:1Online publication date: 22-Jan-2024
    • (2023)Embracing NeurodiversityAutism, Neurodiversity, and Equity in Professional Preparation Programs10.4018/979-8-3693-0163-0.ch008(180-202)Online publication date: 18-Dec-2023
    • (2023)Designing for Common Ground: Visually Representing Conversation Dynamics of Neurodiverse DyadsProceedings of the ACM on Human-Computer Interaction10.1145/36100577:CSCW2(1-33)Online publication date: 4-Oct-2023
    • Show More Cited By

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Login options

    Full Access

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media