research-article

Linking Audience Physiology to Choreography

Authors:

George Chernyshov,

Dingding Zheng,

Taichi Furukawa,

Marcelo Padovani Macieira,

Kouta Minamizawa,

Kai KunzeAuthors Info & Claims

ACM Transactions on Computer-Human Interaction, Volume 30, Issue 1

Article No.: 9, Pages 1 - 32

https://doi.org/10.1145/3557887

Published: 07 March 2023 Publication History

Abstract

The use of wearable sensor technology opens up exciting avenues for both art and HCI research, providing new ways to explore the invisible link between audience and performer. To be effective, such work requires close collaboration between performers and researchers. In this article, we report on the co-design process and research insights from our work integrating physiological sensing and live performance. We explore the connection between the audience’s physiological data and their experience during the performance, analyzing a multi-modal dataset collected from 98 audience members. We identify notable moments based on HRV and EDA, and show how the audience’s physiological responses can be linked to the choreography. The longitudinal changes in HRV features suggest a strong connection to the choreographer’s intended narrative arc, while EDA features appear to correspond with short-term audience responses to dramatic moments. We discuss the physiological phenomena and implications for designing feedback systems and interdisciplinary collaborations.

References

[1]

Solange Akselrod, David Gordon, Jeffrey B. Madwed, Nancy C. Snidman, Danied C. Shannon, and Richard J. Cohen. 1985. Hemodynamic regulation: Investigation by spectral analysis. American Journal of Physiology-Heart and Circulatory Physiology 249, 4 (1985), H867–H875.

[2]

Sarah Fdili Alaoui, Kristin Carlson, and Thecla Schiphorst. 2014. Choreography as mediated through compositional tools for movement: Constructing a historical perspective. In Proceedings of the 2014 International Workshop on Movement and Computing. 1–6.

Digital Library

[3]

John L. Andreassi. 2010. Psychophysiology: Human Behavior and Physiological Response. Psychology Press.

[4]

Jenni Anttonen and Veikko Surakka. 2005. Emotions and heart rate while sitting on a chair. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 491–499.

Digital Library

[5]

Bradley M. Appelhans and Linda J. Luecken. 2006. Heart rate variability as an index of regulated emotional responding. Review of general psychology 10, 3 (2006), 229–240.

[6]

Sinem Aslan, Nese Alyuz, Cagri Tanriover, Sinem E. Mete, Eda Okur, Sidney K. D’Mello, and Asli Arslan Esme. 2019. Investigating the impact of a real-time, multimodal student engagement analytics technology in authentic classrooms. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–12.

Digital Library

[7]

Asaf Bachrach, Yann Fontbonne, Coline Joufflineau, and José Luis Ulloa. 2015. Audience entrainment during live contemporary dance performance: Physiological and cognitive measures. Frontiers in Human Neuroscience 9 (2015), 179. DOI:

[8]

Steve Benford, Chris Greenhalgh, Andy Crabtree, Martin Flintham, Brendan Walker, Joe Marshall, Boriana Koleva, Stefan Rennick Egglestone, Gabriella Giannachi, Matt Adams, Nick Tandavanitj, and Ju Row Farr. 2013. Performance-led research in the wild. ACM Transactions on Computer-Human Interaction (TOCHI) 20, 3 (2013), 1–22.

Digital Library

[9]

Luciano Bernardi, Cesare Porta, and Peter Sleight. 2006. Cardiovascular, cerebrovascular, and respiratory changes induced by different types of music in musicians and non-musicians: the importance of silence. Heart 92, 4 (2006), 445–452.

[10]

Gary G. Berntson, Karen S. Quigley, Greg J. Norman, and David L. Lozano. 2017. Cardiovascular psychophysiology.Handbook of Psychophysiology (2017), 183–216.

[11]

George E. Billman. 2013. The LF/HF ratio does not accurately measure cardiac sympatho-vagal balance. Frontiers in Physiology 4 (2013), 26.

[12]

Miranda Boorsma. 2006. A strategic logic for arts marketing: Integrating customer value and artistic objectives. International journal of cultural policy 12, 1 (2006), 73–92.

[13]

Patricia J. Bota, Chen Wang, Ana L. N. Fred, and Hugo Plácido Da Silva. 2019. A review, current challenges, and future possibilities on emotion recognition using machine learning and physiological signals. IEEE Access 7 (2019), 140990–141020.

[14]

Wolfram Boucsein. 2012. Electrodermal Activity. Springer Science & Business Media.

[15]

Astrid Breel. 2015. Audience agency in participatory performance: A methodology for examining aesthetic experience. Participations: Journal of Audience & Reception Studies 12, 1 (2015), 368–387.

[16]

Jos F. Brosschot, Eduard Van Dijk, and Julian F. Thayer. 2007. Daily worry is related to low heart rate variability during waking and the subsequent nocturnal sleep period. International Journal of Psychophysiology 63, 1 (2007), 39–47.

[17]

Andreas Bulling, Jamie A. Ward, Hans Gellersen, and Gerhard Tröster. 2010. Eye movement analysis for activity recognition using electrooculography. IEEE transactions on Pattern Analysis and Machine Intelligence 33, 4 (2010), 741–753.

Digital Library

[18]

John T. Cacioppo, Gary G. Berntson, and Jean Decety. 2010. Social neuroscience and its relationship to social psychology. Social cognition 28, 6 (2010), 675–685.

[19]

A. John Camm, Marek Malik, J. Thomas Bigger, Günter Breithardt, Sergio Cerutti, Richard J. Cohen, Philippe Coumel, Ernest L. Fallen, Harold L. Kennedy, R. E. Kleiger, F. Lombardi, A. Malliani, A. J. Moss, J. N. Rottman, G. Schmidt, P. J. Schwartz, and D. Singer. 1996. Heart rate variability: standards of measurement, physiological interpretation, and clinical use. Circulation 93, 5 (1996) 1043–1065.

[20]

Zhe Cao, Gines Hidalgo, Tomas Simon, Shih-En Wei, and Yaser Sheikh. 2019. OpenPose: Realtime multi-person 2D pose estimation using Part Affinity Fields. IEEE transactions on pattern analysis and machine intelligence 43, 1 (2019), 172–186.

Digital Library

[21]

Teresa Cerratto-Pargman, Chiara Rossitto, and Louise Barkhuus. 2014. Understanding audience participation in an interactive theater performance. In Proceedings of the 8th Nordic Conference on Human-Computer Interaction: Fun, Fast, Foundational. 608–617.

Digital Library

[22]

Kwang-Ho Choi, Junbeom Kim, O. Sang Kwon, Min Ji Kim, Yeon Hee Ryu, and Ji-Eun Park. 2017. Is heart rate variability (HRV) an adequate tool for evaluating human emotions?–A focus on the use of the International Affective Picture System. Psychiatry Research 251 (2017), 192–196.

[23]

Andy Clark. 2001. Natural-born cyborgs?. In Proceedings of the International Conference on Cognitive Technology. Springer, 17–24.

[24]

Nuno N. Correia, Raul Masu, An Hoang Dieu Pham, and Jochen Feitsch. 2021. Connected layers: Evaluating visualizations of embodiment in contemporary dance performances. In Proceedings of the 15th International Conference on Tangible, Embedded, and Embodied Interaction. 1–12.

Digital Library

[25]

Franco Curmi, Maria Angela Ferrario, Jen Southern, and Jon Whittle. 2013. HeartLink: Open broadcast of live biometric data to social networks. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1749–1758.

Digital Library

[26]

Michael E. Dawson, Anne M. Schell, and Diane L. Filion. 2017. The electrodermal system. Handbook of Psychophysiology (2017), 217–243.

[27]

J. P. A. Delaney and D. A. Brodie. 2000. Effects of short-term psychological stress on the time and frequency domains of heart-rate variability. Perceptual and motor skills 91, 2 (2000), 515–524.

[28]

Elena Di Lascio, Shkurta Gashi, and Silvia Santini. 2018. Unobtrusive assessment of students’ emotional engagement during lectures using electrodermal activity sensors. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 3 (2018), 1–21.

Digital Library

[29]

Nathan Eagle and Alex Sandy Pentland. 2006. Reality mining: Sensing complex social systems. Personal and ubiquitous computing 10, 4 (2006), 255–268.

Digital Library

[30]

Douglas C. Engelbart. 1962. Augmenting human intellect: A conceptual framework. Summary Report, Stanford Research Institute, Menlo Park, California (1962).

[31]

Sarah Fdili Alaoui. 2019. Making an interactive dance piece: Tensions in integrating technology in art. In Proceedings of the 2019 on Designing Interactive Systems Conference. 1195–1208.

Digital Library

[32]

Zhuoqi Fu, Jiawen Han, Dingding Zheng, Moe Sugawa, Taichi Furukawa, Chernyshov George, Hynds Danny, Tachi Furukawa, Marcelo Padovani, Kouta Minamizawa, Karola Marky, Jamie A. Ward, and Kai Kunze. 2021. Boiling mind-a dataset of physiological signals during an exploratory dance performance. In Augmented Humans Conference 2021 (2021), 301–303.

[33]

Nan Gao, Wei Shao, Mohammad Saiedur Rahaman, and Flora D. Salim. 2020. n-Gage: Predicting in-class emotional, behavioural and cognitive engagement in the wild. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 3 (2020), 1–26.

Digital Library

[34]

Maurizio Garbarino, Matteo Lai, Dan Bender, Rosalind W. Picard, and Simone Tognetti. 2014. Empatica E3—A wearable wireless multi-sensor device for real-time computerized biofeedback and data acquisition. In Proceedings of the 2014 4th International Conference on Wireless Mobile Communication and Healthcare-Transforming Healthcare Through Innovations in Mobile and Wireless Technologies. IEEE, 39–42.

[35]

E. Gedik, L. Cabrera-Quiros, C. Martella, G. Englebienne, and H. Hung. 2021. Towards analyzing and predicting the experience of live performances with wearable sensing. IEEE Transactions on Affective Computing 12, 1 (2021), 269–276. DOI:

[36]

Donna Haraway. 2006. A cyborg manifesto: Science, technology, and socialist-feminism in the late 20th century. In Proceedings of the International Handbook of Virtual Learning Environments. Springer, 117–158.

[37]

Mariam Hassib, Daniel Buschek, Paweł W. Wozniak, and Florian Alt. 2017. Heartchat: Heart rate augmented mobile chat to support empathy and awareness. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. 2239–2251.

Digital Library

[38]

Mariam Hassib, Stefan Schneegass, Philipp Eiglsperger, Niels Henze, Albrecht Schmidt, and Florian Alt. 2017. EngageMeter: A system for implicit audience engagement sensing using electroencephalography. In Proceedings of the 2017 Chi Conference on Human Factors in Computing Systems. 5114–5119.

Digital Library

[39]

Jacob B. Holzman and David J. Bridgett. 2017. Heart rate variability indices as bio-markers of top-down self-regulatory mechanisms: A meta-analytic review. Neuroscience & Biobehavioral Reviews 74 (2017), 233–255.

[40]

Kristina Höök. 2008. Affective loop experiences–what are they?. In Proceedings of the International Conference on Persuasive Technology. Springer, 1–12.

Digital Library

[41]

Kristina Höök, Martin P. Jonsson, Anna Ståhl, and Johanna Mercurio. 2016. Somaesthetic appreciation design. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 3131–3142.

Digital Library

[42]

Sybil Huskey, Celine Latulipe, Melissa Word, and Danielle Lottridge. 2018. Postproduction focus groups in dance: A case study and protocol. Journal of Dance Education 18, 2 (2018), 47–54.

[43]

Shoya Ishimaru, Kai Kunze, Yuji Uema, Koichi Kise, Masahiko Inami, and Katsuma Tanaka. 2014. Smarter eyewear: Using commercial EOG glasses for activity recognition. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication. 239–242.

Digital Library

[44]

Takuya Iwamoto and Soh Masuko. 2015. Lovable couch: Mitigating distrustful feelings for couples by visualizing excitation. In Proceedings of the 6th Augmented Human International Conference. 157–158.

Digital Library

[45]

Rachel Jacobs, Steve Benford, and Ewa Luger. 2015. Behind the scenes at HCI’s turn to the arts. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. 567–578.

Digital Library

[46]

Jodi James, Todd Ingalls, Gang Qian, Loren Olsen, Daniel Whiteley, Siew Wong, and Thanassis Rikakis. 2006. Movement-based interactive dance performance. In Proceedings of the 14th ACM International Conference on Multimedia. 470–480.

Digital Library

[47]

Carl Gustav Jung. 1918. Studies in Word-Association. Heinemann.

[48]

Doris Jung, Marie Hermo Jensen, Simon Laing, and Jeremy Mayall. 2012. cyclic. an interactive performance combining dance, graphics, music and kinect-technology. In Proceedings of the 13th International Conference of the NZ Chapter of the ACM’s Special Interest Group on Human-Computer Interaction. 36–43.

Digital Library

[49]

Laewoo Kang, Steven J. Jackson, and Phoebe Sengers. 2018. Intermodulation: Improvisation and collaborative art practice for hci. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 1–13.

Digital Library

[50]

Arvid Kappas, Dennis Küster, Christina Basedow, and Pasquale Dente. 2013. A validation study of the Affectiva Q-Sensor in different social laboratory situations. In Proceedings of the 53rd Annual Meeting of the Society for Psychophysiological Research, Florence, Italy, Vol. 39.

[51]

George Khut. 2006. Development and evaluation of participant-centred biofeedback artworks. Unpublished doctoral exegesis, University of Western Sydney (2006).

[52]

Tom Kuusela. 2013. Methodological aspects of heart rate variability analysis. Heart Rate Variability (HRV) Signal Analysis: Clinical Applications CRC Press, Boca Raton, FL, 10–42.

[53]

Peter J. Lang, Mark K. Greenwald, Margaret M. Bradley, and Alfons O. Hamm. 1993. Looking at pictures: Affective, facial, visceral, and behavioral reactions. Psychophysiology 30, 3 (1993), 261–273.

[54]

Celine Latulipe, Erin A. Carroll, and Danielle Lottridge. 2011. Evaluating longitudinal projects combining technology with temporal arts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1835–1844.

Digital Library

[55]

Celine Latulipe, Erin A. Carroll, and Danielle Lottridge. 2011. Love, hate, arousal,and engagement: Exploring audience responses to performing arts. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1845–1854.

Digital Library

[56]

Celine Latulipe, David Wilson, Berto Gonzalez, Adam Harris, Erin Carroll, Sybil Huskey, Melissa Word, Robert Beasley, and Nathan Nifong. 2011. SoundPainter. In Proceedings of the 8th ACM Conference on Creativity and Cognition. 439–440.

Digital Library

[57]

David Lazer, Alex (Sandy) Pentland, Lada Adamic, Sinan Aral, Albert Laszlo Barabasi, Devon Brewer, Nicholas Christakis, Noshir Contractor, James Fowler, Myron Gutmann, Tony Jebara, Gary King, Michael Macy, Deb Roy, and Marshall Van Alstyne. 2009. Life in the network: The coming age of computational social science. Science (New York, NY) 323, 5915 (2009), 721.

[58]

Robert W. Levenson. 2003. Blood, sweat, and fears: The autonomic architecture of emotion. Annals of the New York Academy of Sciences 1000, 1 (2003), 348–366.

[59]

Robert W. Levenson. 2014. The autonomic nervous system and emotion. Emotion Review 6, 2 (2014), 100–112.

[60]

Christopher Lindinger, Martina Mara, Klaus Obermaier, Roland Aigner, Roland Haring, and Veronika Pauser. 2013. The (St) age of participation: Audience involvement in interactive performances. Digital Creativity 24, 2 (2013), 119–129.

[61]

Lian Loke and George Poonkhin Khut. 2014. Intimate aesthetics and facilitated interaction. In Proceedings of the Interactive Experience in the Digital Age. Springer, 91–108.

[62]

Claudio Martella, Ekin Gedik, Laura Cabrera-Quiros, Gwenn Englebienne, and Hayley Hung. 2015. How was it? Exploiting smartphone sensing to measure implicit audience responses to live performances. In Proceedings of the 23rd ACM International Conference on Multimedia. 201–210.

Digital Library

[63]

Helena M. Mentis and Carolina Johansson. 2013. Seeing movement qualities. In Proceedings of the Sigchi Conference on Human Factors in Computing Systems. 3375–3384.

Digital Library

[64]

Florian Floyd Mueller, Pedro Lopes, Paul Strohmeier, Wendy Ju, Caitlyn Seim, Martin Weigel, Suranga Nanayakkara, Marianna Obrist, Zhuying Li, Joseph Delfa, Jun Nishida, Elizabeth M. Gerber, Dag Svanaes, Jonathan Grudin, Stefan Greuter, Harald Reiterer, Katrin Wolf, Jochen Meyer, Thecla Schiphorst, Dakuo Wang, and Pattie Maes. 2020. Next steps for human-computer integration. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–15.

Digital Library

[65]

David Nunan, Gavin R. H. Sandercock, and David A. Brodie. 2010. A quantitative systematic review of normal values for short-term heart rate variability in healthy adults. Pacing and Clinical Electrophysiology 33, 11 (2010), 1407–1417.

[66]

Yuuki Ooishi, Hideo Mukai, Ken Watanabe, Suguru Kawato, and Makio Kashino. 2017. Increase in salivary oxytocin and decrease in salivary cortisol after listening to relaxing slow-tempo and exciting fast-tempo music. PloS One 12, 12 (2017), e0189075.

[67]

Mirja A. Peltola. 2012. Role of editing of RR intervals in the analysis of heart rate variability. Frontiers in Physiology 3 (2012), 148.

[68]

Arttu Perttula, Pauliina Tuomi, Marko Suominen, Antti Koivisto, and Jari Multisilta. 2010. Users as sensors: Creating shared experiences in co-creational spaces by collective heart rate. In Proceedings of the 14th International Academic MindTrek Conference: Envisioning Future Media Environments. 41–48.

Digital Library

[69]

TW Picton, I. Martin, and P. H. Venables. 1980. Techniques in psychophysiology. John Wiley & Sons.

[70]

Stephen W. Porges. 1991. Vagal tone: An autonomic mediator of affect.The Development of Emotion Regulation and Dysregulation (1991), 111–128.

[71]

Robert F. Potter and Paul Bolls. 2012. Psychophysiological Measurement and Meaning: Cognitive and Emotional Processing of Media. Routledge.

[72]

Jennifer Radbourne, Katya Johanson, Hilary Glow, and Tabitha White. 2009. The audience experience: Measuring quality in the performing arts. International Journal of Arts Management 11, 3 (2009), 16–29 (14 pages).

[73]

Asreen Rostami, Donald McMillan, Elena Márquez Segura, Chiara Rossito, and Louise Barkhuus. 2017. Bio-sensed and embodied participation in interactive performance. In Proceedings of the 11th International Conference on Tangible, Embedded, and Embodied Interaction. 197–208.

Digital Library

[74]

Jerzy Sacha. 2013. Why should one normalize heart rate variability with respect to average heart rate. Frontiers in Physiology 4 (2013), 306.

[75]

Jerzy Sacha and Władysław Pluta. 2008. Alterations of an average heart rate change heart rate variability due to mathematical reasons. International Journal of Cardiology 128, 3 (2008), 444–447.

[76]

Makoto Sakamoto, Takahiro Shinoda, Takahiro Ishizu, Masahiro Hori, Hazuki Watanabe, Amane Takei, and Takao Ito. 2018. A proposal of interactive projection mapping using kinect. In Proceedings of the 2018 International Conference on Information and Communication Technology Robotics. IEEE, 1–4.

[77]

Akane Sano, Andrew J. Phillips, Z. Yu Amy, Andrew W. McHill, Sara Taylor, Natasha Jaques, Charles A. Czeisler, Elizabeth B. Klerman, and Rosalind W. Picard. 2015. Recognizing academic performance, sleep quality, stress level, and mental health using personality traits, wearable sensors and mobile phones. In Proceedings of the 2015 IEEE 12th International Conference on Wearable and Implantable Body Sensor Networks. IEEE, 1–6.

[78]

Philip Schmidt, Attila Reiss, Robert Duerichen, and Kristof Van Laerhoven. 2018. Wearable affect and stress recognition: A review. arXiv:1811.08854 (2018). Retrieved from https://1811.08854.

[79]

Henrique Sequeira, Pascal Hot, Laetitia Silvert, and Sylvain Delplanque. 2009. Electrical autonomic correlates of emotion. International Journal of Psychophysiology 71, 1 (2009), 50–56.

[80]

Fred Shaffer and J. P. Ginsberg. 2017. An overview of heart rate variability metrics and norms. Frontiers in Public Health 5 (2017), 258.

[81]

Fred Shaffer, Rollin McCraty, and Christopher L. Zerr. 2014. A healthy heart is not a metronome: An integrative review of the heart’s anatomy and heart rate variability. Frontiers in Psychology 5 (2014), 1040.

[82]

Haruka Shoda, Mayumi Adachi, and Tomohiro Umeda. 2016. How live performance moves the human heart. PloS One 11, 4 (2016), e0154322.

[83]

Lin Shu, Jinyan Xie, Mingyue Yang, Ziyi Li, Zhenqi Li, Dan Liao, Xiangmin Xu, and Xinyi Yang. 2018. A review of emotion recognition using physiological signals. Sensors 18, 7 (2018), 2074.

[84]

Fernando Silveira, Brian Eriksson, Anmol Sheth, and Adam Sheppard. 2013. Predicting audience responses to movie content from electro-dermal activity signals. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing. 707–716.

Digital Library

[85]

Hazel Smith. 2009. Practice-Led Research, Research-Led Practice in the Creative Arts. Edinburgh University Press.

[86]

Erin T. Solovey, Marin Zec, Enrique Abdon Garcia Perez, Bryan Reimer, and Bruce Mehler. 2014. Classifying driver workload using physiological and driving performance data: Two field studies. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 4057–4066.

Digital Library

[87]

Catherine J. Stevens, Emery Schubert, Rua Haszard Morris, Matt Frear, Johnson Chen, Sue Healey, Colin Schoknecht, and Stephen Hansen. 2009. Cognition and the temporal arts: Investigating audience response to dance using PDAs that record continuous data during live performance. International Journal of Human-Computer Studies 67, 9 (2009), 800–813.

Digital Library

[88]

Moe Sugawa, Taichi Furukawa, George Chernyshov, Danny Hynds, Jiawen Han, Marcelo Padovani, Dingding Zheng, Karola Marky, Kai Kunze, and Kouta Minamizawa. 2021. Boiling mind: Amplifying the audience-performer connection through sonification and visualization of heart and electrodermal activities. In Proceedings of the 15th International Conference on Tangible, Embedded, and Embodied Interaction. Association for Computing Machinery, New York, NY, Article 34, 10 pages. DOI:

Digital Library

[89]

Graeme Sullivan. 2010. Art Practice as Research: Inquiry in Visual Arts. Sage.

[90]

Dana Swarbrick, Dan Bosnyak, Steven R. Livingstone, Jotthi Bansal, Susan Marsh-Rollo, Matthew H. Woolhouse, and Laurel J. Trainor. 2019. How live music moves us: Head movement differences in audiences to live versus recorded music. Frontiers in Psychology 9 (2019), 2682.

[91]

Benjamin Tag, Andrew W. Vargo, Aman Gupta, George Chernyshov, Kai Kunze, and Tilman Dingler. 2019. Continuous alertness assessments: Using EOG glasses to unobtrusively monitor fatigue levels In-The-Wild. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–12.

Digital Library

[92]

Paul Tennent, Stuart Reeves, Steve Benford, Brendan Walker, Joe Marshall, Patrick Brundell, Rupert Meese, and Paul Harter. 2012. The machine in the ghost: Augmenting broadcasting with biodata. In Proceedings of the CHI’12 Extended Abstracts on Human Factors in Computing Systems. 91–100.

Digital Library

[93]

Julian F. Thayer and Esther Sternberg. 2006. Beyond heart rate variability: Vagal regulation of allostatic systems. Annals of the New York Academy of Sciences 1088, 1 (2006), 361–372.

[94]

Lida Theodorou, Patrick G. T. Healey, and Fabrizio Smeraldi. 2019. Engaging with contemporary dance: What can body movements tell us about audience responses? Frontiers in Psychology 10 (2019), 71.

[95]

Christian Tronstad, Gaute E. Gjein, Sverre Grimnes, Ørjan G. Martinsen, Anne-Lene Krogstad, and Erik Fosse. 2008. Electrical measurement of sweat activity. Physiological Measurement 29, 6 (2008), S407.

[96]

Marieke van Dooren, J. J. G de Vries, and Joris H. Janssen. 2012. Emotional sweating across the body: Comparing 16 different skin conductance measurement locations. Physiology & Behavior 106, 2 (2012), 298–304.

[97]

Paul van Gent, Haneen Farah, Nicole van Nes, and Bart van Arem. 2019. Analysing noisy driver physiology real-time using off-the-shelf sensors: Heart rate analysis software from the taking the fast lane project. Journal of Open Research Software 7, 1 (2019), 32. DOI:

[98]

Staci Vicary, Matthias Sperling, Jorina von Zimmermann, Daniel C. Richardson, and Guido Orgs. 2017. Joint action aesthetics. PLOS ONE 12, 7 (072017), 1–21. DOI:

[99]

Pauli Virtanen, Ralf Gommers, Travis E. Oliphant, Matt Haberland, Tyler Reddy, David Cournapeau, Evgeni Burovski, Pearu Peterson, Warren Weckesser, Jonathan Bright, Stéfan J. van der Walt, Matthew Brett, Joshua Wilson, K. Jarrod Millman, Nikolay Mayorov, Andrew R. J. Nelson, Eric Jones, Robert Kern, Eric Larson, C. J. Carey, İlhan Polat, Yu Feng, Eric W. Moore, Jake VanderPlas, Denis Laxalde, Josef Perktold, Robert Cimrman, Ian Henriksen, E. A. Quintero, Charles R. Harris, Anne M. Archibald, Antônio H. Ribeiro, Fabian Pedregosa, Paul van Mulbregt & SciPy 1.0 Contributors. 2020. SciPy 1.0: Fundamental algorithms for scientific computing in Python. Nature Methods 17, 3 (2020), 261–272.

[100]

Chen Wang, Erik N. Geelhoed, Phil P. Stenton, and Pablo Cesar. 2014. Sensing a live audience. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1909–1912.

Digital Library

[101]

Chen Wang, Erik N. Geelhoed, Phil P. Stenton, and Pablo Cesar. 2014. Sensing a live audience. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1909–1912.

Digital Library

[102]

Jamie A. Ward, Daniel Richardson, Guido Orgs, Kelly Hunter, and Antonia Hamilton. 2018. Sensing interpersonal synchrony between actors and autistic children in theatre using wrist-worn accelerometers. In Proceedings of the 2018 ACM International Symposium on Wearable Computers (Singapore, Singapore). Association for Computing Machinery, New York, NY, 148–155. DOI:

Digital Library

[103]

Andrew M. Webb, Chen Wang, Andruid Kerne, and Pablo Cesar. 2016. Distributed liveness: Understanding how new technologies transform performance experiences. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. 432–437.

Digital Library

[104]

Christopher Wm White, Jeffrey Fulmer, Brian Cordova, Alexandria Black, Chloe Danitz, William Evans, Aidan Fischer, Rashaad Greene, Jinhan He, Emily Kenyon, Joan Miller, Madeline Moylan, Abigail Ring, Emily Schwitzgebel, and Yatong Wang. 2021. A new corpus of texture, timbre, and change in 20th-century American popular music. (2021).

[105]

Norbert Wiener. 2019. Cybernetics or Control and Communication in the Animal and the Machine. MIT press.

[106]

Wikipedia contributors. 2021. Boléro. Retrieved September 2021 from https://en.wikipedia.org/wiki/Bolero.

[107]

Shuo Yan, GangYi Ding, Hongsong Li, Ningxiao Sun, Yufeng Wu, Zheng Guan, Longfei Zhang, and Tianyu Huang. 2016. Enhancing audience engagement in performing arts through an adaptive virtual environment with a brain-computer interface. In Proceedings of the 21st International Conference on Intelligent user Interfaces. 306–316.

Digital Library

[108]

Yingfang Zhang and Junren Zhou. 2020. Application of kinect-based multimedia interactive imaging in small theater. In Proceedings of the ACM Turing Celebration Conference-China. 243–246.

Digital Library

Cited By

Hao F(2024)Research on Dynamic Tracking and Choreographic Techniques of Modern Dance Based on Computer 3D Modeling TechnologyApplied Mathematics and Nonlinear Sciences10.2478/amns-2024-04539:1Online publication date: 26-Feb-2024
https://doi.org/10.2478/amns-2024-0453
Barbareschi GZhou SRyoichi AKawaguchi MArmstrong MOgino MAoiki SOhta ETaguchi HKamiyama YMuto MYoshifuji KMinamizawa K(2024)Brain Body Jockey project: Transcending Bodily Limitations in Live Performance via Human AugmentationProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675621(1-14)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675621
Kosch TWeiß ADeja JShrestha SHoppe MMatviienko AMarky K(2024)Intelligent Music Interfaces: When Interactive Assistance and Adaptive Augmentation Meet Musical InstrumentsProceedings of the Augmented Humans International Conference 202410.1145/3652920.3653039(327-330)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3653039
Show More Cited By

Index Terms

Linking Audience Physiology to Choreography
1. Applied computing
  1. Arts and humanities
    1. Performing arts

Recommendations

Interactive stories and the audience: Why empathy is important
SPECIAL ISSUE: TV and Video Entertainment Environments

Interactive narratives have long been advocated as having the potential to create more immersive and transformative experiences for audiences by adding the pleasure of agency. In practice, however, finding the balance between sufficient interactivity ...
Audience empathy: a phenomenological method for mediated performance
C&C '11: Proceedings of the 8th ACM conference on Creativity and cognition

This research investigates audience experience of empathy with a performer during a digitally mediated performance. Theatrical performance necessitates social interaction between performers and audience. We present a performance-based study that ...
Coronary and Myocardial Physiology of Left Ventricular Unloading

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Computer-Human Interaction

ACM Transactions on Computer-Human Interaction Volume 30, Issue 1

February 2023

537 pages

ISSN:1073-0516

EISSN:1557-7325

DOI:10.1145/3585399

Editors:
Kristina Höök
KTH Royal Institute of Technology, Sweden
,
Kasper Hornbæk
University of Copenhagen, Denmark

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 March 2023

Online AM: 17 August 2022

Accepted: 06 May 2022

Revised: 28 April 2022

Received: 19 April 2021

Published in TOCHI Volume 30, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

JST Moonshot R&D Program Grant
British Academy, Royal Academy of Engineering and Royal Society
European Research Council (ERC)

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
889
Total Downloads

Downloads (Last 12 months)265
Downloads (Last 6 weeks)21

Reflects downloads up to 05 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hao F(2024)Research on Dynamic Tracking and Choreographic Techniques of Modern Dance Based on Computer 3D Modeling TechnologyApplied Mathematics and Nonlinear Sciences10.2478/amns-2024-04539:1Online publication date: 26-Feb-2024
https://doi.org/10.2478/amns-2024-0453
Barbareschi GZhou SRyoichi AKawaguchi MArmstrong MOgino MAoiki SOhta ETaguchi HKamiyama YMuto MYoshifuji KMinamizawa K(2024)Brain Body Jockey project: Transcending Bodily Limitations in Live Performance via Human AugmentationProceedings of the 26th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3663548.3675621(1-14)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3663548.3675621
Kosch TWeiß ADeja JShrestha SHoppe MMatviienko AMarky K(2024)Intelligent Music Interfaces: When Interactive Assistance and Adaptive Augmentation Meet Musical InstrumentsProceedings of the Augmented Humans International Conference 202410.1145/3652920.3653039(327-330)Online publication date: 4-Apr-2024
https://dl.acm.org/doi/10.1145/3652920.3653039
Stamm JRichardson DWard J(2024)Squeeze and Slide: Real-time continuous self-reports with physiological arousal to evaluate emotional engagement in short films of contemporary danceExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651886(1-7)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3651886
Sparrow LGalwey CLoveridge BGlasser SOsborne MKelly R(2024)Heart and Soul: The Ethics of Biometric Capture in Immersive Artistic PerformanceProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642309(1-23)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642309
Kátai ZOsztián PIclanzan D(2024)Enacting algorithms: Evolution of the algorythmics storytellingEducation and Information Technologies10.1007/s10639-024-12617-y29:14(19197-19228)Online publication date: 1-Oct-2024
https://dl.acm.org/doi/10.1007/s10639-024-12617-y
Tsuchida S(2024)Dance Information Processing: Computational Approaches for Assisting Dance CompositionNew Generation Computing10.1007/s00354-024-00273-242:5(1049-1064)Online publication date: 1-Dec-2024
https://dl.acm.org/doi/10.1007/s00354-024-00273-2
Deja JEska BShrestha SHoppe MKarolus JKosch TMatviienko AWeiß AMarky KWard JMcGill MMarky K(2023)Intelligent Music Interfaces: When Interactive Assistance and Augmentation Meet Musical InstrumentsProceedings of the Augmented Humans International Conference 202310.1145/3582700.3582731(379-383)Online publication date: 12-Mar-2023
https://dl.acm.org/doi/10.1145/3582700.3582731
Sun YGreaves DOrgs Gde C. Hamilton ADay SWard J(2023)Using Wearable Sensors to Measure Interpersonal Synchrony in Actors and Audience Members During a Live Theatre PerformanceProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35807817:1(1-29)Online publication date: 28-Mar-2023
https://dl.acm.org/doi/10.1145/3580781

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View full text|Download PDF

View Issue’s Table of Contents