Lins Derry
ABSTRACT
In 2019, metaLAB (at) Harvard began work on Curatorial A(i)gents, a digital exhibition that was slated to premiere at the Harvard Art Museums’ Lightbox Gallery in 2020. Half of the projects would be interactive, using mouse and keyboard conventions. With the advent of Covid-19 and the postponement of the show, the authors set out to develop an interface solution that would enable visitors to interact with the works without having to touch any public devices like a tablet. Toward this end, we prototyped a “choreographic interface” that uses machine vision and machine learning to interpret a full-torso gestural vocabulary, which is then translated into interactions. To make the choreographic interface, we relied on open-source solutions, which have all come with equal limitations and opportunities. In 2022, Curatorial A(i)gents was presented in the Lightbox Gallery, where we had the opportunity to test and demonstrate the interface. This paper discusses our design journey in making a choreographic interface using open-source technologies during Covid-19.
- Ozgun Kilic Afsar, Hila Mor, Cedric Honnet, and Hiroshi Ishii. Choreographic Interfaces: Wearable Approaches to Movement Learning in Creative Processes. 3.Google Scholar
- Tom W. Calvert, Armin Bruderlin, Sang Mah, Thecla Schiphorst, and Chris Welman. 1993. The evolution of an interface for choreographers. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI ’93, ACM Press, Amsterdam, The Netherlands, 115–122. DOI:https://doi.org/10.1145/169059.169113Google ScholarDigital Library
- Paul Dourish. 2004. Where the action is: the foundations of embodied interaction. MIT Press, IEEE Xplore, Cambridge, Massachusetts], Piscataqay, New Jersey].Google Scholar
- Sarah Fdili Alaoui, Jules Françoise, Thecla Schiphorst, Karen Studd, and Frederic Bevilacqua. 2017. Seeing, Sensing and Recognizing Laban Movement Qualities. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, ACM, Denver Colorado USA, 4009–4020. DOI:https://doi.org/10.1145/3025453.3025530Google ScholarDigital Library
- Kristina Höök. 2018. Designing with the body: somaesthetic interaction design. The MIT Press, IEEE Xplore, Cambridge, Massachusetts, Piscataqay, New Jersey].Google Scholar
- Bireswar Laha, Jeremy N. Bailenson, Andrea Stevenson Won, and Jakki O. Bailey. 2016. Evaluating Control Schemes for the Third Arm of an Avatar. PRESENCE Teleoperators Virtual Environ. 25, 2 (Spring 2016), 129–147. DOI:https://doi.org/10.1162/PRES_a_00251Google ScholarDigital Library
- Lawrence Shapiro and Shannon Spaulding. 2021. Embodied Cognition. In The Stanford Encyclopedia of Philosophy (Fall 2021), Edward N. Zalta (ed.). Metaphysics Research Lab, Stanford University. Retrieved July 31, 2021 from https://plato.stanford.edu/archives/fall2021/entries/embodied-cognition/Google Scholar
- Sydney Skybetter. 2015. The Choreography of The Internet of Things. Clyde Fitch Report. Retrieved July 28, 2021 from https://www.clydefitchreport.com/2015/08/the-choreography-of-the-internet-of-things/Google Scholar
- Sydney Skybetter. 2015. Dances with Thermostats. Clyde Fitch Report. Retrieved July 28, 2021 from https://www.clydefitchreport.com/2015/09/dance-choreography-internet-of-things/Google Scholar
- Sydney Skybetter. 2019. A Conference for Choreographic Interfaces. Medium. Retrieved August 7, 2021 from https://immerse.news/a-conference-for-choreographic-interfaces-32fff21a82fbGoogle Scholar
- Qiushi Zhou, Cheng Cheng Chua, Jarrod Knibbe, Jorge Goncalves, and Eduardo Velloso. 2021. Dance and Choreography in HCI: A Two-Decade Retrospective. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, ACM, Yokohama Japan, 1–14. DOI:https://doi.org/10.1145/3411764.3445804Google ScholarDigital Library
Index Terms
- Designing a Choreographic Interface During COVID-19
Recommendations
Intercultural user interface design-culture-centered HCI design-cross-cultural user interface design: different terminology or different approaches?
DUXU'13: Proceedings of the Second international conference on Design, User Experience, and Usability: health, learning, playing, cultural, and cross-cultural user experience - Volume Part IIThis paper presents the terminology containing several relevant concepts used in intercultural user interface design as well as the results of an analytic study of literature in the area of culture-centered human-computer interaction (HCI) design. Their ...
The evolution of an interface for choreographers
CHI '93: Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing SystemsThis paper describes the evolution of the interface to Life Forms, a compositional tool for the creation of dance choreography, and highlights some of the important lessons we have learned during a six year design and implementation period. The lessons ...
User-interface design, culture, and the future
AVI '02: Proceedings of the Working Conference on Advanced Visual InterfacesThis paper introduces the cultural anthropologist Hofstede's culture dimensions and considers how they might affect user-interface designs. Examples from the Web illustrate the cultural dimensions User-interface designers have identified basic ...
Comments