Abstract
Cyber–physical interactive performance is a new style of performance art that facilitates impromptu interactions among dancers and virtual characters. This paper presents the design and implementation of a full-stack service platform, called WISE (Wearable Item Service runtimE), that supports such kind of performance. The proposed service platform deals with core issues such as connectivity, manageability and simplicity, behind the scene. Two successful real-world applications have verified the feasibility of WISE: a live public performance called Future Circus and a virtual reality (VR) art exhibition called Step In and Out of the Dreams. The evaluation results show that WISE is not only easy to use but also portable and extensible to fit various cyber–physical interactive performances.





















Similar content being viewed by others
References
Agha G (1986) An overview of actor languages. SIGPLAN Note 21(10):58–67
Aguilar J, Albert A, Ameli F, Anghinolfi M, Anton G, Anvar S, Aslanides E, Aubert J, Barbarito E, Basa S et al (2007) The data acquisition system for the antares neutrino telescope. Nucl Instrum Methods Phys Res Sect A Accel Spectrom Detect Assoc Equip 570(1):107–116
Ali S, Yazdi ET, Willig A (2013) Investigations on passive discovery schemes for IEEE 802.15. 4 based body sensor networks. In: 2013 Australasian telecommunication networks and applications conference (ATNAC). IEEE, pp 89–94
Banks A, Gupta R (2014) MQTT Version 3.1.1. OASIS
Bentley J (1986) Programming pearls: little languages. Commun ACM 29(8):711–721
Buechley L, Eisenberg M (2008) The LilyPad Arduino: toward wearable engineering for everyone. IEEE Perv Comput 7(2):12–15
Cunningham H (2008) A little language for surveys: constructing an internal DSL in Ruby. In: Proceedings of the 46th Annual Southeast Regional Conference on SE. ACM, pp 282–287
DeVaul R, Sung M, Gips J et al (2003) Mithril 2003: applications and architecture. In: Null. IEEE, p 4
Elliott C, Hudak P (1997) Functional reactive animation. ACM SIGPLAN Not 32:263–273
Eloranta V, Koskinen J, Leppänen M, Reijonen V (2014) Designing distributed control systems: a pattern language approach. Wiley software patterns series. Wiley. https://books.google.com.tw/books?id=cMGNnAEACAAJ
Fette I (2011) The websocket protocol. Technical report
Fowler M (2010) Domain-specific languages. Addison-Wesley Signature Series (Fowler). Pearson Education, London
Gamma E, Helm R, Johnson R, Vlissides J (1994) Design patterns: elements of reusable object-oriented software. Pearson Education, London
Gupta M (2012) Akka essentials. Community experience distilled. Packt Publishing, Birmingham
Hare T, Dejdumrong N (2009) A framework on the applications of interactive art. In: Sixth international conference on computer graphics, imaging and visualization, 2009. CGIV’09. IEEE, pp 83–88
Hindley J, Seldin J (1986) Introduction to combinators and (lambda) calculus, vol 1. CUP Archive, Cambridge
Huang H, Huang H, Liao C, Li Y, Tsai T, Teng L, Wang S (2015) Future circus: a performer-guided mixed-reality performance art. In: Proceedings of the 2015 ACM international joint conference on pervasive and ubiquitous computing and proceedings of the 2015 ACM international symposium on wearable computers. ACM, pp 551–556
Hudak P (1996) Building domain-specific embedded languages. ACM Comput Surv (CSUR) 28(4es):196
Lehikoinen J, Holopainen J, Salmimaa M, Aldrovandi A (1999) Mex: a distributed software architecture for wearable computers. In: The third international symposium on wearable computers, 1999. Digest of Papers. IEEE, pp 52–57
Lelli F, Frizziero E, Gulmini M, Maron G, Orlando S, Petrucci A, Squizzato S (2007) The many faces of the integration of instruments and the grid. Int J Web Grid Serv 3(3):239–266
Lin Y, Lin Y, Chih C, Li T, Tai C, Wang Y, Lin F, Kuo H, Huang C, Hsu S (2015) Easyconnect: a management system for IoT devices and its applications for interactive design and art. IEEE Internet Things J 2(6):551–561
Lucas PJ (1993) An object-oriented language system for implementing concurrent, hierarchical, finite state machines. Ph.D. thesis, University of Illinois at Urbana-Champaign
McPhillips T, McPhillips S, Chiu H, Cohen A, Deacon A, Ellis P, Garman E, Gonzalez A, Sauter N, Phizackerley R et al (2002) Blu-ice and the distributed control system: software for data acquisition and instrument control at macromolecular crystallography beamlines. J Synchrotron Radiat 9(6):401–406
Miyamae M, Terada T, Tsukamoto M, Nishio S (2004) Design and implementation of an extensible rule processing system for wearable computing. In: The first annual international conference on mobile and ubiquitous systems: networking and services, 2004. MOBIQUITOUS 2004. IEEE, pp 392–400
Mostinckx S, Carreton A, De Meuter W (2008) Reactive context-aware programming. In: Electronic communications of the EASST, vol 11
Mytilinaiou S, Cham K, Hutchison C (2011) Experience design, interactive art environments and the sense of becoming. In: 2011 IEEE international symposium on mixed and augmented reality-arts, media, and humanities. IEEE, pp 91–98
Namiot D, Sneps-Sneppe M (2014) On IoT programming. Int J Open Inf Technol 2(10):25–28
Odersky M, Altherr P, Cremet V, Emir B, Maneth S, Micheloud S, Mihaylov N, Schinz M, Stenman E, Zenger M (2004) An overview of the scala programming language. Technical report
Oh J, Kim S, Kim S, Shi C (2011) A study of interactive art in the narrative form of “magic monkey”. In: 2011 Eighth international conference on computer graphics, imaging and visualization (CGIV). IEEE, pp 39–46
Song Y, Moon S, Shim G, Park D (2007) Mu-ware: a middleware framework for wearable computer and ubiquitous computing environment. In: Fifth annual IEEE international conference on pervasive computing and communications workshops, 2007. PerCom Workshops’ 07. IEEE, pp 455–460
Upton E, Halfacree G (2014) Raspberry Pi user guide. Wiley, New York
Veizades J, Perkins CE (1997) Service location protocol. Technical report
Vinoski S (2006) Advanced message queuing protocol. IEEE Internet Comput 6:87–89
Walker K (2003) Artful media: interactive and informative art. IEEE Multimed 10(4):4–10
Wan Z, Hudak P (2000) Functional reactive programming from first principles. ACM Sigplan Not 35:242–252
Acknowledgements
This work is sponsored by the Ministry of Science and Technology, Taiwan, under Grants 107-2221-E-004-004, 107-2218-E-004-001 and 106-3011-E-004-001. Special thanks to the following people for their contributions in implementing the platform and the public performances: H. Huang, M. C. Lin, R. Y. Lin, Y. K. Hsiao and Z. Grannan; Director of Future Circus: H. C. Huang; and Director of Step In and Out of the Dreams: Y. L. Tao.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Liao, CF., Chen, K. A service platform for streamlining the production of cyber–physical interactive performance art. SOCA 13, 221–236 (2019). https://doi.org/10.1007/s11761-019-00268-8
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11761-019-00268-8