Serguei A. Mokhov
ABSTRACT
How can software engineers and artists work effectively together to create real-time CG for performing arts on stage? We answer that with Illimitable Space System (ISS) and a live performances. Since 2012, ISS evolved its reusable pipeline architecture for interactive projection mapping, voice recognition, real-time audio/video effects through gesture and motion to achieve mixed reality and immersive visual effects for stage. ISS is a configurable toolbox for multimodal interaction and serves as a platform for artists to enhance their performance.
In 2016--2017, we deployed ISSv2 during Chinese New Year Galas held in West Island, Montreal as well other other events and educational outreach activities. We followed agile software engineering practices to adapt to the new productions. ISS can be configured with different visual effects profiles according to the requirement. Computation artists and designers can make the said effects without formal software engineering training.
- Aris Bezas. 2011. OpenProcessing - SuperFormula. {online}. (30 Dec. 2011). http://www.openprocessing.org/sketch/48808/.Google Scholar
- Deschanel Li, Miao Song, Serguei A. Mokhov, Alexandre Charette, and Amandeep Kaur. 2016. Interactive Media Light Dance Using ISSv2 at the Spring Festival 2016 Gala. {dance show, video}. (23 Jan. 2016). https://vimeo.com/153062959, West Island.Google Scholar
- Serguei A. Mokhov, Miao Song, Satish Chilkaka, Zinia Das, Jie Zhang, Jonathan Llewellyn, and Sudhir P. Mudur. 2016. Agile Forward-Reverse Requirements Elicitation as a Creative Design Process: A Case Study of llimitable Space System v2. Journal of Integrated Design and Process Science 20, 3 (Sept. 2016), 3--37.Google ScholarDigital Library
- Serguei A. Mokhov, Miao Song, Amandeep Kaur, Mehak Talwar, Keerthana Gudavalli, and Sudhir P. Mudur. 2017a. Managing Data and Artifacts Between Software Engineers and Artists: An ISSv2 Case Study. In Proceedings of the 21st International Database Engineering & Applications Symposium (IDEAS 2017). ACM, New York, NY, USA, 6--13. Google ScholarDigital Library
- Serguei A. Mokhov, Miao Song, Sudhir P. Mudur, and Peter Grogono. 2017b. Hands-on: Rapid Interactive Application Prototyping for Media Arts and Stage Performance. In ACM SIGGRAPH 2017 Studio (SIGGRAPH '17). ACM, New York, NY, USA, 3:1--3:29. Google ScholarDigital Library
- Miao Song, Serguei A. Mokhov, Alexandre Charette, Amandeep Kaur, Keerthana Gudavalli, Mehak Talwar, et al. 2016. Canada-China-International-Film-Festival prelaunch event. {cciff prelaunch, video}. (22 March 2016). http://cciff.ca/en/pre-launch/, Grey Nuns Concordia University.Google Scholar
Index Terms
- Real-time motion capture for performing arts and stage
Recommendations
Hands-on: rapid interactive application prototyping for media arts and performing arts in illimitable space
SIGGRAPH '19: ACM SIGGRAPH 2019 StudioWe complement the last three editions of the course at SIGGRAPH Asia (2015, 2016, 2018) and SIGGRAPH (2017) to make it more of a hands-on nature and include OpenISS. We explore a rapid prototyping of interactive graphical applications for stage and ...
Dataflow programming and processing for artists and beyond
SA '19: SIGGRAPH Asia 2019 CoursesWe complement the last three editions of the course at SIGGRAPH Asia (2015, 2016, 2018) and SIGGRAPH (2017) to make it more of a hands-on nature and include OpenISS. We explore a rapid prototyping of interactive graphical applications for stage and ...
Dataflow VFX Programming and Processing for Artists and OpenISS
SIGGRAPH '20: ACM SIGGRAPH 2020 LabsWe explore the notion of dataflow programming in realtime graphics artistic practice. We complement the previous editions of the course at SIGGRAPH Asia (2015, 2016, 2018) and SIGGRAPH (2017, 2019) to include OpenISS and PureData/GEM. First, we explore ...
Comments