Yui Atarashi
ABSTRACT
To show off their playing, musicians publish musical performance videos on streaming services. In order to find out typical characteristics of guitar performance videos, we carried out a quantitative survey of guitar performance videos. Then, we discuss key problems of creating effects informed by the survey. According to the discussion, authoring videos with typical effects takes a long time even for experienced users because they typically need to combine multiple video tracks (e.g., lyrics and videos shot from multiple angles) into a single track. They need to synchronize all tracks with the musical piece and set transitions between them at the right timing, aware of the musical structure. This paper presents Instrumeteor, an authoring tool for musical performance videos. First, it automatically analyzes the musical structure in the tracks to align them on a single timeline. Second, it implements typical video effects informed by the survey. In this way, our tool reduces manual work and unleashes the musicians’ creativity.
- Floraine Berthouzoz, Wilmot Li, and Maneesh Agrawala. 2012. Tools for Placing Cuts and Transitions in Interview Video. ACM Trans. Graph. 31, 4, Article 67 (July 2012), 8 pages. https://doi.org/10.1145/2185520.2185563Google Scholar
Digital Library
- Ying Cao, Xufang Pang, Antoni B. Chan, and Rynson. W. H. Lau. 2017. Dynamic Manga: Animating Still Manga via Camera Movement. IEEE Transactions on Multimedia 19, 1 (2017), 160–172. https://doi.org/10.1109/TMM.2016.2609415Google ScholarDigital Library
- Peggy Chi, Zheng Sun, Katrina Panovich, and Irfan Essa. 2020. Automatic Video Creation From a Web Page. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’20). Association for Computing Machinery, New York, NY, USA, 279–292. https://doi.org/10.1145/3379337.3415814Google ScholarDigital Library
- Ohad Fried, Ayush Tewari, Michael Zollhöfer, Adam Finkelstein, Eli Shechtman, Dan B Goldman, Kyle Genova, Zeyu Jin, Christian Theobalt, and Maneesh Agrawala. 2019. Text-Based Editing of Talking-Head Video. ACM Trans. Graph. 38, 4, Article 68 (July 2019), 14 pages. https://doi.org/10.1145/3306346.3323028Google ScholarDigital Library
- Masataka Goto, Kazuyoshi Yoshii, Hiromasa Fujihara, Matthias Mauch, and Tomoyasu Nakano. 2011. Songle: A Web Service for Active Music Listening Improved by User Contributions.. In Proceedings of the 12th International Society for Music Information Retrieval Conference. ISMIR, Miami, United States, 311–316. https://doi.org/10.5281/zenodo.1416256Google ScholarCross Ref
- Masahiro Hamasaki and Masataka Goto. 2013. Songrium: A Music Browsing Assistance Service Based on Visualization of Massive Open Collaboration within Music Content Creation Community. In Proceedings of the 9th International Symposium on Open Collaboration (Hong Kong, China) (WikiSym ’13). Association for Computing Machinery, New York, NY, USA, Article 4, 10 pages. https://doi.org/10.1145/2491055.2491059Google ScholarDigital Library
- Jun Kato, Tomoyasu Nakano, and Masataka Goto. 2015. TextAlive: Integrated Design Environment for Kinetic Typography. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Republic of Korea) (CHI ’15). Association for Computing Machinery, New York, NY, USA, 3403–3412. https://doi.org/10.1145/2702123.2702140Google ScholarDigital Library
- Mackenzie Leake, Abe Davis, Anh Truong, and Maneesh Agrawala. 2017. Computational Video Editing for Dialogue-Driven Scenes. ACM Trans. Graph. 36, 4, Article 130 (July 2017), 14 pages. https://doi.org/10.1145/3072959.3073653Google ScholarDigital Library
- Tomoyasu Nakano, Sora Murofushi, Masataka Goto, and Shigeo Morishima. 2011. DanceReProducer: An Automatic Mashup Music Video Generation System by Reusing Dance Video Clips on the Web. In Proceedings of the 8th Sound and Music Computing Conference(SMC ’11). 183–189. https://doi.org/10.5281/zenodo.849903Google ScholarCross Ref
- Anh Truong, Floraine Berthouzoz, Wilmot Li, and Maneesh Agrawala. 2016. QuickCut: An Interactive Tool for Editing Narrated Video(UIST ’16). Association for Computing Machinery, New York, NY, USA, 497–507. https://doi.org/10.1145/2984511.2984569Google ScholarDigital Library
- Shuhei Tsuchida, Satoru Fukayama, and Masataka Goto. 2018. Automatic System for Editing Dance Videos Recorded Using Multiple Cameras. In Advances in Computer Entertainment Technology(ACE ’17). Springer International Publishing, Cham, 671–688. https://doi.org/10.1007/978-3-319-76270-8_47Google ScholarCross Ref
Index Terms
- Instrumeteor: Authoring tool for Guitar Performance Video
Recommendations
Guitar man: (an implementation of a rhythm game cooperative musical performance system with actual musical instruments)
SIGGRAPH Asia '08: ACM SIGGRAPH ASIA 2008 educators programmeThis study proposes a method for learning musical instruments using computer graphics. The conventional musical instrument learning systems have been considered as simple game controllers or simple score processors. This study produced an education ...
Automatic Guitar Music Transcription
ACSAT '12: Proceedings of the 2012 International Conference on Advanced Computer Science Applications and TechnologiesThis paper presents a system that helps in automatically generating guitar tablatures and musical scores based on musical audio data. Information gathered from the audio consists of pitch, onsets and durations, chords, and beat and tempo. Major issues ...
Musical Instrument Performance in Augmented Virtuality
ICDSP '22: Proceedings of the 6th International Conference on Digital Signal ProcessingIn this paper, we present the preliminary study results about musical instrument performance in Augmented Virtuality (AV). In our proposed approach, musician can prerecord their performance using any camera device. Then, through the processing pipeline ...
Comments