other

Teaching visual storytelling for virtual production pipelines incorporating motion capture and visual effects

Authors:

Gregory Bennett,

Jan KruseAuthors Info & Claims

SA '15: SIGGRAPH Asia 2015 Symposium on Education

Article No.: 4, Pages 1 - 8

https://doi.org/10.1145/2818498.2818516

Published: 02 November 2015 Publication History

Abstract

Film, television and media production are subject to consistent change due to ever-evolving technological and economic environments. Accordingly, tertiary teaching of subject areas such as cinema, animation and visual effects require frequent adjustments regarding curriculum structure and pedagogy. This paper discusses a multifaceted, cross-disciplinary approach to teaching Visual Narratives as part of a Digital Design program. Specifically, pedagogical challenges in teaching Visual Storytelling through Motion Capture and Visual Effects are addressed, and a new pedagogical framework using three different modes of moving image storytelling is applied and cited as case studies. Further, ongoing changes in film production environments and their impact on curricula for tertiary education providers are detailed, and appropriate suggestions based on tangible teaching experience are made. This paper also discusses the advantages of teaching Motion Capture in the context of immersive environments.

References

[1]

Autodesk. 2009. The New Art of Virtual Moviemaking - An Autodesk Whitepaper. Autodesk.

[2]

Bordwell, D., and Thompson, K. 2008. Film art: an introduction, eighth edition ed. McGraw Hill, Boston.

[3]

Bowen, C. J. 2013. Grammar of the shot, 3rd ed ed. Focal Press, Oxford.

[4]

Corrigan, T., and White, P. 2012. The film experience: an introduction, third edition ed. Bedford/St.Martins, Boston, Mass.

[5]

Delbridge, M. 2015. Motion capture in performance: an introduction. Palgrave Pivot. Palgrave Pivot, Basingstoke, Hampshire.

[6]

Hach, T., and Steurer, J. 2013. A Novel RGB-Z Camera for High-quality Motion Picture Applications. In Proceedings of the 10th European Conference on Visual Media Production, ACM, New York, NY, USA, CVMP '13, 4:1--4:10.

Digital Library

[7]

Howland, K., Good, J., and Robertson, J. 2007. A learner-centred design approach to developing a visual language for interactive storytelling. In Proceedings of the 6th International Conference on Interaction Design and Children, ACM, New York, NY, USA, IDC '07, 45--52.

Digital Library

[8]

Katz, S. D. 1991. Film Directing Shot by Shot: Visualizing from Concept to Screen, 1 edition ed. Focal Press, Studio City, CA, July.

[9]

Kolker, R. 2005. Film, Form, and Culture w/DVD-ROM, 3 edition ed. McGraw-Hill Humanities/Social Sciences/Languages, Boston, Mass., Aug.

[10]

McClean, S. T. 2007. Digital storytelling: the narrative power of visual effects in film. MIT Press, Cambridge, Mass.

Digital Library

[11]

Meyers, C., and Jones, T. B. 1993. Promoting Active Learning. Strategies for the College Classroom. ERIC.

[12]

Mileski, D., Schneider, F., and Bruegge, B. 2015. Visual storytelling. In Proceedings of the 18th European Conference on Pattern Languages of Program, ACM, New York, NY, USA, EuroPLoP '13, 12:1--12:7.

Digital Library

[13]

Okun, J. A., and Zwerman, S., Eds. 2010. The VES Handbook of Visual Effects: Industry Standard VFX Practices and Procedures, 1 ed. Focal Press, Burlington, MA, July.

[14]

Plemmons, D., and Hold, D. 2014. Creating next-gen 3d interactive apps with motion control and unity3d. In ACM SIGGRAPH 2014 Studio, ACM, New York, NY, USA, SIGGRAPH '14, 24:1--24:23.

Digital Library

[15]

Rusli, E. M. 2015. Oculus Studio to Make Virtual-Reality Movies. Wall Street Journal, Europe (Jan.), 16.

[16]

Sijll, J. V. 2005. Cinematic Storytelling: The 100 Most Powerful Film Conventions Every Filmmaker Must Know, 7.2.2005 edition ed. Michael Wiese Productions, Studio City, CA, Aug.

[17]

Wood, A. 2007. Digital encounters. Routledge, London; New York.

Cited By

Najafi HKennedy JRamsay ETodoroki MBennett G(2024)A Pedagogical Workflow for Interconnected Learning: Integrating Motion Capture in Animation, Visual Effects, and Game DesignSIGGRAPH Asia 2024 Educator's Forum10.1145/3680533.3697059(1-7)Online publication date: 3-Dec-2024
https://dl.acm.org/doi/10.1145/3680533.3697059
Forero-Serna A(2024)Toward the Consolidation of Filming Simulators: A Systematic Literature Review of Virtual Environments for Audiovisual Learning and PracticeInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2383035(1-14)Online publication date: 25-Jul-2024
https://doi.org/10.1080/10447318.2024.2383035
Bennett GNajafi HJackson L(2023)Pedagogical strategies for teaching Virtual Production pipelinesSIGGRAPH Asia 2023 Educator's Forum10.1145/3610540.3627010(1-10)Online publication date: 6-Dec-2023
https://dl.acm.org/doi/10.1145/3610540.3627010
Show More Cited By

Index Terms

Teaching visual storytelling for virtual production pipelines incorporating motion capture and visual effects
1. Applied computing
  1. Education
  2. Enterprise computing
2. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

A Pedagogical Workflow for Interconnected Learning: Integrating Motion Capture in Animation, Visual Effects, and Game Design: Major/Minor curriculum structure that supports the integration of Motion Capture with Animation, Visual Effects and Game Design Teaching Pathways.
SA '24: SIGGRAPH Asia 2024 Educator's Forum

This paper presents a case study in a curriculum structure that aims to integrate specialized course content across a range of primary study pathways. The 3-year Bachelor of Design degree at the School of Art and Design, Auckland University of Technology,...
Developing practical models for teaching motion capture
SIGGRAPH ASIA '09: ACM SIGGRAPH ASIA 2009 Educators Program

Motion capture technology is increasingly being used across a range of digital moving image practice, from 3D animation, digital visual effects and gaming, to digitally augmented live performance and dance.

Keeping abreast of developing and cutting edge ...
Pedagogical strategies for teaching Virtual Production pipelines
SA '23: SIGGRAPH Asia 2023 Educator's Forum

The incorporation of LED walls and virtual production tools in the film industry is a recent development that has significant pedagogical implications (BLISTEIN, 2020; FARID and TORRALBA, 2021). The use of LED walls combines physical and digital ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

SA '15: SIGGRAPH Asia 2015 Symposium on Education

November 2015

71 pages

ISBN:9781450339278

DOI:10.1145/2818498

Copyright © 2015 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 2015

Check for updates

Author Tags

Qualifiers

Other

Conference

SA'15

SA'15: SIGGRAPH Asia 2015

November 2 - 6, 2015

Kobe, Japan

Acceptance Rates

Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
445
Total Downloads

Downloads (Last 12 months)45
Downloads (Last 6 weeks)3

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Najafi HKennedy JRamsay ETodoroki MBennett G(2024)A Pedagogical Workflow for Interconnected Learning: Integrating Motion Capture in Animation, Visual Effects, and Game DesignSIGGRAPH Asia 2024 Educator's Forum10.1145/3680533.3697059(1-7)Online publication date: 3-Dec-2024
https://dl.acm.org/doi/10.1145/3680533.3697059
Forero-Serna A(2024)Toward the Consolidation of Filming Simulators: A Systematic Literature Review of Virtual Environments for Audiovisual Learning and PracticeInternational Journal of Human–Computer Interaction10.1080/10447318.2024.2383035(1-14)Online publication date: 25-Jul-2024
https://doi.org/10.1080/10447318.2024.2383035
Bennett GNajafi HJackson L(2023)Pedagogical strategies for teaching Virtual Production pipelinesSIGGRAPH Asia 2023 Educator's Forum10.1145/3610540.3627010(1-10)Online publication date: 6-Dec-2023
https://dl.acm.org/doi/10.1145/3610540.3627010
Vilchis CPerez-Guerrero CMendez-Ruiz MGonzalez-Mendoza M(2023)A survey on the pipeline evolution of facial capture and tracking for digital humansMultimedia Systems10.1007/s00530-023-01081-229:4(1917-1940)Online publication date: 1-Aug-2023
https://dl.acm.org/doi/10.1007/s00530-023-01081-2
Banfi F(2020)Virtual Museums and Human-VR-Computer Interaction for Cultural Heritage Application: New Levels of Interactivity and Knowledge of Digital Models and Descriptive GeometryDigital Heritage. Progress in Cultural Heritage: Documentation, Preservation, and Protection10.1007/978-3-030-73043-7_29(346-357)Online publication date: 2-Nov-2020
https://dl.acm.org/doi/10.1007/978-3-030-73043-7_29
Nikolai JBennett GMarks SGilson G(2018)Active Learning and Teaching through Digital Technology and Live Performance: ‘Choreographic Thinking’ as Art Practice in the Tertiary SectorInternational Journal of Art & Design Education10.1111/jade.1218138:1(137-152)Online publication date: 23-Sep-2018
https://doi.org/10.1111/jade.12181
Chen TWang WChen PKuo P(2016)Dance of China: A User-Centred Design Case Study of a Novel Animated Music Video Production (AMV)2016 IEEE Symposium on Service-Oriented System Engineering (SOSE)10.1109/SOSE.2016.49(256-259)Online publication date: Mar-2016
https://doi.org/10.1109/SOSE.2016.49

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten