abstract

Pedagogical strategies for teaching Virtual Production pipelines

Authors:

Gregory Bennett,

Hossein Najafi,

Lee JacksonAuthors Info & Claims

SA '23: SIGGRAPH Asia 2023 Educator's Forum

Article No.: 11, Pages 1 - 10

https://doi.org/10.1145/3610540.3627010

Published: 06 December 2023 Publication History

Get Access

Abstract

The incorporation of LED walls and virtual production tools in the film industry is a recent development that has significant pedagogical implications (BLISTEIN, 2020; FARID and TORRALBA, 2021). The use of LED walls combines physical and digital realities, potentially reducing post-production time and resource usage (ONG, 2020). Virtual production can facilitate immediate on-set decision-making and mitigate the need for certain post-production adjustments (EPIC GAMES, 2020). MIT researchers posit that such practices may also reduce the carbon footprint associated with location filming (FARID and TORRALBA, 2021). Nonetheless, further research and innovation are needed to overcome any limitations and fully harness the potential of this technology.

The utilization of Unreal Engine software and other real-time tools in visual effects education aligns with industry trends and enhances student preparedness for professional practice (FLEISCHER, 2020). It has been suggested that engaging students with these tools can foster an understanding of the virtual production pipeline, thus aligning the educational curriculum with evolving industry standards (BALSAMO et al., 2021).

As educators at Auckland University of Technology, we recognized the necessity of early integration of these paradigm-shifting tools into our curriculum to prepare students for impending and ongoing industry changes. In anticipation of procuring LED walls, we explored the potential of leveraging existing resources to initiate a pedagogical foray into the virtual production sphere. The available resources encompassed a large green screen studio, a motion capture studio, and virtual reality (VR) headsets and trackers.

This paper offers two pedagogical responses that were deployed in courses situated in the final (third) year of undergraduate studies for an Animation, Visual Effects and Game Design Major, Bachelor of Design, at the School of Art and Design, Auckland University of Technology. One course is positioned within a motion capture minor and the other an option within a major capstone project framework.

These two responses form case studies in the technical modification of existing teaching equipment and the need to push the limits of existing software and hardware resources within the attendant budgetary constraints of a tertiary education institution. This, in turn, is in the service of meeting shifting tertiary curriculum demands in response to a technologically fluid and future-focused industry.

References

[1]

BALSAMO, D., BERTA, R., DE GLORIA, A., AND ADDIMANDO, L. 2021. Innovative Tools and Strategies for Teaching and Learning Film Studies. Journal of e-Learning and Knowledge Society, 17(2). https://doi.org/10.20368/1971-8829/1135042

Crossref

Google Scholar

[2]

BENNETT, G., AND KRUSE, J. 2015. Teaching visual storytelling for virtual production pipelines incorporating motion capture and visual effects. SIGGRAPH Asia 2015 Symposium on Education, 1–8. https://doi.org/10.1145/2818498.2818516

Digital Library

Google Scholar

[3]

BLISTEIN, J. 2020. 'The Mandalorian': See How the Planets Were Created in New Docuseries Clip. Rolling Stone. https://www.rollingstone.com/tv/tv-news/the-mandalorian-gallery-disney-plus-docuseries-994435/

Google Scholar

[4]

CHEN, C., CHENG, L., AND CHEN, Y. 2021. A Study of Applying Virtual Reality to Experiential Learning in Film Education. Computers & Education, 161. https://doi.org/10.1016/j.compedu.2021.104064

Crossref

Google Scholar

[5]

EPIC GAMES. 2020. Virtual Production: A Frontline Report. https://www.unrealengine.com/en-US/spotlights/virtual-production-frontline-report

Google Scholar

[6]

FARID, H., AND TORRALBA, A. 2021. How Computer Science Is Changing Movie-making. Massachusetts Institute of Technology. https://news.mit.edu/2021/how-computer-science-changing-movie-making-0526

Google Scholar

[7]

FLEISCHER, C. 2020. Exploring Filmmaking with Unreal Engine. Journal of Media Practice and Education, 21(1), 71–85. https://doi.org/10.1080/25741136.2020.1721468

Crossref

Google Scholar

[8]

KIM, J., GU, Y., KAUTZ, J., AND THEOBALT, C. 2021. Deep Video Portraits: How AI technology is Changing Filmmaking. IEEE Transactions on Visualization and Computer Graphics. https://doi.org/10.1109/TVCG.2018.2853723

Crossref

Google Scholar

[9]

ONG, T. 2020. Epic Games CTO Kim Libreri is Preparing for a Future in Which Video Games are Unindistinguishable From Reality. The Verge. https://www.theverge.com/2020/7/16/21326091/epic-games-kim-libreri-fortnite-unreal-engine-5-interview-future-of-gaming

Google Scholar

Cited By

View all

Najafi HKennedy JRamsay ETodoroki MBennett G(2024)A Pedagogical Workflow for Interconnected Learning: Integrating Motion Capture in Animation, Visual Effects, and Game DesignSIGGRAPH Asia 2024 Educator's Forum10.1145/3680533.3697059(1-7)Online publication date: 3-Dec-2024
https://dl.acm.org/doi/10.1145/3680533.3697059
Maraffi T(2024)Metahuman Theatre: Teaching Photogrammetry and Mocap as a Performing Arts ProcessSpecial Interest Group on Computer Graphics and Interactive Techniques Conference Educator's Forum10.1145/3641235.3664436(1-2)Online publication date: 13-Jul-2024
https://doi.org/10.1145/3641235.3664436

Index Terms

Pedagogical strategies for teaching Virtual Production pipelines
1. Software and its engineering
  1. Software creation and management
    1. Software development process management
      1. Software development methods
        Agile software development

Recommendations

Teaching visual storytelling for virtual production pipelines incorporating motion capture and visual effects
SA '15: SIGGRAPH Asia 2015 Symposium on Education

Film, television and media production are subject to consistent change due to ever-evolving technological and economic environments. Accordingly, tertiary teaching of subject areas such as cinema, animation and visual effects require frequent ...
Virtual Production in Action: A Creative Implementation of Expanded Cinematography and Narratives
SIGGRAPH '22: ACM SIGGRAPH 2022 Posters

Virtual Production fulfills George Lucas's early dream of having an engulfing “space-opera in the sky” (1). Epic Games’ focus on realistic interactive 3D game environments using Unreal Engine, revolutionized the field of film-making, by replacing rear ...
“Get Real” Defining, Designing and Executing Virtual Production Curriculum at SCAD
SIGGRAPH '22: ACM SIGGRAPH 2022 Educator's Forum

Higher educational programs in Savannah College of Art and Design's (SCAD) School of Digital Media and Entertainment Arts have taken the leap to create a curriculum around virtual production including its adoption of the 40’x20’ LED volume set on SCAD's ...

Comments

Information & Contributors

Information

Published In

SA '23: SIGGRAPH Asia 2023 Educator's Forum

December 2023

76 pages

ISBN:9798400703119

DOI:10.1145/3610540

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 December 2023

Check for updates

Author Tags

Qualifiers

Abstract
Research
Refereed limited

Conference

SA '23

Sponsor:

SIGGRAPH

SA '23: SIGGRAPH Asia 2023

December 12 - 15, 2023

NSW, Sydney, Australia

Acceptance Rates

Overall Acceptance Rate 178 of 869 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
154
Total Downloads

Downloads (Last 12 months)81
Downloads (Last 6 weeks)11

Reflects downloads up to 28 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Najafi HKennedy JRamsay ETodoroki MBennett G(2024)A Pedagogical Workflow for Interconnected Learning: Integrating Motion Capture in Animation, Visual Effects, and Game DesignSIGGRAPH Asia 2024 Educator's Forum10.1145/3680533.3697059(1-7)Online publication date: 3-Dec-2024
https://dl.acm.org/doi/10.1145/3680533.3697059
Maraffi T(2024)Metahuman Theatre: Teaching Photogrammetry and Mocap as a Performing Arts ProcessSpecial Interest Group on Computer Graphics and Interactive Techniques Conference Educator's Forum10.1145/3641235.3664436(1-2)Online publication date: 13-Jul-2024
https://doi.org/10.1145/3641235.3664436

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Abstract

References

Cited By

Index Terms

Recommendations

Teaching visual storytelling for virtual production pipelines incorporating motion capture and visual effects

Virtual Production in Action: A Creative Implementation of Expanded Cinematography and Narratives

“Get Real” Defining, Designing and Executing Virtual Production Curriculum at SCAD

Comments

Information

Published In

Sponsors

Publisher

Publication History

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

HTML Format

Share

Share this Publication link

Share on social media

Affiliations