Joan Llobera
ABSTRACT
Virtual Reality (VR) content production is now a flourishing industry. The specifics of VR, as opposed to videogames or movies, allow for a content format where users experience, at the same time, the narrative richness characteristic of movies and theatre plays with interactive engagement. To create such a content format some technical challenges still need to be solved, the main being the need for a new generation of animation engines that can deliver interactive characters appropriate for narrative-focused VR interactive content. We review the main assumptions of this approach and recent progress in interactive character animation techniques that seems promising to realise this goal.
- Kevin Bergamin, Simon Clavet, Daniel Holden, and James Richard Forbes. 2019. DReCon: data-driven responsive control of physics-based characters. ACM Transactions On Graphics (TOG) 38, 6 (2019), 1–11.Google Scholar
Digital Library
- Michael Büttner and Simon Clavet. 2015. Motion Matching - The Road to NextGen Animation. Proc. of Nucl.ai (2015). https://www.youtube.com/watch?v=z_wpgHFSWss&t=658sGoogle Scholar
- Klaus Dorer. 2004. Extended behavior networks for behavior selection in dynamic and continuous domains. In Proceedings of the ECAI workshop Agents in dynamic domains, Valencia, Spain. Citeseer.Google Scholar
- Daniel Freeman, Polly Haselton, Jason Freeman, Bernhard Spanlang, Sameer Kishore, Emily Albery, Megan Denne, Poppy Brown, Mel Slater, and Alecia Nickless. 2018. Automated psychological therapy using immersive virtual reality for treatment of fear of heights: a single-blind, parallel-group, randomised controlled trial. The Lancet Psychiatry 5, 8 (2018), 625–632.Google ScholarCross Ref
- Daniel Holden, Taku Komura, and Jun Saito. 2017. Phase-functioned neural networks for character control. ACM Transactions on Graphics (TOG) 36, 4 (2017), 1–13.Google ScholarDigital Library
- Jessica Hodgins Libin Liu. August 2018. Learning Basketball Dribbling Skills Using Trajectory Optimization and Deep Reinforcement Learning. ACM Transactions on Graphics 37, 4 (August 2018).Google Scholar
- Joan Llobera. 2012. Stories within Immersive Virtual Environments. Universitat de Barcelona.Google Scholar
- Joan Llobera, Kristopher J Blom, and Mel Slater. 2013. Telling stories within immersive virtual environments. Leonardo 46, 5 (2013), 471–476.Google ScholarCross Ref
- Joan Llobera, Joe Booth, and Caecilia Charbonnier. 2021. New Techniques in Interactive Character Animation. In Special Interest Group on Computer Graphics and Interactive Techniques Conference Courses (SIGGRAPH ’21 Courses), August 09-13, 2021. https://doi.org/10.1145/3450508.3464604Google ScholarDigital Library
- Joan Llobera and Ronan Boulic. 2017. A tool to design interactive characters based on embodied cognition. IEEE Transactions on Games 11, 4 (2017), 311–319.Google ScholarCross Ref
- Josh Merel, Leonard Hasenclever, Alexandre Galashov, Arun Ahuja, Vu Pham, Greg Wayne, Yee Whye Teh, and Nicolas Heess. 2018. Neural Probabilistic Motor Primitives for Humanoid Control. In International Conference on Learning Representations. ICLR.Google Scholar
- Josh Merel, Saran Tunyasuvunakool, Arun Ahuja, Yuval Tassa, Leonard Hasenclever, Vu Pham, Tom Erez, Greg Wayne, and Nicolas Heess. 2020. Catch & Carry: reusable neural controllers for vision-guided whole-body tasks. ACM Transactions on Graphics (TOG) 39, 4 (2020), 39–1.Google ScholarDigital Library
- Xueni Pan, Marco Gillies, and Mel Slater. 2015. Virtual character personality influences participant attitudes and behavior–an interview with a virtual human character about her social anxiety. Frontiers in Robotics and AI 2 (2015), 1.Google ScholarCross Ref
- Xue Bin Peng, Pieter Abbeel, Sergey Levine, and Michiel van de Panne. 2018. Deepmimic: Example-guided deep reinforcement learning of physics-based character skills. ACM Transactions on Graphics (TOG) 37, 4 (2018), 1–14.Google ScholarDigital Library
- Xue Bin Peng, Michael Chang, Grace Zhang, Pieter Abbeel, and Sergey Levine. 2019. MCP: Learning Composable Hierarchical Control with Multiplicative Compositional Policies. In Advances in Neural Information Processing Systems 32, H. Wallach, H. Larochelle, A. Beygelzimer, F. d'Alché-Buc, E. Fox, and R. Garnett (Eds.). Curran Associates, Inc., 3681–3692. http://papers.nips.cc/paper/8626-mcp-learning-composable-hierarchical-control-with-multiplicative-compositional-policies.pdfGoogle Scholar
- Xue Bin Peng, Angjoo Kanazawa, Jitendra Malik, Pieter Abbeel, and Sergey Levine. 2018. Sfv: Reinforcement learning of physical skills from videos. ACM Transactions On Graphics (TOG) 37, 6 (2018), 1–14.Google ScholarDigital Library
- Albert Rizzo, Greg Reger, Karen Perlman, Barbara Rothbaum, JoAnn Difede, Rob McLay, Ken Graap, Greg Gahm, Scott Johnston, Rob Deal, 2011. Virtual reality posttraumatic stress disorder (PTSD) exposure therapy results with active duty OIF/OEF service members. International Journal on Disability and Human Development 10, 4(2011), 301–308.Google ScholarCross Ref
- Richard Skarbez, Solene Neyret, Frederick P Brooks, Mel Slater, and Mary C Whitton. 2017. A psychophysical experiment regarding components of the plausibility illusion. IEEE transactions on visualization and computer graphics 23, 4(2017), 1369–1378.Google ScholarDigital Library
- Mel Slater. 2009. Place illusion and plausibility can lead to realistic behaviour in immersive virtual environments. Philosophical Transactions of the Royal Society B: Biological Sciences 364, 1535 (2009), 3549–3557.Google ScholarCross Ref
- Mel Slater, Aitor Rovira, Richard Southern, David Swapp, Jian J Zhang, Claire Campbell, and Mark Levine. 2013. Bystander responses to a violent incident in an immersive virtual environment. PloS one 8, 1 (2013), e52766.Google ScholarCross Ref
- Sebastian Starke, He Zhang, Taku Komura, and Jun Saito. 2019. Neural state machine for character-scene interactions.ACM Trans. Graph. 38, 6 (2019), 209–1.Google ScholarDigital Library
- Sebastian Starke, Yiwei Zhao, Taku Komura, and Kazi Zaman. 2020. Local motion phases for learning multi-contact character movements. ACM Transactions on Graphics (TOG) 39, 4 (2020), 54–1.Google ScholarDigital Library
- Tingwu Wang, Yunrong Guo, Maria Shugrina, and Sanja Fidler. 2020. UniCon: Universal Neural Controller For Physics-based Character Motion. arxiv:2011.15119 [cs.GR]Google Scholar
Recommendations
Interactive Narrative in Virtual Reality
MUM '18: Proceedings of the 17th International Conference on Mobile and Ubiquitous MultimediaInteractive fiction is a literary genre that is rapidly gaining popularity. In this genre, readers are able to explicitly take actions in order to guide the course of the story. With the recent popularity of narrative focused games, we propose to design ...
Interactive Augmented Live Virtual Reality Streaming: A Health Care Application
ICMHI '18: Proceedings of the 2nd International Conference on Medical and Health InformaticsVirtual Reality (VR) technology has been around for decades; however, we have probably only begun to realize the practical applications until recent years. With increase of computing power, decrease of cost and physical dimension, a new class of ...
Effects of Character Guide in Immersive Virtual Reality Stories
Virtual, Augmented and Mixed Reality. Multimodal InteractionAbstractBringing cinematic experiences from traditional film screens into Virtual Reality (VR) has become increasingly popular in recent years. However, striking a balance between storytelling and user interaction can cause a big challenge for filmmakers. ...
Comments