Mark Lycett
ABSTRACT
Technology continues to pervade social and organizational life (e.g., immersive, and artificial intelligence) and our environments become increasingly virtual. In this context we examine the challenges of creating believable virtual human experiences— photo-realistic digital imitations of ourselves that can act as proxies capable of navigating complex virtual environments while demonstrating autonomous behavior. We first develop a framework for discussion, then use that to explore the state-of-the-art in the context of human-like experience, autonomous behavior, and expansive environments. Last, we consider the key research challenges that emerge from review as a call to action.
- Karim Abdel-Malek , 2007. Development of the virtual-human Santos □ùëá□ùëÄ. Digital Human Modeling. Vincent G. Duffy (Ed.). Springer, Berlin, 490-499. ISBN: 9783642028083.Google Scholar
- Francisco Azuola , 1994. Building anthropometry-based virtual human models. In: Proceedings of the IMAGE VII Conference, Tucson, AZ, 54.Google Scholar
- Norman I. Badler, 1997. Real-time virtual humans. In: Proceedings of the Fifth Pacific Conference on Computer Graphics and Applications. IEEE, 4-13.Google ScholarCross Ref
- Norman I. Badler, Michael J. Hollick and John P. Granieri, 1993. Real-time control of a virtual human using minimal sensors. Presence: Teleoperators and Virtual Environments, 2, 1 (Feb. 1993), 82-86. DOI: https://doi.org/10.1162/pres.1993.2.1.82.Google ScholarDigital Library
- Yoshua Bengio, Yann Lecun and Geoffrey Hinton, 2021. Deep learning for AI. Communications of the ACM, 64, 7 (Jun, 2021), 58-65. DOI: 10.1145/3448250.Google ScholarDigital Library
- David Pal Boros and Karoly Hercegfi, 2020. Digital human modelling in research and development-a state of the art comparison of software. Human Systems Engineering and Design II. Tareq Ahram (Eds.), 543-548. ISBN: 978-3-030-27928-8.Google Scholar
- David Burden and Maggi Savin-Baden, 2019. Virtual humans: Today and tomorrow. London: CRC Press.Google Scholar
- Ergun Ekici, 2020. What's the difference between a chatbot and conversational AI? Amelia, an IPsoft Company. URL: https://youtu.be/xHAnLceQnT0 (visited on 20/06/2021).Google Scholar
- Fuqiang Gu , 2021. A Survey on deep learning for human activity recognition. ACM Computing Surveys, 54, 8 (Oct., 2021). DOI: https://doi.org/10.1145/3472290.Google ScholarDigital Library
- Mubbasir Kapadia , 2012. What's next? The new era of autonomous virtual humans. Motion in Games. Marcelo Kallmann and Kostas Bekris (Eds.). Springer, Berlin, 170-181. DOI: https://doi.org/10.1007/978-3-642-34710-8_16.Google Scholar
- Seokhwan Kim , 2021. Overview of the eighth dialog system technology challenge: DSTC8. IEEE/ACM Transactions on Audio, Speech, and Language Processing (May, 2021), 2529-2540. DOI: https://doi.org/10.1109/ TASLP.2021.3078368.Google Scholar
- Maria de Kleijn, Mark Siebert and Sarah Huggett, 2019. Knowledge management with digital humanities / digital scholarship. In: Artificial Intelligence: How knowledge is created, transferred and used (IFLA WLIC). Corfu, Greece. URL: http://library.ifla.org/2814/.Google Scholar
- Ahmed Köse, Aleksei Tepljakov and Eduard Petlenkov, 2021. Intelligent virtual environments with assessment of user experiences. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), LNCS, volume 12854, 463-373. DOI: https://doi.org/10.1007/978-3-030-87986-0_41.Google ScholarDigital Library
- John E. Laird, 2008. Extending the Soar cognitive architecture. In: Proceedings of the 2008 Conference on Artificial General Intelligence, 171. IOS Press, 224-235.Google Scholar
- Hobson Lane, Cole Howard and Hannes Max Hapke, 2019. Natural language processing in action: Understanding, analyzing, and generating text with Python. Manning, Shelter Island, NY. ISBN: 9781617294631.Google Scholar
- Antonio Lieto , 2018. The role of cognitive architectures in general artificial intelligence. Cognitive Systems Research, 48 (May, 2018), 1-3. DOI: https://doi.org/10.1016/j.cogsys.2017.08.003.Google Scholar
- Nadia Magnenat-Thalmann and Daniel Thalmann., 2004. An overview of virtual humans. Handbook of Virtual Humans. N. Magnenat-Thalmann and D. Thalmann (Eds.). John Wiley & Sons, Chichester, 1-25. ISBN: 0-470-02316-3.Google Scholar
- John Markoff and Tom Gruber, 2019. A conversation about conversational AI. TEDxBeaconStreet (Jan., 2019). URL: https://youtu.be/yoCwsvIyp9Y (visited on 20/06/2021).Google Scholar
- Shervin Minaee , 2021. Deep Learning-based text classification: A comprehensive review. ACM Computing Surveys, 54, 3 (Apr., 2021). DOI: https://doi.org/10.1145/3439726.Google ScholarDigital Library
- Jinjie Ni , 2021. Recent advances in deep learning-based dialogue systems: A systematic survey. arXiv preprint (2021). URL: https://arxiv-download.xixiaoyao.cn/pdf/2105.04387.pdf (visited on 20/06/2021).Google Scholar
- Isabella Panella, Luca Zanotti Fragonara and Antonios Tsourdos, 2021. A deep learning cognitive architecture: Towards a unified theory of cognition. Advances in Intelligent Systems and Computing (AISC), volume 1250, 566-582. DOI: https://doi.org/10.1007/978-3-030-55180-3_42.Google ScholarCross Ref
- Gopika Rajendran and Ojus Thomas Lee, 2020. Virtual character animation based on data-driven motion capture using deep learning technique. In: Proceedings of the 15th International Conference on Industrial and Information Systems (ICIIS 2020). 333-338. DOI: https://doi.org/10.1109/ICIIS51140.2020. 9342693.Google ScholarCross Ref
- Mark Sagar, Mike Seymour and Annette Henderson, 2016. Creating connection with autonomous facial animation. Communications of the ACM, 59, 12 (Dec., 2016), 82-91. DOI: https://doi.org/10.1145/2950041.Google ScholarDigital Library
- Mike Seymour, 2018. What happens when technology has a human face? TEDxSydnesSalon (Dec. 2018). URL: https://youtu.be/FPm3ZDKnS6A (visited on 03/06/2021).Google Scholar
- Chris Stokel-Walker, 2022. Welcome to the metaverse. New Scientist, 253, 3368 (Jan., 2022), 39-43. DOI: https://doi.org/10.1016/S0262-4079(22)00018-5.Google ScholarCross Ref
- Ben Thompson, 2021. Metaverses. Stratechery (Aug., 2021). URL: https://stratechery.com/2021/metaverses/ (visited on 04/08/2021).Google Scholar
- Charlie C. L. Wang , 2003. Virtual human modeling from photographs for garment industry. Computer-Aided Design, 35, 6 (May, 2003), 577-589. DOI: https://doi.org/10.1016/S0010-4485(02)00080-5.Google ScholarCross Ref
- Isaac Wang and Jaime Ruiz, 2021. Examining the use of nonverbal communication in virtual agents. International Journal of Human-Computer Interaction, 37, 17 (Mar 2021), 1648-1673, DOI: 10.1080/10447318.2021.1898851.Google ScholarCross Ref
- YouTube, 2019. How far is too far? | The age of A.I. YouTube Originals (Dec., 2019). URL: https://youtu. be/UwsrzCVZAb8 (visited on 21/06/2021).Google Scholar
Recommendations
How should metaverse augment humans with disabilities?
AH2022: 13th Augmented Human International ConferenceThe metaverse is a new paradigm made possible by emerging technologies like virtual reality, augmented reality, and blockchains. Humans with disabilities should not be excluded from the metaverse and should have equitable access to it. However, it is ...
Digital humans for virtual assembly evaluation
ICDHM'07: Proceedings of the 1st international conference on Digital human modelingThis paper studies the use of Virtual Reality and Human Simulation for the ergonomic evaluation of manual assembly processes. A virtual environment has been developed to represent the actual workspace where the assembly task took place. Into the virtual ...
Empowering Virtual Humans’ Emotional Expression in the Metaverse
Universal Access in Human-Computer InteractionAbstractThe Metaverse is defined as an interconnected network of 3D environments that enable multisensory interactions with virtual environments, digital objects, and people. A central component of a Metaverse is the realism of human interaction with the ...
Comments