Md. Yousuf Hossain
Skip Abstract Section
Skip Supplemental Material SectionAbstract
When learning how to develop AI behavior it is common for students to test different ideas before settling on a desired outcome. This functionality is not available in modern behavior tree systems beyond the traditional methods of duplication and conditional execution. We present NCAlt - a visual behavior authoring framework for exploring multiple game AI behaviors. The system also allows selective merging of nodes between multiple behavior tree alternatives and their visual differencing in the game scene and behavior tree views. We present two worked examples which demonstrate how NCAlt can improve the workflow of game development students. We have conducted a user study where NCAlt was compared against NodeCanvas for creating and using alternatives with moderately skilled game development students. Participants rated NCAlt 15% higher than NodeCanvas on the System Usability Scale (SUS). NCAlt was also rated higher on a self-developed questionnaire. We also conducted a semi-structured interview and a detailed longitudinal follow-up and obtained mostly positive feedback for NCAlt. The results suggest NCAlt has a potential to improve the types of workflows with behavior trees that involve exploration for game development students and facilitate learning, as a result. NCAlt was built on top of NodeCanvas - a plugin for the Unity Engine.
Supplemental Material
- Alvarez, G.A. and Franconeri, S.L. 2007. How many objects can you track?: Evidence for a resource-limited attentive tracking mechanism. Journal of Vision. 7, 13 (Oct. 2007), 14--14. DOI:https://doi.org/10.1167/7.13.14.Google Scholar
Cross Ref
- Behavior Designer - Behavior Trees for Everyone | Visual Scripting | Unity Asset Store: https://assetstore.unity.com/packages/tools/visual-scripting/behavior-designer-behavior-trees-for-everyone-15277?gclid=Cj0KCQjw9b_4BRCMARIsADMUIypkySxldYUkWqI-HTUpPdYxjzc0Xy23V-YZG8x2T4mSASxIZr5LNmkaAvzIEALw_wcB. Accessed: 2020-07--16.Google Scholar
- Behavior Trees: https://docs.unrealengine.com/en-US/Engine/ArtificialIntelligence/BehaviorTrees/index.html. Accessed: 2020-08-04.Google Scholar
- Behavior Trees or Finite State Machines | Opsive: https://opsive.com/support/documentation/behavior-designer/behavior-trees-or-finite-state-machines/. Accessed: 2020-01--26.Google Scholar
- Blueprints Visual Scripting: https://docs.unrealengine.com/en-us/Engine/Blueprints. Accessed: 2018--12--22.Google Scholar
- Bolt: Visual Scripting for Unity: https://ludiq.io/bolt. Accessed: 2019--12-04.Google Scholar
- Bremm, S., von Landesberger, T., Heß, M., Schreck, T., Weil, P. and Hamacherk, K. 2011. Interactive visual comparison of multiple trees. 2011 IEEE Conference on Visual Analytics Science and Technology (VAST) (Oct. 2011), 31--40.Google ScholarCross Ref
- Brooke, J. 1996. SUS: A "Quick and Dirty" Usability Scale. Usability evaluation in industry. Taylor & Francis. 189--194.Google Scholar
- Build software better, together: https://github.com. Accessed: 2020-01--14.Google Scholar
- Card, S.K., Bongwon Sun, Pendleton, B.A., Heer, J. and Bodnar, J.W. 2006. Time Tree: Exploring Time Changing Hierarchies. Visual Analytics Science and Technology, 2006 IEEE Symposium On (Oct. 2006), 3--10.Google Scholar
- Cherry, E. and Latulipe, C. 2014. Quantifying the Creativity Support of Digital Tools Through the Creativity Support Index. ACM Trans. Comput.-Hum. Interact. 21, 4 (Jun. 2014), 21:1--21:25. DOI:https://doi.org/10.1145/2617588.Google ScholarDigital Library
- Chu, E. and Zaman, L. 2021. Exploring alternatives with Unreal Engine's Blueprints Visual Scripting System. Entertainment Computing. 36, (Jan. 2021), 100388. DOI:https://doi.org/10.1016/j.entcom.2020.100388.Google Scholar
- Cristie, V. and Joyce, S. 2017. Capturing And Visualising Parametric Design Flow Through Interactive Web Versioning Snapshots. IASS Annual Symposium 2017 "Interfaces - Architecture. Engineering. Science." (Hamburg, Germany, Sep. 2017).Google Scholar
- Cristie, V. and Joyce, S. 2018. GHShot: 3D Design Versioning for Learning and Collaboration in the Web. (2018), 1--6.Google Scholar
- Dadgari, D. and Stuerzlinger, W. 2010. Novel User Interfaces for Diagram Versioning and Differencing. British HCI (2010).Google Scholar
- Dey, R. and Child, C. 2013. QL-BT: Enhancing behaviour tree design and implementation with Q-learning. 2013 IEEE Conference on Computational Inteligence in Games (CIG) (Aug. 2013), 1--8.Google ScholarCross Ref
- Elkhaldi, M. and Woodbury, R. 2015. Interactive Design Exploration with Alt.Text. International Journal of Architectural Computing. 13, 2 (Jun. 2015), 103--122. DOI:https://doi.org/10.1260/1478-0771.13.2.103.Google ScholarCross Ref
- Field, A., Miles, J. and Field, Z. 2012. Discovering Statistics Using R. SAGE Publications Ltd.Google Scholar
- FlowCanvas - Visual Scripting for Unity: http://flowcanvas.paradoxnotion.com/. Accessed: 2018--12--22.Google Scholar
- Git: https://git-scm.com/. Accessed: 2018--12--22.Google Scholar
- Gleicher, M., Albers, D., Walker, R., Jusufi, I., Hansen, C.D. and Roberts, J.C. 2011. Visual comparison for information visualization. Information Visualization. 10, 4 (Oct. 2011), 289--309. DOI:https://doi.org/10.1177/1473871611416549.Google ScholarDigital Library
- Graham, M. and Kennedy, J. 2010. A survey of multiple tree visualisation. Information Visualization. 9, 4 (Dec. 2010), 235--252. DOI:http://dx.doi.org/10.1057/ivs.2009.29.Google ScholarDigital Library
- GrasshopperTM: https://www.grasshopper3d.com/. Accessed: 2018--12--22.Google Scholar
- Guenther, J.R. 2016. Shiro - A language to represent alternatives. Simon Fraser University.Google Scholar
- Guerra-Gómez, J.A., Buck-coleman, A., Pack, M.L., Plaisant, C. and Shneiderman, B. 2013. TreeVersity: Interactive Visualizations for Comparing Hierarchical Datasets. Transportation Research Record (TRR), Journal of the Transportation Research Board (2013). (2013), 21. DOI:https://doi.org/10.3141/2392-06.Google Scholar
- Guerra-Gómez, J.A., Buck-Coleman, A., Plaisant, C. and Shneiderman, B. 2011. TreeVersity: Comparing tree structures by topology and node's attributes differences. 2011 IEEE Conference on Visual Analytics Science and Technology (VAST) (Oct. 2011), 275--276.Google ScholarCross Ref
- Guerra-Gómez, J.A., Buck-coleman, A., Plaisant, C. and Shneiderman, B. 2012. TreeVersity: Visualizing Hierarchal Data for Value with Topology Changes. Proceedings of the Digital Research Society 2012. 2, (Jul. 2012), 640--653.Google Scholar
- Guerra-Gómez, J.A., Pack, M.L., Plaisant, C. and Shneiderman, B. 2013. Visualizing Change over Time Using Dynamic Hierarchies: TreeVersity2 and the StemView. IEEE Transactions on Visualization and Computer Graphics. 19, 12 (2013), 2566--2575. DOI:https://doi.org/10.1109/TVCG.2013.231.Google ScholarDigital Library
- Hailpern, J., Hinterbichler, E., Leppert, C., Cook, D. and Bailey, B.P. 2007. TEAM STORM: Demonstrating an Interaction Model for Working with Multiple Ideas During Creative Group Work. Proceedings of the 6th ACM SIGCHI Conference on Creativity & Cognition (New York, NY, USA, 2007), 193--202.Google Scholar
- Hartmann, B., Yu, L., Allison, A., Yang, Y. and Klemmer, S.R. 2008. Design as exploration: creating interface alternatives through parallel authoring and runtime tuning. UIST 2008 (New York, NY, USA, 2008), 91--100.Google Scholar
- Herman, I., Melançon, G., de Ruiter, M.M. and Delest, M. 1999. Latour - A Tree Visualisation System. Graph Drawing (Berlin, Heidelberg, 1999), 392--399.Google Scholar
- Hossain, Md.Y. and Zaman, L. 2022. NCCollab: collaborative behavior tree authoring in game development. Multimedia Tools and Applications. (Apr. 2022). DOI:https://doi.org/10.1007/s11042-022--12307--2.Google Scholar
- Iovino, M., Scukins, E., Styrud, J., Ögren, P. and Smith, C. 2020. A Survey of Behavior Trees in Robotics and AI. arXiv:2005.05842 [cs]. (May 2020).Google Scholar
- Jantke, K.P., Lunzer, A. and Fujima, J. 2005. Subjunctive Interfaces in Exploratory e-Learning. Proceedings of the Third Biennial Conference on Professional Knowledge Management (Berlin, Heidelberg, 2005), 176--188.Google Scholar
- Johansson, A. and Dell'Acqua, P. 2012. Comparing behavior trees and emotional behavior networks for NPCs. 2012 17th International Conference on Computer Games (CGAMES) (Jul. 2012), 253--260.Google ScholarDigital Library
- Kazi, R.H., Grossman, T., Cheong, H., Hashemi, A. and Fitzmaurice, G. 2017. DreamSketch: Early Stage 3D Design Explorations with Sketching and Generative Design. Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (New York, NY, USA, 2017), 401--414.Google ScholarDigital Library
- Kirby, N. 2010. Introduction to Game AI. Cengage Learning PTR.Google Scholar
- Kolaric, S., Erhan, H. and Woodbury, R. 2017. CAMBRIA: Interacting with Multiple CAD Alternatives. Computer-Aided Architectural Design. Future Trajectories (Jul. 2017), 81--99.Google Scholar
- Kolaric, S., Woodbury, R. and Erhan, H. 2014. CAMBRIA: A Tool for Managing Multiple Design Alternatives. Proceedings of the 2014 Companion Publication on Designing Interactive Systems (New York, NY, USA, 2014), 81--84.Google ScholarDigital Library
- Lunzer, A. and Hornbæk, K. 2006. An Enhanced Spreadsheet Supporting Calculation-Structure Variants, and Its Application to Web-Based Processing. Federation over the Web (2006), 143--158.Google Scholar
- Lunzer, A. and Hornbæk, K. 2006. RecipeSheet: Creating, Combining and Controlling Information Processors. Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (New York, NY, USA, 2006), 145--154.Google Scholar
- Lunzer, A. and Hornbæk, K. 2003. Side-by-side display and control of multiple scenarios: Subjunctive interfaces for exploring multi-attribute data. Proceedings of OzCHI 2003. (2003), 26--28.Google Scholar
- Lunzer, A. and Hornbæk, K. 2008. Subjunctive Interfaces: Extending Applications to Support Parallel Setup, Viewing and Control of Alternative Scenarios. ACM TOCHI. 14, 4 (Jan. 2008), 17:1--17:44. DOI:https://doi.org/10.1145/1314683.1314685.Google ScholarDigital Library
- Lunzer, A. and Hornbæk, K. 2004. Usability Studies on a Visualisation for Parallel Display and Control of Alternative Scenarios. Proceedings of the Working Conference on Advanced Visual Interfaces (New York, NY, USA, 2004), 125--132.Google ScholarDigital Library
- Maccormick, D. and Zaman, L. 2019. SuBViS: The Use of Subjunctive Visual Programming Environments for Exploring Alternatives in Game Development. Foundations of Digital Games (FDG) 2019 (2019).Google Scholar
- MacKenzie, I.S. 2013. Chapter 5 - Designing HCI Experiments. Human-computer Interaction. I.S. MacKenzie, ed. Morgan Kaufmann. 157--189.Google Scholar
- Marks, J., Andalman, B., Beardsley, P.A., Freeman, W., Gibson, S., Hodgins, J., Kang, T., Mirtich, B., Pfister, H., Ruml, W., Ryall, K., Seims, J. and Shieber, S. 1997. Design galleries: a general approach to setting parameters for computer graphics and animation. SIGGRAPH '97 (New York, NY, USA, 1997), 389--400.Google Scholar
- Mohiuddin, A., Woodbury, R., Ashtari, N., Cichy, M. and Mueller, V. 2017. A Design Gallery System: Prototype and Evaluation. ACADIA 2017: DISCIPLINES & DISRUPTION [Proceedings of the 37th Annual Conference of the Association for Computer Aided Design in Architecture (ACADIA) ISBN 978-0--692--96506--1] Cambridge, MA 2--4 November, 2017), pp. 414- 425 (2017).Google ScholarCross Ref
- Munzner, T., Guimbretière, F., Tasiran, S., Zhang, L. and Zhou, Y. 2003. TreeJuxtaposer: scalable tree comparison using Focus+Context with guaranteed visibility. SIGGRAPH 2003. 22, 3 (2003), 453--462. DOI:https://doi.org/10.1145/882262.882291.Google ScholarDigital Library
- Namata, G.M., Staats, B., Getoor, L. and Shneiderman, B. 2007. A dual-view approach to interactive network visualization. CIKM 2007 (Lisbon, Portugal, 2007), 939--942.Google Scholar
- Namco 1980. Pac-Man. Namco.Google Scholar
- Nancel, M. and Cockburn, A. 2014. Causality: a conceptual model of interaction history. Proceedings of the 32nd annual ACM conference on Human factors in computing systems - CHI '14 (Toronto, Ontario, Canada, 2014), 1777--1786.Google ScholarDigital Library
- NodeCanvas - Asset Store: https://assetstore.unity.com/packages/tools/visual-scripting/nodecanvas-14914. Accessed: 2019-07-08.Google Scholar
- NodeCanvas - Behaviour Trees and State Machines for Unity Game Engine: https://nodecanvas.paradoxnotion.com/. Accessed: 2020-04-05.Google Scholar
- Noguchi, K., Gel, Y.R., Brunner, E. and Konietschke, F. 2012. nparLD: An R Software Package for the Nonparametric Analysis of Longitudinal Data in Factorial Experiments. Journal of Statistical Software. 50, 1 (Sep. 2012), 1--23. DOI:https://doi.org/10.18637/jss.v050.i12.Google ScholarCross Ref
- Open Broadcaster Software | OBS: https://obsproject.com/. Accessed: 2020-04--18.Google Scholar
- Parametric Modelling, Process, Advantages and Parametric Modelling Tools.: https://www.designtechsys.com/articles/parametric-modelling. Accessed: 2020-01--14.Google Scholar
- Pettersson, I., Lachner, F., Frison, A.-K., Riener, A. and Butz, A. 2018. A Bermuda Triangle?: A Review of Method Application and Triangulation in User Experience Evaluation. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2018), 461:1--461:16.Google ScholarDigital Library
- Playmaker | Visual Scripting | Unity Asset Store: https://assetstore.unity.com/packages/tools/visual-scripting/playmaker-368?gclid=Cj0KCQjw9b_4BRCMARIsADMUIyorQklboS6T1kXrXmFUnh4L61KJ4vXl1Pn6H9Q7U7g06Emhd0h8-_oaAqWSEALw_wcB. Accessed: 2020-07--16.Google Scholar
- Rasmussen, J. Are Behavior Trees a Thing of the Past?Google Scholar
- Santoni, C., Salvati, G., Tibaldo, V. and Pellacini, F. 2018. LevelMerge: Collaborative Game Level Editing by Merging Labeled Graphs. IEEE Computer Graphics and Applications. 38, 4 (Jul. 2018), 71--83. DOI:https://doi.org/10.1109/MCG.2018.042731660.Google ScholarCross Ref
- Sharp, H., Preece, J. and Rogers, Y. 2019. Interaction Design: Beyond Human-Computer Interaction. Wiley.Google Scholar
- Shireen, N., Erhan, H., Woodbury, R. and Wang, I. 2017. Making Sense of Design Space. Computer-Aided Architectural Design. Future Trajectories (Singapore, 2017), 191--211.Google Scholar
- Smith, B.N., Xu, A. and Bailey, B.P. 2010. Improving interaction models for generating and managing alternative ideas during early design work. Graphics Interface 2010 (Toronto, Ont., Canada, Canada, 2010), 121--128.Google ScholarDigital Library
- Soroush Ghorashi, S. and Jensen Carlos Jimbo | Proceedings of the 9th International Workshop on Cooperative and Human Aspects of Software Engineering.Google Scholar
- Terry, M. and Mynatt, E.D. 2002. Recognizing creative needs in user interface design. Creativity and Cognition 2002 (New York, NY, USA, 2002), 38--44.Google Scholar
- Terry, M., Mynatt, E.D., Nakakoji, K. and Yamamoto, Y. 2004. Variation in element and action: supporting simultaneous development of alternative solutions. CHI 2004 (New York, NY, USA, 2004), 711--718.Google Scholar
- Unity: https://unity.com/frontpage. Accessed: 2019--12--10.Google Scholar
- Unreal Engine: https://www.unrealengine.com/. Accessed: 2020-08-04.Google Scholar
- Wexler, J., Pushkarna, M., Bolukbasi, T., Wattenberg, M., Viégas, F. and Wilson, J. 2020. The What-If Tool: Interactive Probing of Machine Learning Models. IEEE Transactions on Visualization and Computer Graphics. 26, 1 (Jan. 2020), 56--65. DOI:https://doi.org/10.1109/TVCG.2019.2934619.Google Scholar
- Woodbury, R., Mohiuddin, A., Cichy, M. and Mueller, V. 2017. Interactive design galleries: A general approach to interacting with design alternatives. Design Studies. 52, (Sep. 2017), 40--72. DOI:https://doi.org/10.1016/j.destud.2017.05.001.Google Scholar
- Zacharis, N.Z. 2011. Measuring the Effects of Virtual Pair Programming in an Introductory Programming Java Course. IEEE Transactions on Education. 54, 1 (Feb. 2011), 168--170. DOI:https://doi.org/10.1109/TE.2010.2048328.Google ScholarDigital Library
- Zaman, L., Kalra, A. and Stuerzlinger, W. 2011. The effect of animation, dual view, difference layers, and relative re-layout in hierarchical diagram differencing. Graphics Interface 2011 (St. John's, Newfoundland, Canada, 2011), 183--190.Google Scholar
- Zaman, L., Neugebauer, C., Stuerzlinger, W. and Woodbury, R. 2018. GEM-NI+: Leveraging Difference Visualization and Multiple Displays for Supporting Multiple Complex Generative Design Alternatives. Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, 2018), LBW106:1-LBW106:6.Google ScholarDigital Library
- Zaman, L., Stuerzlinger, W. and Neugebauer, C. 2017. MACE: A New Interface for Comparing and Editing of Multiple Alternative Documents for Generative Design. Proceedings of the 2017 ACM Symposium on Document Engineering (New York, NY, USA, 2017), 67--76.Google ScholarDigital Library
- Zaman, L., Stuerzlinger, W., Neugebauer, C., Woodbury, R., Elkhaldi, M., Shireen, N. and Terry, M. 2015. GEM-NI: A System for Creating and Managing Alternatives In Generative Design. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (New York, NY, USA, 2015), 1201--1210.Google ScholarDigital Library
Index Terms
- NCAlt: Alternatives and Difference Visualizations for Behavior Trees in Game Development Learning
Recommendations
NCCollab: collaborative behavior tree authoring in game development
AbstractGame development is a collective process in which a variety of different professionals from different backgrounds collaborate together not only by means of conversational interaction but also collaborative participation, one of which is ...
Evolutionary algorithm for game difficulty control
CIMMACS'05: Proceedings of the 4th WSEAS international conference on Computational intelligence, man-machine systems and cyberneticsIn this paper we propose an evolutionary algorithm against player (EAP) for game that controls the difficulty of a game based on the player's propensity and proficiency fundamental using the Genetic Algorithm (GA). This paper describes how we use the GA ...
A game AI production shell framework: generating AI opponents for geomorphic-isometric strategy games via modeling of expert player intuition
DIMEA '07: Proceedings of the 2nd international conference on Digital interactive media in entertainment and artsOne of the most challenging aspects of game AI implementation in computer games is in the production of artificial opponents that can demonstrate human-intuitive strategic skills. In this paper, the need and requirements for a quick and efficient method ...
Comments