Abstract
Large Language Models (LLMs) have significantly influenced everyday computational tasks and the pursuit of Artificial General Intelligence (AGI). However, their creativity is limited by the conventional data they learn from, particularly lacking in novelty. To enhance creativity in LLMs, this paper introduces an innovative approach using the Learning Intelligent Decision Agent (LIDA) cognitive architecture. We describe and implement a multimodal vector embeddings-based LIDA in this paper. A LIDA agent from this implementation is used to demonstrate our proposition to make generative AI more creative, specifically making it more novel. By leveraging episodic memory and attention, the LIDA-based agent can relate memories of recent unrelated events to solve current problems with novelty. Our approach incorporates a neuro-symbolic implementation of a LIDA agent that assists in generating creative ideas while illuminating a prompting technique for LLMs to make them more creative. Comparing responses from a baseline LLM and our LIDA-enhanced agent indicates an improvement in the novelty of the ideas generated.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
The responses from the agent, here and throughout the paper, are clipped using triple dots (‘…’) wherever needed to provide necessary context for creativity while removing irrelevant text.
References
Vaswani, A., et al.: Attention is all you need. In: Advances in Neural Information Processing Systems. Curran Associates, Inc. (2017)
Achiam, J., et al.: GPT-4 technical report. arXiv Prepr. arXiv:2303.08774 (2023)
Brown, T., et al.: Language models are few-shot learners. Adv. Neural. Inf. Process. Syst. 33, 1877–1901 (2020)
Bubeck, S., et al.: Sparks of artificial general intelligence: early experiments with GPT-4. arXiv Prepr. arXiv:2303.12712 (2023)
Kosinski, M.: Theory of mind may have spontaneously emerged in large language models. arXiv Prepr. arXiv:2302.02083, vol. 4, p. 169 (2023)
Romero, O.J., Zimmerman, J., Steinfeld, A., Tomasic, A.: Synergistic integration of large language models and cognitive architectures for robust AI: an exploratory analysis. Presented at the Proceedings of the AAAI Symposium Series (2023)
Park, J.S., O’Brien, J., Cai, C.J., Morris, M.R., Liang, P., Bernstein, M.S.: Generative agents: Interactive simulacra of human behavior. Presented at the Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology (2023)
Karimi, P., Rezwana, J., Siddiqui, S., Maher, M.L., Dehbozorgi, N.: Creative sketching partner: an analysis of human-AI co-creativity. Presented at the Proceedings of the 25th International Conference on Intelligent User Interfaces (2020)
Lawton, T., Ibarrola, F.J., Ventura, D., Grace, K.: Drawing with reframer: emergence and control in co-creative AI. Presented at the Proceedings of the 28th International Conference on Intelligent User Interfaces (2023)
Torrance, E.P.: Torrance Tests of Creative Thinking (2012). https://doi.apa.org/doi/10.1037/t05532-000. https://doi.org/10.1037/t05532-000
Zhao, Y., et al.: Assessing and Understanding Creativity in Large Language Models (2024). http://arxiv.org/abs/2401.12491. https://doi.org/10.48550/arXiv.2401.12491
Franklin, S., et al.: A LIDA cognitive model tutorial. Biol. Inspired Cogn. Archit. 16, 105–130 (2016)
Franklin, S.: Artificial Minds. MIT Press, Cambridge (1997)
Franklin, S., Madl, T., D’Mello, S., Snaider, J.: LIDA: a systems-level architecture for cognition, emotion, and learning. IEEE Trans. Auton. Ment. Dev. 6, 19–41 (2014). https://doi.org/10.1109/TAMD.2013.2277589
Dong, D.: Enabling an autonomous agent sharing its minds, describing its conscious contents. Cogn. Syst. Res. 80, 103–109 (2023)
Dong, D., Franklin, S.: A new action execution module for the learning intelligent distribution agent (LIDA): the sensory motor system. Cogn. Comput. 7, 1–17 (2015). https://doi.org/10.1007/s12559-015-9322-3
Khayi, N.A., Franklin, S.: Initiating language in LIDA: learning the meaning of vervet alarm calls. Biol. Inspired Cogn. Archit. 23, 7–18 (2018)
Kronsted, C., Neemeh, Z.A., Kugele, S., Franklin, S.: Modeling long-term intentions and narratives in autonomous agents. J. Artif. Intell. Conscious. 8, 229–265 (2021)
McCall, R.J., Franklin, S., Faghihi, U., Snaider, J., Kugele, S.: Artificial motivation for cognitive software agents. J. Artif. Gen. Intell. 11, 38–69 (2020)
Dong, D., Franklin, S., Agrawal, P.: Estimating human movements using memory of errors. Procedia Comput. Sci. 71, 1–10 (2015). https://doi.org/10.1016/j.procs.2015.12.174
Baars, B.J.: A Cognitive Theory of Consciousness. Cambridge University Press, New York (1988)
Baars, B.J.: The conscious access hypothesis: origins and recent evidence. Trends Cogn. Sci. 6, 47–52 (2002)
Madl, T., Baars, B.J., Franklin, S.: The timing of the cognitive cycle. PLoS ONE 6, e14803 (2011). https://doi.org/10.1371/journal.pone.0014803
Glenberg, A.M.: What memory is for: creating meaning in the service of action. Behav. Brain Sci. 20, 41–50 (1997). https://doi.org/10.1017/S0140525X97470012
Baddeley, A.D., Hitch, G.: Working memory. In: Bower, G.H. (ed.) Psychology of Learning and Motivation, pp. 47–89. Academic Press (1974). https://doi.org/10.1016/S0079-7421(08)60452-1
Varela, F.J., Thompson, E.T., Rosch, E.: The Embodied Mind: Cognitive Science and Human Experience. MIT Press, Cambridge (1992)
Ramamurthy, U., Franklin, S., Agrawal, P.: Self-system in a model of cognition. Int. J. Mach. Conscious. 04, 325–333 (2012). https://doi.org/10.1142/S1793843012400185
Ryan, K., Agrawal, P., Franklin, S.: The pattern theory of self in artificial general intelligence: a theoretical framework for modeling self in biologically inspired cognitive architectures. Cogn. Syst. Res. 62, 44–56 (2020). https://doi.org/10.1016/j.cogsys.2019.09.018
Conway, M.A.: Sensory–perceptual episodic memory and its context: autobiographical memory. Philos. Trans. R. Soc. Lond. B Biol. Sci. 356, 1375–1384 (2001). https://doi.org/10.1098/rstb.2001.0940
Moulton, S.T., Kosslyn, S.M.: Imagining predictions: mental imagery as mental emulation. Philos. Trans. R. Soc. B Biol. Sci. 364, 1273–1280 (2009)
Snaider, J., Franklin, S.: Vector LIDA. Procedia Comput. Sci. 41, 188–203 (2014)
Agrawal, P., Franklin, S., Snaider, J.: Sensory memory for grounded representations in a cognitive architecture. In: Proceedings of the Sixth Annual Conference on Advances in Cognitive Systems (ACS Poster Collection), pp. 1–18 (2018)
Cropley, A.J.: Creativity and cognition: producing effective novelty. Roeper Rev. 21, 253–260 (1999). https://doi.org/10.1080/02783199909553972
McCall, R., Snaider, J., Franklin, S.: Sensory and perceptual scene representation (2010). https://ccrg.cs.memphis.edu/assets/papers/2010/Scene_Representation_v20.doc
Llama 2: Open Foundation and Fine-Tuned Chat Models | Research - AI at Meta. https://ai.meta.com/research/publications/llama-2-open-foundation-and-fine-tuned-chat-models/. Accessed 23 Apr 2024
LLM Settings – Nextra. https://www.promptingguide.ai/introduction/settings. Accessed 23 Apr 2024
Kugele, S., Franklin, S.: Learning in LIDA. Cogn. Syst. Res. 66, 176–200 (2021). https://doi.org/10.1016/j.cogsys.2020.11.001
Agrawal, P., Franklin, S.: Multi-layer cortical learning algorithms. In: 2014 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB), pp. 141–147 (2014). https://doi.org/10.1109/CCMB.2014.7020707
Agrawal, P.: Applications of Sparse Representations. Electron. Theses Diss. (2019)
Kugele, S.C.: Embodied, Simulation-Based Cognition: A Hybrid Approach (2023)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Agrawal, P., Yagnik, A., Dong, D. (2024). Generative AI Can Be Creative Too. In: Thórisson, K.R., Isaev, P., Sheikhlar, A. (eds) Artificial General Intelligence. AGI 2024. Lecture Notes in Computer Science(), vol 14951. Springer, Cham. https://doi.org/10.1007/978-3-031-65572-2_1
Download citation
DOI: https://doi.org/10.1007/978-3-031-65572-2_1
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-65571-5
Online ISBN: 978-3-031-65572-2
eBook Packages: Computer ScienceComputer Science (R0)