Skip to main content
SpringerLink
Log in

Instructions for Engineering Sustainable People

  • Conference paper
Artificial General Intelligence (AGI 2014)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 8598))

Included in the following conference series:

  • 1192 Accesses

Abstract

Exactly as Artificial Intelligence (AI) did before, Artificial General Intelligence (AGI) has lost its way. Having forgotten our original intentions, AGI researchers will continue to stumble over the problems of inflexibility, brittleness, lack of generality and safety until it is realized that tools simply cannot possess adaptability greater than their innate intentionality and cannot provide assurances and promises that they cannot understand. The current short-sighted static and reductionist definition of intelligence which focuses on goals must be replaced by a long-term adaptive one focused on learning, growth and self-improvement. AGI must claim an intent to create safe artificial people via autopoiesis before its promise(s) can be fulfilled.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. McCarthy, J., Hayes, P.J.: Some philosophical problems from the standpoint of artificial intelligence. In: Meltzer, B., Michie, D. (eds.) Machine Intelligence 4, pp. 463–502. Edinburgh University Press, Edinburgh (1969)

    Google Scholar 

  2. Dennett, D.: Cognitive Wheels: The Frame Problem of AI. In: Hookway, C. (ed.) Minds, Machines, and Evolution: Philosophical Studies, pp. 129–151. Cambridge University Press, Cambridge (1984)

    Google Scholar 

  3. Harnad, S.: The symbol grounding problem. Physica D 42, 335–346 (1990)

    Article  Google Scholar 

  4. Brooks, R.: Elephants don’t play chess. Robotics and Autonomous Systems 6(1-2), 1–16 (1990)

    Article  Google Scholar 

  5. Searle, J.: Minds, brains and programs. Behavioral and Brain Sciences 3(3), 417–457 (1980)

    Article  Google Scholar 

  6. Dreyfus, H.L.: What Computers Can’t Do: A Critique of Artificial Reason. Harper, Row New York (1972)

    Google Scholar 

  7. Dreyfus, H.L.: From Micro-Worlds to Knowledge Representation: AI at an Impasse. In: Haugeland, J. (ed.) Mind Design II: Philosophy, Psychology, Artificial Intelligence, pp. 143–182. MIT Press, Cambridge (1997)

    Google Scholar 

  8. Dreyfus, H.L.: What Computers Still Can’t Do: A Critique of Artificial Reason. MIT Press, Cambridge (1992)

    Google Scholar 

  9. Harnad, S.: To Cognize is to Categorize: Cognition is Categorization. In: Cohen, H., Lefebvre, C. (eds.) Handbook of Categorization in Cognitive Science, pp. 20–44. Elsevier, Amsterdam (2005)

    Google Scholar 

  10. Waser, M.R.: Safe/Moral Autopoiesis & Consciousness. International Journal of Machine Consciousness 5(1), 59–74 (2013)

    Article  Google Scholar 

  11. Haugeland, J.: Mind Design. MIT Press, Cambridge (1981)

    Google Scholar 

  12. Hutter, M.: Universal Artificial Intelligence: Sequential Decisions Based on Algorithmic Probability. Springer, Berlin (2005)

    Google Scholar 

  13. Omohundro, S.: The Basic AI Drives. In: Wang, P., Goertzel, B., Franklin, S. (eds.) Proceedings of the First AGI Conference, pp. 483–492. IOS Press, Amsterdam (2008)

    Google Scholar 

  14. Fox, J., Shulman, C.: Superintelligence Does Not Imply Benevolence. In: Mainzer, K. (ed.) ECAP 2010: VIII European Conference on Computing and Philosophy, pp. 456–462. Verlag, Munich (2010)

    Google Scholar 

  15. Waser, M.R.: Wisdom Does Imply Benevolence. In: Ess, C., Hagengruber, R. (eds.) The Computational Turn: Past, Presents, Futures?, pp. 169–172. MV-Verlag, Munster (2011)

    Google Scholar 

  16. Waser, M.R.: Designing a Safe Motivational System for Intelligent Machines. In: Baum, E.B., Hutter, M., Kitzelmann, E. (eds.) Artificial General Intelligence: Proceedings of the Third Conference, AGI 2010, Atlantis, Amsterdam, pp. 170–175 (2010)

    Google Scholar 

  17. Dennett, D.C.: Intentional Systems. The Journal of Philosophy 68(4), 87–106 (1971)

    Article  Google Scholar 

  18. Dennett, D.C.: The Intentional Stance. MIT Press, Cambridge (1987)

    Google Scholar 

  19. Good, I.J.: Speculations concerning the first ultraintelligent machine. In: Alt, F., Rubinoff, M. (eds.) Advances in Computers, vol. 6, pp. 31–88. Academic Press, New York (1965), doi:10.1016/S0065-2458(08)60418-0

    Google Scholar 

  20. Rosenthal, R.W.: Games of Perfect Information, Predatory Pricing and Chain Store Paradox. Journal of Economic Theory 25(1), 92–100 (1981), http://www.professorchaing.com/files/Rosenthal_1981_JET.pdf

    Article  MATH  MathSciNet  Google Scholar 

  21. Smart, J.M.: Evo Devo Universe? A Framework for Speculations on Cosmic Culture. In: Dick, S.J., Lupisella, M.L. (eds.) Cosmos and Culture: Cultural Evolution in a Cosmic Context, NASA SP-2009-4802, pp. 201–295. US Government Printing Ofiice, Washington, DC (2009)

    Google Scholar 

  22. Muehlhauser, L.: Facing The Intelligence Explosion. Machine Intelligence Research Institute, Berkeley (2013)

    Google Scholar 

  23. Haidt, J., Kesebir, S.: Morality. In: Fiske, S., Gilbert, D., Lindzey, G. (eds.) Handbook of Social Psychology, 5th edn., pp. 797–832 (2010)

    Google Scholar 

  24. Yudkowsky, E.: Creating Friendly AI 1.0: The Analysis and Design of Benevolent Goal Architectures. Machine Intelligence Research Institute, Berkeley (2001), http://intelligence.org/files/CFAI.pdf

    Google Scholar 

  25. Yudkowsky, E.: Coherent Extrapolated Volition. Machine Intelligence Research Institute, Berkeley (2004), http://intelligence.org/files/CFAI.pdf

    Google Scholar 

  26. Goertzel, B.: Should Humanity Build a Global AI Nanny to Delay the Singularity Until It’s Better Understood? Journal of Consciousness Studies 19(1-2), 96–111 (2012)

    Google Scholar 

  27. Metzinger, T.: The Ego Tunnel: The Science of the Mind and the Myth of the Self. Basic Books, New York (2009)

    Google Scholar 

  28. Amazon, http://www.amazon.com/The-Ego-Tunnel-Science-Mind/dp/0465020690/

  29. Dennett, D.C.: The Self as a Center of Narrative Gravity. In: Kessel, F., Cole, P., Johnson, D. (eds.) Self and Consciousness: Multiple Perspectives, Erlbaum, Hillsdale (1992), http://cogprints.org/266/

    Google Scholar 

  30. Hofstadter, D.: I Am A Strange Loop. Basic Books, New York (2007)

    MATH  Google Scholar 

  31. Llinas, R.R.: I of the Vortex: From Neurons to Self. MIT Press, Cambridge (2001)

    Google Scholar 

  32. Damasio, A.R.: Self Comes to Mind: Constructing the Conscious Brain. Pantheon, New York (2010)

    Google Scholar 

  33. Chalmers, D.: Facing Up to the Problem of Consciousness. Journal of Consciousness Studies 2(3), 200–219 (1995)

    MathSciNet  Google Scholar 

  34. Chalmers, D.: The Conscious Mind: In Search of a Fundamental Theory. Oxford University Press, New York (1996)

    MATH  Google Scholar 

  35. Chalmers, D.: Consciousness and its Place in Nature. In: Stich, S., Warfield, F. (eds.) The Blackwell Guide to the Philosophy of Mind, Blackwell, Malden (2003), http://consc.net/papers/nature.pdf

    Google Scholar 

  36. Waser, M.: Architectural Requirements & Implications of Consciousness, Self, and “Free Will”. In: Samsonovich, A., Johannsdottir, K. (eds.) Biologically Inspired Cognitive Architectures 2011. IOS Press, Amsterdam (2011), doi:10.3233/978-1-60750-959-2-438

    Google Scholar 

  37. Jackson, F.: Epiphenomenal Qualia. Philosophical Quarterly 32, 127–136 (1982)

    Article  Google Scholar 

  38. Dennett, D.C.: Consciousness Explained. Little Brown and Company, Boston (1991)

    Google Scholar 

  39. Dennett, D.C.: Intuition Pumps and Other Tools for Thinking. Norton & Company, New York (2013)

    Google Scholar 

  40. Tononi, G.: An Information Integration Theory of Consciousness. BMC Neurosci. 5(42) (2004), http://www.ncbi.nlm.nih.gov/pmc/articles/PMC543470/pdf/1471-2202-5-42.pdf , doi:10.1186/1471-2202-5-42

  41. Tononi, G.: Consciousness as Integrated Information: a Provisional Manifesto. Biol. Bull. 215(3), 216–242 (2008)

    Article  Google Scholar 

  42. Balduzzi, B., Tononi, G.: Qualia: The Geometry of Integrated Information. PLoS Comput Biol 5(8), e1000462 (2009), doi:10.1371/journal.pcbi.1000462

    Google Scholar 

  43. Varela, F.J., Maturana, H.R., Uribe, R.: Autopoiesis: The organization of living systems, its characterization and a model. BioSystems 5, 187–196 (1974)

    Article  Google Scholar 

  44. Maturana, H.R., Varela, F.J.: Autopoiesis and Cognition: The Realization of the Living. Kluwer Academic Publishers (1980)

    Google Scholar 

  45. Maturana, H.R., Varela, F.J.: The Tree of Knowledge: The Biological Roots of (1987)

    Google Scholar 

  46. Human Understanding. Shambhala Publications

    Google Scholar 

  47. Varela, F.J., Thompson, E., Rosch, E.: The Embodied Mind: Cognitive Science and Human Experience. MIT Press (1991)

    Google Scholar 

  48. Varela, F.J.: Autopoiesis and a Biology of Intentionality. In: Proc. of Autopoiesis and Perception: A Workshop with ESPRIT BRA 3352, Dublin, Ireland, pp. 4–14 (1992)

    Google Scholar 

  49. Varela, F.J.: Patterns of Life: Intertwining Identity and Cognition. Brain and Cognition 34(1), 72–87 (1997)

    Article  MathSciNet  Google Scholar 

  50. Blackmore, S.: Conversations on Consciousness. Oxford University Press, Oxford (2006)

    Google Scholar 

  51. Cashmore, A.R.: The Lucretian swerve: The biological basis of human behavior and the criminal justice system. PNAS 2010(107), 4499–4504 (2010)

    Article  Google Scholar 

  52. Waser, M.R.: Safety and Morality Require the Recognition of Self-Improving Machines as Moral/Justice Patients and Agents. In: Gunkel, D.J., Bryson, J.J., Torrance, S. (eds.) The Machine Question: AI, Ethics & Moral Responsibility, http://events.cs.bham.ac.uk/turing12/proceedings/14.pdf

  53. Brundage, M.: Limitations and Risks of Machine Ethics. Journal of Experimental and Theoretical Artificial Intelligence, (forthcoming) (2013), http://www.milesbrundage.com/uploads/2/1/6/8/21681226/limitations_and_risks_of_machine_ethics.pdf

Download references

Author information

Authors and Affiliations

  1. Digital Wisdom Institute, Vienna, VA, USA

    Mark R. Waser

Authors
  1. Mark R. Waser
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. OpenCog Foundation, G/F, 51C Lung Mei Village, Tai Po, N.T., Hong Kong

    Ben Goertzel

  2. AgroParisTech, 16 rue Claude Bernard, 75005, Paris, France

    Laurent Orseau

  3. Google Inc., 1600 Amphitheatre Parkway, 94043, Mountain View, CA, USA

    Javier Snaider

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Waser, M.R. (2014). Instructions for Engineering Sustainable People. In: Goertzel, B., Orseau, L., Snaider, J. (eds) Artificial General Intelligence. AGI 2014. Lecture Notes in Computer Science(), vol 8598. Springer, Cham. https://doi.org/10.1007/978-3-319-09274-4_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-09274-4_21

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-09273-7

  • Online ISBN: 978-3-319-09274-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation