Skip to main content
SpringerLink
Log in
Book cover

International Conference on Artificial General Intelligence

AGI 2015: Artificial General Intelligence pp 46–49Cite as

Safe Baby AGI

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 9205))

Abstract

Out of fear that artificial general intelligence (AGI) might pose a future risk to human existence, some have suggested slowing or stopping AGI research, to allow time for theoretical work to guarantee its safety. Since an AGI system will necessarily be a complex closed-loop learning controller that lives and works in semi-stochastic environments, its behaviors are not fully determined by its design and initial state, so no mathematico-logical guarantees can be provided for its safety. Until actual running AGI systems exist – and there is as of yet no consensus on how to create them – that can be thoroughly analyzed and studied, any proposal on their safety can only be based on weak conjecture. As any practical AGI will unavoidably start in a relatively harmless baby-like state, subject to the nurture and education that we provide, we argue that our best hope to get safe AGI is to provide it proper education.

This work is supported by Reykjavik University’s School of Computer Science and a Centers of Excellence grant of the Science & Technology Policy Council of Iceland.

This is a preview of subscription content, log in via an institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Bieger, J., Thórisson, K.R., Garrett, D.: Raising AI: tutoring matters. In: Goertzel, B., Orseau, L., Snaider, J. (eds.) AGI 2014. LNCS, vol. 8598, pp. 1–10. Springer, Heidelberg (2014)

    Google Scholar 

  2. Bostrom, N.: Superintelligence: Paths, dangers, strategies. Oxford University Press (2014)

    Google Scholar 

  3. Dewey, D.: Learning what to value. In: Schmidhuber, J., Thórisson, K.R., Looks, M. (eds.) AGI 2011. LNCS, vol. 6830, pp. 309–314. Springer, Heidelberg (2011)

    Chapter  Google Scholar 

  4. Future of Life Institute: Research priorities for robust and beneficial artificial intelligence (January 2015)

    Google Scholar 

  5. Goertzel, B., Bugaj, S.V.: Stages of ethical development in artificial general intelligence systems. Frontiers in Artificial Intelligence and applications 171, 448 (2008)

    Google Scholar 

  6. Omohundro, S.M.: The basic AI drives. Frontiers in Artificial Intelligence and applications 171, 483 (2008)

    Google Scholar 

  7. Sotala, K., Yampolskiy, R.V.: Responses to catastrophic AGI risk: a survey. Physica Scripta 90(1), 018001 (2015)

    Article  Google Scholar 

  8. Turing, A.M.: Computing machinery and intelligence. Mind 59(236), 433–460 (1950)

    Article  MathSciNet  MATH  Google Scholar 

  9. Waser, M.R.: Discovering the foundations of a universal system of ethics as a road to safe artificial intelligence. In: AAAI Fall Symposium: Biologically Inspired Cognitive Architectures, pp. 195–200 (2008)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Center for Analysis and Design of Intelligent Agents / School of Computer Science, Reykjavik University, Menntavegur 1, 101, Reykjavik, Iceland

    Jordi Bieger & Kristinn R. Thórisson

  2. Icelandic Institute for Intelligent Machines, Uranus, Menntavegur 1, 101, Reykjavik, Iceland

    Kristinn R. Thórisson

  3. Department of Computer and Information Sciences, Temple University, Philadelphia, PA, 19122, USA

    Pei Wang

Authors
  1. Jordi Bieger
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Kristinn R. Thórisson
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pei Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jordi Bieger .

Editor information

Editors and Affiliations

  1. Reykjavik University, Reykjavik, Iceland

    Jordi Bieger

  2. Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR

    Ben Goertzel

  3. Mechanics and Optics, Saint Petersburg State University of Information Technologies, St. Petersburg, Russia

    Alexey Potapov

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this paper

Cite this paper

Bieger, J., Thórisson, K.R., Wang, P. (2015). Safe Baby AGI. In: Bieger, J., Goertzel, B., Potapov, A. (eds) Artificial General Intelligence. AGI 2015. Lecture Notes in Computer Science(), vol 9205. Springer, Cham. https://doi.org/10.1007/978-3-319-21365-1_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-21365-1_5

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-21364-4

  • Online ISBN: 978-3-319-21365-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation