Skip to main content

How Do You Test the Strength of AI?

  • Conference paper
  • First Online:
Artificial General Intelligence (AGI 2020)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 12177))

Included in the following conference series:

Abstract

Creating Strong AI means to develop artificial intelligence to the point where the machine’s intellectual capability is in a way equal to a human’s. Science is definitely one of the summits of human intelligence, the other being the art. Scientific research consists in creating hypotheses that are limited applicability models (methods) implying lossy information compression. In this article, we show that this paradigm is not unique to the science and is common to the most developed areas of human activities, like business and engineering. Thus, we argue, a Strong AI should possess a capability to build such models. Still, the known tests to confirm the human-level AI do not address this consideration. Based on the above we suggest a series of six tests of rising complexity to check if AI have achieved the human-level intelligence (Explanation, Problem-setting, Refutation, New phenomenon prediction, Business creation, Theory creation), five of which are new to the AGI literature.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
€32.70 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
EUR 29.95
Price includes VAT (France)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
EUR 74.89
Price includes VAT (France)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
EUR 94.94
Price includes VAT (France)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Kurzweil, R.: Long Live AI, Forbes, 15 August 2005. https://www.forbes.com/home/free_forbes/2005/0815/030.html. Accessed 25 Feb 2020

  2. Franz, A.: Will super-human artificial intelligence (AI) be subject to evolution? H+ Magazine, 6 September 2013. https://hplusmagazine.com/2013/09/06/will-super-human-artificial-intelligence-ai-be-subject-to-evolution/. Accessed 05 Apr 2020

  3. Turing, A.M.: Computing machinery and intelligence. Mind 59(236), 433–460 (1950). https://doi.org/10.1093/mind/lix.236.433

    Article  MathSciNet  Google Scholar 

  4. Diderot, D.: Pensees Philosophiques, Addition aux Pensees Philosophiques, p. 68. Flammarion, Paris (2007). ISBN 978-2-0807-1249-3

    Google Scholar 

  5. Moor, J.H. (ed.): The Turing Test. The Elusive Standard of Artificial Intelligence. COGS, vol. 30. Kluwer Academic Publishers, Boston (2003)

    MATH  Google Scholar 

  6. Bringsjord, S., Bello, P., Ferrucci, D.: Creativity, the turing test, and the (better) lovelace test. In: Moor, J.H. (ed.) The Turing Test. The Elusive Standard of Artificial Intelligence. COGS, vol. 30. Kluwer Academic Publishers, Boston (2003)

    Chapter  Google Scholar 

  7. Bringsjord, S., Schimanski, B.: What is artificial intelligence? Psychometric AI as an answer. In: Proceedings of the 18th International Joint Conference on Artificial Intelligence (IJCAI 2003), pp. 887–893. Morgan Kaufmann, San Francisco (2003)

    Google Scholar 

  8. Bringsjord, S., Licato, J.: Psychometric artificial general intelligence: the Piaget-MacGuyver room. In: Wang, P., Goertzel, B. (eds.) Theoretical Foundations of Artificial General Intelligence. Atlantis Thinking Machines, vol. 4. Atlantis Press, Paris (2012)

    Chapter  Google Scholar 

  9. Goertzel, B., Iklé, M., Wigmore, J.: The architecture of human-like general intelligence. In: Wang, P., Goertzel, B. (eds.) Theoretical Foundations of Artificial General Intelligence. Atlantis Thinking Machines, vol. 4. Atlantis Press, Paris (2012)

    Chapter  Google Scholar 

  10. Adams, S., et al.: Mapping the landscape of human-level artificial general intelligence. AI Mag. 33(1), 25–42 (2012). https://doi.org/10.1609/aimag.v33i1.2322

    Article  Google Scholar 

  11. Schrittwieser, J., et al.: Mastering Atari, Go, chess and shogi by planning with a learned model. arXiv:1911.08265 (2019)

  12. Nilsson, N.J.: Human-level artificial intelligence? Be serious! AI Mag. 26(4), 68 (2005). https://doi.org/10.1609/aimag.v26i4.1850

    Article  Google Scholar 

  13. Muehlhauser, L.: What is AGI? (2013). https://intelligence.org/2013/08/11/what-is-agi/. Accessed 29 Feb 2020

  14. Shane, J.: Why did the neural network cross the road? (2018). https://aiweirdness.com/post/174691534037/why-did-the-neural-network-cross-the-road. Accessed 29 Feb 2020

  15. Popper, K.: The Myth of the Framework: In Defence of Science and Rationality. Routledge, New York (1994). ISBN 9781135974800. Editor: Notturno M.A.

    Google Scholar 

  16. Illarionov, S.V.: Theory of Knowledge and Philosophy of Science. ROSSPEN, Moscow (2007). (in Russian)

    Google Scholar 

  17. Blank, S.: The Four Steps to the Epiphany: Successful Strategies for Products That Win. K&S Ranch, New York (2013)

    Google Scholar 

  18. Ries, E.: The Lean Startup. Crown Business (2011)

    Google Scholar 

  19. Kapitsa, P.L.: Problems in Physics. Znaniye, Moscow (1996). (in Russian)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Nikolay Mikhaylovskiy .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mikhaylovskiy, N. (2020). How Do You Test the Strength of AI?. In: Goertzel, B., Panov, A., Potapov, A., Yampolskiy, R. (eds) Artificial General Intelligence. AGI 2020. Lecture Notes in Computer Science(), vol 12177. Springer, Cham. https://doi.org/10.1007/978-3-030-52152-3_27

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-52152-3_27

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-52151-6

  • Online ISBN: 978-3-030-52152-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics