Macinnes, Armstrong, Pare, Cree, and Joordens (2009) Proceedings of the 2nd Conference on Artificial General Intelligence --- Everyone's a critic: Memory models and uses for an artificial Turing judge

MacInnes, W. J.*, Armstrong, B. C., Pare, D., Cree, G. S., & Joordens, S. (2009). Everyone’s a critic: Memory models and uses for an artificial Turing judge. In B. Goertzel, M. Hutter, & P. Hitzler (Eds.) Proceedings of the Second Conference on Artificial General Intelligence (pp. 132-137). Paris, France: Atlantic Press.

***Second runner up for Kurzweil Best Artificial General Intelligence Paper at AGI 2009 ***

Download:

Author's self-archived version (.pdf) (6 pages)

Official version from the Association for the Advancement of Artificial Intelligence [external link]

Other materials:

**Video recording of the talk ** [external link to copy cached by the society]

**Slides from the talk ** [exernal link to copy cached by society]

Abstract

The Turing test was originally conceived by Alan Turing (1950, Mind) to determine if a machine had achieved human-level intelligence. Although no longer taken as a comprehensive measure of human intelligence, passing the Turing test remains an interesting challenge as evidenced by the still unclaimed Loebner prize, a high profile prize for the first AI to pass a Turing style test. In this paper, we sketch the development of an artificial “Turing judge” capable of critically evaluating the likelihood that a stream of discourse was generated by a human or a computer. The knowledge our judge uses to make the assessment comes from a model of human lexical semantic memory known as latent semantic analysis (Landauer & Dumais, 1997; Psych. Rev.). We provide empirical evidence that our implemented judge is capable of distinguishing between human and computer generated language from the Loebner Turing test competition with a degree of success similar to human judges.

Keywords: Semantic Memory, General Knowledge, Decision Making, Machine learning, Language, Turing test

Copyright Notice (borrowed from David Plaut): The documents distributed here have been provided as a means to ensure timely dissemination of scholarly and technical work on a noncommercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.