The winograd schema challenge

Hector J. Levesque, Ernest Davis, Leora Morgenstern

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, we present an alternative to the Turing Test that has some conceptual and practical advantages. A Wino-grad schema is a pair of sentences that differ only in one or two words and that contain a referential ambiguity that is resolved in opposite directions in the two sentences. We have compiled a collection of Winograd schemas, designed so that the correct answer is obvious to the human reader, but cannot easily be found using selectional restrictions or statistical techniques over text corpora. A contestant in the Winograd Schema Challenge is presented with a collection of one sentence from each pair, and required to achieve human-level accuracy in choosing the correct disambiguation.

Original languageEnglish (US)
Title of host publication13th International Conference on the Principles of Knowledge Representation and Reasoning, KR 2012
Pages552-561
Number of pages10
Publication statusPublished - 2012
Event13th International Conference on the Principles of Knowledge Representation and Reasoning, KR 2012 - Rome, Italy
Duration: Jun 10 2012Jun 14 2012

Other

Other13th International Conference on the Principles of Knowledge Representation and Reasoning, KR 2012
CountryItaly
CityRome
Period6/10/126/14/12

ASJC Scopus subject areas

  • Software

Cite this

Levesque, H. J., Davis, E., & Morgenstern, L. (2012). The winograd schema challenge. In 13th International Conference on the Principles of Knowledge Representation and Reasoning, KR 2012 (pp. 552-561)