The winograd schema challenge

Hector J. Levesque, Ernest Davis, Leora Morgenstern

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, we present an alternative to the Turing Test that has some conceptual and practical advantages. A Wino-grad schema is a pair of sentences that differ only in one or two words and that contain a referential ambiguity that is resolved in opposite directions in the two sentences. We have compiled a collection of Winograd schemas, designed so that the correct answer is obvious to the human reader, but cannot easily be found using selectional restrictions or statistical techniques over text corpora. A contestant in the Winograd Schema Challenge is presented with a collection of one sentence from each pair, and required to achieve human-level accuracy in choosing the correct disambiguation.

Original languageEnglish (US)
Title of host publication13th International Conference on the Principles of Knowledge Representation and Reasoning, KR 2012
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages552-561
Number of pages10
ISBN (Print)9781577355601
StatePublished - Jan 1 2012
Event13th International Conference on the Principles of Knowledge Representation and Reasoning, KR 2012 - Rome, Italy
Duration: Jun 10 2012Jun 14 2012

Publication series

NameProceedings of the International Workshop on Temporal Representation and Reasoning

Other

Other13th International Conference on the Principles of Knowledge Representation and Reasoning, KR 2012
CountryItaly
CityRome
Period6/10/126/14/12

ASJC Scopus subject areas

  • Software

Cite this

Levesque, H. J., Davis, E., & Morgenstern, L. (2012). The winograd schema challenge. In 13th International Conference on the Principles of Knowledge Representation and Reasoning, KR 2012 (pp. 552-561). (Proceedings of the International Workshop on Temporal Representation and Reasoning). Institute of Electrical and Electronics Engineers Inc..