Grammatically-based automatic word class formation

Lynette Hirschman, Ralph Grishman, Naomi Sager

Research output: Contribution to journalArticle

Abstract

Most previous attempts at producing word classes (thesauri) by statistical analysis have used very limited distributional information such as word co-occurrence in a document or a sentence. This paper describes an automatic procedure which uses the syntactic relations as the basis for grouping words into classes. It forms classes by grouping together nouns that occur as subject (or object) of the same verbs, and similarly by grouping together verbs occurring with the same subject or object. The program was applied to a small corpus of sentences in a subfield of pharmacology. This procedure yielded the word classes for the subfield, in good agreement with the word classes recognized by pharmacologists. The word classes can be used to describe the informational patterns that occur in texts of the subfield, to disambiguate parses of a sentence, and perhaps to improve the performance of current information retrieval systems.

Original languageEnglish (US)
Pages (from-to)39-57
Number of pages19
JournalInformation Processing and Management
Volume11
Issue number1-2
DOIs
StatePublished - 1975

Fingerprint

Thesauri
Information retrieval systems
Syntactics
grouping
Statistical methods
Controlled Vocabulary
Information Systems
pharmacology
thesaurus
Pharmacology
information retrieval
statistical analysis
performance
Grouping

ASJC Scopus subject areas

  • Computer Science Applications
  • Information Systems
  • Library and Information Sciences
  • Engineering(all)
  • Medicine(all)

Cite this

Grammatically-based automatic word class formation. / Hirschman, Lynette; Grishman, Ralph; Sager, Naomi.

In: Information Processing and Management, Vol. 11, No. 1-2, 1975, p. 39-57.

Research output: Contribution to journalArticle

Hirschman, Lynette ; Grishman, Ralph ; Sager, Naomi. / Grammatically-based automatic word class formation. In: Information Processing and Management. 1975 ; Vol. 11, No. 1-2. pp. 39-57.
@article{4393910004454f40b7380beb89aa90cd,
title = "Grammatically-based automatic word class formation",
abstract = "Most previous attempts at producing word classes (thesauri) by statistical analysis have used very limited distributional information such as word co-occurrence in a document or a sentence. This paper describes an automatic procedure which uses the syntactic relations as the basis for grouping words into classes. It forms classes by grouping together nouns that occur as subject (or object) of the same verbs, and similarly by grouping together verbs occurring with the same subject or object. The program was applied to a small corpus of sentences in a subfield of pharmacology. This procedure yielded the word classes for the subfield, in good agreement with the word classes recognized by pharmacologists. The word classes can be used to describe the informational patterns that occur in texts of the subfield, to disambiguate parses of a sentence, and perhaps to improve the performance of current information retrieval systems.",
author = "Lynette Hirschman and Ralph Grishman and Naomi Sager",
year = "1975",
doi = "10.1016/0306-4573(75)90033-3",
language = "English (US)",
volume = "11",
pages = "39--57",
journal = "Information Processing and Management",
issn = "0306-4573",
publisher = "Elsevier Limited",
number = "1-2",

}

TY - JOUR

T1 - Grammatically-based automatic word class formation

AU - Hirschman, Lynette

AU - Grishman, Ralph

AU - Sager, Naomi

PY - 1975

Y1 - 1975

N2 - Most previous attempts at producing word classes (thesauri) by statistical analysis have used very limited distributional information such as word co-occurrence in a document or a sentence. This paper describes an automatic procedure which uses the syntactic relations as the basis for grouping words into classes. It forms classes by grouping together nouns that occur as subject (or object) of the same verbs, and similarly by grouping together verbs occurring with the same subject or object. The program was applied to a small corpus of sentences in a subfield of pharmacology. This procedure yielded the word classes for the subfield, in good agreement with the word classes recognized by pharmacologists. The word classes can be used to describe the informational patterns that occur in texts of the subfield, to disambiguate parses of a sentence, and perhaps to improve the performance of current information retrieval systems.

AB - Most previous attempts at producing word classes (thesauri) by statistical analysis have used very limited distributional information such as word co-occurrence in a document or a sentence. This paper describes an automatic procedure which uses the syntactic relations as the basis for grouping words into classes. It forms classes by grouping together nouns that occur as subject (or object) of the same verbs, and similarly by grouping together verbs occurring with the same subject or object. The program was applied to a small corpus of sentences in a subfield of pharmacology. This procedure yielded the word classes for the subfield, in good agreement with the word classes recognized by pharmacologists. The word classes can be used to describe the informational patterns that occur in texts of the subfield, to disambiguate parses of a sentence, and perhaps to improve the performance of current information retrieval systems.

UR - http://www.scopus.com/inward/record.url?scp=0016519170&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0016519170&partnerID=8YFLogxK

U2 - 10.1016/0306-4573(75)90033-3

DO - 10.1016/0306-4573(75)90033-3

M3 - Article

VL - 11

SP - 39

EP - 57

JO - Information Processing and Management

JF - Information Processing and Management

SN - 0306-4573

IS - 1-2

ER -