Finding predominant word senses in untagged text

Diana McCarthy, Rob Koeling, Julie Weeds, John Carroll

Research output: Contribution to journalConference articlepeer-review

251 Scopus citations

Abstract

In word sense disambiguation (WSD), the heuristic of choosing the most common sense is extremely powerful because the distribution of the senses of a word is often skewed. The problem with using the predominant, or first sense heuristic, aside from the fact that it does not take surrounding context into account, is that it assumes some quantity of hand-tagged data. Whilst there are a few hand-tagged corpora available for some languages, one would expect the frequency distribution of the senses of words, particularly topical words, to depend on the genre and domain of the text under consideration. We present work on the use of a thesaurus acquired from raw textual corpora and the WordNet similarity package to find predominant noun senses automatically. The acquired predominant senses give a precision of 64% on the nouns of the SENSEVAL-2 English all-words task. This is a very promising result given that our method does not require any hand-tagged text, such as SemCor. Furthermore, we demonstrate that our method discovers appropriate predominant senses for words from two domain-specific corpora.

Original languageEnglish
Pages (from-to)279-286
Number of pages8
JournalProceedings of the Annual Meeting of the Association for Computational Linguistics
StatePublished - 2004
Externally publishedYes
Event42nd Annual Meeting of the Association for Computational Linguistics, ACL 2004 - Barcelona, Spain
Duration: Jul 21 2004Jul 26 2004

Fingerprint

Dive into the research topics of 'Finding predominant word senses in untagged text'. Together they form a unique fingerprint.

Cite this