Information Theory

M. L. Gregory

doi:10.1016/B0-08-044854-2/04778-7

Information Theory

M. L. Gregory

Research output: Chapter in Book/Report/Conference proceeding › Chapter › peer-review

1 Scopus citations

Abstract

The field of information theory defines mathematical models used to quantify the amount of information in various linguistic constructs, independe of their content. Core to information theory is entropy, a method of incorporating frequency and contextual information of a linguistic unit to estimate its information value.

Original language	English
Title of host publication	Encyclopedia of Language & Linguistics
Publisher	Elsevier Ltd
Pages	683-685
Number of pages	3
ISBN (Print)	9780080448541
DOIs	https://doi.org/10.1016/B0-08-044854-2/04778-7
State	Published - 2006
Externally published	Yes

Keywords

Communication theory
Entropy
Frequency
Information
Mathematical models
Natural language processing
Probability
Redundancy
Statistics

Access to Document

10.1016/B0-08-044854-2/04778-7

Cite this

@inbook{f7ba0654bb724052968f4d8833caa694,

title = "Information Theory",

abstract = "The field of information theory defines mathematical models used to quantify the amount of information in various linguistic constructs, independe of their content. Core to information theory is entropy, a method of incorporating frequency and contextual information of a linguistic unit to estimate its information value.",

keywords = "Communication theory, Entropy, Frequency, Information, Mathematical models, Natural language processing, Probability, Redundancy, Statistics",

author = "Gregory, {M. L.}",

year = "2006",

doi = "10.1016/B0-08-044854-2/04778-7",

language = "Ingl{\'e}s",

isbn = "9780080448541",

pages = "683--685",

booktitle = "Encyclopedia of Language & Linguistics",

publisher = "Elsevier Ltd",

address = "Reino Unido",

}

TY - CHAP

T1 - Information Theory

AU - Gregory, M. L.

PY - 2006

Y1 - 2006

N2 - The field of information theory defines mathematical models used to quantify the amount of information in various linguistic constructs, independe of their content. Core to information theory is entropy, a method of incorporating frequency and contextual information of a linguistic unit to estimate its information value.

AB - The field of information theory defines mathematical models used to quantify the amount of information in various linguistic constructs, independe of their content. Core to information theory is entropy, a method of incorporating frequency and contextual information of a linguistic unit to estimate its information value.

KW - Communication theory

KW - Entropy

KW - Frequency

KW - Information

KW - Mathematical models

KW - Natural language processing

KW - Probability

KW - Redundancy

KW - Statistics

UR - http://www.scopus.com/inward/record.url?scp=84882856348&partnerID=8YFLogxK

U2 - 10.1016/B0-08-044854-2/04778-7

DO - 10.1016/B0-08-044854-2/04778-7

M3 - Capítulo

AN - SCOPUS:84882856348

SN - 9780080448541

SP - 683

EP - 685

BT - Encyclopedia of Language & Linguistics

PB - Elsevier Ltd

ER -

Information Theory

Abstract

Keywords

Access to Document

Other files and links

Fingerprint

Cite this