Entropy and its many Avatars

Srinivasa Varadhan

Research output: Contribution to journalArticle

Abstract

Entropy was first introduced in 1865 by Rudolf Clausius in his study of the connection between work and heat. A mathematical definition was given by Boltzmann as the logarithm of the number of micro states that corresponds to a macro state. It plays important roles in statistical mechanics, in the theory of large deviations in probability, as an invariant in ergodic theory and as a useful tool in communication theory. This article explores some of the connections between these different contexts.

Original languageEnglish (US)
Pages (from-to)1845-1857
Number of pages13
JournalJournal of the Mathematical Society of Japan
Volume67
Issue number4
DOIs
StatePublished - 2015

Fingerprint

Communication Theory
Avatar
Ergodic Theory
Large Deviations
Ludwig Boltzmann
Statistical Mechanics
Logarithm
Heat
Entropy
Invariant
Context

Keywords

  • Entropy
  • Information
  • Large deviations

ASJC Scopus subject areas

  • Mathematics(all)

Cite this

Entropy and its many Avatars. / Varadhan, Srinivasa.

In: Journal of the Mathematical Society of Japan, Vol. 67, No. 4, 2015, p. 1845-1857.

Research output: Contribution to journalArticle

Varadhan, Srinivasa. / Entropy and its many Avatars. In: Journal of the Mathematical Society of Japan. 2015 ; Vol. 67, No. 4. pp. 1845-1857.
@article{f6106bbded09476b95412d924da58c1c,
title = "Entropy and its many Avatars",
abstract = "Entropy was first introduced in 1865 by Rudolf Clausius in his study of the connection between work and heat. A mathematical definition was given by Boltzmann as the logarithm of the number of micro states that corresponds to a macro state. It plays important roles in statistical mechanics, in the theory of large deviations in probability, as an invariant in ergodic theory and as a useful tool in communication theory. This article explores some of the connections between these different contexts.",
keywords = "Entropy, Information, Large deviations",
author = "Srinivasa Varadhan",
year = "2015",
doi = "10.2969/jmsj/06741845",
language = "English (US)",
volume = "67",
pages = "1845--1857",
journal = "Journal of the Mathematical Society of Japan",
issn = "0025-5645",
publisher = "Mathematical Society of Japan - Kobe University",
number = "4",

}

TY - JOUR

T1 - Entropy and its many Avatars

AU - Varadhan, Srinivasa

PY - 2015

Y1 - 2015

N2 - Entropy was first introduced in 1865 by Rudolf Clausius in his study of the connection between work and heat. A mathematical definition was given by Boltzmann as the logarithm of the number of micro states that corresponds to a macro state. It plays important roles in statistical mechanics, in the theory of large deviations in probability, as an invariant in ergodic theory and as a useful tool in communication theory. This article explores some of the connections between these different contexts.

AB - Entropy was first introduced in 1865 by Rudolf Clausius in his study of the connection between work and heat. A mathematical definition was given by Boltzmann as the logarithm of the number of micro states that corresponds to a macro state. It plays important roles in statistical mechanics, in the theory of large deviations in probability, as an invariant in ergodic theory and as a useful tool in communication theory. This article explores some of the connections between these different contexts.

KW - Entropy

KW - Information

KW - Large deviations

UR - http://www.scopus.com/inward/record.url?scp=84947081288&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84947081288&partnerID=8YFLogxK

U2 - 10.2969/jmsj/06741845

DO - 10.2969/jmsj/06741845

M3 - Article

VL - 67

SP - 1845

EP - 1857

JO - Journal of the Mathematical Society of Japan

JF - Journal of the Mathematical Society of Japan

SN - 0025-5645

IS - 4

ER -