Index: A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

Home > Asymptotic equipartition property

The asymptotic equipartition property (AEP), or Shannon-McMillan theorem, is a direct consequence of the weak law of large numbers and is used extensively in information theory. It can be summed up by the phrase 'Almost everything is almost equally probable.'

Given independent identically-distributed random variables X₁, ..., X_n with entropy H(X) and p(X₁, ..., X_k) the probability of observing the sequence X₁, ..., X_k, the AEP states that in probability,

The AEP is used to define the typical set, which is used extensively in theories of compression.

<Hide>

Topics: Asymptotic Equipartition Property, Asymptotic Notation...

Asymptotic equipartition propertyInformation theory The asymptotic equipartition property (AEP or Shannon-McMillan theorem, is a direct consequence of the weak law of large numbers and is used extensively in information theory. It can be summed up by the phrase 'Almost everything is almo	Asymptotic notationIn mathematical analysis, and in particular in the analysis of algorithms, to classify the growth of functions one has recourse to asymptotic notations . Knuth advocated the following notations (other notations hold in various contexts, e. Landau and Hard	Asymptotic analysisIn mathematics and applications, particularly the analysis of algorithms, asymptotic analysis is a method of classifying limiting behaviour, by concentrating on some trend''. It is sometimes expressed in the language of equivalence relations. For example,
Asymptotic freedomIn physics, asymptotic freedom is the property of some gauge theories in which the interaction between the particles, such as quarks, becomes arbitrarily weak at ever shorter distances, i. length scales that asymptotically converge to zero (or, equivalent	Asymptotic curveIn the differential geometry of surfaces, an asymptotic curve is a curve always tangent to an asymptotic direction of the surface (where they exist). It is sometimes called an asymptotic line although it needn't be a line. An asymptotic direction is one i	Asymptotic gain modelA negative feedback system can be described by the following equations (a picture would be nice): : : : The model is maybe called "Black's model". Here is a source quantity and is an output quantity. In electronics, each of and can be either a voltage or
Asymptotic Giant Branch

Non User