algorithmic entropy

Algorithmic entropy is closely related to statistically defined entropy, the statistical entropy of an ensemble being, for any concisely describable ensemble, very nearly equal to the ensemble average of the algorithmic entropy of its members; but for this reason algorithmic entropy corresponds intuitively to randomness rather than to complexity.