Source Word
information entropy
Noun
uncountable
(information
theory)
A
measure
of
the
uncertainty
associated
with
a
random
variable;
a
measure
of
the
average
information
content
one
is
missing
when
one
does
not
know
the
value
of
the
random
variable
(usually
in
units
such
as
bits);
the
amount
of
information
(measured
in,
say,
bits)
contained
per
average
instance
of
a
character
in
a
stream
of
characters.
Japanese Meaning
情報理論における不確実性の尺度。すなわち、ランダム変数の値を知らないときに欠如している平均的な情報量を、通常はビットなどの単位で示す指標。
Sense（1）
(information
theory)
A
measure
of
the
uncertainty
associated
with
a
random
variable;
a
measure
of
the
average
information
content
one
is
missing
when
one
does
not
know
the
value
of
the
random
variable
(usually
in
units
such
as
bits);
the
amount
of
information
(measured
in,
say,
bits)
contained
per
average
instance
of
a
character
in
a
stream
of
characters.
