信息熵

概率 $p\left ( x \right )$ 取值$0\sim 1$，概率越高，信息越少

香农公式: $L\left ( x \right ) =log_{2}\frac{1}{p\left ( x \right )}=-log_{2}\left ( x \right )$

$L\left ( x \right ) =log_{2}\frac{1}{p\left ( x \right )}=-log_{2}\left ( x \right )$