Entropy in bits

Calculate the entropy of a vector of probabilities, in bits. Probabilities should sum to one. Probabilities equalling zero will be ignored.

Usage

Entropy(...)

Arguments

...

Numerics or numeric vector specifying probabilities of outcomes.

Value

Entropy() returns the entropy of the specified probabilities, in bits.

Author

Martin R. Smith (martin.smith@durham.ac.uk)

Examples

Entropy(1/2, 0, 1/2) # = 1
#> [1] 1
Entropy(rep(1/4, 4)) # = 2
#> [1] 2