Interactive demo · Statistical Methods for Modern Biology · Chapter 6

The exact binomial test: rejection regions, p-values and power

Toss a coin n times and count the heads k. Under the null hypothesis P(head) = p0, the count has the binomial distribution, so every probability needed for the test is a finite sum. Choose how the rejection region is built, read off the exact p-value, see how the power grows with n, and check that a p-value from a discrete statistic is super-uniform: P(p ≤ α) ≤ α, usually with strict inequality.

View

Tosses n

Observed heads k

Null p0

True P(head) (for power and new tosses)

Rejection region

Level α

Scoreboard

Try these

The two-sided p-value is the one of R's binom.test: the total null probability of all outcomes that are not more probable than the observed one. For p0 = 0.5 it equals 2 P(K ≥ max(k, n − k)).

In the lecture notes