[Math] Flipping fair coin –

probability

Examining an event. Let's say we flip a fair coin many times. Let's say 1.000.000 times. We know that even though each flip is not connected, influenced by past or future flips, in the long run each side heads or tails will end up approximately around 500.000 (50/50 event – theory of equilibrium)

My question is: What price ranges can the difference take between heads and tails throughout the 1.000.000 flips?
For example, if we could see the results at 1892 flips we may have witnessed a "70" difference (981 Heads over 911 Tails).

Or maybe if we could see the results at 15250 flips we may have witnessed a "6" difference (7622 Heads over 7628 Tails)

So… What could be considered a normal difference range? $\pm 70$? $\pm50$?
And what could be considered an EXTREME RARE difference range somewhere in the flips? $\pm500$ $\pm2000$? $\pm10.000$?

Best Answer

Given a fair coin, the number of heads (in $1000000$ flips) has a binomial distribution with a mean of $500000$, but it is very close to being normally distributed with that same mean, and with a standard deviation of

$$ \sigma = \sqrt{1000000 \left(\frac{1}{2}\right) \left(\frac{1}{2}\right)} = 500 $$

Using the usual properties of the normal distribution, we find that the number of heads should be within $500$ (one sigma) of $500000$ about $68$ percent of the time, within $1000$ (two sigmas) about $95$ percent of the time, and so on.

ETA: (Semi-)fun fact—The probability that we are outside one sigma is approximately $\frac{1}{\pi}$; the probability that we are outside two sigmas is about $\frac{1}{7\pi}$; the probability that we are outside three sigmas is about $\frac{1}{16e^\pi}$.