[Math] Toss two coins until two Heads and two Tails come up

combinatoricsprobability

You play a game where you toss two fair coins in the air. You always win $1. However, if you have tossed 2 heads at least once, and 2 tails at least once, you surrender all winnings, and cannot play again. You may stop playing at anytime. What’s your strategy?

My thoughts were that this seems similar to the coupon collector. We have two bad events (2H and 2T). So after the occurence of the first bad event the second one will occur in an expected number of 4 turns. So my strategy is to stop after 3 tosses from the moment the first bad event occured.
However, I can't prove it.

Best Answer

After the first bad event one has $x\geq1$ dollars in the pocket. The question is whether one shall go on playing. Denote by $E(x)$ the expected total win under the best strategy in this situation. If we decide to quit we have won $x$, and if we make a next turn we have (with probability ${3\over4}$) won $x+1$ and the possibility of further play, or (with probability ${1\over4}$) we have won $0$. This shows that $$E(x)=\max\left\{x, \ {3\over4}E(x+1)\right\}\ .\tag{1}$$ I'm assuming (without proof) that there will be an $n$ where we definitely won't play once more; hence $E(n)=n$. From this and $(1)$ we get $$E(n-1)=\max\left\{n-1,\ {3\over4}n\right\}=n-1\qquad(n\geq4)\ .$$ By downwards induction it follows that $$E(n)=n\qquad(n\geq 3)\ .$$ Using $(1)$ one then computes $$E(2)=\max\left\{2,\ {3\over4}E(3)\right\}={9\over4}\ ,\qquad E(1)=\max\left\{1,\ {3\over4}E(2)\right\}={27\over16}\ .$$ This means that one should play on when $1\leq x\leq2$, and quit otherwise.

Related Question