More aggressive variation of gambler’s ruin

markov chainsprobability theory

I am working on a variation of the classical gambler's ruin. Assume the gambler has $\$100$ and can bet on something.
For example, the probability of winning is $40\%$ (i.e., if he bets $B$ dollars, he wins $B$ dollars with $40\%$ probability and loses $B$ dollars with $60\%$ probability). However, unlike in the classical gambler's ruin, he must bet all of his current money for each bet but never more than necessary. His final fortune can only be $\$0$ or $\$500$.

For example, if he has $\$200$, he will bet all the money. However, if he has $\$400$, he will only bet $\$100$ because if he wins this bet, the goal is achieved. And even if he loses, he has some chances to bet. The idea is that if the gambler has little money, he tends to be a risk seeker. Therefore, he wants to bet all the money to earn high returns. However, if he is close to the goal, he tends to be more conservative.

So, if at some stage $t$ of the game he owns $0 < X_t \leq 250$, he will bet $X_t$. If he owns $250 < X_t < 500$, he will bet $500−X_t$. If $X_t=0$, the game ends with a loss. If $X_t=500$, the game ends with a win. He starts out with $X_0=100$.

What is the probability that his final wealth reaches $\$500$ before losing all his money?

Could someone please provide some ideas to solve this question?

Best Answer

Just for fun, here is a graph of the winning probability $q(x)$ as a function of relative initial fortune $x \in [0, 1]$, as the probability $p$ of winning each bet varies from $0$ to $1$:

Graph

Indeed, writing $x = \sum_{n=1}^{\infty} a_n 2^{-n}$ with $a_n \in \{0, 1\}$ and noting that

$$ q(x) = p^{1-a_1}(1-p)^{a_1} q(2x - a_1) + p a_1, $$

we obtain an infinite series expansion for $q(x)$:

$$ q(x) = \sum_{n=1}^{\infty} p a_n \biggl( \prod_{k=1}^{n-1} p^{1-a_k}(1-p)^{a_k} \biggr). $$

As a sanity check, note that $\frac{1}{5} = 0.\overline{0011}_{(2)} $. So

\begin{align*} q(1/5) &= \sum_{n=1}^{4} p a_n \biggl( \prod_{k=1}^{n-1} p^{1-a_k}(1-p)^{a_k} \biggr) + p^2(1-p)^2 q(1/5), \end{align*}

and simplifying this yields the same value as in @Raskolnikov's answer.