[Math] the correct inter-arrival time distribution in a Poisson process

probability distributionsqueueing-theory

Given a Poisson process (e.g. radioactive decay) with rate $\lambda$, then the expression $\exp(-\lambda t)$ is the probability of observing no counts in time interval $t$. This can be interpreted (after normalization) as the probability distribution (exponential distribution) of time intervals during which no counts are observed.

It is often said that this can also be interpreted as the distribution of times between counts. Although I'm sure this is right, I disagree: the distribution of time intervals in which no counts are observed is different than the distribution of time intervals between counts.

I would appreciate an explanation. Here's my reasoning.

I agree the exponential distribution is the time distribution for the first arrival, since the time origin (your stopwatch) was started at a non-specific time. However, the second arrival time must be measured with respect to the first one, which is a known time.

Take for example a low count rate (say 5 per minute) and a short time interval (0.1 sec). It is unlikely that I will get a count in that interval (i.e. probability of observing no counts is high -> exponential distribution). But that does not mean that 0.1 sec is a highly probable time interval between successive counts (quite the contrary actually). In fact, the exponential distribution says that the most likely interval is 0.

If you start your stopwatch at the time you record the first count, then the time interval before you record a second count would follow the distribution $P(1)= (\lambda t) \exp(-\lambda t)$, which seems to me to be the right inter-arrival time distribution.

Thanks!

Best Answer

Let $X(t)$ be a Poisson process with rate $\lambda$. For any time $t>0$, $X(t)$ follows a Poisson distribution $\mathcal{Po}(\lambda t)$. The probability that the count remains at zero at time $t$, given that is started with zero is then $$ \mathbb{P}\left(X(t)=0\right) = \mathrm{e}^{-\lambda t} $$ Let $T_1$ be the time of the first jump (a random variable). Then the event $\{X(t) = 0\}$ is the same as the event $\{T_1 > t\}$, meaning that the first jump will occur after epoch $t$, i.e. $$ \mathbb{P}\left(T_1 > t\right) = \mathbb{P}\left(X(t)=0\right) = \mathrm{e}^{-\lambda t} $$ That means that $T_1$ is an exponential random variable, whose density is $\lambda \mathrm{e}^{-\lambda t}$.

In order to establish that Poisson inter-arrival times are also exponential random variables we need to consider the values of the process at times $s$ and $t$, such that $s<t$. Since Poisson process has independent increments: $$ \mathbb{P}\left(X(s) = n, X(t) = m\right) = \mathbb{P}\left(X(s) = n, X(t) - X(s) = m -n\right) \stackrel{\text{indep. incr.}}{=} \\ \mathbb{P}\left(X(s)=n\right) \cdot \mathbb{P}\left(X(t-s)=m-n\right) = \frac{(\lambda s)^n}{n!} \mathrm{e}^{-\lambda s} \frac{(\lambda (t-s))^{m-n}}{(m-n)!} \mathrm{e}^{-\lambda (t-s)} \mathbf{1}_{ m \geqslant n \geqslant 0} = \\\frac{(\lambda t)^m}{m!} \mathrm{e}^{-\lambda t} \cdot \binom{m}{n} \left(\frac{s}{t}\right)^n \left(1-\frac{s}{t}\right)^{m-n} \mathbf{1}_{ m \geqslant n \geqslant 0} $$ This implies, for $s>0$: $$ \mathbb{P}\left(X(t+s) = n| X(t) = n\right) = \frac{\mathbb{P}\left(X(t+s) = n, X(t) = n\right)}{\mathbb{P}\left(X(t) = n\right)} = \mathrm{e}^{-\lambda s} $$ That is, given that the state of the process at times $t$, the probability that no jump occurs within $s$ seconds is $\mathrm{e}^{-\lambda s}$, i.e. the time to the next jump is an exponential random variable with rate $\lambda$.

Of course, this is all a consequence of the independence of increments and the property $X(t+s) - X(t) \stackrel{d}{=} X(s)$.