In a poisson process, getting an exponential distribution from a poisson assumption (for eg. in a given period of time $t$, if number of books that arrive is given by a Poisson, then the time until first email will be given by an Exponential) is pretty straightforward, for eg. see Relationship between poisson and exponential distribution.
I'm trying to get the opposite. Given that each new email arrives following an exponential distribution, how can I retrieve that the number of emails in a time period $t$ is given by a Poisson?
I can get the basic cases. For example, let $X_i$ be time to receive $i$th email after having received $(i-1)$th email, and assume $X_i \sim Expo(\lambda)$. Also let $Y$ be the number of emails received in time period of length $t$.
Then
\begin{align*}
P(Y=0) &= P(\mbox{no book arrives before time } t) \\
&= P(X_1 > t) = e^{-\lambda t}
\end{align*}
and
\begin{align*}
P(Y=1) &= P(\mbox{first book arrives before time }t \mbox{ but then no other book arrives until time }t) \\
&= \int_0^t P(X_0 = x) \cdot P(X_1 > t-x) \,dx \\
&= \int_0^t \lambda e^{-\lambda x} \cdot e^{-\lambda (t-x)} \,dx
= \int_0^t \lambda e^{-\lambda t} \,dx = \lambda t e^{-\lambda t}
\end{align*}
which are both Poisson. We can continue this process, for example
$$ P(Y=2) = \int^t_0 P(X_1=x_1) \left[ \int^t_{x_1} P(X_2=x_2) \cdot P(X_3>t-x_2) \,dy \right] \,dx$$
But this quickly becomes unwieldy. Is there a better method to get this result? For example, I just learned that a sum of exponential r.v. (eg. the $X_i$'s here) can be modeled using a Gamma distribution, but not sure if this is of any help.
Best Answer
I'll leave it to you to fill the details of this:
The exponential waiting time implies that an infinitesimal interval of length $dt$ will have probability $\lambda dt$ of seeing a jump. Since the process we generate from these exponentials is memoryless, it resets on every hit. A region $[0,t]$, can be broken into bins of length $t/n$. As $n$ goes to infinity, each interval approximates an infinitesimal. Each bin is independent of all others. Thus the number of jumps in such an interval $[0,t]$ is asymptotically a binomial distribution with $n$ bins and probability $\lambda t/n$ of each bin getting a hit. Thus we get:
$$P(Y=x)=\binom{n}{x}(\lambda t/n)^k(1-\lambda t/n)^{n-k}.$$
Now use your favorite method of showing that a binomial with $n$ bins whose probability scales like $c/n$ approaches a poisson distribution with parameter $c$. You could use Stirling's approximation on the above, or even easier, recall that the characteristic function of a binomial looks like $(1-p+pe^{ix})^n$. The characteristic function of a poisson with rate $\lambda t$ is $\exp(\lambda t (\exp(ix-1))$. Then the definition of $e$ implies:
$$(1-p+pe^{ix})^n=(1-(1-e^{ix})\lambda t/n)^n\rightarrow \exp(\lambda t (\exp(ix-1)).$$