One of the axioms of probability is:
If the sample space is finite and $A$ and $B$ are disjoint events then $Pr[A\cup B]=Pr[A]+Pr[B]$, and if the sample space is infinite, then for for any (possibly infinite number of) disjoint events, like $A_1,A_2,\ldots$, then $Pr[\cup_iA_i]=\sum_iPr[A_i]$
I cannot understand why the first one cannot imply the second one. I have seen several probability books and they have mentioned it and skipped its detail. Can anyone give an example that the union of just two disjoint sets does not imply the union of any (possibly infinite) number of disjoint events?
Best Answer
First of all, there's no reason to restrict the definition of finite additivity to finite spaces. It's just that if a finitely additive measure is defined on a finite space, then, trivially, it's countably additive.
We can extend finite additivity as you've defined it by induction. Your axiom implies that, for any $n \in \mathbb{N}$, if $A_1,...,A_n$ is a sequence of pairwise disjoint events, then $$\sum_nP(A_n) = P(\cup_n A_n).$$
But finite additivity does not imply countable additivity. Indeed, consider the "fair integer lottery" (the uniform distribution over integers) that was of interest to De Finetti. This is a finitely additive probability measure defined on all subsets of $\mathbb{Z}$ such that $P(\{ z\})=0$ for all $z \in \mathbb{Z}$. Countable additivity fails because $$P(\mathbb{Z}) = 1 \neq 0 = \sum_z P(\{z \}).$$
Note that this is analogous to Lebesgue measure on $[0,1]$, for which we have countable additivity but not uncountable additivity.
Now, it's a little bit difficult to show rigorously that the measure described above actually exists. A relatively easy way to do it uses an ultrafilter. The existence of the required ultrafilter is usually established by using the axiom of choice or its equivalent, Zorn's lemma. (I wrote a little bit about this here.)
In fact, any ultrafilter $\mathcal{U}$ defines a finitely additive measure by setting $P(U)=1$ if $U \in \mathcal{U}$ and $P(U) = 0$ if $U \notin \mathcal{U}$. See this for example.
On the other hand, it has been shown that any purely finitely additive measure is non-constructible: the existence of such a measure cannot be proved with the ZF axioms of set theory alone. See this paper.