Easiest way to estimate that number is to employ the Stirling approximation: you have
$$ n! \sim \sqrt{2\pi n}\left(\frac{n}{e}\right)^n $$
(this is asymptotic notation), or even more roughly speaking, $ n! \approx e^{n\ln n} $ as order of magnitude. In your case, say $ n = 10^{80} $, you have
$$ n! \approx e^{80\cdot\ln{10}\cdot10^{80}} \approx 10^{10^{81.9}}. $$
(EDIT:
I had written 81 instead of 81.9 at the exponent; not only was the rounding incorrect, but especially, rounding exponents needs a lot of care when talking about orders of magnitude!)
By the way, this is also the plausible order of magnitude (in natural units) for the volume of the phase space of the observable universe.
Pictorially speaking, the decimal expansion of this number would need to convert every single particle in the observable universe into a digit in order to be written out.
For an even more pictorial comparison, the age of the universe is thought to be about $ 10^{17} $ seconds. This is far less than the number of digits you would need to write out the above number. Even if you could churn out, say, a billion of digits per seconds, you would still need about $ 10^{82}/10^9 = 10^{73} $ seconds to complete the task, which is a ridiculously prohibitory amount of time.
Best Answer
You get $\infty$ on your calculator because it is too big a number for it to handle. By using Sterling's approximation, we get
$$10^{78}!\approx\sqrt{2\pi} 10^{39}\left(\frac{10^{78}}{e} \right)^{10^{78}}$$ which is still way too big to even begin to fathom, but you probably won't get much closer to understanding this number. The real monster of this expression is $\left(10^{78}\right)^{10^{78}}$; it is approximately a $1$ followed by $10^{80}$ zeros.
Here is an entertaining post from Reddit trying to handle "just" $52!$, but it should put $10^{78}!$ a bit into perspective.