Bayesian Likelihood – How to Understand the Posterior Distribution is the Same as Likelihood Function

bayesiandensity functionlikelihood

So I read this post Why is the posterior distribution the same as the likelihood function when uniform prior distribution is used in Bayesian Analysis, and learned that when we have a uniform prior, the posterior distribution is the same as the likelihood function. However, we also have that What is the reason that a likelihood function is not a pdf, i.e. likelihood is not a pdf. For example, the sum of the likelihood might not be 1.

Given these, how should we understand the posterior distribution is the same as the likelihood function when we have a uniform prior? Does this mean the sum of a posterior distribution doesn't need to be 1?

Best Answer

When a Bayesian posterior is derived from a likelihood function that does not integrate (or sum) to unity the posterior function is simply re-scaled to make that integral (or sum) equal one in order that the posterior can be a 'proper' probability distribution.

The use of a uniform prior makes the scaled likelihood function into the posterior and so it might make one wonder whether such a Bayesian approach offers anything beyond a pure likelihood approach. See these little books if you are interested in likelihood-based inference: https://www.goodreads.com/book/show/735705.Likelihood https://www.routledge.com/Statistical-Evidence-A-Likelihood-Paradigm/Royall/p/book/9780412044113