I am currently learning about Markov chains and Markov processes, as part of my study on stochastic processes. I feel there are so many properties about Markov chain, but the book that I have makes me miss the big picture, and I might better look at some other references.
So I would like to know if there are some references with nice treatment on Markov chains/processes? They can be a whole book, some chapters of a book, some lecture notes, some webpages, …. Their approaches can be different, either with or without referring to measure theory (I think a measure-theory approach will be helpful in clarifying things, but I hope it also has some intuitive interpretation), as long as they have clear organization, and provide both a big picture and cover most of the important topics of Markov chains/processes.
I really appreciate your contribution!
Best Answer
Two excellent introductions are James Norris's "Markov Chains" and Pierre Bremaud's "Markov Chains: Gibbs fields, Monte Carlo simulation, and queues". Both books assume a motivated student who is somewhat mathematically mature, though Bremaud reviews basic probability before he gets going.
Also the wonderful book "Markov Chains and Mixing Times" by Levin, Peres, and Wilmer is available online here. It starts right with the definition of Markov Chains, but eventually touches on topics in current research. So it is pretty advanced, but also well worth a look.