This book presents a thorough treatment of the theory of denumerable Markov chains, both in discrete and in continuous time. In continuous time, it carefully examines the explosion phenomenon and the Kolmogorov equations. It then applies these results to birth and death processes.