The theory of Markov chains has a natural non-commutative (or `quantum') extension in terms of operator algebras. This extension turns out to yield realistic results with applications in Quantum Optics. Starting from the familiar Markov chain on a finite state space we shall work our way up to general quantum Markov chains and `quantum trajectories', illustrated by the physical example of resonance fluorescence.