Powers of s-finite, finite and Markov kernels #
Iterating an s-finite kernel remains s-finite; iterating a uniformly finite kernel remains uniformly finite. The latter permits taking finite transition masses, and thus nonnegative real transition matrices, for every iterate. Iterating a Markov kernel also preserves the probability normalization of every row. Every power of a kernel preserves each of its invariant measures.
The powers of a deterministic kernel are the deterministic kernels of the iterates. Restricting
the Chapman–Kolmogorov integral to one intermediate state bounds (κ ^ (m + n)) x s below by
(κ ^ m) x {y} * (κ ^ n) y s; this is how positivity of multi-step transition masses propagates
along paths of states.
Every natural power of an s-finite kernel is s-finite.
Every natural power of a finite kernel is finite.
Every natural power of a Markov kernel is a Markov kernel.
The unit of the monoid of kernels Kernel α α is the identity kernel.
Every power of a kernel preserves each of its invariant measures.
A kernel intertwining two one-step kernels also intertwines all their powers.
A measure invariant under a kernel is invariant under every natural power of it.
The n-th power of the deterministic kernel of f is the deterministic kernel of the
n-th iterate of f.
Chapman–Kolmogorov lower bound. The m + n-step mass of a set s is at least the mass of
the paths that sit at the intermediate state y at time m.
Positive multi-step masses compose: if x reaches y with positive probability in m steps
and y reaches s with positive probability in n steps, then x reaches s with positive
probability in m + n steps.