Home Statistical Dictionary Absorbing State
Absorbing State
A state that, once entered, is never left, its transition probability to itself is exactly 1.
In Plain English
An absorbing state is a trap door: once the chain steps into it, it's stuck there forever. "Game over" in a board game, "bankrupt" in a gambler's-ruin model, or "death" in a simple epidemic model are all absorbing states, there's no transition out. A chain with at least one absorbing state, and a way to reach it from every other state, will eventually be absorbed with probability 1, which is exactly the kind of long-run guarantee that makes absorbing Markov chains useful for modeling processes with a natural endpoint.
Definition
A state in a Markov chain is absorbing if , equivalently, for all . Once the chain enters an absorbing state it remains there for all future time steps. A Markov chain containing at least one absorbing state, in which every non-absorbing (transient) state has a positive-probability path to some absorbing state, is called an absorbing Markov chain. For such chains, standard results give closed-form expressions (via the fundamental matrix , where is the sub-matrix of transition probabilities among transient states) for quantities like the expected number of steps before absorption and the probability of ending up in each particular absorbing state.
Formula
Notation
Properties
- Absorbing states model natural terminal outcomes cleanly: bankruptcy in the classic gambler's ruin problem, death or full recovery in simple compartmental disease models, and 'accept' or 'reject' outcomes in sequential decision processes are all standard examples.
- A chain can have multiple absorbing states simultaneously, e.g. both 'ruin' and 'target wealth reached' in gambler's ruin, in which case the analysis asks not just when absorption happens but which absorbing state is reached, computed from the fundamental matrix.
- Absorbing Markov chain theory gives exact, closed-form answers (not just simulation estimates) for expected time to absorption and absorption probabilities, one of the cleanest applications of the transition-matrix machinery to a concrete, interpretable question.
At a Glance