Absorbing Markov Chain

Requires a Wolfram Notebook System
Interact on desktop, mobile and cloud with the free Wolfram Player or other Wolfram Language products.
This abstract example of an absorbing Markov chain provides three basic measurements: The fundamental matrix is the mean number of times the process is in state
given that it started in state
. The absorption probability matrix shows the probability of each transient state being absorbed by the two absorption states, 1 and 7. The mean time for each transient state to be absorbed is shown in the absorption time matrix. The graph shows all the transient states, 2, 3, 4, 5, 6, and 8, and the two absorbing states, 1 and 7, together with all the probabilities allowed between the states.
Contributed by: Conrad A. Benulis (March 2011)
Open content licensed under CC BY-NC-SA
Snapshots
Details
The absorbing Markov chain shown above the original caption was designed with some simple symmetry as can be seen by observing the patterns in the original matrices. State 8 shows an isolated state that is immediately absorbed after 1 clock cycle. The extremes of the slider affect the fundamental matrix and the absorption of most of the other states. Although it can be discarded after extractions, the full probability state matrix in canonical form is provided in the program. The methods used to calculate all fundamental and absorption matrices are done using standard industry methods.
Permanent Citation
"Absorbing Markov Chain"
http://demonstrations.wolfram.com/AbsorbingMarkovChain/
Wolfram Demonstrations Project
Published: March 7 2011