Absorbing Markov Chain

This abstract example of an absorbing Markov chain provides three basic measurements: The fundamental matrix is the mean number of times the process is in state given that it started in state . The absorption probability matrix shows the probability of each transient state being absorbed by the two absorption states, 1 and 7. The mean time for each transient state to be absorbed is shown in the absorption time matrix. The graph shows all the transient states, 2, 3, 4, 5, 6, and 8, and the two absorbing states, 1 and 7, together with all the probabilities allowed between the states.
You can vary the probability of the transition from 2 to 1 with the slider. Because the sum of the probabilities is 1, for each state's total transitions, the transition probability for the transition from 2 to 3 is internally computed to sum to 1 when you drag the slider.


  • [Snapshot]
  • [Snapshot]
  • [Snapshot]


The absorbing Markov chain shown above the original caption was designed with some simple symmetry as can be seen by observing the patterns in the original matrices. State 8 shows an isolated state that is immediately absorbed after 1 clock cycle. The extremes of the slider affect the fundamental matrix and the absorption of most of the other states. Although it can be discarded after extractions, the full probability state matrix in canonical form is provided in the program. The methods used to calculate all fundamental and absorption matrices are done using standard industry methods.
    • Share:

Embed Interactive Demonstration New!

Just copy and paste this snippet of JavaScript code into your website or blog to put the live Demonstration on your site. More details »

Files require Wolfram CDF Player or Mathematica.

Mathematica »
The #1 tool for creating Demonstrations
and anything technical.
Wolfram|Alpha »
Explore anything with the first
computational knowledge engine.
MathWorld »
The web's most extensive
mathematics resource.
Course Assistant Apps »
An app for every course—
right in the palm of your hand.
Wolfram Blog »
Read our views on math,
science, and technology.
Computable Document Format »
The format that makes Demonstrations
(and any information) easy to share and
interact with.
STEM Initiative »
Programs & resources for
educators, schools & students.
Computerbasedmath.org »
Join the initiative for modernizing
math education.
Step-by-Step Solutions »
Walk through homework problems one step at a time, with hints to help along the way.
Wolfram Problem Generator »
Unlimited random practice problems and answers with built-in step-by-step solutions. Practice online or make a printable study sheet.
Wolfram Language »
Knowledge-based programming for everyone.
Powered by Wolfram Mathematica © 2018 Wolfram Demonstrations Project & Contributors  |  Terms of Use  |  Privacy Policy  |  RSS Give us your feedback
Note: To run this Demonstration you need Mathematica 7+ or the free Mathematica Player 7EX
Download or upgrade to Mathematica Player 7EX
I already have Mathematica Player or Mathematica 7+