The computer center at Rockbottom University has been experiencing computer downtime. Let us assume that the trials of an associated Markov process are defined as one-hour periods and that the probability of the system being in a running state or a down state is based on the state of the system in the previous period. Historical data show the following transition probabilities: From Running Down
Running 0.90 0.10
Down 0.30 0.70
A. If the system is initially running, what is the probability of the system being down in the next hour of operation?
B. What are the steady-state probabilities of the system being in the running state and in the down state?