Consider a Markov chain {} on state space {1, 2, 3, 4, 5} with the transition probability matrix whose rows are (0, 1/2, 1/2, 0, 0), (0, 0, 1, 0, 0), (0, 1/3, 0, 1/3, 1/3), (1, 0, 0, 0, 0) and (0, 0, 0, 0, 1). Then, which of the following statements are true?
Multi-select · full marks only for the exact set · Limit Theorems and Markov Chains