Microsoft PowerPoint - 第五章 马尔科夫过程.pdf

••• ... t n t n t n t ... n tt tt nn nn ••• t n ... (1)(1)(1) (2)(2)(2) (3)(3)(3)... ... 1.1.1. T 0,1,2, ... 2.2.2. S 0,1,2, S ,2,1,0,1,2, ... X n , n 0(, F , P ) S n 1 ... 0 t t t t , i , i , , i , j S 1 2 n n1 1 2 n P X j X i , X i ,, X i P X j X i () t t 1 t 2 t n t t n n1 1 2 n n1 n X n , n 0 SS XX ,, nn 0 0 nn S () X n , n 0 pp ((mm )) PP XX jj XX ii ,, ii ,, jj SS ijij mm11 mm ... X , n 0 S ::: n ,,, p (n ) (m ) P X j X i , i , j S ij mn m m i n ,,, jj nn ... p (n ) (m ) ij (1)(1)(1) p (n ) (m ) 0, i , j S ,,, ij p (n ) (m ) P X j X i 1, i S (2)(2)(2) ij mn m j S j S (1) (0) 1, i j , 111p ij (m ) p ij (m ) 222 p ij (m ) ij