如何计算二阶马尔可夫链的转移概率矩阵

Question

我有这样的数据

经纪人职位

IP BP SP IP IP ..

我想以这种形式计算二阶跃迁矩阵

             BP IP SP

BPBP

SPSP

IPIP

BPSP

血压

国际植保计划

SPIP

BPIP

IPBP

Answer 1

您可以使用embed生成成对的连续过渡，使用table进行计数， apply以计算总数并将计数转换为概率，进行dcast和melt将数组转换为data.frame。

# Sample data
states <- sample(LETTERS[1:3], 1e5, replace=TRUE)

# Pairs of transitions
d <- embed( states, 3 )
colnames(d) <- c("today", "yesterday", "day before yesterday")
head(d)

# Count the transitions
counts <- table( as.data.frame( d ) )

# Divide by the total number of transitions, to have probabilities
probabilities <- counts
probabilities[] <- as.vector(counts) / rep( as.vector(apply( counts, 2:3, sum )), each=dim(counts)[1] )

# Check that the probabilities sum up to 1
apply( probabilities, 2:3, sum )

# Convert the 3-dimensional array to a data.frame
library(reshape2)
dcast( melt( probabilities ), yesterday + `day before yesterday` ~ today )