[英]Min and max of NA sequences
我有一個數據框,其中列foo
包含運行中的NA值序列。 例如:
> test
id foo time
1 1 <NA> 2018-11-19 00:00:48
2 1 <NA> 2018-11-19 00:10:51
3 1 <NA> 2018-11-19 00:21:15
4 1 <NA> 2018-11-19 00:31:02
5 1 x 2018-11-19 00:40:59
6 1 x 2018-11-19 00:50:49
7 1 x 2018-11-19 01:01:15
8 1 <NA> 2018-11-19 01:11:07
9 1 <NA> 2018-11-19 01:20:49
10 2 <NA> 2018-11-19 01:30:50
11 2 <NA> 2018-11-19 01:40:43
12 2 x 2018-11-19 01:50:46
13 2 x 2018-11-19 02:01:02
14 2 x 2018-11-19 02:10:44
15 2 <NA> 2018-11-19 02:20:51
16 2 <NA> 2018-11-19 02:31:06
17 2 <NA> 2018-11-19 02:40:42
18 2 <NA> 2018-11-19 02:50:45
19 3 <NA> 2018-11-19 03:01:00
20 3 <NA> 2018-11-19 03:10:42
21 3 <NA> 2018-11-19 03:21:10
22 3 <NA> 2018-11-19 03:31:10
23 3 x 2018-11-19 03:40:44
24 3 <NA> 2018-11-19 03:50:46
25 3 <NA> 2018-11-19 04:00:46
我的目標是例如通過id
和time
標記每個序列的位置-上面的數據集將有一個名為index
的額外列,用於標記這些NA值的開始和結束位置。 但是,應忽略id
系列中的最后一個NA,並且將單個NA值標記為“兩個”。 例如:
> test
id foo time index
1 1 <NA> 2018-11-19 00:00:48 na_starts
2 1 <NA> 2018-11-19 00:10:51
3 1 <NA> 2018-11-19 00:21:15
4 1 <NA> 2018-11-19 00:31:02 na_ends
5 1 x 2018-11-19 00:40:59
6 1 x 2018-11-19 00:50:49
7 1 x 2018-11-19 01:01:15
8 1 <NA> 2018-11-19 01:11:07 na_starts
9 1 <NA> 2018-11-19 01:20:49
10 2 <NA> 2018-11-19 01:30:50 na_starts
11 2 <NA> 2018-11-19 01:40:43 na_ends
12 2 x 2018-11-19 01:50:46
13 2 x 2018-11-19 02:01:02
14 2 x 2018-11-19 02:10:44
15 2 <NA> 2018-11-19 02:20:51 na_starts
16 2 <NA> 2018-11-19 02:31:06
17 2 <NA> 2018-11-19 02:40:42
18 2 <NA> 2018-11-19 02:50:45
19 3 <NA> 2018-11-19 03:01:00
20 3 <NA> 2018-11-19 03:10:42 na_starts
21 3 <NA> 2018-11-19 03:21:10
22 3 <NA> 2018-11-19 03:31:10 na_ends
23 3 x 2018-11-19 03:40:44
24 3 <NA> 2018-11-19 03:50:46 both
25 3 x 2018-11-19 04:00:46
如何用rle
或R中的類似功能實現這一目標?
dput(test)
structure(list(id = c(1, 1, 1, 1, 1, 1, 1, 1, 1, 2, 2, 2, 2,
2, 2, 2, 2, 2, 3, 3, 3, 3, 3, 3, 3), foo = c(NA, NA, NA, NA,
"x", "x", "x", NA, NA, NA, NA, "x", "x", "x", NA, NA, NA, NA,
NA, NA, NA, NA, "x", NA, "x"), time = structure(c(1542585648,
1542586251, 1542586875, 1542587462, 1542588059, 1542588649, 1542589275,
1542589867, 1542590449, 1542591050, 1542591643, 1542592246, 1542592862,
1542593444, 1542594051, 1542594666, 1542595242, 1542595845, 1542596460,
1542597042, 1542597670, 1542598270, 1542598844, 1542599446, 1542600046
), class = c("POSIXct", "POSIXt"), tzone = "UTC")), row.names = c(NA,
-25L), class = "data.frame")
也許這行得通嗎? 除了我認為您希望按id
和time
進行排序外,我還不確定time
與問題之間的關系。
library("tidyverse") -25L), class = "data.frame")
test = test %>%
arrange(id, time) %>%
mutate(miss = is.na(foo))
# This will make the index column for a single run
mark_ends = function(n, miss){
if(!miss){
rep("", times = n)
}
else{
if(n == 1){"both"}
else(c("na_starts", rep("", times = (n-2)), "na_ends"))}
}
# This will use mark_ends across a single ID
mark_index = function(id){
runs = test$miss[test$id == id] %>%
rle
result = Map(f = mark_ends, n = runs$lengths, miss = runs$values) %>%
reduce(.f = c)
result[length(result)] = ""
result
}
# use the function on each id, combine, and put it in test
test$index = unique(test$id) %>%
map(mark_index) %>%
reduce(.f = c)
使用tidyverse
和data.table
您可以執行以下操作:
df %>%
rowid_to_column() %>%
group_by(id, temp = rleid(foo)) %>%
mutate(temp2 = seq_along(temp),
index = ifelse(is.na(foo) & temp2 == min(temp2) & temp2 == max(temp2), paste0("both"),
ifelse(is.na(foo) & temp2 == min(temp2), paste0("na_starts"),
ifelse(is.na(foo) & temp2 == max(temp2), paste0("na_ends"), NA)))) %>%
group_by(id) %>%
mutate(index = ifelse(rowid == max(rowid[is.na(foo) & max(temp) & max(temp2)]) &
is.na(lag(foo)), NA, index)) %>%
select(-temp, -temp2, -rowid)
id foo time index
<dbl> <chr> <dttm> <chr>
1 1. <NA> 2018-11-19 00:00:48 na_starts
2 1. <NA> 2018-11-19 00:10:51 <NA>
3 1. <NA> 2018-11-19 00:21:15 <NA>
4 1. <NA> 2018-11-19 00:31:02 na_ends
5 1. x 2018-11-19 00:40:59 <NA>
6 1. x 2018-11-19 00:50:49 <NA>
7 1. x 2018-11-19 01:01:15 <NA>
8 1. <NA> 2018-11-19 01:11:07 na_starts
9 1. <NA> 2018-11-19 01:20:49 <NA>
10 2. <NA> 2018-11-19 01:30:50 na_starts
11 2. <NA> 2018-11-19 01:40:43 na_ends
12 2. x 2018-11-19 01:50:46 <NA>
13 2. x 2018-11-19 02:01:02 <NA>
14 2. x 2018-11-19 02:10:44 <NA>
15 2. <NA> 2018-11-19 02:20:51 na_starts
16 2. <NA> 2018-11-19 02:31:06 <NA>
17 2. <NA> 2018-11-19 02:40:42 <NA>
18 2. <NA> 2018-11-19 02:50:45 <NA>
19 3. <NA> 2018-11-19 03:01:00 na_starts
20 3. <NA> 2018-11-19 03:10:42 <NA>
21 3. <NA> 2018-11-19 03:21:10 <NA>
22 3. <NA> 2018-11-19 03:31:10 na_ends
23 3. x 2018-11-19 03:40:44 <NA>
24 3. <NA> 2018-11-19 03:50:46 both
25 3. x 2018-11-19 04:00:46 <NA>
首先,它正在創建唯一的行ID。 其次,它按“ id”和運行長度“ foo”分組。 第三,它圍繞“ foo”的運行長度排序。 第四,它使用給定條件創建“ index”變量。 然后,它按“ id”分組,並為每個id將NA分配給丟失的“ foo”序列的最后一行。 最后,它刪除了冗余變量。
使用data.table的可能解決方案:
library(data.table)
setDT(test)
ind <- test[, .(ri = unique(.I[c(1,.N)][all(is.na(foo))]))
, by = .(id, rl = rleid(is.na(foo)))
][, index := list("both",c("na_starts","na_ends"))[[1 + (.N > 1)]]
, by = .(id, rl)][]
test[ind$ri, index := ind$index
][test[, .I[.N], by = id]$V1, index := NA][]
這使:
> test id foo time index 1: 1 <NA> 2018-11-19 00:00:48 na_starts 2: 1 <NA> 2018-11-19 00:10:51 <NA> 3: 1 <NA> 2018-11-19 00:21:15 <NA> 4: 1 <NA> 2018-11-19 00:31:02 na_ends 5: 1 x 2018-11-19 00:40:59 <NA> 6: 1 x 2018-11-19 00:50:49 <NA> 7: 1 x 2018-11-19 01:01:15 <NA> 8: 1 <NA> 2018-11-19 01:11:07 na_starts 9: 1 <NA> 2018-11-19 01:20:49 <NA> 10: 2 <NA> 2018-11-19 01:30:50 na_starts 11: 2 <NA> 2018-11-19 01:40:43 na_ends 12: 2 x 2018-11-19 01:50:46 <NA> 13: 2 x 2018-11-19 02:01:02 <NA> 14: 2 x 2018-11-19 02:10:44 <NA> 15: 2 <NA> 2018-11-19 02:20:51 na_starts 16: 2 <NA> 2018-11-19 02:31:06 <NA> 17: 2 <NA> 2018-11-19 02:40:42 <NA> 18: 2 <NA> 2018-11-19 02:50:45 <NA> 19: 3 <NA> 2018-11-19 03:01:00 na_starts 20: 3 <NA> 2018-11-19 03:10:42 <NA> 21: 3 <NA> 2018-11-19 03:21:10 <NA> 22: 3 <NA> 2018-11-19 03:31:10 na_ends 23: 3 x 2018-11-19 03:40:44 <NA> 24: 3 <NA> 2018-11-19 03:50:46 both 25: 3 x 2018-11-19 04:00:46 <NA>
聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.