[英]Optimizing/alternative ddply, transform, and na.omit
I have the following situation: 我有以下情况:
library(TTR)
library(scales)
library(dplyr)
library(tidyr)
#prepare data
df = data.frame(X=seq.int(100000), high = runif(100000, 1, 100), low = runif(100000, 1, 100), close = runif(100000, 1, 100))
#some calculation
df$cci14 = rescale(CCI(df[,c('high','low','close')], n=14, maType=SMA), to=c(0,100), from=c(-100,100))
#filtering
df$select = df$cci14 >=100 | lag(df$cci14)>=100 | lead(df$cci14)>=100 | df$cci14 <=0 | lag(df$cci14)<=0 | lead(df$cci14)<=0
ff = df %>% filter(select) %>% group_by(group1 = cumsum(c(1, diff(X) != 1))) %>% dplyr::mutate(len = NA) %>% dplyr::mutate(Y = seq(n())) %>% spread(Y, cci14) %>% ungroup()
#sync column values high,low,close
ff = (ff %>% group_by(group1) %>% mutate(X=first(X)) %>% mutate(high=max(high)) %>% mutate(low=min(low)) %>% mutate(close=last(close)) )
library(plyr) # have to detach afterward, without this, ddply runs with unexpected result
#this one very slow, any alternative?
ff %>% group_by(group1)
%>% ddply(.(group1), transform, `1`=na.omit(`1`)[1])
%>% ddply(.(group1), transform, X2=na.omit(X2)[1])
%>% ddply(.(group1), transform, X3=na.omit(X3)[1])
%>% ddply(.(group1), transform, X4=na.omit(X4)[1])
%>% ddply(.(group1), transform, X5=na.omit(X5)[1])
%>% ddply(.(group1), transform, X6=na.omit(X6)[1])
%>% ddply(.(group1), transform, X7=na.omit(X7)[1])
%>% ddply(.(group1), transform, X8=na.omit(X8)[1])
%>% ddply(.(group1), transform, X9=na.omit(X9)[1])
%>% ddply(.(group1), transform, X10=na.omit(X10)[1])
%>% ddply(.(group1), transform, X11=na.omit(X11)[1])
%>% ddply(.(group1), transform, X12=na.omit(X12)[1])
%>% ddply(.(group1), transform, X13=na.omit(X13)[1])
%>% ddply(.(group1), transform, X14=na.omit(X14)[1])
%>% ddply(.(group1), transform, X15=na.omit(X15)[1])
%>% ddply(.(group1), transform, X16=na.omit(X16)[1])
...
and more column depends on data frame.
The last part, ddply runs very slow especially with many columns generated. 最后一部分,ddply运行非常慢,尤其是生成许多列时。
Question, any other options/suggestion to optimize it? 问题,还有其他选择/建议来优化它吗? and how to apply across all tailing columns? 以及如何应用于所有尾矿塔?
刚刚找到,但是使用库(data.table)
setDT(ff)[, lapply(.SD, na.omit) , by = group1]
Another option is dplyr
另一个选择是dplyr
library(dplyr)
ff %>%
group_by(group1) %>%
mutate_each(funs(na.omit))
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.