脫字號ref + gbm + ROC

Question

我正在嘗試使用插入符號包中的rfe函數，但無法使用ROC指標使其適用於gbm模型。

我在那里發現了一些見解：

插入符號rfe中的特征選擇+用ROC求和

http://www.cybaea.net/Blogs/Feature-selection-Using-the-caret-package.html

我結束了這段代碼：

gbmFuncs <- treebagFuncs
gbmFuncs$fit <- function (x, y, first, last, ...) {
  library("gbm")
  n.levels <- length(unique(y))
  if ( n.levels == 2 ) {
    distribution = "bernoulli"
  } else {
    distribution = "gaussian"
  }
  gbm.fit(x, y, distribution = distribution, ...)
}
gbmFuncs$pred <- function (object, x) {
  n.trees <- suppressWarnings(gbm.perf(object,
                                       plot.it = FALSE,
                                       method = "OOB"))
  if ( n.trees <= 0 ) n.trees <- object$n.trees
  predict(object, x, n.trees = n.trees, type = "link")
}

control <- rfeControl(functions = gbmFuncs, method = "cv", verbose = TRUE, returnResamp="final", 
                  number = 5)
trainctrl <- trainControl(classProbs= TRUE,
                          summaryFunction = twoClassSummary)

gbmFit_bernoulli_sel <- rfe(data_model[x, -as.numeric(y)+2,
                            sizes=c(10, 15, 20, 30, 40, 50), rfeControl = control, verbose = FALSE,
                        interaction.depth = 14, n.trees = 10000, shrinkage = .01, metric="ROC", 
                        trControl = trainctrl)

但是我得到這個錯誤：

Error in { : 
  task 1 failed - "argument inutilisé (trControl = list(method = "boot", number = 25, repeats = 25, p = 0.75, initialWindow = NULL, horizon = 1, fixedWindow = TRUE, verboseIter = FALSE, returnData = TRUE, returnResamp = "final", savePredictions = FALSE, classProbs = TRUE, summaryFunction = function (data, lev = NULL, model = NULL) 
{
    require(pROC)
    if (!all(levels(data[, "pred"]) == levels(data[, "obs"]))) stop("levels of observed and predicted data do not match")
rocObject <- try(pROC::roc(data$obs, data[, lev[1]]), silent = TRUE)
rocAUC <- if (class(rocObject)[1] == "try-error") NA else rocObject$auc
out <- c(rocAUC, sensitivity(data[, "pred"], data[, "obs"], lev[1]), specificity(data[, "pred"], data[, "obs"], lev[2]))
names(out) <- c("ROC", "Sens", "Spec")
out

編輯

使用此代碼：

caretFuncs$summary <- twoClassSummary
controlrfe <- rfeControl(functions = caretFuncs, method = "cv", number = 3, verbose = TRUE)
gbmGrid <- expand.grid(interaction.depth = 5, n.trees = 1000, shrinkage = .01)
confroltrain <- trainControl(method = "none", classProbs=T, summaryFunction =     twoClassSummary, verbose = TRUE)
gbmFit_bernoulli_sel <- rfe(data_model[,-ncol(data_model)], data_model[,ncol(data_model)],
                            sizes=c(10,15), rfeControl = controlrfe, metric="ROC",
                            trControl = confroltrain, tuneGrid=gbmGrid, method="gbm")

我必須使用訓練函數，因為當我使用gbmFuncs時，我顯然遇到了一些問題，因為gbm.fit需要一個數字目標變量，但是ROC度量評估需要一個因子。

感謝您的幫助。

Answer 1

您正在嘗試將trControl傳遞給gbm.fit 。 連接（三個）點=]

嘗試刪除trControl = trainctrl 。

馬克斯