CRAN Package Check Results for Package mlr3benchmark

Last updated on 2025-12-04 19:50:24 CET.

Flavor Version Tinstall Tcheck Ttotal Status Flags
r-devel-linux-x86_64-debian-clang 0.1.7 6.12 88.04 94.16 OK
r-devel-linux-x86_64-debian-gcc 0.1.7 4.44 61.44 65.88 OK
r-devel-linux-x86_64-fedora-clang 0.1.7 33.00 108.52 141.52 ERROR
r-devel-linux-x86_64-fedora-gcc 0.1.7 27.00 103.71 130.71 ERROR
r-devel-windows-x86_64 0.1.7 8.00 83.00 91.00 OK
r-patched-linux-x86_64 0.1.7 6.22 72.62 78.84 OK
r-release-linux-x86_64 0.1.7 6.11 76.04 82.15 OK
r-release-macos-arm64 0.1.7 OK
r-release-macos-x86_64 0.1.7 5.00 58.00 63.00 OK
r-release-windows-x86_64 0.1.7 8.00 83.00 91.00 OK
r-oldrel-macos-arm64 0.1.7 OK
r-oldrel-macos-x86_64 0.1.7 5.00 70.00 75.00 OK
r-oldrel-windows-x86_64 0.1.7 11.00 107.00 118.00 OK

Check Details

Version: 0.1.7
Check: examples
Result: ERROR Running examples in ‘mlr3benchmark-Ex.R’ failed The error most likely occurred in: > ### Name: autoplot.BenchmarkAggr > ### Title: Plots for BenchmarkAggr > ### Aliases: autoplot.BenchmarkAggr > > ### ** Examples > > if (requireNamespaces(c("mlr3learners", "mlr3", "rpart", "xgboost"))) { + library(mlr3) + library(mlr3learners) + library(ggplot2) + + set.seed(1) + task = tsks(c("iris", "sonar", "wine", "zoo")) + learns = lrns(c("classif.featureless", "classif.rpart", "classif.xgboost")) + learns$classif.xgboost$param_set$values$nrounds = 50 + bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 3))) + obj = as_benchmark_aggr(bm) + + # mean and error bars + autoplot(obj, type = "mean", level = 0.95) + + if (requireNamespace("PMCMRplus", quietly = TRUE)) { + # critical differences + autoplot(obj, type = "cd",style = 1) + autoplot(obj, type = "cd",style = 2) + + # post-hoc friedman-nemenyi + autoplot(obj, type = "fn") + } + + } INFO [20:00:50.334] [mlr3] Running benchmark with 36 resampling iterations INFO [20:00:50.462] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [20:00:50.645] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [20:00:50.748] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [20:00:50.937] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [20:00:51.139] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [20:00:51.310] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [20:00:51.372] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 1/3) INFO [20:00:51.837] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 2/3) INFO [20:00:51.978] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 3/3) INFO [20:00:52.385] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [20:00:52.587] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [20:00:52.814] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [20:00:52.944] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [20:00:53.374] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [20:00:53.554] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [20:00:53.827] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 1/3) INFO [20:00:54.289] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 2/3) INFO [20:00:54.759] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 3/3) INFO [20:00:55.176] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 1/3) INFO [20:00:55.321] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 2/3) INFO [20:00:55.545] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 3/3) INFO [20:00:55.590] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 1/3) INFO [20:00:55.913] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 2/3) INFO [20:00:55.973] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 3/3) INFO [20:00:56.034] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 1/3) INFO [20:00:56.298] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 2/3) INFO [20:00:56.474] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 3/3) INFO [20:00:56.754] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 1/3) INFO [20:00:56.981] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 2/3) INFO [20:00:57.136] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 3/3) INFO [20:00:57.180] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 1/3) INFO [20:00:57.309] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 2/3) INFO [20:00:57.368] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 3/3) INFO [20:00:57.429] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 1/3) INFO [20:00:57.761] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 2/3) INFO [20:00:58.251] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 3/3) Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. INFO [20:00:58.595] [mlr3] Finished benchmark Error: Global Friedman test non-significant (p > 0.05), try type = 'mean' instead. Execution halted Flavor: r-devel-linux-x86_64-fedora-clang

Version: 0.1.7
Check: examples
Result: ERROR Running examples in ‘mlr3benchmark-Ex.R’ failed The error most likely occurred in: > ### Name: autoplot.BenchmarkAggr > ### Title: Plots for BenchmarkAggr > ### Aliases: autoplot.BenchmarkAggr > > ### ** Examples > > if (requireNamespaces(c("mlr3learners", "mlr3", "rpart", "xgboost"))) { + library(mlr3) + library(mlr3learners) + library(ggplot2) + + set.seed(1) + task = tsks(c("iris", "sonar", "wine", "zoo")) + learns = lrns(c("classif.featureless", "classif.rpart", "classif.xgboost")) + learns$classif.xgboost$param_set$values$nrounds = 50 + bm = benchmark(benchmark_grid(task, learns, rsmp("cv", folds = 3))) + obj = as_benchmark_aggr(bm) + + # mean and error bars + autoplot(obj, type = "mean", level = 0.95) + + if (requireNamespace("PMCMRplus", quietly = TRUE)) { + # critical differences + autoplot(obj, type = "cd",style = 1) + autoplot(obj, type = "cd",style = 2) + + # post-hoc friedman-nemenyi + autoplot(obj, type = "fn") + } + + } INFO [18:45:18.269] [mlr3] Running benchmark with 36 resampling iterations INFO [18:45:18.355] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 1/3) INFO [18:45:18.499] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 2/3) INFO [18:45:18.690] [mlr3] Applying learner 'classif.featureless' on task 'iris' (iter 3/3) INFO [18:45:18.896] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 1/3) INFO [18:45:19.047] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 2/3) INFO [18:45:19.192] [mlr3] Applying learner 'classif.rpart' on task 'iris' (iter 3/3) INFO [18:45:19.254] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 1/3) INFO [18:45:19.560] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 2/3) INFO [18:45:19.811] [mlr3] Applying learner 'classif.xgboost' on task 'iris' (iter 3/3) INFO [18:45:20.063] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 1/3) INFO [18:45:20.226] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 2/3) INFO [18:45:20.401] [mlr3] Applying learner 'classif.featureless' on task 'sonar' (iter 3/3) INFO [18:45:20.602] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 1/3) INFO [18:45:21.000] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 2/3) INFO [18:45:21.279] [mlr3] Applying learner 'classif.rpart' on task 'sonar' (iter 3/3) INFO [18:45:21.486] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 1/3) INFO [18:45:21.961] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 2/3) INFO [18:45:22.363] [mlr3] Applying learner 'classif.xgboost' on task 'sonar' (iter 3/3) INFO [18:45:22.846] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 1/3) INFO [18:45:23.063] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 2/3) INFO [18:45:23.274] [mlr3] Applying learner 'classif.featureless' on task 'wine' (iter 3/3) INFO [18:45:23.462] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 1/3) INFO [18:45:23.654] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 2/3) INFO [18:45:23.857] [mlr3] Applying learner 'classif.rpart' on task 'wine' (iter 3/3) INFO [18:45:24.047] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 1/3) INFO [18:45:24.365] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 2/3) INFO [18:45:24.680] [mlr3] Applying learner 'classif.xgboost' on task 'wine' (iter 3/3) INFO [18:45:24.985] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 1/3) INFO [18:45:25.190] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 2/3) INFO [18:45:25.375] [mlr3] Applying learner 'classif.featureless' on task 'zoo' (iter 3/3) INFO [18:45:25.501] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 1/3) INFO [18:45:25.676] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 2/3) INFO [18:45:25.850] [mlr3] Applying learner 'classif.rpart' on task 'zoo' (iter 3/3) INFO [18:45:26.003] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 1/3) INFO [18:45:26.446] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 2/3) INFO [18:45:26.867] [mlr3] Applying learner 'classif.xgboost' on task 'zoo' (iter 3/3) Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. Warning in check.deprecation(deprecated_train_params, match.call(), ...) : Passed invalid function arguments: nthread, num_class, eval_metric. These should be passed as a list to argument 'params'. Conversion from argument to 'params' entry will be done automatically, but this behavior will become an error in a future version. Warning in check.custom.obj(params, objective) : Argument 'objective' is only for custom objectives. For built-in objectives, pass the objective under 'params'. This warning will become an error in a future version. INFO [18:45:27.373] [mlr3] Finished benchmark Error: Global Friedman test non-significant (p > 0.05), try type = 'mean' instead. Execution halted Flavor: r-devel-linux-x86_64-fedora-gcc

These binaries (installable software) and packages are in development.
They may not be fully stable and should be used with caution. We make no claims about them.