Last updated on 2025-12-25 01:51:53 CET.
| Flavor | Version | Tinstall | Tcheck | Ttotal | Status | Flags |
|---|---|---|---|---|---|---|
| r-devel-linux-x86_64-debian-clang | 0.4.0 | 16.19 | 308.03 | 324.22 | ERROR | |
| r-devel-linux-x86_64-debian-gcc | 0.4.0 | 9.61 | 211.21 | 220.82 | ERROR | |
| r-devel-linux-x86_64-fedora-clang | 0.4.0 | 24.00 | 535.60 | 559.60 | OK | |
| r-devel-linux-x86_64-fedora-gcc | 0.4.0 | 24.00 | 544.37 | 568.37 | OK | |
| r-devel-windows-x86_64 | 0.4.0 | 18.00 | 293.00 | 311.00 | OK | |
| r-patched-linux-x86_64 | 0.4.0 | 14.61 | 313.80 | 328.41 | OK | |
| r-release-linux-x86_64 | 0.4.0 | 13.22 | 320.29 | 333.51 | OK | |
| r-release-macos-arm64 | 0.4.0 | OK | ||||
| r-release-macos-x86_64 | 0.4.0 | 9.00 | 267.00 | 276.00 | OK | |
| r-release-windows-x86_64 | 0.4.0 | 17.00 | 291.00 | 308.00 | OK | |
| r-oldrel-macos-arm64 | 0.4.0 | OK | ||||
| r-oldrel-macos-x86_64 | 0.4.0 | 9.00 | 252.00 | 261.00 | OK | |
| r-oldrel-windows-x86_64 | 0.4.0 | 21.00 | 422.00 | 443.00 | OK |
Version: 0.4.0
Check: examples
Result: ERROR
Running examples in ‘mlr3fairness-Ex.R’ failed
The error most likely occurred in:
> base::assign(".ptime", proc.time(), pos = "CheckExEnv")
> ### Name: fairness_accuracy_tradeoff
> ### Title: Plot Fairness Accuracy Trade-offs
> ### Aliases: fairness_accuracy_tradeoff
>
> ### ** Examples
>
> ## Don't show:
> if (rlang::is_installed("rpart") && rlang::is_installed("ranger")) (if (getRversion() >= "3.4") withAutoprint else force)({ # examplesIf
+ ## End(Don't show)
+ library("mlr3")
+ library("mlr3learners")
+ library("ggplot2")
+
+ # Setup the Fairness measure and tasks
+ task = tsk("adult_train")$filter(1:500)
+ learner = lrn("classif.ranger", predict_type = "prob")
+ fairness_measure = msr("fairness.tpr")
+
+ # Example 1 - A single prediction
+ learner$train(task)
+ predictions = learner$predict(task)
+ fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
+
+ # Example2 - A benchmark
+ design = benchmark_grid(
+ tasks = task,
+ learners = lrns(c("classif.featureless", "classif.rpart"),
+ predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2)
+ )
+ bmr = benchmark(design)
+ fairness_accuracy_tradeoff(bmr, fairness_measure)
+ ## Don't show:
+ }) # examplesIf
> library("mlr3")
> library("mlr3learners")
> library("ggplot2")
> task = tsk("adult_train")$filter(1:500)
> learner = lrn("classif.ranger", predict_type = "prob")
> fairness_measure = msr("fairness.tpr")
> learner$train(task)
> predictions = learner$predict(task)
> fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
> design = benchmark_grid(tasks = task, learners = lrns(c("classif.featureless",
+ "classif.rpart"), predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2))
> bmr = benchmark(design)
INFO [04:34:46.064] [mlr3] Running benchmark with 4 resampling iterations
INFO [04:34:46.317] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/2)
INFO [04:34:46.386] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/2)
INFO [04:34:46.433] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/2)
INFO [04:34:46.490] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/2)
INFO [04:34:46.587] [mlr3] Finished benchmark
Error in `[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash") :
attempt access index 9/9 in VECTOR_ELT
Calls: <Anonymous> ... initialize -> .__ResultData__initialize -> [ -> [.data.table
Execution halted
Flavor: r-devel-linux-x86_64-debian-clang
Version: 0.4.0
Check: tests
Result: ERROR
Running ‘testthat.R’ [31s/25s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
Saving _problems/test_visualizations-6.R
Saving _problems/test_visualizations-30.R
Saving _problems/test_visualizations-52.R
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:10:5', 'test_learners_fairml.R:21:5',
'test_learners_fairml.R:33:5', 'test_learners_fairml.R:43:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:18:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_visualizations.R:6:3'): fairness_accuracy_tradeoff ─────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:6:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:30:3'): compare_metrics ───────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:30:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:52:3'): prediction_density ────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:52:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
Error:
! Test failures.
Execution halted
Flavor: r-devel-linux-x86_64-debian-clang
Version: 0.4.0
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
...
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
INFO [04:35:24.643] [mlr3] Running benchmark with 6 resampling iterations
INFO [04:35:24.948] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [04:35:25.246] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [04:35:25.447] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [04:35:25.660] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 1/3)
INFO [04:35:26.278] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 2/3)
INFO [04:35:27.113] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 3/3)
INFO [04:35:27.479] [mlr3] Finished benchmark
Quitting from debiasing-vignette.Rmd:61-67 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(grd)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'debiasing-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
INFO [04:35:38.207] [mlr3] Running benchmark with 6 resampling iterations
INFO [04:35:38.426] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [04:36:07.322] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [04:36:47.201] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [04:37:24.222] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [04:37:24.676] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [04:37:24.992] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [04:37:25.490] [mlr3] Finished benchmark
Quitting from measures-vignette.Rmd:174-189 [unnamed-chunk-13]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'measures-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
[WARNING] Deprecated: --highlight-style. Use --syntax-highlighting instead.
[WARNING] Deprecated: --highlight-style. Use --syntax-highlighting instead.
INFO [04:37:32.502] [mlr3] Resampling 'cv' is being instantiated on task 'adult_train'
INFO [04:37:32.730] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/5)
INFO [04:37:32.834] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/5)
INFO [04:37:32.918] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/5)
INFO [04:37:32.965] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 4/5)
INFO [04:37:33.009] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 5/5)
Quitting from reports-vignette.Rmd:69-75 [build_fairness_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::resample(task, learner, rsmp("cv", folds = 5))
2. └─ResultData$new(data, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
INFO [04:37:42.694] [mlr3] Running benchmark with 6 resampling iterations
INFO [04:37:43.197] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [04:37:45.019] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [04:37:47.160] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [04:37:49.117] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [04:37:49.223] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [04:37:49.298] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [04:37:49.435] [mlr3] Finished benchmark
Quitting from visualization-vignette.Rmd:56-65 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'visualization-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following files failed:
‘debiasing-vignette.Rmd’ ‘measures-vignette.Rmd’
‘reports-vignette.Rmd’ ‘visualization-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavor: r-devel-linux-x86_64-debian-clang
Version: 0.4.0
Check: examples
Result: ERROR
Running examples in ‘mlr3fairness-Ex.R’ failed
The error most likely occurred in:
> base::assign(".ptime", proc.time(), pos = "CheckExEnv")
> ### Name: fairness_accuracy_tradeoff
> ### Title: Plot Fairness Accuracy Trade-offs
> ### Aliases: fairness_accuracy_tradeoff
>
> ### ** Examples
>
> ## Don't show:
> if (rlang::is_installed("rpart") && rlang::is_installed("ranger")) (if (getRversion() >= "3.4") withAutoprint else force)({ # examplesIf
+ ## End(Don't show)
+ library("mlr3")
+ library("mlr3learners")
+ library("ggplot2")
+
+ # Setup the Fairness measure and tasks
+ task = tsk("adult_train")$filter(1:500)
+ learner = lrn("classif.ranger", predict_type = "prob")
+ fairness_measure = msr("fairness.tpr")
+
+ # Example 1 - A single prediction
+ learner$train(task)
+ predictions = learner$predict(task)
+ fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
+
+ # Example2 - A benchmark
+ design = benchmark_grid(
+ tasks = task,
+ learners = lrns(c("classif.featureless", "classif.rpart"),
+ predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2)
+ )
+ bmr = benchmark(design)
+ fairness_accuracy_tradeoff(bmr, fairness_measure)
+ ## Don't show:
+ }) # examplesIf
> library("mlr3")
> library("mlr3learners")
> library("ggplot2")
> task = tsk("adult_train")$filter(1:500)
> learner = lrn("classif.ranger", predict_type = "prob")
> fairness_measure = msr("fairness.tpr")
> learner$train(task)
> predictions = learner$predict(task)
> fairness_accuracy_tradeoff(predictions, fairness_measure, task = task)
> design = benchmark_grid(tasks = task, learners = lrns(c("classif.featureless",
+ "classif.rpart"), predict_type = "prob", predict_sets = c("train", "test")),
+ resamplings = rsmps("cv", folds = 2))
> bmr = benchmark(design)
INFO [17:16:28.315] [mlr3] Running benchmark with 4 resampling iterations
INFO [17:16:28.637] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 1/2)
INFO [17:16:28.699] [mlr3] Applying learner 'classif.featureless' on task 'adult_train' (iter 2/2)
INFO [17:16:28.797] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/2)
INFO [17:16:28.891] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/2)
INFO [17:16:28.989] [mlr3] Finished benchmark
Error in `[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash") :
attempt access index 9/9 in VECTOR_ELT
Calls: <Anonymous> ... initialize -> .__ResultData__initialize -> [ -> [.data.table
Execution halted
Flavor: r-devel-linux-x86_64-debian-gcc
Version: 0.4.0
Check: tests
Result: ERROR
Running ‘testthat.R’ [22s/26s]
Running the tests in ‘tests/testthat.R’ failed.
Complete output:
> if (requireNamespace("testthat", quietly = TRUE)) {
+ library("testthat")
+ library("checkmate")
+ library("mlr3")
+ library("mlr3pipelines")
+ library("mlr3fairness")
+ test_check("mlr3fairness")
+ }
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
[1] "fairness.acc"
[1] "fairness.mse"
[1] "fairness.fnr"
[1] "fairness.fpr"
[1] "fairness.tnr"
[1] "fairness.tpr"
[1] "fairness.npv"
[1] "fairness.ppv"
[1] "fairness.fomr"
[1] "fairness.fp"
[1] "fairness.tp"
[1] "fairness.tn"
[1] "fairness.fn"
[1] "fairness.pp"
[1] "fairness.equalized_odds"
[1] "fairness.predictive_parity"
[1] "fairness.acc_eod=.05"
[1] "fairness.acc_ppv=.05"
Saving _problems/test_visualizations-6.R
Saving _problems/test_visualizations-30.R
Saving _problems/test_visualizations-52.R
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
══ Skipped tests (30) ══════════════════════════════════════════════════════════
• On CRAN (30): 'test_datasets.R:16:3', 'test_datasets.R:32:3',
'test_datasets.R:47:3', 'test_learners_fairml.R:2:5',
'test_learners_fairml.R:10:5', 'test_learners_fairml.R:21:5',
'test_learners_fairml.R:33:5', 'test_learners_fairml.R:43:5',
'test_learners_fairml_ptas.R:2:5', 'test_learners_fairml_ptas.R:18:5',
'test_measure_subgroup.R:47:3', 'test_measure_subgroup.R:66:3',
'test_pipeop_eod.R:2:3', 'test_pipeop_eod.R:17:3', 'test_pipeop_eod.R:57:3',
'test_pipeop_explicit_pta.R:3:5', 'test_pipeop_explicit_pta.R:17:5',
'test_pipeop_reweighing.R:2:3', 'test_pipeop_reweighing.R:15:3',
'test_pipeop_reweighing.R:25:3', 'test_pipeop_reweighing.R:34:3',
'test_pipeop_reweighing.R:51:3', 'test_pipeop_reweighing.R:61:3',
'test_report_modelcard_datasheet.R:2:3',
'test_report_modelcard_datasheet.R:18:3',
'test_report_modelcard_datasheet.R:34:3',
'test_use_modelcard_datasheet.R:2:3', 'test_use_modelcard_datasheet.R:17:3',
'test_use_modelcard_datasheet.R:31:3', 'test_write_files.R:2:3'
══ Failed tests ════════════════════════════════════════════════════════════════
── Error ('test_visualizations.R:6:3'): fairness_accuracy_tradeoff ─────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:6:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:30:3'): compare_metrics ───────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:30:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
── Error ('test_visualizations.R:52:3'): prediction_density ────────────────────
Error in ``[.data.table`(data, , `:=`("task_hash", task[[1L]]$hash), by = "uhash")`: attempt access index 9/9 in VECTOR_ELT
Backtrace:
▆
1. └─mlr3fairness:::test_bmr() at test_visualizations.R:52:3
2. └─mlr3::benchmark(...) at ./helper_data.R:34:3
3. └─ResultData$new(grid, data_extra, store_backends = store_backends)
4. └─mlr3 (local) initialize(...)
5. └─mlr3:::.__ResultData__initialize(...)
6. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
7. └─data.table:::`[.data.table`(...)
[ FAIL 3 | WARN 0 | SKIP 30 | PASS 286 ]
Error:
! Test failures.
Execution halted
Flavor: r-devel-linux-x86_64-debian-gcc
Version: 0.4.0
Check: re-building of vignette outputs
Result: ERROR
Error(s) in re-building vignettes:
...
--- re-building ‘debiasing-vignette.Rmd’ using rmarkdown
INFO [17:17:04.416] [mlr3] Running benchmark with 6 resampling iterations
INFO [17:17:04.574] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:17:05.050] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:17:05.345] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:17:05.658] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:17:07.231] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:17:08.623] [mlr3] Applying learner 'reweighing_wts.classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:17:09.821] [mlr3] Finished benchmark
Quitting from debiasing-vignette.Rmd:61-67 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(grd)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'debiasing-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘debiasing-vignette.Rmd’
--- re-building ‘measures-vignette.Rmd’ using rmarkdown
INFO [17:17:17.496] [mlr3] Running benchmark with 6 resampling iterations
INFO [17:17:17.613] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [17:17:43.752] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [17:18:02.360] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [17:18:26.389] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:18:26.846] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:18:27.173] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:18:27.436] [mlr3] Finished benchmark
Quitting from measures-vignette.Rmd:174-189 [unnamed-chunk-13]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'measures-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘measures-vignette.Rmd’
--- re-building ‘reports-vignette.Rmd’ using rmarkdown
[WARNING] Deprecated: --highlight-style. Use --syntax-highlighting instead.
[WARNING] Deprecated: --highlight-style. Use --syntax-highlighting instead.
INFO [17:18:31.172] [mlr3] Resampling 'cv' is being instantiated on task 'adult_train'
INFO [17:18:31.305] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/5)
INFO [17:18:31.369] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/5)
INFO [17:18:31.396] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/5)
INFO [17:18:31.421] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 4/5)
INFO [17:18:31.446] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 5/5)
Quitting from reports-vignette.Rmd:69-75 [build_fairness_example_for_vignette]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::resample(task, learner, rsmp("cv", folds = 5))
2. └─ResultData$new(data, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'reports-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘reports-vignette.Rmd’
--- re-building ‘visualization-vignette.Rmd’ using rmarkdown
INFO [17:18:40.715] [mlr3] Running benchmark with 6 resampling iterations
INFO [17:18:41.200] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 1/3)
INFO [17:18:43.271] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 2/3)
INFO [17:18:44.654] [mlr3] Applying learner 'classif.ranger' on task 'adult_train' (iter 3/3)
INFO [17:18:46.260] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 1/3)
INFO [17:18:46.338] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 2/3)
INFO [17:18:46.401] [mlr3] Applying learner 'classif.rpart' on task 'adult_train' (iter 3/3)
INFO [17:18:46.529] [mlr3] Finished benchmark
Quitting from visualization-vignette.Rmd:56-65 [unnamed-chunk-5]
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
<error/rlang_error>
Error in `[.data.table`:
! attempt access index 9/9 in VECTOR_ELT
---
Backtrace:
▆
1. └─mlr3::benchmark(design)
2. └─ResultData$new(grid, data_extra, store_backends = store_backends)
3. └─mlr3 (local) initialize(...)
4. └─mlr3:::.__ResultData__initialize(...)
5. ├─data[, `:=`("task_hash", task[[1L]]$hash), by = "uhash"]
6. └─data.table:::`[.data.table`(...)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Error: processing vignette 'visualization-vignette.Rmd' failed with diagnostics:
attempt access index 9/9 in VECTOR_ELT
--- failed re-building ‘visualization-vignette.Rmd’
SUMMARY: processing the following files failed:
‘debiasing-vignette.Rmd’ ‘measures-vignette.Rmd’
‘reports-vignette.Rmd’ ‘visualization-vignette.Rmd’
Error: Vignette re-building failed.
Execution halted
Flavor: r-devel-linux-x86_64-debian-gcc
These binaries (installable software) and packages are in development.
They may not be fully stable and should be used with caution. We make no claims about them.