The hardware and bandwidth for this mirror is donated by METANET, the Webhosting and Full Service-Cloud Provider.
If you wish to report a bug, or if you are interested in having us mirror your free-software or open-source project, please feel free to contact us at mirror[@]metanet.ch.

sacRebleu

The goal of sacRebleu is to provide a simple interface to the BLEU score, a metric for evaluating the quality of generated text. This package is inspired by the NLTK and sacrebleu implementations of the BLEU score, and is implemented in C++ for the R programming language.

Installation

You can install the development version of sacRebleu from GitHub with:

Linux and MacOS

# install.packages("devtools")
devtools::install_github("LazerLambda/sacRebleu")

Windows

This package builds upon the tok package, which requires the Rust toolchain to be installed. To install the rustup, follow the instructions at https://www.rust-lang.org/tools/install and at tok. After installing the Rust toolchain, you can install the development version of sacRebleu as described above.

Example

library(sacRebleu)
cand_corpus <- list("This is good", "This is not good")
ref_corpus <- list(list("Perfect outcome!", "Excellent!"), list("Not sufficient.", "Horrible."))
bleu_corpus <- bleu_corpus(ref_corpus, cand_corpus)

These binaries (installable software) and packages are in development.
They may not be fully stable and should be used with caution. We make no claims about them.