The hardware and bandwidth for this mirror is donated by METANET, the Webhosting and Full Service-Cloud Provider.
If you wish to report a bug, or if you are interested in having us mirror your free-software or open-source project, please feel free to contact us at mirror[@]metanet.ch.

Open Scoring API Client for R

R-CMD-check CRAN/METACRAN Version codecov

Creativity research involves the need to score open-ended problems. Usually done by humans, automatic scoring using AI becomes more and more accurate. This package provides a simple interface to the ‘Open Scoring’ API, leading creativity scoring technology by Organiscak et al. (2023). With it, you can score your own data directly from an R script.

Installation

Install the released version of openscoring from CRAN with:

install.packages("openscoring")

You can install the development version of openscoring from GitHub with:

# install.packages("devtools")
devtools::install_github("jakub-jedrusiak/openscoring")

Example

library(openscoring)

df <- tibble::tibble(
  stimulus = c("brick", "hammer", "sponge"),
  response = c("butter for trolls", "make Thor jealous", "make it play in a kids show")
)

df
#> # A tibble: 3 × 2
#>   stimulus response                   
#>   <chr>    <chr>                      
#> 1 brick    butter for trolls          
#> 2 hammer   make Thor jealous          
#> 3 sponge   make it play in a kids show

scored_df <- oscai(df, stimulus, response, model = "chatgpt2")

scored_df
#> # A tibble: 3 × 3
#>   stimulus response                    .originality
#>   <chr>    <chr>                              <dbl>
#> 1 brick    butter for trolls                    3  
#> 2 hammer   make Thor jealous                    3.5
#> 3 sponge   make it play in a kids show          3.6

The "1.5" model works for multiple languages:

df_polish <- tibble::tibble(
 stimulus = c("cegła", "młotek", "gąbka"),
  response = c("masło dla trolli", "wywoływanie zazdrości u Thora", "postać w programie dla dzieci")
)

oscai(df_polish, stimulus, response, model = "1.5", language = "Polish")
#> # A tibble: 3 × 3
#>   stimulus response                      .originality
#>   <chr>    <chr>                                <dbl>
#> 1 cegła    masło dla trolli                       2.3
#> 2 młotek   wywoływanie zazdrości u Thora          3.7
#> 3 gąbka    postać w programie dla dzieci          2.3

These binaries (installable software) and packages are in development.
They may not be fully stable and should be used with caution. We make no claims about them.