The hardware and bandwidth for this mirror is donated by METANET, the Webhosting and Full Service-Cloud Provider.
If you wish to report a bug, or if you are interested in having us mirror your free-software or open-source project, please feel free to contact us at mirror[@]metanet.ch.

Coqui TTS

Introduction

Coqui TTS is a text-to-speech (TTS) library that enables the conversion of regular text into speech and is completely free to use. This is not true of the other text to speech engines used by text2speech.

Coqui TTS provides pre-trained tts and vocoder models as part of its package. To get a sense of the best tts and vocoder models, take a look at this GitHub Discussion post. In the Coqui TTS Hugging Face Space, you have the opportunity to experiment with a few of these models by inputting text and receiving corresponding audio output.

The underlying technology of text-to-speech is highly intricate and will not be the focus of this vignette. However, if you’re interested in delving deeper into the subject, here are some recommended talks:

Coqui TTS includes pre-trained models like Spectogram models (such as Tacotron2 and FastSpeech2), End-to-End Models (including VITS and YourTTS), and Vocoder models (like MelGAN and WaveGRAD).

Installation

To install Coqui TTS, you will need to enter the following command in the terminal:

$ pip install TTS

Note: If you are using a Mac with an M1 chip, initial step is to execute the following command in terminal:

$ brew install mecab

Afterward, you can proceed to install TTS by executing the following command:

$ pip install TTS

Authentication

library(text2speech)

To use Coqui TTS, text2speech needs to know the correct path to the Coqui TTS executable. This path can be obtained through two methods: manual and automatic.

Manual

You have the option to manually specify the path to the Coqui TTS executable in R. This can be done by setting a global option using the set_coqui_path() function:

set_coqui_path("your/path/to/tts")

To determine the location of the Coqui TTS executable, you can enter the command which tts in the terminal.

Internally, the set_coqui_path() function runs options("path_to_coqui" = path) to set the provided path as the value for the path_to_coqui global option, as long as the Coqui TTS executable exists at that location.

Automatic

The functions tts_auth(service = "coqui"), tts_voices(service = "coqui"), and tts(service = "coqui") incorporate a way to search through a predetermined list of known locations for the Coqui TTS executable. If none of these paths yield a valid TTS executable, an error message will be generated, directing you to use set_coqui_path() to manually set the correct path.

List Voices

The function tts_voices(service = "coqui") is a wrapper for the system command tts --list_models, which lists the released Coqui TTS models.

tts_voices(service = "coqui")

The result is a tibble with the following columns: language, dataset, model_name, and service.

You can find a list of papers associated with some of the implemented models for Coqui TTS here.

By providing the values from this tibble (language, dataset, and model_name) in tts(), you can select the specific voice you want for text-to-speech synthesis.

Text-to-Speech

To convert text to speech, you can use the function tts(text = "Hello world!", service = "coqui").

tts(text = "Hello world!", service = "coqui")

The result is a tibble with the following columns: index, original_text, text, wav, file, audio_type, duration, and service. Some of the noteworthy ones are:

By default, the function tts(service = "coqui") uses the tacotron2-DDC_ph model and the ljspeech/univnet vocoder. You can specify a different model with the argument model_name, or a different vocoder with the argument vocoder_name.

tts(text = "Hello world, using a different voice!",
    service = "coqui",
    model_name = "fast_pitch",
    vocoder_name = "ljspeech/hifigan_v2")

Another default is that tts(service = "coqui") saves the audio output in a temporary folder and its path is shown in the file column of the resulting tibble. However, a temporary directory lasts only as long as the current R session, which means that when you restart your R session, that path will not exist!

A more sustainable workflow would be to save the audio output in a local folder. To save the audio output in a local folder, set the arguments save_local = TRUE and save_local_dest = /full/path/to/local/folder. Make sure to provide the full path to the local folder.

tts(text = "Hello world! I am saving the audio output in a local folder",
    service = "coqui",
    save_local = TRUE,
    save_local_dest = "/full/path/to/local/folder")


Session Info

#> R version 4.2.3 (2023-03-15)
#> Platform: aarch64-apple-darwin20 (64-bit)
#> Running under: macOS Ventura 13.4.1
#> 
#> Matrix products: default
#> BLAS:   /Library/Frameworks/R.framework/Versions/4.2-arm64/Resources/lib/libRblas.0.dylib
#> LAPACK: /Library/Frameworks/R.framework/Versions/4.2-arm64/Resources/lib/libRlapack.dylib
#> 
#> locale:
#> [1] C/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8
#> 
#> attached base packages:
#> [1] stats     graphics  grDevices utils     datasets  methods   base     
#> 
#> other attached packages:
#> [1] text2speech_1.0.0
#> 
#> loaded via a namespace (and not attached):
#>  [1] rstudioapi_0.14  knitr_1.43       magrittr_2.0.3   tidyselect_1.2.0
#>  [5] R6_2.5.1         rlang_1.1.1      fastmap_1.1.1    fansi_1.0.4     
#>  [9] dplyr_1.1.2      tools_4.2.3      xfun_0.39        utf8_1.2.3      
#> [13] cli_3.6.1        withr_2.5.0      jquerylib_0.1.4  htmltools_0.5.5 
#> [17] yaml_2.3.7       digest_0.6.33    tibble_3.2.1     lifecycle_1.0.3 
#> [21] purrr_1.0.1      tidyr_1.3.0      sass_0.4.6       vctrs_0.6.3     
#> [25] glue_1.6.2       cachem_1.0.8     evaluate_0.21    rmarkdown_2.22  
#> [29] compiler_4.2.3   bslib_0.4.2      pillar_1.9.0     generics_0.1.3  
#> [33] jsonlite_1.8.7   pkgconfig_2.0.3

These binaries (installable software) and packages are in development.
They may not be fully stable and should be used with caution. We make no claims about them.