The hardware and bandwidth for this mirror is donated by METANET, the Webhosting and Full Service-Cloud Provider.
If you wish to report a bug, or if you are interested in having us mirror your free-software or open-source project, please feel free to contact us at mirror[@]metanet.ch.
To cite the tokenizers package in publications, please cite the paper in the Journal of Open Source Software:
Mullen LA, Benoit K, Keyes O, Selivanov D, Arnold J (2018). “Fast, Consistent Tokenization of Natural Language Text.” Journal of Open Source Software, 3, 655. doi:10.21105/joss.00655, https://doi.org/10.21105/joss.00655.
Corresponding BibTeX entry:
@Article{,
title = {Fast, Consistent Tokenization of Natural Language Text},
author = {Lincoln A. Mullen and Kenneth Benoit and Os Keyes and
Dmitry Selivanov and Jeffrey Arnold},
journal = {Journal of Open Source Software},
year = {2018},
volume = {3},
issue = {23},
pages = {655},
url = {https://doi.org/10.21105/joss.00655},
doi = {10.21105/joss.00655},
}
These binaries (installable software) and packages are in development.
They may not be fully stable and should be used with caution. We make no claims about them.