SSentencePiece
github.com ↗A C++ library for unsupervised text tokenization and detokenization, widely used in modern NLP models.
READMEView on GitHub ↗
SSA C++ library for unsupervised text tokenization and detokenization, widely used in modern NLP models.