Foundations of Tokenization
arxiv.org ↗(ICLR 2025) - first formal unified framework for tokenizer models using stochastic-map category theory; establishes conditions for statistical consistency.
AboutVisit arxiv.org ↗
(ICLR 2025) - first formal unified framework for tokenizer models using stochastic-map category theory; establishes conditions for statistical consistency.
This entry links to an external website rather than a GitHub repository, so there's no README to display here.