summaryrefslogtreecommitdiff
path: root/tokenizer/bpe/split/fsa.go
Commit message (Expand)AuthorAgeFilesLines
* Preserve per-byte error replacementsJonas Knobloch2026-03-241-0/+7
* Remove input bufferJonas Knobloch2026-03-241-36/+26
* Expose finite state automatonJonas Knobloch2026-03-241-0/+230