summaryrefslogtreecommitdiff
path: root/tokenizer/bpe/split/fsa.go
Commit message (Collapse)AuthorAgeFilesLines
* Remove input bufferJonas Knobloch2026-03-241-36/+26
|
* Expose finite state automatonJonas Knobloch2026-03-241-0/+230
generated by cgit v1.3.1 (git 2.54.0) at 2026-10-07 04:47:40 +0000