summaryrefslogtreecommitdiff
path: root/tokenizer/bpe/validate.go
Commit message (Collapse)AuthorAgeFilesLines
* Fix reachable merges validatorJonas Knobloch2026-04-141-4/+29
| | | | * Previous implementation ignored byte replacements
* Add lesci moduleJonas Knobloch2026-04-141-0/+14
|
* Handle unknown runesJonas Knobloch2026-03-311-0/+108