summaryrefslogtreecommitdiff
path: root/llm
Commit message (Expand)AuthorAgeFilesLines
* Update perplexity evaluatorJonas Knobloch2026-03-179-208/+304
* Rename dataset readerJonas Knobloch2026-03-162-4/+4
* Use vanity import pathJonas Knobloch2026-03-163-5/+7
* Add ppl Python scriptJonas Knobloch2026-03-091-0/+112
* Fix perplexity calculationJonas Knobloch2026-03-094-12/+31
* Expose window and strideJonas Knobloch2026-03-092-7/+7
* Add ppl commandJonas Knobloch2026-03-091-0/+69
* Use dataset packageJonas Knobloch2026-03-091-16/+13
* Update module pathsJonas Knobloch2026-02-281-1/+1
* Bump Go to 1.25.0Jonas Knobloch2026-02-101-1/+1
* Bump github.com/jonasknobloch/mbpe to v0.1.1Jonas Knobloch2026-02-103-1/+89
* Wait for progress barJonas Knobloch2025-11-261-0/+2
* Use seen tokens to warm up cacheJonas Knobloch2025-11-261-2/+2
* Add perplexity evaluationJonas Knobloch2025-11-185-0/+340
* Scaffold byte-pair correctionJonas Knobloch2025-11-173-0/+13