summaryrefslogtreecommitdiff
Commit message (Expand)AuthorAgeFilesLines
* Refactor tail cleanupJonas Knobloch2026-04-031-13/+13
* Track already seen tokensJonas Knobloch2026-04-022-9/+75
* Add token bufferJonas Knobloch2026-04-022-0/+250
* Count skipped textsJonas Knobloch2026-03-311-2/+14
* Handle unknown runesJonas Knobloch2026-03-314-1/+119
* Refactor llm moduleJonas Knobloch2026-03-252-0/+0
* Expose progress bar titleJonas Knobloch2026-03-254-6/+6
* Add helper to collect resultsJonas Knobloch2026-03-253-44/+39
* Refactor evaluator initializationJonas Knobloch2026-03-254-27/+9
* Sort importsJonas Knobloch2026-03-252-2/+2
* Tidy dependenciesJonas Knobloch2026-03-254-2/+215
* Preserve per-byte error replacementsJonas Knobloch2026-03-244-0/+38
* Remove input bufferJonas Knobloch2026-03-242-36/+66
* Expose finite state automatonJonas Knobloch2026-03-244-1/+320
* Refactor tokenizer usageJonas Knobloch2026-03-241-12/+7
* Add tokenizer moduleJonas Knobloch2026-03-245-0/+117
* Refactor progress bar life cycleJonas Knobloch2026-03-242-21/+36
* Sync dependenciesJonas Knobloch2026-03-236-67/+54
* Add mbpe submoduleJonas Knobloch2026-03-233-0/+4
* Tidy dependenciesJonas Knobloch2026-03-171-0/+5
* Remove bpc moduleJonas Knobloch2026-03-175-151/+0
* Remove llm importJonas Knobloch2026-03-171-2/+0
* Sync dependenciesJonas Knobloch2026-03-175-63/+44
* Add log probs extractorJonas Knobloch2026-03-174-35/+355
* Update perplexity evaluatorJonas Knobloch2026-03-179-208/+304
* Add string readerJonas Knobloch2026-03-171-0/+25
* Update progress barJonas Knobloch2026-03-171-19/+84
* Print on finishJonas Knobloch2026-03-171-1/+1
* Rename receiversJonas Knobloch2026-03-161-16/+16
* Add progress barJonas Knobloch2026-03-163-0/+68
* Add reader interfaceJonas Knobloch2026-03-161-0/+8
* Rename dataset readerJonas Knobloch2026-03-164-11/+11
* Add build manifestJonas Knobloch2026-03-161-0/+31
* Use vanity import pathJonas Knobloch2026-03-1612-17/+19
* Add ppl Python scriptJonas Knobloch2026-03-091-0/+112
* Fix perplexity calculationJonas Knobloch2026-03-094-12/+31
* Expose window and strideJonas Knobloch2026-03-092-7/+7
* Add ppl commandJonas Knobloch2026-03-091-0/+69
* Use dataset packageJonas Knobloch2026-03-091-16/+13
* Add dataset packageJonas Knobloch2026-03-027-2/+1388
* Update module pathsJonas Knobloch2026-02-288-9/+13
* Add tensor packageJonas Knobloch2026-02-254-0/+458
* Verify sequence lengthJonas Knobloch2026-02-161-4/+9
* Add top-K and logit RMSE inference testsJonas Knobloch2026-02-111-0/+138
* Allow controlling IntraOpNumThreadsJonas Knobloch2026-02-112-20/+40
* Bump Go to 1.25.0Jonas Knobloch2026-02-104-4/+4
* Bump github.com/yalue/onnxruntime_go to v1.25.0Jonas Knobloch2026-02-103-3/+5
* Bump github.com/jonasknobloch/mbpe to v0.1.1Jonas Knobloch2026-02-107-9/+94
* Bump Go to 1.24.7Jonas Knobloch2026-02-101-1/+1
* Wait for progress barJonas Knobloch2025-11-261-0/+2