summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Preserve per-byte error replacementsJonas Knobloch2026-03-244-0/+38
|
* Remove input bufferJonas Knobloch2026-03-242-36/+66
|
* Expose finite state automatonJonas Knobloch2026-03-244-1/+320
|
* Refactor tokenizer usageJonas Knobloch2026-03-241-12/+7
|
* Add tokenizer moduleJonas Knobloch2026-03-245-0/+117
| | | | * Wrap MBPE tokenizer
* Refactor progress bar life cycleJonas Knobloch2026-03-242-21/+36
|
* Sync dependenciesJonas Knobloch2026-03-236-67/+54
|
* Add mbpe submoduleJonas Knobloch2026-03-233-0/+4
|
* Tidy dependenciesJonas Knobloch2026-03-171-0/+5
|
* Remove bpc moduleJonas Knobloch2026-03-175-151/+0
|
* Remove llm importJonas Knobloch2026-03-171-2/+0
|
* Sync dependenciesJonas Knobloch2026-03-175-63/+44
|
* Add log probs extractorJonas Knobloch2026-03-174-35/+355
|
* Update perplexity evaluatorJonas Knobloch2026-03-179-208/+304
| | | | | | * Introduce results channel * Introduce jobs channel * Generalize evaluation via callback
* Add string readerJonas Knobloch2026-03-171-0/+25
|
* Update progress barJonas Knobloch2026-03-171-19/+84
| | | | | | * Rename steps to total * Support concurrent updates * Add method to watch progress
* Print on finishJonas Knobloch2026-03-171-1/+1
|
* Rename receiversJonas Knobloch2026-03-161-16/+16
|
* Add progress barJonas Knobloch2026-03-163-0/+68
|
* Add reader interfaceJonas Knobloch2026-03-161-0/+8
|
* Rename dataset readerJonas Knobloch2026-03-164-11/+11
|
* Add build manifestJonas Knobloch2026-03-161-0/+31
|
* Use vanity import pathJonas Knobloch2026-03-1612-17/+19
|
* Add ppl Python scriptJonas Knobloch2026-03-091-0/+112
|
* Fix perplexity calculationJonas Knobloch2026-03-094-12/+31
| | | | | * Track total evaluated tokens * Use first token as context
* Expose window and strideJonas Knobloch2026-03-092-7/+7
|
* Add ppl commandJonas Knobloch2026-03-091-0/+69
|
* Use dataset packageJonas Knobloch2026-03-091-16/+13
|
* Add dataset packageJonas Knobloch2026-03-027-2/+1388
|
* Update module pathsJonas Knobloch2026-02-288-9/+13
|
* Add tensor packageJonas Knobloch2026-02-254-0/+458
|
* Verify sequence lengthJonas Knobloch2026-02-161-4/+9
|
* Add top-K and logit RMSE inference testsJonas Knobloch2026-02-111-0/+138
|
* Allow controlling IntraOpNumThreadsJonas Knobloch2026-02-112-20/+40
|
* Bump Go to 1.25.0Jonas Knobloch2026-02-104-4/+4
|
* Bump github.com/yalue/onnxruntime_go to v1.25.0Jonas Knobloch2026-02-103-3/+5
|
* Bump github.com/jonasknobloch/mbpe to v0.1.1Jonas Knobloch2026-02-107-9/+94
|
* Bump Go to 1.24.7Jonas Knobloch2026-02-101-1/+1
|
* Wait for progress barJonas Knobloch2025-11-261-0/+2
|
* Use seen tokens to warm up cacheJonas Knobloch2025-11-262-49/+79
|
* Use dynamic sessionJonas Knobloch2025-11-241-62/+123
|
* Add perplexity evaluationJonas Knobloch2025-11-1810-29/+413
|
* Scaffold byte-pair correctionJonas Knobloch2025-11-1713-18/+280
|
* Refactor into workspaceJonas Knobloch2025-11-136-21/+33
|
* Add logit tracingJonas Knobloch2025-11-111-5/+9
|
* Combine priming and generation loopsJonas Knobloch2025-11-111-33/+18
|
* Return generated tokensJonas Knobloch2025-11-111-6/+12
|
* Support multi-token promptsJonas Knobloch2025-11-111-3/+32
|
* Introduce generative loopJonas Knobloch2025-11-111-17/+34
|
* Refactor forward passJonas Knobloch2025-11-101-21/+30
|
generated by cgit v1.3.1 (git 2.54.0) at 2026-10-07 08:10:40 +0000