summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* Require cache when generating new tokensJonas Knobloch2026-04-061-0/+4
|
* Add parameter to control logits output bindingJonas Knobloch2026-04-065-24/+50
|
* Access outputs by nameJonas Knobloch2026-04-062-9/+13
|
* Fix input and output names capacityJonas Knobloch2026-04-061-2/+12
|
* Bind either logits or log probsJonas Knobloch2026-04-042-22/+14
|
* Add score methodJonas Knobloch2026-04-046-26/+182
|
* Add config structJonas Knobloch2026-04-046-32/+53
|
* Add allocator abstractionJonas Knobloch2026-04-042-177/+432
|
* Add clamped readerJonas Knobloch2026-04-031-0/+39
|
* Add helper to count documentsJonas Knobloch2026-04-034-0/+39
|
* Add file readerJonas Knobloch2026-04-031-0/+110
|
* Return document index in text iteratorJonas Knobloch2026-04-037-82/+87
|
* Scope text column to parquet readerJonas Knobloch2026-04-037-13/+15
|
* Use token buffer to generate jobsJonas Knobloch2026-04-032-111/+36
|
* Return relative offset in push iteratorJonas Knobloch2026-04-032-28/+32
|
* Refactor tail cleanupJonas Knobloch2026-04-031-13/+13
|
* Track already seen tokensJonas Knobloch2026-04-022-9/+75
|
* Add token bufferJonas Knobloch2026-04-022-0/+250
|
* Count skipped textsJonas Knobloch2026-03-311-2/+14
|
* Handle unknown runesJonas Knobloch2026-03-314-1/+119
|
* Refactor llm moduleJonas Knobloch2026-03-252-0/+0
|
* Expose progress bar titleJonas Knobloch2026-03-254-6/+6
|
* Add helper to collect resultsJonas Knobloch2026-03-253-44/+39
|
* Refactor evaluator initializationJonas Knobloch2026-03-254-27/+9
|
* Sort importsJonas Knobloch2026-03-252-2/+2
|
* Tidy dependenciesJonas Knobloch2026-03-254-2/+215
|
* Preserve per-byte error replacementsJonas Knobloch2026-03-244-0/+38
|
* Remove input bufferJonas Knobloch2026-03-242-36/+66
|
* Expose finite state automatonJonas Knobloch2026-03-244-1/+320
|
* Refactor tokenizer usageJonas Knobloch2026-03-241-12/+7
|
* Add tokenizer moduleJonas Knobloch2026-03-245-0/+117
| | | | * Wrap MBPE tokenizer
* Refactor progress bar life cycleJonas Knobloch2026-03-242-21/+36
|
* Sync dependenciesJonas Knobloch2026-03-236-67/+54
|
* Add mbpe submoduleJonas Knobloch2026-03-233-0/+4
|
* Tidy dependenciesJonas Knobloch2026-03-171-0/+5
|
* Remove bpc moduleJonas Knobloch2026-03-175-151/+0
|
* Remove llm importJonas Knobloch2026-03-171-2/+0
|
* Sync dependenciesJonas Knobloch2026-03-175-63/+44
|
* Add log probs extractorJonas Knobloch2026-03-174-35/+355
|
* Update perplexity evaluatorJonas Knobloch2026-03-179-208/+304
| | | | | | * Introduce results channel * Introduce jobs channel * Generalize evaluation via callback
* Add string readerJonas Knobloch2026-03-171-0/+25
|
* Update progress barJonas Knobloch2026-03-171-19/+84
| | | | | | * Rename steps to total * Support concurrent updates * Add method to watch progress
* Print on finishJonas Knobloch2026-03-171-1/+1
|
* Rename receiversJonas Knobloch2026-03-161-16/+16
|
* Add progress barJonas Knobloch2026-03-163-0/+68
|
* Add reader interfaceJonas Knobloch2026-03-161-0/+8
|
* Rename dataset readerJonas Knobloch2026-03-164-11/+11
|
* Add build manifestJonas Knobloch2026-03-161-0/+31
|
* Use vanity import pathJonas Knobloch2026-03-1612-17/+19
|
* Add ppl Python scriptJonas Knobloch2026-03-091-0/+112
|
generated by cgit v1.3.1 (git 2.54.0) at 2026-10-07 04:28:57 +0000