summaryrefslogtreecommitdiff
path: root/llm/cmd
Commit message (Collapse)AuthorAgeFilesLines
* Clamp perplexity evaluationJonas Knobloch2026-06-271-2/+5
|
* Pad token bufferJonas Knobloch2026-06-271-2/+6
|
* Add token buffer configJonas Knobloch2026-06-271-1/+6
|
* Rename default configJonas Knobloch2026-05-041-1/+1
|
* Recover tokenization based on configJonas Knobloch2026-04-241-1/+4
|
* Cleanup eval commandJonas Knobloch2026-04-243-135/+0
| | | | * Remove logprob extraction
* Access artifacts via shelfJonas Knobloch2026-04-241-3/+4
|
* Use platform specific defaults for CUDA device IDJonas Knobloch2026-04-231-1/+1
|
* Destroy session on model teardownJonas Knobloch2026-04-102-0/+8
|
* Refactor model optionsJonas Knobloch2026-04-081-1/+7
| | | | * Add options struct
* Add evaluator configJonas Knobloch2026-04-082-0/+6
|
* Rename default config constructorJonas Knobloch2026-04-081-1/+1
|
* Run evaluator with scoreJonas Knobloch2026-04-073-48/+14
|
* Handle environment initialization on package levelJonas Knobloch2026-04-061-0/+8
|
* Add parameter to control logits output bindingJonas Knobloch2026-04-061-1/+1
|
* Add score methodJonas Knobloch2026-04-041-1/+1
|
* Add config structJonas Knobloch2026-04-041-1/+1
|
* Return document index in text iteratorJonas Knobloch2026-04-031-1/+1
|
* Scope text column to parquet readerJonas Knobloch2026-04-031-1/+1
|
* Expose progress bar titleJonas Knobloch2026-03-252-2/+2
|
* Add helper to collect resultsJonas Knobloch2026-03-252-44/+11
|
* Refactor evaluator initializationJonas Knobloch2026-03-252-12/+4
|
* Sort importsJonas Knobloch2026-03-251-2/+1
|
* Refactor tokenizer usageJonas Knobloch2026-03-241-12/+7
|
* Add log probs extractorJonas Knobloch2026-03-172-0/+178
|
* Update perplexity evaluatorJonas Knobloch2026-03-172-18/+81
| | | | | | * Introduce results channel * Introduce jobs channel * Generalize evaluation via callback
* Rename dataset readerJonas Knobloch2026-03-161-3/+3
|
* Use vanity import pathJonas Knobloch2026-03-161-3/+4
|
* Expose window and strideJonas Knobloch2026-03-091-1/+1
|
* Add ppl commandJonas Knobloch2026-03-091-0/+69