x/llm, branch main x Clamp perplexity evaluation 2026-06-27T18:45:08+00:00 Jonas Knobloch jonas.knobloch@t-online.de 2026-06-27T18:45:08+00:00 48cac2575c9ba5377ddeba2f17ddb68277e410d9 






Pad token buffer
2026-06-27T18:41:40+00:00

Jonas Knobloch
jonas.knobloch@t-online.de

2026-06-27T18:24:38+00:00

c87625c71737f41f42f0188ff87b8d9313c8548a












Add token buffer config
2026-06-27T17:08:39+00:00

Jonas Knobloch
jonas.knobloch@t-online.de

2026-06-27T17:08:39+00:00

e1e4eab2e1a682d633125f3c71cc09c3e95b30d3












Add stream iterator to token buffer
2026-06-27T17:04:34+00:00

Jonas Knobloch
jonas.knobloch@t-online.de

2026-06-27T16:54:58+00:00

416fa02619a2111ab3184f083f513bd263fc7cf2












Bump github.com/jonasknobloch/mbpe to v0.1.2
2026-06-27T13:06:57+00:00

Jonas Knobloch
jonas.knobloch@t-online.de

2026-06-27T13:06:57+00:00

b1ba8ff474afc003e956de7bf371887859fb1df1












Rename default config
2026-05-04T13:28:03+00:00

Jonas Knobloch
jonas.knobloch@t-online.de

2026-05-04T13:19:01+00:00

3150cbb7cf7c6febbf24ce73a9cb2ab048670607












Recover tokenization based on config
2026-04-24T09:50:02+00:00

Jonas Knobloch
jonas.knobloch@t-online.de

2026-04-24T09:49:26+00:00

12f15fdd8c048e5958e294f12a9f163f6f950b3e












Cleanup eval command
2026-04-24T09:14:43+00:00

Jonas Knobloch
jonas.knobloch@t-online.de

2026-04-24T09:14:43+00:00

408536516bdfedc93d93226dc08280ed224361fc

* Remove logprob extraction





* Remove logprob extraction







Access artifacts via shelf
2026-04-24T09:07:01+00:00

Jonas Knobloch
jonas.knobloch@t-online.de

2026-04-24T09:07:01+00:00

1e02a5ec7f7794bb542e99ceb804ed88048b6b54












Use platform specific defaults for CUDA device ID
2026-04-23T18:19:46+00:00

Jonas Knobloch
jonas.knobloch@t-online.de

2026-04-23T18:14:26+00:00

d35f5fad1d26fc09cfd98f6e7faf17d6a48e4e8f