x/llmc/tokenize.go, branch main
x
http://git.jknobloc.com/x/atom/llmc/tokenize.go?h=main
2026-04-30T11:20:32Z
Manually rename first shard
2026-04-30T11:20:32Z
Jonas Knobloch
jonas.knobloch@t-online.de
2026-04-30T11:20:32Z
urn:sha1:e2aa50000f5ac1a0672c25a1e116e81ff54009c8
Return number of written shards
2026-04-30T11:19:08Z
Jonas Knobloch
jonas.knobloch@t-online.de
2026-04-30T11:10:03Z
urn:sha1:806dcb7f2c01514275dab76116d494345ffb0fd0
Update parameter names
2026-04-30T10:58:23Z
Jonas Knobloch
jonas.knobloch@t-online.de
2026-04-30T10:58:23Z
urn:sha1:4740e5aa19012e5f8e67ac8cb857d9741208c364
Fix output order
2026-04-23T18:18:00Z
Jonas Knobloch
jonas.knobloch@t-online.de
2026-04-22T10:44:08Z
urn:sha1:d3276058dd057178e1218a6b76f2ec42d713d6e8
Add llmc module
2026-04-23T18:17:53Z
Jonas Knobloch
jonas.knobloch@t-online.de
2026-04-22T13:36:58Z
urn:sha1:babd70eb9d4e4b028c0eb8c32e6bed65dafa0481