mlow
/
lmcli
1
0
Fork 0
Code Issues 3 Pull Requests Packages Projects Releases Wiki Activity
216 Commits 3 Branches 0 Tags 1.4 MiB
Commit Graph

2 Commits

Author SHA1 Message Date
Matt Low dfe43179c0 Include token count in api.Chunk 
And calculate the tokens/chunk for gemini responses, fixing the tok/s
meter for gemini models.

Further, only consider the first candidate of streamed gemini responses.
 2024-06-09 20:49:18 +00:00
Matt Low a2c860252f Refactor pkg/lmcli/provider 
Moved `ChangeCompletionInterface` to `pkg/api`, moved individual
providers to `pkg/api/provider`
 2024-06-09 18:31:43 +00:00