mlow/lmcli
1
0
Fork 0
Code Issues 3 Pull Requests Packages Projects Releases Wiki Activity
dfe43179c0
lmcli/pkg/api/provider
History
Matt Low dfe43179c0 Include token count in api.Chunk 
And calculate the tokens/chunk for gemini responses, fixing the tok/s
meter for gemini models.

Further, only consider the first candidate of streamed gemini responses.
2024-06-09 20:49:18 +00:00
..
anthropic Include token count in api.Chunk 2024-06-09 20:49:18 +00:00
google Include token count in api.Chunk 2024-06-09 20:49:18 +00:00
ollama Include token count in api.Chunk 2024-06-09 20:49:18 +00:00
openai Include token count in api.Chunk 2024-06-09 20:49:18 +00:00