mirror of
https://github.com/NicolasBohn/NexQuant.git
synced 2026-07-28 16:07:46 +00:00
aa8ceed2fa
* feat: Track and log accumulated completion cost in LiteLLMAPIBackend * refactor: Use variable for retry count and update import formatting * lint * fix: Allow chat_max_tokens to be None in LLMSettings * feat: Add logging for LiteLLM settings and finish reason in cost calculation