ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
23,118 Commits 9 Branches 7 Tags 935 MiB
4b3b4f8dff
Commit Graph

23118 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Krish Dholakia
0295a22561
LiteLLM Minor Fixes and Improvements (09/10/2024) (#5618) 
* fix(cost_calculator.py): move to debug for noisy warning message on cost calculation error

Fixes https://github.com/BerriAI/litellm/issues/5610

* fix(databricks/cost_calculator.py): Handles model name issues for databricks models

* fix(main.py): fix stream chunk builder for multiple tool calls

Fixes https://github.com/BerriAI/litellm/issues/5591

* fix: correctly set user_alias when passed in

Fixes https://github.com/BerriAI/litellm/issues/5612

* fix(types/utils.py): allow passing role for message object

https://github.com/BerriAI/litellm/issues/5621

* fix(litellm_logging.py): Fix langfuse logging across multiple projects

Fixes issue where langfuse logger was re-using the old logging object

* feat(proxy/_types.py): support adding key-based tags for tag-based routing

Enable tag based routing at key-level

* fix(proxy/_types.py): fix inheritance

* test(test_key_generate_prisma.py): fix test

* test: fix test

* fix(litellm_logging.py): return used callback object
 2024-09-11 11:30:29 -07:00
Christopher Chou
a451cfc2d6
Add gemini 1.5 flash exp 0827 (#5636) 2024-09-11 11:30:13 -07:00
Ishaan Jaff
860516c843 langsmith use batching for logging 2024-09-11 11:28:27 -07:00
Ishaan Jaff
2f670a16fc fix langsmith_batch_size 2024-09-11 11:25:33 -07:00
Ishaan Jaff
ccda616f2f
Merge pull request #5631 from miri-bar/update_ai21_docs 
docs: update ai21 docs
 2024-09-11 09:27:35 -07:00
Ishaan Jaff
2fa9709af0 stash - langsmith use batching for logging 2024-09-11 08:06:56 -07:00
Miri Bar
ebf42d6764 docs: update ai21 docs 2024-09-11 13:35:40 +03:00
Ishaan Jaff
ce5182710f ci/cd run again 2024-09-10 19:21:13 -07:00
Ishaan Jaff
720c7c6d08
Merge pull request #5629 from BerriAI/dependabot/npm_and_yarn/docs/my-website/multi-27a054522e 
Bump body-parser and express in /docs/my-website
 2024-09-10 19:12:57 -07:00
Ishaan Jaff
af960b2138
Merge pull request #5628 from BerriAI/dependabot/npm_and_yarn/docs/my-website/multi-e639cebc61 
Bump serve-static and express in /docs/my-website
 2024-09-10 19:12:45 -07:00
Ishaan Jaff
256c72d93b
Merge pull request #5626 from BerriAI/dependabot/npm_and_yarn/docs/my-website/multi-d983993043 
Bump send and express in /docs/my-website
 2024-09-10 19:12:36 -07:00
dependabot[bot]
35a81e7b23
Bump body-parser and express in /docs/my-website 
Bumps [body-parser](https://github.com/expressjs/body-parser) and [express](https://github.com/expressjs/express). These dependencies needed to be updated together.

Updates `body-parser` from 1.20.2 to 1.20.3
- [Release notes](https://github.com/expressjs/body-parser/releases)
- [Changelog](https://github.com/expressjs/body-parser/blob/master/HISTORY.md)
- [Commits](https://github.com/expressjs/body-parser/compare/1.20.2...1.20.3)

Updates `express` from 4.19.2 to 4.20.0
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/master/History.md)
- [Commits](https://github.com/expressjs/express/compare/4.19.2...4.20.0)

---
updated-dependencies:
- dependency-name: body-parser
  dependency-type: indirect
- dependency-name: express
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-09-11 02:11:53 +00:00
dependabot[bot]
1b41badb69
Bump serve-static and express in /docs/my-website 
Bumps [serve-static](https://github.com/expressjs/serve-static) and [express](https://github.com/expressjs/express). These dependencies needed to be updated together.

Updates `serve-static` from 1.15.0 to 1.16.0
- [Release notes](https://github.com/expressjs/serve-static/releases)
- [Changelog](https://github.com/expressjs/serve-static/blob/master/HISTORY.md)
- [Commits](https://github.com/expressjs/serve-static/compare/v1.15.0...1.16.0)

Updates `express` from 4.19.2 to 4.20.0
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/master/History.md)
- [Commits](https://github.com/expressjs/express/compare/4.19.2...4.20.0)

---
updated-dependencies:
- dependency-name: serve-static
  dependency-type: indirect
- dependency-name: express
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-09-11 02:11:51 +00:00
dependabot[bot]
e48459389c
Bump send and express in /docs/my-website 
Bumps [send](https://github.com/pillarjs/send) and [express](https://github.com/expressjs/express). These dependencies needed to be updated together.

Updates `send` from 0.18.0 to 0.19.0
- [Release notes](https://github.com/pillarjs/send/releases)
- [Changelog](https://github.com/pillarjs/send/blob/master/HISTORY.md)
- [Commits](https://github.com/pillarjs/send/compare/0.18.0...0.19.0)

Updates `express` from 4.19.2 to 4.20.0
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/master/History.md)
- [Commits](https://github.com/expressjs/express/compare/4.19.2...4.20.0)

---
updated-dependencies:
- dependency-name: send
  dependency-type: indirect
- dependency-name: express
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-09-11 02:11:46 +00:00
Ishaan Jaff
a6f9020884 bump: version 1.44.23 → 1.44.24 2024-09-10 19:10:27 -07:00
Ishaan Jaff
c1262addbe
Merge pull request #5623 from BerriAI/litellm_vertex_use_async_for_getting_token 
[Feat-Vertex Perf] Use async func to get auth credentials
 2024-09-10 18:53:48 -07:00
Ishaan Jaff
9261599ab9 add doc string to vertex llm base 2024-09-10 18:52:43 -07:00
Ishaan Jaff
8d773e66af fix gemini streaming test 2024-09-10 17:50:24 -07:00
Ishaan Jaff
26aa20df73 fix test get token url 2024-09-10 17:38:03 -07:00
Ishaan Jaff
899eaa9566
Merge pull request #5571 from jalammar/cohere-updated-models 
Add Cohere refresh models and update pricing
 2024-09-10 17:22:51 -07:00
Ishaan Jaff
24474789d7 fix gemini test 2024-09-10 17:20:01 -07:00
Ishaan Jaff
96fa9d46f5 fix case when gemini is used 2024-09-10 17:06:45 -07:00
Ishaan Jaff
1c6f8b1be2 fix vertex use async func to set auth creds 2024-09-10 16:12:18 -07:00
Ishaan Jaff
aed48e3bad
Merge pull request #5622 from BerriAI/litellm_fix_auth_refresh_vertex 
[Feat-Perf Improvement Vertex] Only Refresh credentials when token is expired
 2024-09-10 15:03:35 -07:00
Ishaan Jaff
2d4be4cf1f
Merge pull request #5620 from BerriAI/litellm_use_helper_to_get_httpx_clients 
[Feat-Perf] Use common helper to get async httpx clients for all providers
 2024-09-10 15:03:11 -07:00
Ishaan Jaff
3ebff903c3
Merge branch 'main' into litellm_use_helper_to_get_httpx_clients 2024-09-10 15:02:54 -07:00
Ishaan Jaff
478a36ae36 fix bedrock get async client 2024-09-10 14:17:18 -07:00
Ishaan Jaff
26ae86e59b fix types for vertex project id 2024-09-10 14:02:15 -07:00
Ishaan Jaff
f3593aed68
Merge pull request #5619 from BerriAI/litellm_vertex_use_get_httpx_client 
[Fix-Perf] Vertex AI cache httpx clients
 2024-09-10 13:59:39 -07:00
Ishaan Jaff
68ce46c4b8 fix getting params 2024-09-10 13:54:42 -07:00
Ishaan Jaff
7bddbdd56e fix vertex only refresh auth when required 2024-09-10 13:49:28 -07:00
Ishaan Jaff
72dd21dc47 fix linting error 2024-09-10 13:29:02 -07:00
Ishaan Jaff
7ad3fe464e fix get_async_httpx_client 2024-09-10 13:20:55 -07:00
Ishaan Jaff
d7afeee71c fix test 2024-09-10 13:15:50 -07:00
Ishaan Jaff
dc63a16a6f
Merge pull request #5616 from BerriAI/litellm_fix_regen_keys 
[Fix-Proxy] Regenerate keys when no duration is passed
 2024-09-10 13:09:57 -07:00
Ishaan Jaff
08f8f9634f use get async httpx client 2024-09-10 13:08:49 -07:00
Ishaan Jaff
0f154abf9e use get_async_httpx_client for logging httpx 2024-09-10 13:03:55 -07:00
Ishaan Jaff
421b857714 pass llm provider when creating async httpx clients 2024-09-10 11:51:42 -07:00
Ishaan Jaff
87bac7c026 fix rps / rpm values on load testing 2024-09-10 11:22:19 -07:00
Jay Alammar
795b29dfc4 Updating Cohere models, prices, and documentation 2024-09-10 13:47:05 -04:00
Ishaan Jaff
a0e4510f53 add enum for all llm providers LlmProviders 2024-09-10 10:44:57 -07:00
Ishaan Jaff
d4b9a1307d rename get_async_httpx_client 2024-09-10 10:38:01 -07:00
Ishaan Jaff
1e8cf9f2a6 fix vertex ai use _get_async_client 2024-09-10 10:33:19 -07:00
Peter Laß
b1ecfe065c
fix #5614 (#5615) 
Co-authored-by: Peter Laß <peter.lass@maibornwolff.de>
 2024-09-10 09:26:44 -07:00
Ishaan Jaff
39a8bb2bc4 add test test_regenerate_key_ui 2024-09-10 09:12:03 -07:00
Ishaan Jaff
428762542c fix regen keys when no duration is passed 2024-09-10 08:04:18 -07:00
Ishaan Jaff
43cd657ac5
Merge pull request #5603 from BerriAI/litellm_allow_turning_off_message_logging_for_callbacks 
[Feat-Proxy] allow turning off message logging for OTEL (callback specific)
 2024-09-09 22:00:09 -07:00
Ishaan Jaff
479b12be09
Merge branch 'main' into litellm_allow_turning_off_message_logging_for_callbacks 2024-09-09 21:59:36 -07:00
Krrish Dholakia
2e5583919a bump: version 1.44.22 → 1.44.23 2024-09-09 21:58:27 -07:00
Krish Dholakia
2d2282101b
LiteLLM Minor Fixes and Improvements (09/09/2024) (#5602) 
* fix(main.py): pass default azure api version as alternative in completion call

Fixes api error caused due to api version

Closes https://github.com/BerriAI/litellm/issues/5584

* Fixed gemini-1.5-flash pricing (#5590)

* add /key/list endpoint

* bump: version 1.44.21 → 1.44.22

* docs architecture

* Fixed gemini-1.5-flash pricing

---------

Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>

* fix(bedrock/chat.py): fix converse api stop sequence param mapping

Fixes https://github.com/BerriAI/litellm/issues/5592

* fix(databricks/cost_calculator.py): handle databricks model name changes

Fixes https://github.com/BerriAI/litellm/issues/5597

* fix(azure.py): support azure api version 2024-08-01-preview

Closes https://github.com/BerriAI/litellm/issues/5377

* fix(proxy/_types.py): allow dev keys to call cohere /rerank endpoint

Fixes issue where only admin could call rerank endpoint

* fix(azure.py): check if model is gpt-4o

* fix(proxy/_types.py): support /v1/rerank on non-admin routes as well

* fix(cost_calculator.py): fix split on `/` logic in cost calculator

---------

Co-authored-by: F1bos <44951186+F1bos@users.noreply.github.com>
Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
 2024-09-09 21:56:12 -07:00