Commit Graph

23118 Commits

Author SHA1 Message Date
James Braza
ef6e920161 Added handling of unmapped provider, with test 2024-06-11 18:34:10 -07:00
Ishaan Jaff
995b1e7315 fix when user_api_key_dict is None 2024-06-11 18:33:15 -07:00
Krish Dholakia
7c23077a71
Merge pull request #4119 from BerriAI/litellm_tiktoken_bump
feat(utils.py): bump tiktoken dependency to 0.7.0 (gpt-4o token counting support)
2024-06-11 18:24:58 -07:00
Krish Dholakia
a53ba9b2fb
Merge pull request #4134 from BerriAI/litellm_azure_ai_route
Azure AI support all models
2024-06-11 18:24:05 -07:00
James Braza
8be37bee04 Added simple test of get_supported_openai_params with no custom provider 2024-06-11 18:18:21 -07:00
James Braza
cb5456c9f5 Allowing inferring custom LLM provider from model inside get_supported_openai_params 2024-06-11 18:16:19 -07:00
Ishaan Jaff
b10ac0d1f3 fix linting error 2024-06-11 18:14:06 -07:00
Ishaan Jaff
f5b10a47e3
Merge pull request #4136 from jamesbraza/adding-mypy-dev-group
Added `mypy` to the Poetry `dev` group
2024-06-11 18:14:00 -07:00
Krrish Dholakia
b0daeba8e7 build(requirements.txt): make sure tiktoken v0.7.0 is provided 2024-06-11 18:11:08 -07:00
Ishaan Jaff
fba7d2e623 fix team endpoints 2024-06-11 18:10:20 -07:00
Krrish Dholakia
0ab0111d57 test(test_team.py): fix error string asserted 2024-06-11 18:05:20 -07:00
Ishaan Jaff
7ad981b85c fix - log mgmt data to OTEL 2024-06-11 18:05:10 -07:00
Ishaan Jaff
51b78422df fix http_request 2024-06-11 17:57:50 -07:00
Krrish Dholakia
a9cbf2209c fix(utils.py): support dynamic api key for azure_ai route 2024-06-11 17:51:29 -07:00
Ishaan Jaff
479a39cebd fix test new team 2024-06-11 17:48:11 -07:00
Krrish Dholakia
a1ca70a8a7 fix: more bug fixes 2024-06-11 17:41:59 -07:00
hughcrt
418caf800d fix: lunary callback tags 2024-06-11 21:30:11 -03:00
Krrish Dholakia
6305d2dbcf fix(__init__.py): add 'log_raw_request_response' flag to init 2024-06-11 17:26:03 -07:00
Ishaan Jaff
30f74aa471 fix import error 2024-06-11 17:17:57 -07:00
Ishaan Jaff
427f2ee1fa feat - otel log /team exceptions 2024-06-11 16:27:07 -07:00
Ishaan Jaff
f2abac748e fix refactor management endpoint utils 2024-06-11 16:16:10 -07:00
Krrish Dholakia
c27ae34a39 fix(proxy_server.py): use consistent 400-status code error code for exceeded budget errors
standardizes error code for budget exceeded errors to status code 400
2024-06-11 16:10:58 -07:00
Ishaan Jaff
13cb49688a feat - log management endpoint logs to otel 2024-06-11 16:09:11 -07:00
Krrish Dholakia
9c7788ae48 fix(utils.py): fix formatting 2024-06-11 15:49:20 -07:00
Krrish Dholakia
2d8e4ddfa0 fix(main.py): trigger new build 2024-06-11 15:13:50 -07:00
James Braza
917e8678db Added mypy to the dev Poetry group 2024-06-11 14:43:32 -07:00
Ishaan Jaff
5eb2822d31
Merge pull request #4133 from BerriAI/litellm_work_with_traceparents
[Feat] OTEL - allow propagating traceparent in headers
2024-06-11 14:27:08 -07:00
Ishaan Jaff
d7f1445615 doc - OTEL trace propogation 2024-06-11 14:25:33 -07:00
Krrish Dholakia
61a450d0fc docs(azure_ai.md): add updated azure ai routing docs 2024-06-11 14:18:34 -07:00
Krrish Dholakia
f40d47942f test(test_completion.py): add testing to make sure tool calling works as expected for 'azure_ai/' route 2024-06-11 14:11:02 -07:00
Krrish Dholakia
88e567af2c fix(utils.py): add new 'azure_ai/' route
supports azure's openai compatible api endpoint
2024-06-11 14:06:56 -07:00
Ishaan Jaff
d829e6a297 test - propogate trace IDs across services 2024-06-11 14:00:25 -07:00
Ishaan Jaff
7ce1289548 feat - use traceparent to proporgate OTEL traces 2024-06-11 13:57:31 -07:00
dependabot[bot]
1a847ec47c
build(deps): bump braces from 3.0.2 to 3.0.3 in /ui/litellm-dashboard
Bumps [braces](https://github.com/micromatch/braces) from 3.0.2 to 3.0.3.
- [Changelog](https://github.com/micromatch/braces/blob/master/CHANGELOG.md)
- [Commits](https://github.com/micromatch/braces/compare/3.0.2...3.0.3)

---
updated-dependencies:
- dependency-name: braces
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-11 20:37:41 +00:00
Krrish Dholakia
a389ec95a2 bump: version 1.40.8 → 1.40.9 2024-06-11 13:36:40 -07:00
Krrish Dholakia
7eae0ff7e3 fix(utils.py): allow user to opt in to raw request logging to langfuse 2024-06-11 13:35:22 -07:00
dependabot[bot]
8838c8af66
build(deps): bump azure-identity from 1.15.0 to 1.16.1
Bumps [azure-identity](https://github.com/Azure/azure-sdk-for-python) from 1.15.0 to 1.16.1.
- [Release notes](https://github.com/Azure/azure-sdk-for-python/releases)
- [Changelog](https://github.com/Azure/azure-sdk-for-python/blob/main/doc/esrp_release.md)
- [Commits](https://github.com/Azure/azure-sdk-for-python/compare/azure-identity_1.15.0...azure-identity_1.16.1)

---
updated-dependencies:
- dependency-name: azure-identity
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-06-11 20:32:08 +00:00
Krrish Dholakia
a8ea7c6d31 docs(ui.md): add okta sso support to docs 2024-06-11 13:17:41 -07:00
Krrish Dholakia
c9bb4b29c7 docs(vertex.md): add vertex ai function calling to docs 2024-06-11 12:32:24 -07:00
Ishaan Jaff
7b4fca8fb7
Merge pull request #4129 from BerriAI/litellm_fix_docker
fix opentelemetry-semantic-conventions-ai does not exist on LiteLLM Docker
2024-06-11 12:30:46 -07:00
Ishaan Jaff
1af3d34d8b fix OTEL semantic conventions does not exist 2024-06-11 12:28:38 -07:00
Ishaan Jaff
842b8337e6 fix opentelemetry-semantic-conventions-ai 2024-06-11 12:19:56 -07:00
David Manouchehri
844f15f8b0
fix(bedrock_httpx.py): Add IAM caching for converse flow. 2024-06-11 17:00:18 +00:00
David Manouchehri
9aee0b4a0f
fix(bedrock_httpx.py): Fix STS region endpoint for converse flow. 2024-06-11 16:35:03 +00:00
David Manouchehri
d950373768
feat(azure.py): Add Azure AD cred caching for OIDC flow. 2024-06-11 15:54:44 +00:00
David Manouchehri
a31fa5fbc8
feat(util.py/azure.py): Add OIDC support when running in Azure Kubernetes Service (AKS). 2024-06-11 15:54:34 +00:00
David Manouchehri
857df1d6af
Merge remote-tracking branch 'upstream/main' into aks-oidc-1852 2024-06-11 15:54:10 +00:00
David Manouchehri
95a4bc46d4
Revert "feat(util.py/azure.py): Add OIDC support when running in Azure Kubernetes Service (AKS)."
This reverts commit 640b955e12.
2024-06-11 15:52:07 +00:00
David Manouchehri
7154c25903
Revert "feat(azure.py): Add Azure AD cred caching for OIDC flow."
This reverts commit 73d9d0d7db.
2024-06-11 15:51:59 +00:00
David Manouchehri
7faf0b9586
fix(bedrock_httpx.py): Fix STS region endpoint. 2024-06-11 15:43:33 +00:00