Marc Abramowitz
3a2cb151aa
Proxy: Add x-litellm-call-id response header
...
This gives the value of `logging_obj.litellm_call_id` and one particular use of
this is to correlate the HTTP response from a request with a trace in an LLM
logging tool like Langfuse, Langsmith, etc.
For example, if a user in my environment (w/ Langfuse) gets back this in the
response headers:
```
x-litellm-call-id: ffcb49e7-bd6e-4e56-9c08-a7243802b26e
```
then they know that they can see the trace for this request in Langfuse by
visiting https://langfuse.domain.com/trace/ffcb49e7-bd6e-4e56-9c08-a7243802b26e
They can also use this ID to submit scores for this request to the Langfuse
scoring API.
2024-07-10 16:05:37 -07:00
Krrish Dholakia
aace0b22a3
fix(proxy_server.py): fix proxy_server.py premium user check for encrypted license key
2024-07-10 12:25:31 -07:00
Krrish Dholakia
d5d782f844
build(requirements.txt): bump openai version
...
Fixes https://github.com/BerriAI/litellm/issues/4639
2024-07-10 11:52:29 -07:00
Ishaan Jaff
e4dbd5abd4
Merge pull request #4645 from BerriAI/litellm_add_assistants_delete_endpoint
...
[Feat-Proxy] Add DELETE /assistants
2024-07-10 11:45:37 -07:00
Ishaan Jaff
09fe40791e
add "/v1/assistants/{assistant_id}", as openai route
2024-07-10 11:42:02 -07:00
Ishaan Jaff
62f475919b
feat - add DELETE assistants endpoint
2024-07-10 11:37:37 -07:00
Ishaan Jaff
7e82d98299
test assistants endpoint
2024-07-10 11:15:28 -07:00
Ishaan Jaff
5587dbbd32
add async assistants delete support
2024-07-10 11:14:40 -07:00
Ishaan Jaff
3480382495
test - delete assistants
2024-07-10 10:35:30 -07:00
Ishaan Jaff
5bf430f201
add delete assistant SDK
2024-07-10 10:33:00 -07:00
Krrish Dholakia
e201b06d9c
docs(prod.md): update redis url doc for best prod practices
2024-07-10 08:03:50 -07:00
Krrish Dholakia
d077148135
style(litellm_license.py): add debug statement for litellm license
2024-07-09 22:43:33 -07:00
Ishaan Jaff
78e67f36e7
fix bedrock better debugging for credentials
2024-07-09 22:02:17 -07:00
Ishaan Jaff
de13d06ce6
docs - show how to use with azure openai
2024-07-09 18:33:22 -07:00
Ishaan Jaff
3a06e2e425
fix show exact prisma exception when starting proxy
2024-07-09 18:20:09 -07:00
Ishaan Jaff
5e12364fad
update docker compose to show how to pass a config.yaml
2024-07-09 17:59:02 -07:00
Ishaan Jaff
f10f589ddd
bump: version 1.41.14 → 1.41.15
2024-07-09 16:33:17 -07:00
Ishaan Jaff
a250e99934
ui new build
2024-07-09 16:33:00 -07:00
Ishaan Jaff
59666f3d92
Merge pull request #4628 from BerriAI/dependabot/pip/zipp-3.19.1
...
build(deps): bump zipp from 3.18.2 to 3.19.1
2024-07-09 16:28:47 -07:00
Ishaan Jaff
8d0eddf87b
Merge pull request #4632 from BerriAI/litellm_set_ip_address_on_ui
...
ui - allow setting allowed ip addresses
2024-07-09 16:28:14 -07:00
Ishaan Jaff
8195a4eacc
check if premium user for sso / allowed ip
2024-07-09 16:25:23 -07:00
Ishaan Jaff
f7002ecd08
fixes when no ip addresses enabled
2024-07-09 16:15:05 -07:00
Ishaan Jaff
e966d9fd0f
fix text hierarhcy
2024-07-09 16:04:03 -07:00
Ishaan Jaff
b04c4da12e
fix allowed ip screen
2024-07-09 15:57:53 -07:00
Ishaan Jaff
f3dddd234d
ui - get, set, delete allowed ip addresses
2024-07-09 15:43:44 -07:00
Ishaan Jaff
22df67edb7
feat - add mgtm endpoint routes
2024-07-09 15:29:41 -07:00
Ishaan Jaff
362c01c21f
ui - add Create, get, delete endpoints for IP Addresses
2024-07-09 15:12:08 -07:00
Ishaan Jaff
2c338296c1
ui - allow setting allowed ip
2024-07-09 14:46:46 -07:00
Krrish Dholakia
a1986fab60
fix(vertex_httpx.py): add sync vertex image gen support
...
Fixes https://github.com/BerriAI/litellm/issues/4623
2024-07-09 13:33:54 -07:00
Krrish Dholakia
5f279c937c
docs(supported_embedding.md): cleanup
2024-07-09 12:41:24 -07:00
Krrish Dholakia
58ac2a7e2b
docs(supported_embeddings.md): add doc on provider-specific params for embedding models
2024-07-09 12:39:10 -07:00
Ishaan Jaff
ed5cc86e8f
docs - assistants api
2024-07-09 12:29:53 -07:00
dependabot[bot]
0daa9e94a6
build(deps): bump zipp from 3.18.2 to 3.19.1
...
Bumps [zipp](https://github.com/jaraco/zipp ) from 3.18.2 to 3.19.1.
- [Release notes](https://github.com/jaraco/zipp/releases )
- [Changelog](https://github.com/jaraco/zipp/blob/main/NEWS.rst )
- [Commits](https://github.com/jaraco/zipp/compare/v3.18.2...v3.19.1 )
---
updated-dependencies:
- dependency-name: zipp
dependency-type: indirect
...
Signed-off-by: dependabot[bot] <support@github.com>
2024-07-09 19:26:57 +00:00
Krrish Dholakia
ba334ff8b9
refactor(provider_specific_params.md): create separate doc for provider-specific param
...
Make it easier for people to know, how litellm handles provider-specific params.
2024-07-09 12:23:46 -07:00
Ishaan Jaff
6bce7e73a3
Merge pull request #4627 from BerriAI/litellm_fix_thread_auth
...
[Fix] Authentication on /thread endpoints on Proxy
2024-07-09 12:19:19 -07:00
Ishaan Jaff
e9b14a56d2
test /threads endpoint
2024-07-09 12:17:42 -07:00
Krrish Dholakia
127eaafaa4
test(test_completion.py): skip test
2024-07-09 12:10:34 -07:00
Ishaan Jaff
d2f8269674
test is open ai routes function
2024-07-09 12:10:04 -07:00
Krish Dholakia
aa2fd29e48
Merge pull request #3955 from liuyl/empower-functions-v1
...
Add empower-functions integration to litellm
2024-07-09 12:09:55 -07:00
Ishaan Jaff
b30fa64e2a
fix - use helper to check if a route is openai route
2024-07-09 12:00:07 -07:00
Krrish Dholakia
dbf4acc4ce
docs(image_generation.md): add proxy image gen example to docs
2024-07-09 11:56:21 -07:00
Ishaan Jaff
e380954de1
add helper to check is_openai_route
2024-07-09 11:50:12 -07:00
Ishaan Jaff
9423ab95ba
fix add assistant settings on config
2024-07-09 10:05:32 -07:00
Ishaan Jaff
12f207b499
feat - support /create assistants endpoint
2024-07-09 10:03:47 -07:00
Ishaan Jaff
6479442d5b
feat - support acreate_assistants endpoint
2024-07-09 09:49:38 -07:00
Ishaan Jaff
f5eb862635
router - add acreate_assistants
2024-07-09 09:46:28 -07:00
Ishaan Jaff
e4ad792d5d
async test assistants
2024-07-09 09:44:18 -07:00
Ishaan Jaff
f4f07e13f3
add acreate_assistants
2024-07-09 09:33:41 -07:00
Ishaan Jaff
06926920d5
test - create assistants
2024-07-09 08:54:49 -07:00
Ishaan Jaff
9e22ce905e
add create_assistants
2024-07-09 08:51:42 -07:00
