ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
34,378 Commits 9 Branches 7 Tags 935 MiB
dd183a7fcb
Commit Graph

34378 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ishaan Jaff
bf048ecda4 docs - titan embeddings v2 2024-05-03 15:59:02 -07:00
Ishaan Jaff
fbe412a3a6 feat - add amazon.titan-embed-text-v2 2024-05-03 15:58:05 -07:00
Ishaan Jaff
5333474a6f
Merge pull request #3431 from BerriAI/litellm_simplify_docs_prod 
docs - simplify best practices for prod
 2024-05-03 15:56:03 -07:00
Ishaan Jaff
209baaca02 docs - simplify prod docs 2024-05-03 15:40:05 -07:00
Krrish Dholakia
5b39f8e282 feat(proxy_server.py): return api base in response headers 
Closes https://github.com/BerriAI/litellm/issues/2631
 2024-05-03 15:27:32 -07:00
Ishaan Jaff
bae5d3601d feat - add unit tests for slack alerting 2024-05-03 15:08:55 -07:00
Ishaan Jaff
ab27866b6a fix test slack alerting len 2024-05-03 14:58:11 -07:00
Ishaan Jaff
a369867e02 test - num alerts on callbacks 2024-05-03 14:46:44 -07:00
Ishaan Jaff
e5311d35f2 fix test len active callbacks 2024-05-03 14:32:13 -07:00
Ishaan Jaff
3997ea6442 fix - return num callbacks in /active/callbacks 2024-05-03 14:24:01 -07:00
Ishaan Jaff
e9eead2f25 test - size of callbacks, alerts 2024-05-03 14:22:15 -07:00
Ishaan Jaff
e99edaf4e1
Merge pull request #3426 from BerriAI/litellm_set_db_exceptions_on_ui 
UI - set DB Exceptions webhook_url on UI
 2024-05-03 14:05:37 -07:00
Ishaan Jaff
776f541f6c fix bug where slack would get inserting several times 2024-05-03 14:04:38 -07:00
Ishaan Jaff
fdc9856652 UI - set DB Exceptions webhook_url 2024-05-03 13:33:43 -07:00
Ishaan Jaff
34bf0b37f5
Merge pull request #3423 from BerriAI/litellm_test_callbacks_proxy 
[Test] Assert num Callbacks on Proxy don't increase
 2024-05-03 12:44:56 -07:00
Krrish Dholakia
b2a0502383 bump: version 1.35.36 → 1.35.37 2024-05-03 12:42:20 -07:00
Krrish Dholakia
defc205348 test(test_alangfuse.py): fix test 2024-05-03 12:39:38 -07:00
frob
4adba181b2
Merge branch 'BerriAI:main' into ollama-image-handling 2024-05-03 20:56:10 +02:00
Lunik
9ba9b3891f
⚡️ perf: Remove test violation on each stream chunk 
Signed-off-by: Lunik <lunik@tiwabbit.fr>
 2024-05-03 20:51:40 +02:00
Lunik
e7405f105c
✅ ci: Add tests 
Signed-off-by: Lunik <lunik@tiwabbit.fr>
 2024-05-03 20:50:37 +02:00
Krish Dholakia
cb1872d7cb
Merge pull request #3422 from BerriAI/litellm_lowest_latency_fix 
fix(lowest_latency.py): fix the size of the latency list to 10 by default (can be modified)
 2024-05-03 10:14:50 -07:00
Krrish Dholakia
2dd9d2f704 test(test_amazing_vertex_completion.py): try-except api errors 2024-05-03 10:09:57 -07:00
Ishaan Jaff
9ba5685722 test active callbacks on proxy 2024-05-03 10:05:06 -07:00
Ishaan Jaff
fe6e465466 test - num callbacks on proxy should not increase 2024-05-03 09:59:59 -07:00
Vincelwt
508e53593b
Merge branch 'BerriAI:main' into main 2024-05-03 17:43:17 +01:00
Vince Loewe
3677d56e9e
Lunary: Fix tool calling 2024-05-03 17:42:50 +01:00
Ishaan Jaff
c6a9b460cd
Merge pull request #3419 from BerriAI/litellm_fix_lowest_latency_router 
[Fix] Ensure callbacks are not added to router when `store_model_in_db=True`
 2024-05-03 09:28:35 -07:00
Ishaan Jaff
23d334fe60 proxy - return num callbacks on /health/readiness 2024-05-03 09:14:32 -07:00
Ishaan Jaff
a1814a3e4c test - num callbacks on proxy 2024-05-03 09:13:37 -07:00
Krrish Dholakia
0b72904608 fix(lowest_latency.py): fix the size of the latency list to 10 by default (can be modified) 2024-05-03 09:00:32 -07:00
Ishaan Jaff
540a35ed5e fix update router logic 2024-05-03 08:48:11 -07:00
mogith-pn
723ef9963e Clarifai - Added streaming and async completion support 2024-05-03 14:03:38 +00:00
sumanth
3bc6b5d119 usage-based-routing-ttl-on-cache 2024-05-03 10:50:45 +05:30
mikey
de7fe98556
Merge branch 'BerriAI:main' into main 2024-05-03 11:30:03 +08:00
ffreemt
a7ec1772b1 Add litellm\tests\test_batch_completion_return_exceptions.py 2024-05-03 11:28:38 +08:00
Krrish Dholakia
91971fa9e0 feat(router.py): add 'get_model_info' helper function to get the model info for a specific model, based on it's id 2024-05-02 17:53:09 -07:00
Krrish Dholakia
fdc4fdb91a fix(proxy/utils.py): fix slack alerting to only raise alerts for llm api exceptions 
don't spam for bad user requests. Closes https://github.com/BerriAI/litellm/issues/3395
 2024-05-02 17:18:21 -07:00
Krrish Dholakia
5baeeec899 fix(openmeter.py): fix get from env 2024-05-02 16:34:22 -07:00
Krish Dholakia
2200900ca2
Merge pull request #3393 from Priva28/main 
Add Llama3 tokenizer and allow custom tokenizers.
 2024-05-02 16:32:41 -07:00
Ishaan Jaff
0b27f5b3dc
Merge pull request #3409 from BerriAI/litellm_revert_passing_langfuse_traces_alerts 
fix - revert init langfuse client on slack alerts
 2024-05-02 16:09:23 -07:00
Ishaan Jaff
9edf463c3b fix - revert init langfuse client on slack alerts 2024-05-02 16:02:52 -07:00
Marc Abramowitz
cdb39e90ce Improve mocking in test_proxy_exception_mapping 
Mock the calls to the backend and assert that the correct parameters are passed
to the backend.
 2024-05-02 15:16:20 -07:00
Ishaan Jaff
f893f8bc55
Merge pull request #3403 from msabramo/disambiguate-invalid-model-name-errors 
Disambiguate invalid model name errors
 2024-05-02 15:09:59 -07:00
Krish Dholakia
9e56472a81
Merge pull request #3406 from msabramo/test_proxy_server_mock_improvements 
Improve mocking in `test_proxy_server.py`
 2024-05-02 15:05:09 -07:00
Marc Abramowitz
6d154e2317 Update tests to reflect new error messages 2024-05-02 15:02:58 -07:00
Marc Abramowitz
988c37fda3 Disambiguate invalid model name errors 
because that error can be thrown in several different places, so
knowing the function it's being thrown from can be very useul for debugging.
 2024-05-02 15:02:54 -07:00
Krrish Dholakia
acda064be6 fix(proxy/utils.py): fix retry logic for generic data request 2024-05-02 14:50:50 -07:00
Lunik
406c9820d1
➕ feat: Add python requirements for Azure Content-Safety callback 
Signed-off-by: Lunik <lunik@tiwabbit.fr>
 2024-05-02 23:28:21 +02:00
Lunik
6cec252b07
✨ feat: Add Azure Content-Safety Proxy hooks 
Signed-off-by: Lunik <lunik@tiwabbit.fr>
 2024-05-02 23:21:08 +02:00
Krish Dholakia
e26b39822c
Merge pull request #3405 from azohra/patch-1 
Vision for Claude 3 Family + Info for Azure/GPT-4-0409
 2024-05-02 13:42:01 -07:00