Commit Graph

12519 Commits

Author SHA1 Message Date
Ishaan Jaff
2ce5dc0dfd ci/cd run again 2024-06-01 21:19:32 -07:00
Ishaan Jaff
309a66692f fix test_rate_limit[usage-based-routing-True-3-2] 2024-06-01 21:18:23 -07:00
Ishaan Jaff
ebc29bed8f
Merge pull request #3970 from BerriAI/litellm_traceloop_logging_fixes
[Fix] Traceloop / OTEL logging fixes + easier docs
2024-06-01 21:17:05 -07:00
Ishaan Jaff
c9e5102ab5
Merge pull request #3973 from BerriAI/litellm_Add_batches_api_docs
feat - add batches api to docs
2024-06-01 21:16:56 -07:00
Ishaan Jaff
0e52698a2e feat - add batches api to docs 2024-06-01 21:16:32 -07:00
Ishaan Jaff
315e4f5ffa bump: version 1.40.0 → 1.40.1 2024-06-01 21:02:36 -07:00
Ishaan Jaff
a01746c19e fix test_daily_reports_redis_cache_scheduler 2024-06-01 21:00:24 -07:00
Ishaan Jaff
2f9dac6238 test - test gpt-3.5-turbo on test_parallel_streaming_requests 2024-06-01 20:56:33 -07:00
Krish Dholakia
b7c6f0500b
Merge pull request #3969 from BerriAI/litellm_log_api_version
feat(proxy_server.py): log litellm api version to langfuse
2024-06-01 19:52:22 -07:00
Ishaan Jaff
39d2d98467 docs - clean up traceloop logging 2024-06-01 19:51:49 -07:00
Krrish Dholakia
64ad3f8137 feat(proxy_server.py): log litellm api version on llm api calls
Closes https://github.com/BerriAI/litellm/issues/3673
2024-06-01 19:49:57 -07:00
Ishaan Jaff
85daa467c5 fix - traceloop logging 2024-06-01 19:33:41 -07:00
Krrish Dholakia
9ef83126d7 fix(utils.py): correctly instrument passing through api version in optional param check 2024-06-01 19:31:52 -07:00
Ishaan Jaff
373a41ca6d fix async_function_with_retries 2024-06-01 19:00:22 -07:00
Krrish Dholakia
5e85a5b208 fix(test_scheduler.py): simplify scheduler testing. fix race condition 2024-06-01 18:57:47 -07:00
Krrish Dholakia
7efac4d36c fix(azure.py): support dropping 'tool_choice=required' for older azure API versions
Closes https://github.com/BerriAI/litellm/issues/3876
2024-06-01 18:44:50 -07:00
Ishaan Jaff
054456c50e
Merge pull request #3963 from BerriAI/litellm_set_allowed_fail_policy
[FEAT]- set custom AllowedFailsPolicy on litellm.Router
2024-06-01 17:57:11 -07:00
Ishaan Jaff
9f0ae21ef5 docs - AllowedFailsPolicy 2024-06-01 17:56:57 -07:00
Ishaan Jaff
fb49d036fb
Merge pull request #3962 from BerriAI/litellm_return_num_rets_max_exceptions
[Feat] return `num_retries` and `max_retries` in exceptions
2024-06-01 17:48:38 -07:00
Ishaan Jaff
d4378143f1 fix current_attempt, num_retries not defined 2024-06-01 17:42:37 -07:00
Ishaan Jaff
4eaeec2a2d feat - set allowed fails policy 2024-06-01 17:39:44 -07:00
Ishaan Jaff
eb203c051a feat - set custom AllowedFailsPolicy 2024-06-01 17:26:21 -07:00
Ishaan Jaff
cfc55b39a9 fix - return in LITELLM_EXCEPTION_TYPES 2024-06-01 17:05:33 -07:00
Ishaan Jaff
3caa9dfec6 add test 2024-06-01 17:03:53 -07:00
Krish Dholakia
edf296fb5b
Update README.md 2024-06-01 16:53:06 -07:00
Ishaan Jaff
286d42a881 feat - add num retries and max retries in exception 2024-06-01 16:53:00 -07:00
Krrish Dholakia
93c9ea160d fix(openai.py): fix client caching logic 2024-06-01 16:45:56 -07:00
Ishaan Jaff
40622f5f27 feat - include LiteLLM Retried and max retries in exception 2024-06-01 16:40:14 -07:00
Krish Dholakia
63fb3a95be
Merge pull request #3961 from BerriAI/litellm_docker_compose_start
Litellm docker compose start
2024-06-01 16:28:28 -07:00
Krrish Dholakia
ce4ba80fd4 build(docker-compose.yml): load local .env in docker compose quick start 2024-06-01 16:27:07 -07:00
Krrish Dholakia
2245ee1cc8 test(test_scheduler.py): fix testing 2024-06-01 16:21:02 -07:00
Krrish Dholakia
9b4a19b3aa build(docker-compose.yml): startup docker compose with postgres 2024-06-01 16:18:12 -07:00
Krrish Dholakia
7715267989 fix(router.py): simplify scheduler
move the scheduler poll queuing logic into the router class, making it easier to use
2024-06-01 16:09:57 -07:00
Krish Dholakia
27087f60c2
Merge pull request #3959 from BerriAI/litellm_support_verify_ssl_false
fix(http_handler.py): support verify_ssl=False when using httpx client
2024-06-01 15:30:15 -07:00
Krrish Dholakia
d7160eb3ea fix(test_scheduler.py): fix test 2024-06-01 15:11:13 -07:00
Krrish Dholakia
a16a1c407a fix(http_handler.py): allow setting ca bundle path 2024-06-01 14:48:53 -07:00
Krrish Dholakia
f75c15d6cd fix(proxy_server.py): security fix - fix sql injection attack on global spend logs 2024-06-01 14:16:41 -07:00
Krrish Dholakia
f1ce7bb300 fix(http_handler.py): add bool check for os.getenv verif ssl value 2024-06-01 14:07:41 -07:00
Krish Dholakia
1ec2ba186f
Create main.yml
Create a workflow to deploy dev releases
2024-06-01 14:02:35 -07:00
Krrish Dholakia
22a0c400dd fix(http_handler.py): support verify_ssl=False when using httpx client 2024-06-01 13:56:45 -07:00
Krrish Dholakia
3b94993ddc bump: version 1.39.6 → 1.40.0 2024-06-01 11:31:24 -07:00
Krrish Dholakia
c6559753c7 fix(test_scheduler.py): fix test 2024-06-01 11:30:26 -07:00
Krrish Dholakia
a0fb301b18 docs(assistants.md): add assistants api to docs 2024-06-01 10:30:07 -07:00
Ishaan Jaff
d83b4a00d3
Merge pull request #3956 from BerriAI/litellm_cache_openai_clients
[FEAT] Perf improvements - litellm.completion / litellm.acompletion - Cache OpenAI client
2024-06-01 09:46:42 -07:00
Ishaan Jaff
47dd52c566 fix used hashed api key 2024-06-01 09:24:16 -07:00
Krrish Dholakia
5cce31ae61 docs(enterprise.md): update enterprise docs with public model hub and custom email branding information 2024-06-01 09:01:05 -07:00
Ishaan Jaff
47337c172e fix - in memory client cache 2024-06-01 08:58:22 -07:00
Krish Dholakia
8375e9621c
Merge pull request #3954 from BerriAI/litellm_simple_request_prioritization
feat(scheduler.py): add request prioritization scheduler
2024-05-31 23:29:09 -07:00
Krrish Dholakia
183dd81087 fix(router.py): fix should_retry logic 2024-05-31 23:27:43 -07:00
Krrish Dholakia
04f42d7e63 docs(enterprise.md): update docs 2024-05-31 22:07:48 -07:00