Commit Graph

26473 Commits

Author SHA1 Message Date
Felipe Gare
0212eb6f04 change gpt-5-codex support in model_price json 2025-10-14 13:37:56 -03:00
Krrish Dholakia
3e193a3542 bump: version 1.78.0 → 1.78.1 2025-10-13 14:26:47 -07:00
Krrish Dholakia
3d7c55516e build: bump version 2025-10-13 14:26:38 -07:00
Ishaan Jaff
f13eb283e1
[Fix] GEMINI - CLI - add google_routes to llm_api_routes (#15500)
* fix: add google_routes to llm_api_routes

* test: test_virtual_key_llm_api_routes_allows_google_routes
2025-10-13 10:58:47 -07:00
Krrish Dholakia
0c86c3d791 docs(index.md): bump rc 2025-10-13 10:56:14 -07:00
Krrish Dholakia
611bda94cb docs: fix doc 2025-10-13 09:59:07 -07:00
Krish Dholakia
2ea7005c40
Merge pull request #15448 from dhruvyad/main
Get completion cost directly from OpenRouter
2025-10-12 22:12:52 -07:00
Krish Dholakia
d81843070a
Merge pull request #15461 from BerriAI/litellm_update_docs
[Docs] - Update benchmark results
2025-10-12 22:11:57 -07:00
Krish Dholakia
760000e48e
Merge pull request #15465 from kowyo/kowyo/fix-ollama-think
fix(ollama/chat): correctly map reasoning_effort to think in requests
2025-10-12 22:11:17 -07:00
Krish Dholakia
b7b16d69bc
Merge pull request #15468 from mubashir1osmani/litellm_add_docs
docs: add ecs deployment guide
2025-10-12 22:10:00 -07:00
Krish Dholakia
176c45d51b
Merge pull request #15472 from huangyafei/update_price
Add anthropic/claude-sonnet-4.5 to OpenRouter cost map
2025-10-12 22:07:04 -07:00
Krish Dholakia
ff20f8402a
Merge pull request #15456 from BerriAI/litellm_staging_branch_10_11_2025_p1
Litellm staging branch 10 11 2025 p1
2025-10-12 22:01:45 -07:00
Krrish Dholakia
0ffc81f010 fix: fix reformatting 2025-10-12 22:01:16 -07:00
Krrish Dholakia
1949436047 test: update test 2025-10-12 21:58:06 -07:00
Krish Dholakia
04dc9d091c
Merge branch 'main' into litellm_staging_branch_10_11_2025_p1 2025-10-12 21:55:44 -07:00
huangyafei
409299de84 Add anthropic/claude-sonnet-4.5 to OpenRouter cost map 2025-10-13 10:46:37 +08:00
mubashir1osmani
950ee924fc add ecs to docs 2025-10-12 16:13:56 -04:00
Dhruv Yadav
84a65440c5 add tests for openrouter cost tracking 2025-10-12 12:36:24 +05:30
Kowyo
89aad0e21f
Merge branch 'BerriAI:main' into kowyo/fix-ollama-think 2025-10-12 11:54:30 +08:00
Ishaan Jaffer
e761665f22 docs fix 2025-10-11 18:21:35 -07:00
AlexsanderHamir
5d1fa76d14 update benchmarks 2025-10-11 18:06:37 -07:00
AlexsanderHamir
2cb1db27cb docs: update benchmark results with improved infrastructure
- Update to 2 instance baseline (1035 RPS @ 200ms median)
- Add 4 instance results (1170 RPS @ 100ms median)
- Update machine specs to 4 CPU / 8GB RAM
- Update Locust settings to 1000 users
2025-10-11 18:00:26 -07:00
Imad Saddik
133189e191
Fixed a few typos (#15267) 2025-10-11 17:53:42 -07:00
Hampus Näsström
e650f39821
Reduce claude-4-sonnet max_output_tokens to 64k (#15409)
Claude 4 Sonnet doesn't support more than 64k output tokens: https://cloud.google.com/vertex-ai/generative-ai/docs/partner-models/claude/sonnet-4
2025-10-11 17:51:27 -07:00
Copilot
f5359ba007
Fix apply_guardrail endpoint returning raw string instead of ApplyGuardrailResponse (#15436)
* Initial plan

* Fix apply_guardrail endpoint to return ApplyGuardrailResponse

Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>
2025-10-11 17:50:37 -07:00
Alexsander Hamir
300a142926
[Add]: perf summary (#15458)
* add: perf summary

* update docs

* fix: focus on p99
2025-10-11 17:38:13 -07:00
Krrish Dholakia
78e2274381 fix(pass_through_endpoints.py): use path instead of endpoint
includes the mapped route
2025-10-11 17:04:56 -07:00
jlan-nl
328505dcda
Fix prices (#15374)
Co-authored-by: IQHL (Hans Jacob Landelius) <iqhl@novnordisk.com>
2025-10-11 16:53:55 -07:00
Ishaan Jaffer
087bd2d306 docs fix 2025-10-11 16:49:11 -07:00
Krrish Dholakia
3ee3cb945d fix(team_endpoints.py): document new param 2025-10-11 16:45:55 -07:00
Krrish Dholakia
a71329fbe1 fix: fix linting errors 2025-10-11 16:42:22 -07:00
Krrish Dholakia
2266b272aa fix(proxy/_types.py): fix default to be none 2025-10-11 16:41:03 -07:00
Krrish Dholakia
23870cbda0 fix(pass_through_endpoints.py): fix typo 2025-10-11 16:38:32 -07:00
Ishaan Jaffer
1ccd949495 docs fix 2025-10-11 16:34:47 -07:00
Ishaan Jaffer
b9fef02f04 docs v1.78.0 2025-10-11 16:33:46 -07:00
Ishaan Jaffer
7288f4355f docs fix 2025-10-11 16:24:21 -07:00
Ishaan Jaffer
54b8bde60c docs fix 2025-10-11 16:23:46 -07:00
Krrish Dholakia
a7456ab21e refactor: refactor to cut down large functions 2025-10-11 16:18:37 -07:00
Ishaan Jaffer
8d29fc8cdd docs 2025-10-11 16:12:00 -07:00
Krrish Dholakia
6bd722bba4 fix: always retain config models 2025-10-11 16:09:33 -07:00
Krrish Dholakia
8eb58db989 fix: fix linting error 2025-10-11 15:42:53 -07:00
Krrish Dholakia
090a2c0cfe fix: remove unused uuid import 2025-10-11 15:38:28 -07:00
Krrish Dholakia
f96f2106f7 fix(pass_through_endpoints.py): fix check for mapped routes 2025-10-11 15:32:48 -07:00
Krish Dholakia
8c4c4acda2
Merge pull request #15457 from BerriAI/litellm_docs_10_11_2025
Litellm docs 10 11 2025
2025-10-11 15:16:13 -07:00
Krrish Dholakia
3f921d8dbe docs(index.md): document mcp oauth support 2025-10-11 15:14:15 -07:00
Krrish Dholakia
9b5943ae50 docs: cleanup docs 2025-10-11 15:09:24 -07:00
Krrish Dholakia
fdaa163758 docs(claude_responses_api.md): update docs with mcp server tutorial 2025-10-11 15:07:54 -07:00
Ishaan Jaffer
e4f3d78579 docs v1.78.0.rc.1 2025-10-11 14:57:28 -07:00
Krrish Dholakia
73257be604 docs(index.md): initial commit for github mcp oauth docs 2025-10-11 14:00:50 -07:00
Krish Dholakia
323389c244
(feat) Passthrough - allow admin to give access to specific passthrough endpoints
(feat) Passthrough - allow admin to give access to specific passthrough endpoints
2025-10-11 13:51:10 -07:00