ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
30,881 Commits 9 Branches 7 Tags 935 MiB
12bc66aa5b
Commit Graph

30881 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Kowyo
4f33bc4e46 fix(ollama/chat): 'think' param handling 2025-10-14 13:57:39 -07:00
mubashir1osmani
6424480571 add ecs to docs 2025-10-14 13:57:39 -07:00
huangyafei
9a980f36d4 Add anthropic/claude-sonnet-4.5 to OpenRouter cost map 2025-10-14 13:57:39 -07:00
Davi S. Zucon
9d944b1404
small fix code snippet custom_prompt_management.md 
passing parameter: 
prompt_id directly to openai client, raises error: 
TypeError: Completions.create() got an unexpected keyword argument 'prompt_id'

instead use: 
extra_body={
        "prompt_id": "1234"
 }
 2025-10-14 16:37:00 -03:00
Ishaan Jaffer
c86c6bc507 v0 for Export 2025-10-14 11:11:37 -07:00
Ishaan Jaffer
bda58bc3ed v0 for export 2025-10-14 11:11:24 -07:00
Felipe Gare
0212eb6f04 change gpt-5-codex support in model_price json 2025-10-14 13:37:56 -03:00
Hana Volků
55e44e1b1d
Prompt caching for anthropic models with openrouter 2025-10-14 14:51:55 +02:00
Krrish Dholakia
3e193a3542 bump: version 1.78.0 → 1.78.1 2025-10-13 14:26:47 -07:00
Krrish Dholakia
3d7c55516e build: bump version 2025-10-13 14:26:38 -07:00
Ishaan Jaff
f13eb283e1
[Fix] GEMINI - CLI - add google_routes to llm_api_routes (#15500) 
* fix: add google_routes to llm_api_routes

* test: test_virtual_key_llm_api_routes_allows_google_routes
 2025-10-13 10:58:47 -07:00
Krrish Dholakia
0c86c3d791 docs(index.md): bump rc 2025-10-13 10:56:14 -07:00
Krrish Dholakia
611bda94cb docs: fix doc 2025-10-13 09:59:07 -07:00
Classic298
732063074d
correct claude opus 2025-10-13 14:20:24 +02:00
Krish Dholakia
2ea7005c40
Merge pull request #15448 from dhruvyad/main 
Get completion cost directly from OpenRouter
 2025-10-12 22:12:52 -07:00
Krish Dholakia
d81843070a
Merge pull request #15461 from BerriAI/litellm_update_docs 
[Docs] - Update benchmark results
 2025-10-12 22:11:57 -07:00
Krish Dholakia
760000e48e
Merge pull request #15465 from kowyo/kowyo/fix-ollama-think 
fix(ollama/chat): correctly map reasoning_effort to think in requests
 2025-10-12 22:11:17 -07:00
Krish Dholakia
b7b16d69bc
Merge pull request #15468 from mubashir1osmani/litellm_add_docs 
docs: add ecs deployment guide
 2025-10-12 22:10:00 -07:00
Krish Dholakia
176c45d51b
Merge pull request #15472 from huangyafei/update_price 
Add anthropic/claude-sonnet-4.5 to OpenRouter cost map
 2025-10-12 22:07:04 -07:00
Krish Dholakia
ff20f8402a
Merge pull request #15456 from BerriAI/litellm_staging_branch_10_11_2025_p1 
Litellm staging branch 10 11 2025 p1
 2025-10-12 22:01:45 -07:00
Krrish Dholakia
0ffc81f010 fix: fix reformatting 2025-10-12 22:01:16 -07:00
Krrish Dholakia
1949436047 test: update test 2025-10-12 21:58:06 -07:00
Krish Dholakia
04dc9d091c
Merge branch 'main' into litellm_staging_branch_10_11_2025_p1 2025-10-12 21:55:44 -07:00
huangyafei
409299de84 Add anthropic/claude-sonnet-4.5 to OpenRouter cost map 2025-10-13 10:46:37 +08:00
mubashir1osmani
950ee924fc add ecs to docs 2025-10-12 16:13:56 -04:00
Dhruv Yadav
84a65440c5 add tests for openrouter cost tracking 2025-10-12 12:36:24 +05:30
Kowyo
89aad0e21f
Merge branch 'BerriAI:main' into kowyo/fix-ollama-think 2025-10-12 11:54:30 +08:00
Ishaan Jaffer
e761665f22 docs fix 2025-10-11 18:21:35 -07:00
AlexsanderHamir
5d1fa76d14 update benchmarks 2025-10-11 18:06:37 -07:00
AlexsanderHamir
2cb1db27cb docs: update benchmark results with improved infrastructure 
- Update to 2 instance baseline (1035 RPS @ 200ms median)
- Add 4 instance results (1170 RPS @ 100ms median)
- Update machine specs to 4 CPU / 8GB RAM
- Update Locust settings to 1000 users
 2025-10-11 18:00:26 -07:00
Imad Saddik
133189e191
Fixed a few typos (#15267) 2025-10-11 17:53:42 -07:00
Hampus Näsström
e650f39821
Reduce claude-4-sonnet max_output_tokens to 64k (#15409) 
Claude 4 Sonnet doesn't support more than 64k output tokens: https://cloud.google.com/vertex-ai/generative-ai/docs/partner-models/claude/sonnet-4
 2025-10-11 17:51:27 -07:00
Copilot
f5359ba007
Fix apply_guardrail endpoint returning raw string instead of ApplyGuardrailResponse (#15436) 
* Initial plan

* Fix apply_guardrail endpoint to return ApplyGuardrailResponse

Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>

---------

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ishaan-jaff <29436595+ishaan-jaff@users.noreply.github.com>
 2025-10-11 17:50:37 -07:00
Alexsander Hamir
300a142926
[Add]: perf summary (#15458) 
* add: perf summary

* update docs

* fix: focus on p99
 2025-10-11 17:38:13 -07:00
Krrish Dholakia
78e2274381 fix(pass_through_endpoints.py): use path instead of endpoint 
includes the mapped route
 2025-10-11 17:04:56 -07:00
jlan-nl
328505dcda
Fix prices (#15374) 
Co-authored-by: IQHL (Hans Jacob Landelius) <iqhl@novnordisk.com>
 2025-10-11 16:53:55 -07:00
Ishaan Jaffer
087bd2d306 docs fix 2025-10-11 16:49:11 -07:00
Krrish Dholakia
3ee3cb945d fix(team_endpoints.py): document new param 2025-10-11 16:45:55 -07:00
Krrish Dholakia
a71329fbe1 fix: fix linting errors 2025-10-11 16:42:22 -07:00
Krrish Dholakia
2266b272aa fix(proxy/_types.py): fix default to be none 2025-10-11 16:41:03 -07:00
Krrish Dholakia
23870cbda0 fix(pass_through_endpoints.py): fix typo 2025-10-11 16:38:32 -07:00
Ishaan Jaffer
1ccd949495 docs fix 2025-10-11 16:34:47 -07:00
Ishaan Jaffer
b9fef02f04 docs v1.78.0 2025-10-11 16:33:46 -07:00
Ishaan Jaffer
7288f4355f docs fix 2025-10-11 16:24:21 -07:00
Ishaan Jaffer
54b8bde60c docs fix 2025-10-11 16:23:46 -07:00
Krrish Dholakia
a7456ab21e refactor: refactor to cut down large functions 2025-10-11 16:18:37 -07:00
Ishaan Jaffer
8d29fc8cdd docs 2025-10-11 16:12:00 -07:00
Krrish Dholakia
6bd722bba4 fix: always retain config models 2025-10-11 16:09:33 -07:00
Krrish Dholakia
8eb58db989 fix: fix linting error 2025-10-11 15:42:53 -07:00
Krrish Dholakia
090a2c0cfe fix: remove unused uuid import 2025-10-11 15:38:28 -07:00