Commit Graph

34378 Commits

Author SHA1 Message Date
AlexsanderHamir
48810e6bcb refactor: improve MCP TextContent serialization to follow existing patterns
- Remove risky __dict__ fallback for non-BaseModel objects
- Only convert BaseModel objects to dicts using model_dump() (consistent with line 4745-4746)
- Keep other objects unchanged to maintain backward compatibility
- Follows existing codebase patterns for Pydantic model serialization
2025-11-25 13:14:25 -08:00
AlexsanderHamir
ab877d9551 fix: convert MCP TextContent objects to JSON-serializable format in logging
- Convert Pydantic BaseModel objects (TextContent, ImageContent, etc.) to dicts in get_final_response_obj
- Fixes TypeError: Object of type TextContent is not JSON serializable
- Resolves test failures in test_mcp_tool_call_hook and test_mcp_cost_tracking
2025-11-25 13:07:09 -08:00
AlexsanderHamir
2ef5a41a24 fix: resolve type checking errors in vertex_ai and mcp_server_manager
- Fix type incompatibility in vertex_ai/videos/transformation.py by casting litellm_params to Dict[str, Any]
- Add await to async add_update_server call in mcp_server_manager.py
- Resolves 4 type checking errors across 2 files
2025-11-25 12:48:24 -08:00
AlexsanderHamir
7f991fe897 refactor: clean up lazy loading system and remove type ignore comments
- Remove excessive comments and simplify documentation
- Remove @overload decorators (type stubs are sufficient)
- Remove Logging type stub to avoid redefinition errors
- Keep only essential type stubs for cost_per_token and completion_cost
- Fixes type checking errors without using type: ignore comments
2025-11-25 12:37:54 -08:00
Ishaan Jaff
be712908a3
[Feat] Add OpenAI compatible bedrock imported models. - qwen etc (#17097)
* test_bedrock_openai_imported_model

* AmazonBedrockOpenAIConfig

* add openai route for bedrock

* docs fix

* fix code qa check
2025-11-25 12:20:39 -08:00
AlexsanderHamir
36f8c9463f fix: resolve type checking errors for lazy-loaded functions in budget_manager
- Add type stubs and @overload decorators for cost_per_token and completion_cost
- Refactor lazy loading system with centralized registry for better maintainability
- Add comprehensive documentation for adding new lazy-loaded functions
- Fixes 'Any? not callable' errors at lines 111, 139, and 146 in budget_manager.py
2025-11-25 12:13:19 -08:00
yuneng-jiang
44cde2e48f Disable edit, delete, info, for dynamically generated spend tags 2025-11-25 12:03:01 -08:00
Krrish Dholakia
db2c8e3631 docs: initial doc cleanup 2025-11-25 11:57:51 -08:00
Sameer Kankute
67622fb040
Add day 0 support for anthropic new feat (#17091)
* Added tool search support for anthropic

* Add programtic tool calling support

* Add tool use input examples support

* Add anthropic effort param support

* Add anthropic effort param support

* Add blog for new features

* fix mypy and lint errors

* fix mypy and lint errors

* fix mypy and lint errors

* fix mypy and lint errors

* Add better handling

* Add better handling
2025-11-25 11:28:47 -08:00
abi_jey
aec0ab777b feat: add GA protocol as litellm_params for realtime api on azure provider 2025-11-25 19:18:41 +00:00
yuneng-jiang
359025554e bump: version 0.4.6 → 0.4.7 2025-11-25 11:05:49 -08:00
yuneng-jiang
42fa19a152 Revert "Test prisma changes for Gemini tests"
This reverts commit 031bb3c5d9.
2025-11-25 11:02:45 -08:00
Sameer Kankute
3249f6dd2d
Merge pull request #17070 from BerriAI/litellm_add_vertex_ai_image_support
Add vertex ai image gen support for both gemini and imagen models
2025-11-26 00:04:03 +05:30
Sameer Kankute
83a9dcd2d2
Merge pull request #16886 from BerriAI/litellm_anthopic_azure_support
Added support for azure anthopic models via chat completion
2025-11-26 00:03:52 +05:30
Sameer Kankute
59b4b9a07c fix documentation of anthropic azure 2025-11-26 00:02:48 +05:30
Sameer Kankute
59bcf079fb
Merge pull request #17078 from BerriAI/litellm_add_search_logging
Add search API logging and cost tracking in LiteLLM Proxy
2025-11-25 23:59:41 +05:30
Sameer Kankute
2e50db81a5
Merge pull request #17071 from BerriAI/litellm_azure_gpt_5_reasoning
Fix `reasoning_effort="none"` not working on Azure for GPT-5.1
2025-11-25 23:59:25 +05:30
Krish Dholakia
00e17c81a1
Add enforce user param functionality (#17088)
* feat: Add reject_metadata_tags to proxy config

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* Refactor: Rename reject_metadata_tags to reject_clientside_metadata_tags

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-11-25 09:36:24 -08:00
Sameer Kankute
1c612288bc fix lint errors 2025-11-25 20:20:09 +05:30
Sameer Kankute
255d1bc239 fix lint errors 2025-11-25 20:20:09 +05:30
Sameer Kankute
e0396e5fa7
Merge pull request #17082 from BerriAI/main
merge main
2025-11-25 18:49:52 +05:30
Sameer Kankute
e2f2ccd913 Add tests related messages api 2025-11-25 18:45:51 +05:30
Sameer Kankute
dd4c8ecbef Add v1/messages support for azure anthropic models 2025-11-25 18:36:39 +05:30
Sameer Kankute
afe540e88d Fix auth issue 2025-11-25 18:26:25 +05:30
naaa760
2cf86e8ef8 new mocked 2025-11-25 17:28:02 +05:30
naaa760
a24b43cbdf only added the helper that converts 2025-11-25 17:27:39 +05:30
naaa760
2cc2f67a76 added the minimal GET logic 2025-11-25 17:27:12 +05:30
naaa760
c54986c3c9 list path now routes to Vertex 2025-11-25 17:26:53 +05:30
Sameer Kankute
67d69d12b0 Add cost tracking and logging support 2025-11-25 17:14:59 +05:30
Sameer Kankute
c149ade6a8 Add tests related to reasoning param none 2025-11-25 13:57:15 +05:30
Sameer Kankute
a50083a87b Remove none support from reasoning param 2025-11-25 13:56:30 +05:30
Sameer Kankute
b0d511143c remove unsused imports 2025-11-25 13:36:20 +05:30
Sameer Kankute
883cfaeeaf Add tests 2025-11-25 13:32:13 +05:30
Sameer Kankute
f52f05748d Update docs related to vertex ai image gen 2025-11-25 13:31:50 +05:30
Sameer Kankute
29ab291cf5 Add vertex ai image support 2025-11-25 13:31:16 +05:30
yuneng-jiang
031bb3c5d9 Test prisma changes for Gemini tests 2025-11-24 22:40:46 -08:00
wcyat
6dcb5425a5
fix(vertex): fix CreateCachedContentRequest enum error (#16965)
* feat: add _fix_enum_types function to remove enums from non-string fields in schema

* test: add test for _fix_enum_types function to validate enum removal from non-string fields
2025-11-24 21:24:29 -08:00
yuneng-jiang
e629a6b703 Merge remote-tracking branch 'origin' into litellm_org_usage 2025-11-24 21:14:05 -08:00
yuneng-jiang
babee43dde
Merge pull request #17068 from BerriAI/litellm_additional_delete_resource_modal
[Feature] Change Delete Modals to Common Component
2025-11-24 20:58:46 -08:00
Dmitrii Komarov
046b7efbbe
Make Bedrock image generation more consistent (#17021) 2025-11-24 20:58:01 -08:00
Saar wintrov
cfd35d3b14
Metadata: fix 401 when audio/transcriptions (#17023)
* Metadata: fix 401 when audio/transcriptions

* check if str, CR fixes
2025-11-24 20:56:27 -08:00
Cesar Garcia
650b18974f
fix(gemini): skip thinking config for image models (#17027)
* fix(gemini): exclude image models from automatic thinking_level parameter (#17013)

- gemini-3-pro-image-preview does not support thinking_level parameter
- Added check to skip adding thinkingConfig for models containing "image"
- Fixes BadRequestError: "Thinking level is not supported for this model"
- Only affects automatic default behavior, user can still pass reasoning_effort explicitly

Fixes #17013

* test: add tests for gemini-3 image models thinking_level exclusion

* update docs
2025-11-24 20:54:12 -08:00
yuneng-jiang
3aba6d96fd
[Fix] UI - Add No Default Models for Team and User Settings (#17037)
* Add No Default Models to Team and User settings

* Removing unused imports

* Adding to Create User and Team flow
2025-11-24 20:53:17 -08:00
Saar wintrov
777ef628d2
Enhancement(helm): ServiceMonitor template rendering (#17038)
* Metadata: fix 401 when audio/transcriptions

* check if str, CR fixes

* Added new helmchart functionality

* .

* .

* adding new tests
2025-11-24 20:53:02 -08:00
Emerson Gomes
597fa4d35c
Fix image edit endpoint (#17046)
* Fix image edit endpoint

* Update litellm/proxy/image_endpoints/endpoints.py

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>

---------

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
2025-11-24 20:52:35 -08:00
yuneng-jiang
d2b3ef0667
Add aws_bedrock_runtime_endpoint into Credential Types (#17053) 2025-11-24 20:48:51 -08:00
Krish Dholakia
1ae80955e8
Docs: Add link to logging payload spec (#17049)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-11-24 20:48:10 -08:00
yuneng-jiang
3f5a34d72c
Deleting a user from team deletes key user created for team (#17057) 2025-11-24 20:47:43 -08:00
yuneng-jiang
e371ff454a
Non root docker build fix (#17060) 2025-11-24 20:45:56 -08:00
yuya_matsuba
262fb742d2
Fix: Distinguish permission errors from idempotent errors in Prisma migrations (#17064)
* fix: distinguish permission errors from idempotent errors in Prisma migrations

* style: apply Black formatting and fix line length issues
2025-11-24 20:41:44 -08:00