Commit Graph

23504 Commits

Author SHA1 Message Date
Ishaan Jaff
d5ee93aa0c
[Feat] Add Recraft API - Image Edits Support (#12874)
* test_recraft_image_edit_api

* add RecraftImageEditConfig

* complete RecraftImageEditConfig

* add RecraftImageEditRequestParams in types

* update RecraftImageEditRequestParams

* working

* transform_image_edit_request

* Image Edit docs recraft

* working transform_image_edit_request

* TestRecraftImageEditTransformation
2025-07-22 15:03:08 -07:00
Ishaan Jaff
31e9303232 remove old test 2025-07-22 14:11:43 -07:00
Jugal D. Bhatt
aa1ebf37b2
pass in cmd args (#12871) 2025-07-22 14:10:23 -07:00
Ishaan Jaff
934af0e9a0
add azure-keyvault==4.2.0 (#12873) 2025-07-22 14:08:33 -07:00
dependabot[bot]
d4900d7dc0
build(deps): bump form-data from 4.0.3 to 4.0.4 in /docs/my-website (#12867)
---
updated-dependencies:
- dependency-name: form-data
  dependency-version: 4.0.4
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-07-22 11:23:41 -07:00
Ishaan Jaff
6f0c211788 [Feat] MCP Gateway - allow using MCPs with all LLM APIs when using /responses with LiteLLM (#12546)
* add MCPResponsesAPIHelper

* rename LiteLLM_Proxy_MCP_Handler

* aresponses_api_with_mcp

* mock_responses_api_response

* test response with litellm proxy MCP

* add _should_use_litellm_mcp_gateway

* fix transform_mcp_tool_to_openai_responses_api_tool

* use correct _transform_mcp_tools_to_openai

* fix config.yaml

* fixes for native MCP handling

* docs MCP with litellm proxy

* aresponses_api_with_mcp

* fix linting

* fix mypy

* fix linting

* test_aresponses_api_with_mcp_mock_integration

* docs How it works when server_url="litellm_proxy"
2025-07-22 10:22:45 -07:00
Krrish Dholakia
e683a41993 bump: version 1.74.7 → 1.74.8 2025-07-22 08:54:03 -07:00
Mateo Di Loreto
c65392cf81
Replace non-root Dockerfile base with Alpine multi-stage build; (#12707)
* Change Dockerfile.noon_root with alpine base image

* Improve non_root docker image

* Re add the build_admin_ui.sh script step

* Re add the build_admin_ui.sh script step

* Remove unnecessary workdir set

* Remove unnecessary workdir set

* Configure chainguard image

* A bit of optimization and improve comments

* delete extra build_ui script run

* Optimizie Dockerfile copy statements
2025-07-22 08:53:10 -07:00
Krrish Dholakia
964c3b7a3d docs(index.md): cleanup 2025-07-22 08:47:52 -07:00
Krrish Dholakia
b4469dafd4 docs(index.md): cleanup 2025-07-22 08:47:26 -07:00
Krrish Dholakia
581e96a768 docs(index.md): cleanup 2025-07-22 08:43:33 -07:00
tanjiro
03e420f91a
Improvements on the Regenerate Key Flow (#12788)
* improve regeneration ux

* toLocaleString

* regenerate key twice in a row

* fix delete key
2025-07-22 07:47:26 -07:00
Ishaan Jaff
03baf23ad1 [Feat] Add Recraft Image Generation API Support - New LLM Provider (#12832)
* add recraft

* init RecraftImageGenerationConfig

* add get_complete_url + validate_environment

* add image_generation_handler in llm http clas

* fixes for transform

* working recraft request

* fixed img gen transform

* fixes for llm http handler

* test: TestRecraftImageGeneration

* fixes for llm_http_handler

* fix RecraftImageGenerationConfig

* TestRecraftImageGenerationTransformation

* add recraft API

* docs recraft API

* fix code QA

* map_openai_params

* fix recraft

* cost tracking for recraft/recraftv3

* fix code qa check
2025-07-21 22:19:58 -07:00
Krish Dholakia
e5251e7188
Openrouter - filter out cache_control flag for non-anthropic models (allows usage with claude code) (#12850)
* fix(gpt_transformation.py): remove 'cache_control' flag for openai/openai-compatible calls

Fixes https://github.com/BerriAI/litellm/issues/12787

* fix(openrouter/chat/transformation.py): allow passing openrouter cache control flag for claude models

* fix(gpt_transformation.py): fix import

* fix: fix adding tools
2025-07-21 22:15:48 -07:00
Krish Dholakia
e4e10aa4ed
Litellm dev 07 21 2025 p1 (#12848)
* fix(main.py): fix async retryer

Fixes https://github.com/BerriAI/litellm/issues/12830

* fix(forward_clientside_headers_by_model_group.py): filter out 'content-type' from forwardable headers

clientside content-type != proxy content type, can cause requests to hang

* test(tests/): update tests
2025-07-21 22:09:39 -07:00
Krish Dholakia
db498c1805
Fix team_member_budget update logic (#12843)
* fix(team_endpoints.py): always remove team member budget from updated_kv

this is not a field for the litellm team table

Prevents startup issue

* test(test_team_endpoints.py): add unit test to ensure 'team_member_budget' is never in update to table - separate logic

* refactor: cleanup
2025-07-21 22:06:29 -07:00
dependabot[bot]
2be16eb493
build(deps): bump form-data from 4.0.0 to 4.0.4 in /ui/litellm-dashboard (#12851)
---
updated-dependencies:
- dependency-name: form-data
  dependency-version: 4.0.4
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2025-07-21 22:05:38 -07:00
Krish Dholakia
70ffdcd210
Passthrough Auth - make Auth checks OSS + Anthropic - only show 'reasoning_effort' for supported models (#12847)
* fix(anthropic/chat/transformation.py): move 'reasoning_effort' to inside 'supports_reasoning' check

Fixes https://github.com/BerriAI/litellm/issues/12833

* fix(proxy_settings_endpoints.py): change order of checks - don't add allowed ip unless db is connected

Fixes https://github.com/BerriAI/litellm/issues/12815

* feat(user_api_key_auth.py): make passthrough auth checks OSS

Fixes https://github.com/BerriAI/litellm/issues/12789

* docs(enterprise.md): clarify on docs
2025-07-21 21:55:41 -07:00
Ishaan Jaff
49d40a1c3d test_router_provider_wildcard_routing 2025-07-21 21:33:40 -07:00
Krrish Dholakia
68a5415a51 docs(config_settings.md): document new flags 2025-07-21 20:19:26 -07:00
Krish Dholakia
00677afefe
Litellm batch cost tracking debug (#12782)
* feat(proxy_server.py): support batch polling interval

allows admin to control batch polling interval (default is 3600s)

easier debugging

* fix(proxy_settings_endpoint.py): ensure value is actually set before updating env var
2025-07-21 20:17:56 -07:00
Cole McIntosh
ff22aed1ea
Merge pull request #12826 from colesmcintosh/feature/add-hyperbolic-provider 2025-07-21 20:10:45 -06:00
Tomáš Dvořák
270e3d75db
fix(watsonx): use correct parameter name for tool choice (#9980)
Closes BerriAI/litellm#9979
2025-07-21 19:01:10 -07:00
Ishaan Jaff
c91712e579 bump: version 1.74.7 → 1.74.8 2025-07-21 18:29:34 -07:00
Ishaan Jaff
83463e3ea5 fix docusaurus package lock 2025-07-21 18:29:17 -07:00
Ishaan Jaff
443e26f46d fix openrouter/qwen/qwen-vl-plus 2025-07-21 18:25:25 -07:00
Ishaan Jaff
4a7b9dee5f test fix - anthropic deprecated claude 2 2025-07-21 18:22:39 -07:00
Ishaan Jaff
4ca3e8e617
Docs - litellm benchmarks (#12842)
* docs litellm overhead

* In these tests the baseline latency characteristics
2025-07-21 18:10:30 -07:00
Ishaan Jaff
133c26c015
[Azure OpenAI Feature] - Support DefaultAzureCredential without hard-coded environment variables (#12841)
* DefaultAzureCredential

* update get_azure_ad_token_provider

* fixes for get_azure_ad_token_provider

* test_get_azure_ad_token_provider_with_default_azure_credential

* test_get_azure_ad_token_fallback_to_default_azure_credential

* docs DefaultAzureCredential

* fix linting
2025-07-21 18:04:16 -07:00
Jugal D. Bhatt
7bdb5593bf
[LLM Translation] add qwen-vl-plus (#12829)
* add qwen-vl-plus

* add qwen-vl-plus
2025-07-21 16:58:59 -07:00
Cole McIntosh
34ccda10ed Merge upstream/main - resolve conflicts to include both hyperbolic and recraft providers 2025-07-21 17:38:17 -06:00
Ishaan Jaff
27c9be67ba
[Feat] Add fireworks - fireworks/models/kimi-k2-instruct (#12837)
* add fireworks - fireworks/models/kimi-k2-instruct

* update source
2025-07-21 16:28:02 -07:00
Ishaan Jaff
1b05ea79ce update docs 2025-07-21 15:52:54 -07:00
Ishaan Jaff
9022d144a6
[Bug Fix] - gemini leaking FD for sync calls with litellm.completion (#12824)
* bug fix - gemini leaking FD for sync calls

* fixes for leaking FD
2025-07-21 15:01:43 -07:00
Ishaan Jaff
2941a555a8
[Feat] Add Recraft Image Generation API Support - New LLM Provider (#12832)
* add recraft

* init RecraftImageGenerationConfig

* add get_complete_url + validate_environment

* add image_generation_handler in llm http clas

* fixes for transform

* working recraft request

* fixed img gen transform

* fixes for llm http handler

* test: TestRecraftImageGeneration

* fixes for llm_http_handler

* fix RecraftImageGenerationConfig

* TestRecraftImageGenerationTransformation

* add recraft API

* docs recraft API

* fix code QA

* map_openai_params

* fix recraft

* cost tracking for recraft/recraftv3

* fix code qa check
2025-07-21 15:01:32 -07:00
Cole McIntosh
774af8085e
docs: add Google Cloud Model Armor guardrail documentation (#12814)
- Add comprehensive documentation for Model Armor integration
- Include configuration examples and parameter descriptions
- Add Model Armor to sidebars navigation
- Document authentication methods and error handling
2025-07-21 14:24:44 -07:00
Adam Holmberg
6a1b232330
fix: remove deprecated groq/qwen-qwq-32b and add qwen/qwen3-32b (#12831)
fixes #12825
2025-07-21 14:21:21 -07:00
Cole McIntosh
c5b51cd2b4
feat: add Morph provider support (#12821)
* feat: add Morph provider support

- Add MorphChatConfig implementation for OpenAI-compatible API
- Support morph-v3-fast and morph-v3-large models
- Add pricing: morph-v3-fast (/bin/zsh.8/.2 per 1M tokens), morph-v3-large (/bin/zsh.9/.9 per 1M tokens)
- Both models support 16k context window and system messages
- Add comprehensive documentation and unit tests
- Update all necessary integration points (constants, init, provider logic)

* feat: Add Morph provider support in ProviderConfigManager

- Extend ProviderConfigManager to include MorphChatConfig for the Morph LLM provider.
- Update MorphChatConfig by removing unused parameters from the configuration.
2025-07-21 13:52:45 -07:00
Cole McIntosh
c1d5e275bc feat: register Hyperbolic provider in ProviderConfigManager
- Added support for Hyperbolic provider in the ProviderConfigManager.
- Integrated HyperbolicChatConfig to handle configurations for the new provider.
2025-07-21 14:51:49 -06:00
Cole McIntosh
6059b5c1f6
Merge branch 'BerriAI:main' into feature/add-hyperbolic-provider 2025-07-21 14:43:30 -06:00
Jugal D. Bhatt
b653aed603
added dynamic endpoint support (#12827) 2025-07-21 12:38:53 -07:00
Cole McIntosh
6040c329a4 feat: add Hyperbolic provider support
- Add Hyperbolic as a new OpenAI-compatible provider
- Implement HyperbolicChatConfig inheriting from OpenAILikeChatConfig
- Register Hyperbolic in provider lists and constants
- Add comprehensive model configurations with pricing for:
  - DeepSeek models (V3, R1, etc.)
  - Qwen models (2.5, 3, QwQ, etc.)
  - Meta Llama models (3.1, 3.2, 3.3)
  - Other models like Kimi K2, Hermes 3, etc.
- Configure default API base URL: https://api.hyperbolic.xyz/v1
- Add provider documentation with usage examples
- Create unit tests for provider functionality
- Support all standard OpenAI parameters

Hyperbolic provides low-cost inference with OpenAI-compatible APIs,
supporting latest models without infrastructure overhead.
2025-07-21 13:18:50 -06:00
Ishaan Jaff
0ae83d6594
[Docs] Show correct list of vertex ai mistral models (#12828)
* docs update - mistral-large-2411

* docs VertexAI Mistral API

* docs vertex mistral
2025-07-21 12:04:04 -07:00
Ishaan Jaff
67edd7c481
fix team edit guardrail (#12823) 2025-07-21 11:44:22 -07:00
Cole McIntosh
41436fefa0
feat: Add Lambda AI provider support (#12817)
* feat: add Lambda AI provider support

Add support for Lambda AI (lambda.ai) as a new LLM provider in LiteLLM. Lambda AI provides access to a wide range of open-source models through their cloud GPU infrastructure.

Changes:
- Add Lambda AI provider implementation (OpenAI-compatible)
- Register 20 Lambda AI models with accurate pricing and 131k context windows
- Add comprehensive tests for Lambda AI integration
- Add detailed documentation with usage examples
- Use "lambda_ai" as provider name to avoid Python keyword conflict

Models include Llama 3.x, DeepSeek, Hermes, Qwen, and specialized models for coding and vision tasks.

* fix(tests): ensure lambda_ai_models list is repopulated after model cost reload

Updated test cases to clear and repopulate the lambda_ai_models list after reloading the model cost map. This ensures that the tests accurately reflect the current state of available models.

* feat: add Lambda AI chat configuration support

Added support for Lambda AI chat configuration in the ProviderConfigManager. This enhancement allows the integration of Lambda AI as a provider, expanding the capabilities of LiteLLM.
2025-07-21 10:23:10 -07:00
Pavan Gudiwada
1faedd599f
Adding HolmesGPT to projects using LiteLLM (#12798) 2025-07-21 09:24:09 -07:00
Lv Zehui
db80b98141
docs(moonshot): correct base url and document CN-specific endpoint (#12804) 2025-07-21 09:23:48 -07:00
tanjiro
a752d7acc9
Fix SSO Logout | Create Unified Login Page with SSO and Username/Password Options (#12703) 2025-07-20 20:24:38 -07:00
Krrish Dholakia
c946ae8550 docs(bulk_edit_users.md): add guide on bulk editing existing users 2025-07-19 18:26:09 -07:00
Ishaan Jaff
3062a2fead docs fixes 2025-07-19 18:04:38 -07:00