iabhi4
75e698feef
bug(auth): support for ES256/ES384/ES512 and EdDSA JWT verification
2025-08-31 15:58:26 -07:00
Dharamendra Kumar
4278c3b596
feat: Add dependency injection support to BaseLLMAIOHTTPHandler
...
- Add optional client_session, transport, and connector parameters to constructor
- Implement session ownership tracking to prevent closing user-provided sessions
- Add comprehensive session resolution hierarchy (dynamic > instance > create new)
- Include transport control for advanced HTTP stack management
- Add 29 comprehensive tests covering all injection scenarios
- Maintain backward compatibility with existing code
This enhancement allows users to inject their own configured aiohttp sessions,
transports, and connectors for fine-grained control over connection pooling,
SSL settings, proxy configurations, and other HTTP stack parameters.
2025-08-31 11:14:19 -07:00
tanjiro
15baaf68db
back to logs added conditionally
2025-08-31 17:09:11 +09:00
Yuta Saito
d83c420d48
feat: Add guardrail for the Anthropic API endpoint
2025-08-31 16:44:01 +09:00
tanjiro
f17b5730a5
client side pagination of models page
2025-08-31 15:06:29 +09:00
tanjiro
82cec3885e
model filters ui matches the users page
2025-08-31 14:33:15 +09:00
tanjiro
eed2358335
move filter inside user table
2025-08-31 14:03:32 +09:00
Krrish Dholakia
b6f6dc5c1c
feat(vertex_ai.py): support parsing thinking content into gemini format
...
allows function calls with thought signatures to be sent back to gemini
Closes https://github.com/BerriAI/litellm/pull/13842
2025-08-30 18:49:34 -07:00
Krrish Dholakia
51c73dc60b
fix(vertex_and_google_ai_studio_gemini.py): bubble up thoughtsignature back to client
2025-08-30 17:26:18 -07:00
Ishaan Jaff
dea3b53578
UI new build
2025-08-30 17:13:48 -07:00
Krrish Dholakia
599071321d
fix(braintrust_logging.py): refactor to consistently use standard logging payload
2025-08-30 16:24:03 -07:00
Krrish Dholakia
9cffabb433
refactor(braintrust_logging.py): migrate braintrust logging to standard logging payload
...
avoids issue with span in request metadata
standard logging payload is always json serializable
2025-08-30 16:17:57 -07:00
Krrish Dholakia
cb5464421f
fix(braintrust_logging.py): filter metadata before logging
...
avoid unserializable json
2025-08-30 16:11:39 -07:00
tanjiro
ce8e24fea8
Merge branch 'main' into teams-on-users-page
2025-08-31 07:51:13 +09:00
Ishaan Jaff
ccb7ce03a3
[Docs] v1.76.1-stable ( #14094 )
...
* docs 1.76.1
* fix docs
* docs 1.76.1
* New Model Support
* docs fixes
2025-08-30 14:54:27 -07:00
John Lathouwers
cf5a695571
Merge branch 'BerriAI:main' into main
2025-08-30 22:03:39 +01:00
gotsysdba
07d9d14b49
Update OCIResposeClass
2025-08-30 22:02:00 +01:00
Ishaan Jaff
34275ab273
Revert "Merge pull request #14005 from moshemorad/bedrock_fix_structure_output"
...
This reverts commit 75c327cb9eafa687182a
2025-08-30 13:37:10 -07:00
Ishaan Jaff
48d3aad68f
test_caching_with_models_v2
2025-08-30 13:21:14 -07:00
John Lathouwers
d137371026
Merge branch 'BerriAI:main' into main
2025-08-30 21:17:28 +01:00
gotsysdba
1ae5466daf
Test Case
2025-08-30 21:15:54 +01:00
Ishaan Jaff
c9b86775a7
test_system_message_with_no_user_message
2025-08-30 13:09:25 -07:00
Ishaan Jaff
7ff93cd1b1
Revert "Merge pull request #12865 from aholmberg/holmberg/default-reasoning"
...
This reverts commit 68f4847659df39320889
2025-08-30 13:07:33 -07:00
gotsysdba
a27604b67a
Fixes #14090
2025-08-30 20:57:57 +01:00
Ishaan Jaff
3cb8e23dfe
Revert "Merge pull request #14026 from TomeHirata/citation-supported-text"
...
This reverts commit afa687182a55186dad4c
2025-08-30 11:23:18 -07:00
Ishaan Jaff
dc6161535a
fix for supports_reasoning check added in 68f4847659
2025-08-30 11:06:02 -07:00
Ishaan Jaff
de6b08e76e
test_supports_tool_choice
2025-08-30 10:35:16 -07:00
Ishaan Jaff
3fc2198d27
fix: test_gemini_image_generation_async_stream
2025-08-30 10:33:23 -07:00
Ishaan Jaff
efebf7ec7b
test_gemini_image_generation_async
2025-08-30 10:29:24 -07:00
Ishaan Jaff
fa4c833e58
fix: supports reasoning
2025-08-30 10:29:08 -07:00
Ishaan Jaff
fd39f22e3e
test_completion_openrouter_reasoning_content
2025-08-30 09:27:37 -07:00
superpoussin22
7ed4a84393
Fix indentation in get_llm_provider_logic.py ( #14088 )
...
* Fix indentation in get_llm_provider_logic.py
fix missing closing )
* Fix indentation in get_llm_provider_logic.py
fix typo
2025-08-30 09:24:41 -07:00
Krish Dholakia
4d0c1a1769
Merge pull request #13144 from joshualipman123/add-vercel-ai-gateway-provider
...
Add Vercel AI Gateway provider
2025-08-29 22:27:20 -07:00
Krish Dholakia
8b11452d9e
Merge branch 'main' into add-vercel-ai-gateway-provider
2025-08-29 22:27:08 -07:00
Krish Dholakia
ead7e7259b
Merge pull request #13152 from betterthanbreakfast/bug-openmeter-user-id-from-token
...
[Bug]: Set user from token user_id for OpenMeter integration
2025-08-29 22:21:26 -07:00
Krish Dholakia
85640e57cd
Merge pull request #14075 from BerriAI/fix-collapsible-nav
...
Fix collapsible navbar design
2025-08-29 22:16:25 -07:00
Krish Dholakia
75c327cb9e
Merge pull request #14005 from moshemorad/bedrock_fix_structure_output
...
Bedrock fix structure output
2025-08-29 22:04:51 -07:00
Krish Dholakia
afa687182a
Merge pull request #14026 from TomeHirata/citation-supported-text
...
Add supported text field to anthropic citation response
2025-08-29 22:02:18 -07:00
Krrish Dholakia
55186dad4c
fix: fix linting error
2025-08-29 21:53:37 -07:00
Zain Hasan
8a5df2eb74
update together models
...
- add tool choice for models
- add deepseek v3.1
2025-08-30 00:44:42 -04:00
Ishaan Jaff
562790cb31
fix: /v1/realtime check
2025-08-29 18:38:14 -07:00
Ishaan Jaff
37d885e46a
[Fix] LiteLLM does not support new web_search tool (Responses API) ( #14083 )
...
* test_basic_openai_responses_with_websearch
* fix: ResponsesAPIResponse
* fix: StandardBuiltInToolCostTracking
2025-08-29 18:33:52 -07:00
frankzye1
75a7b39700
pass function tool description for databricks provider
...
Signed-off-by: frankzye1 <frankzye@qq.com>
2025-08-30 09:27:39 +08:00
Ishaan Jaff
d9ca0f9300
security: fix next js version ( #14084 )
2025-08-29 18:09:11 -07:00
Ishaan Jaff
be86861eb8
feat: add gpt-realtime models - gpt-realtime ( #14082 )
...
* feat: add gpt-realtime models
* add input_cost_per_image
2025-08-29 17:49:47 -07:00
WilsonSunBritten
6d81d75948
docs: Add documentation for MAX_STRING_LENGTH_PROMPT_IN_DB environment variable ( #14079 )
...
Added documentation for the new MAX_STRING_LENGTH_PROMPT_IN_DB environment variable to the config settings guide. This variable controls the maximum length of strings in spend logs when sanitizing request bodies, with a default value of 1000 characters.
🤖 Generated with [Claude Code](https://claude.ai/code )
Co-authored-by: Claude <noreply@anthropic.com>
2025-08-29 17:38:50 -07:00
Ishaan Jaff
5ee7a675f2
[Bug]: grok-4 does not support frequency_penalty, litellm should drop this param for grok-4 ( #14078 )
...
* fix: _supports_frequency_penalty
* _supports_frequency_penalty
* test_xai_grok_4_frequency_penalty_not_supported
2025-08-29 17:31:48 -07:00
Mubashir Osmani
38df2500b6
docs: usaged-based routing perf warnings ( #14080 )
2025-08-29 17:31:12 -07:00
Krrish Dholakia
86c5de17bc
fix(handle_jwt.py): document the raw received jwt token
2025-08-29 14:53:07 -07:00
Ishaan Jaff
607f425cc6
[Bug]: Fix Can't set reasoning_effort for DeepSeek-V3.1 on DeepInfra by default ( #14053 )
...
* fix DeepInfraConfig
* track supports reasoning
* fix: get_supported_openai_params
* test_deepseek_supported_openai_params
2025-08-29 13:15:43 -07:00
