Commit Graph

28908 Commits

Author SHA1 Message Date
Ishaan Jaff
424363fb1d
[Feat] Add New Google Interactions API on AI Gateway (#18081)
* init BaseInteractionsAPIConfig

* updated types for interactions API

* fix SDK level interactions API

* InteractionsAPIRequestUtils

* init base

* init interactions API

* init Interactions API Types

* init interactins API

* GoogleAIStudioInteractionsConfig

* init http handler

* remove file no longer needed

* test OPENAPI_SPEC_URL

* TestGoogleInteractionsCreate

* add google interctions routes

* init interactions api

* init interactions api

* new routes

* fix config

* working streaming interactons api
2025-12-17 02:20:23 +04:00
Ishaan Jaff
c727c8216f
[Feat] New Endpoint - Google Interactions API - added on litellm SDK (#18079)
* init BaseInteractionsAPIConfig

* updated types for interactions API

* fix SDK level interactions API

* InteractionsAPIRequestUtils

* init base

* init interactions API

* init Interactions API Types

* init interactins API

* GoogleAIStudioInteractionsConfig

* init http handler

* remove file no longer needed

* test OPENAPI_SPEC_URL

* TestGoogleInteractionsCreate
2025-12-17 02:18:51 +04:00
codgician
58e081b6e0
feat: add github_copilot model info (#17858) 2025-12-17 02:15:13 +04:00
Emerson Gomes
8df713b887
Add Azure DeepSeek V3.2 versions (#18019) 2025-12-17 01:01:57 +04:00
Ishaan Jaff
77b8004ab1
add brazil pii patterns (#18076) 2025-12-17 00:47:10 +04:00
Alexsander Hamir
233e89976a
Lazy load OpenAILikeChatConfig to avoid heavy import (#18075)
- Remove direct import of OpenAILikeChatConfig from llms.openai_like.chat.handler
- Add OpenAILikeChatConfig to LLM_CONFIG_NAMES for lazy loading
- Add handler in _lazy_import_llm_configs() to lazy load when accessed
- Add OpenAILikeChatConfig to TYPE_CHECKING block for type hints

This defers the import until OpenAILikeChatConfig is actually needed, improving import time.
2025-12-16 12:43:42 -08:00
Alexsander Hamir
9b440caac2
Lazy load ImageEditRequestUtils in images/main.py to avoid heavy import (#18074)
- Remove direct import of ImageEditRequestUtils from images.utils
- Add __getattr__ handler to lazy load ImageEditRequestUtils when accessed
- Create _get_ImageEditRequestUtils() helper function with caching
- Use importlib instead of sys to avoid importing sys inside functions
- Update image_edit() to use helper function for accessing ImageEditRequestUtils
- Add TYPE_CHECKING import for proper type hints

This defers the heavy import from images.utils until ImageEditRequestUtils is actually needed, improving import time when from .images.main import * is executed.
2025-12-16 12:28:33 -08:00
Alexsander Hamir
80d445a96f
feat: lazy load GuardrailItem following existing patterns (#18072)
- Add TYPES_NAMES tuple and _lazy_import_types function in _lazy_imports.py
- Remove direct import of GuardrailItem from __init__.py
- Add lazy loading handler in __getattr__ to dispatch type imports
- Add type stub for GuardrailItem in TYPE_CHECKING block
- Add test_types_lazy_imports test to verify lazy loading works
- Use from __future__ import annotations for forward reference support
- Follows same pattern as DOTPROMPT_NAMES and LLM_CONFIG_NAMES for consistency
2025-12-16 11:48:36 -08:00
yuneng-jiang
d918c7b8a3
Merge pull request #18071 from BerriAI/litellm_ui_hide_add_models
[Feature] UI - Add Models Conditional Rendering
2025-12-16 11:38:50 -08:00
yuneng-jiang
975edbcab2 Fixing build 2025-12-16 11:26:45 -08:00
yuneng-jiang
0487c610b8 Add Model Tab Visibility Changes 2025-12-16 11:25:43 -08:00
Alexsander Hamir
f177e4f1a3
[Refactor] litellm/init.py: lazy load encoding from main.py (#18070)
- Add __getattr__ in main.py to lazy load encoding when accessed
- Remove direct assignment of encoding = tiktoken.get_encoding() at module level
- Heavy tiktoken.get_encoding() call is now deferred until encoding is first accessed
- Follows existing lazy loading patterns
- All existing code using litellm.encoding continues to work
2025-12-16 11:19:59 -08:00
Alexsander Hamir
014c74fd06
[Refactor] litellm/init.py: lazy-load AmazonConverseConfig (#18069)
- Add LLM_CONFIG_NAMES tuple and _lazy_import_llm_configs function in _lazy_imports.py
- Remove direct import of AmazonConverseConfig from __init__.py
- Add lazy loading handler in __getattr__ to dispatch LLM config imports
- Add type stub for AmazonConverseConfig in TYPE_CHECKING block
- Add test_llm_config_lazy_imports test to verify lazy loading works
- Follows same pattern as DOTPROMPT_NAMES for consistency
2025-12-16 10:48:11 -08:00
Alexsander Hamir
8be2eac816
add warning about library imported on litellm/init (#18066) 2025-12-16 09:36:24 -08:00
Sameer Kankute
2b495f84ab
Merge pull request #18025 from BerriAI/litellm_staging_12_16_2025
Litellm staging 12 16 2025
2025-12-16 22:31:39 +05:30
Alexsander Hamir
06a499ccd0
[Refactor] litellm/init.py: lazy-load heavy client decorator imports (#18064) 2025-12-16 08:21:07 -08:00
Sameer Kankute
343319889c
Merge pull request #18063 from BerriAI/revert-17970-fix/auth-passthrough-enhancements
Revert "Fix get_model_from_request() to extract model ID from Vertex AI passthrough URLs"
2025-12-16 21:44:40 +05:30
Sameer Kankute
3661f8010f
Revert "fix(proxy): extract model from vertex ai passthrough url pattern (#17…"
This reverts commit ae7c994526.
2025-12-16 21:44:10 +05:30
Sameer Kankute
20bdada900
Merge pull request #18046 from BerriAI/litellm_fix_managed_files_endpoint
Fix managed files endpoint
2025-12-16 21:39:34 +05:30
Sameer Kankute
8864c6937c
Merge pull request #18031 from BerriAI/litellm_anthropic_claude_skills_int
Add support for agent skills in chat completion
2025-12-16 21:39:11 +05:30
Sameer Kankute
215857cce3
Merge branch 'main' into litellm_staging_12_16_2025 2025-12-16 21:38:14 +05:30
Sameer Kankute
755f024087 remove print statments 2025-12-16 21:37:09 +05:30
Sameer Kankute
fc5c5d4dbe
Merge pull request #18042 from BerriAI/litellm_embedding_default_omit
fix: Add none to encoding_format instead of omitting it
2025-12-16 21:35:29 +05:30
Sameer Kankute
abfa869030
Merge pull request #18049 from BerriAI/litellm_bedrock_ttl_issue
Remove ttl field when routing to bedrock
2025-12-16 21:34:57 +05:30
Sameer Kankute
616417eaaa
Merge pull request #18037 from BerriAI/litellm_fix_vertex_ai_headers
fix: skip adding beta headers for vertex ai as it is not suppported
2025-12-16 21:33:35 +05:30
Sameer Kankute
de5471e3cd
Merge pull request #18036 from BerriAI/litellm_fix_responses_headers
Add custom headers in responses API
2025-12-16 21:30:59 +05:30
Sameer Kankute
f23f157556 fix error: Incompatible types (expression has type dict[Any, Any] 2025-12-16 21:27:42 +05:30
Mateo Di Loreto
107ea9043a
[Feature] Download Prisma binaries at build time instead of at runtime for Security Restricted environments (#17695)
* Use config file to enable prometheus metrics

* Revert "Use config file to enable prometheus metrics"

This reverts commit 15ae36e1711791c0ac0a7aa84dcec142951717f5.

* Improve hardened stack and Prisma offline flow

* Document hardened compose usage

* Remove undesired change in fastapi-sso

* Restore dashboard lockfile

* Remove unecessary tempdirs

* Document hardened/offline Docker validation flow
2025-12-16 21:25:53 +05:30
Alexsander Hamir
8f976df651
[Refactor] litellm/init.py: lazy load default encoding from client decorator (#18059) 2025-12-16 07:45:24 -08:00
Alexsander Hamir
f8168f5063
[Refactor] litellm/init.py: lazy load dotprompt integration (#18056) 2025-12-16 07:18:11 -08:00
Alexsander Hamir
feb6924efe
[Refactor] litellm/init.py: lazy load .types.utils (#18054) 2025-12-16 06:42:17 -08:00
Alexsander Hamir
ea06fb70fb
refactor: lazy load bedrock types (#18053) 2025-12-16 06:05:01 -08:00
Alexsander Hamir
6ca812130b
[Refactor] litellm/init.py: lazy load LLMClientCache (#18008) 2025-12-16 05:44:06 -08:00
Sameer Kankute
0931d50461 Fix code quality check litellm_staging_12_16_2025 2025-12-16 16:30:41 +05:30
Sameer Kankute
6ccfb8b45e Remove ttl fiedl when routing to bedrock 2025-12-16 16:20:19 +05:30
Krish Dholakia
e31d8a1cf6
Router order parameter documentation (#18045)
* feat: Add deployment ordering for load balancing

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

* Refactor docs to simplify load balancing and deployment ordering explanations

Co-authored-by: krrishdholakia <krrishdholakia@gmail.com>

---------

Co-authored-by: Cursor Agent <cursoragent@cursor.com>
2025-12-16 15:57:05 +05:30
Sameer Kankute
6a3f0a8baf Add output file id in managed objects for batches 2025-12-16 15:52:07 +05:30
Sameer Kankute
3222b4e3a8 Add batch output file in managed table 2025-12-16 15:44:30 +05:30
Sameer Kankute
8ffffb4d15 Fix model getting twice 2025-12-16 15:43:55 +05:30
Nicolai van der Smagt
09ba89d4fe
fix: add headers to metadata for guardrails on pass-through endpoints (#17992)
Fixes #17477

Guardrails couldn't access request headers (like User-Agent) on Bedrock
pass-through endpoints because headers were only stored in
data["proxy_server_request"]["headers"] but not in data["metadata"]["headers"]
where guardrails typically look for them.

This fix adds headers to metadata in add_litellm_data_to_request() so
guardrails can access User-Agent, API keys, and other header-based checks
on all endpoints including Bedrock pass-through.

Test added to verify headers are available in metadata for guardrails.
2025-12-16 13:41:34 +05:30
Sameer Kankute
dbcae4aca5 fix: Add none to encoding_format instead of omitting it 2025-12-16 13:23:15 +05:30
Sameer Kankute
4c482186cd remove is_vertex param from request 2025-12-16 12:00:37 +05:30
Sameer Kankute
7a5e49a328 fix: skip adding beta headers for vertex ai as it is not suppported 2025-12-16 11:56:46 +05:30
Sameer Kankute
85907cebb5 Add custom headers in responses API 2025-12-16 11:31:15 +05:30
Krrish Dholakia
5e78ffd5fd fix: fix docker compose quick start 2025-12-16 11:26:38 +05:30
Krrish Dholakia
6041155de0 docs: cleanup 2025-12-16 11:21:41 +05:30
Sameer Kankute
1222d9e376 Add doc and tests for agent skils 2025-12-16 10:20:21 +05:30
Sameer Kankute
bcfc77f683 Add beta headers for claude skills 2025-12-16 10:12:36 +05:30
Sameer Kankute
9802a6a19e Add container field in streaming response 2025-12-16 10:02:07 +05:30
yuneng-jiang
0b5317c12b
Merge pull request #18030 from BerriAI/litellm_ui_milvus
[Feature] UI - Milvus Vector Store
2025-12-15 20:22:38 -08:00