Commit Graph

30881 Commits

Author SHA1 Message Date
Ishaan Jaff
dbb651ea95 remove old mapped test 2025-08-07 13:51:50 -07:00
Ishaan Jaff
621b3dca7b
[Bug Fix] Mistral Tool Calling - Grammar error: at 3(11): failed to compile JSON schema (#13389)
* test_claude_tool_use_with_gemini

* add _remove_json_schema_refs

* add _clean_tool_schema_for_mistral

* fixes mistral tool calls

* _remove_json_schema_refs

* fix - vertex, remove hardcoded test
2025-08-07 13:50:22 -07:00
Parham Alvani
849c262a02
fix: we need to have project files for running migration using this image (#13379) 2025-08-07 13:31:10 -07:00
Ishaan Jaff
984f91f4f5 test_completion_gemini_stream 2025-08-07 13:24:00 -07:00
Ishaan Jaff
70ddde2215 fix - remove dup model entries 2025-08-07 13:22:00 -07:00
Ishaan Jaff
d9f9465bc2 fix models by provider 2025-08-07 13:20:28 -07:00
Ishaan Jaff
b7ced315dd fix - publish new PIP / prisma migrations 2025-08-07 13:18:45 -07:00
Ishaan Jaff
08ac2aeb6d
Revert "Fix SSO Logout | Create Unified Login Page with SSO and Username/Password Options (#12703)" (#13387)
This reverts commit a752d7acc9.
2025-08-07 13:13:05 -07:00
Ishaan Jaff
2e767c8faf
[Feat] add azure/gpt-5 model family (#13385)
* add azure/gpt-5 model family

* add azure gpt-5 model family

* fixes for gpt-5

* add azure/gpt-5 model family
2025-08-07 12:50:37 -07:00
Timothy Lowrimore
14155b717d
Merge branch 'main' into heroku-llms 2025-08-07 13:27:04 -06:00
Ishaan Jaff
087a1a622c
feat: Add GPT-5 model family with official OpenAI specifications (#13… (#13386)
* feat: Add GPT-5 model family with official OpenAI specifications (#13378)

* Add GPT-5 model family support

Added four new GPT-5 models:
- gpt-5: Flagship model for logic and multi-step tasks
- gpt-5-mini: Cost-sensitive version for budget use cases
- gpt-5-nano: Speed-optimized version for low latency
- gpt-5-chat: Enterprise-focused version for advanced conversations

* Update GPT-5 models with official OpenAI specifications

- Add gpt-5-chat-latest with 400k context, 128k output tokens
- Add gpt-5-2025-08-07 with enhanced reasoning capabilities
- Add gpt-5-mini-2025-08-07 with cost-optimized pricing
- Add gpt-5-nano-2025-08-07 with ultra-fast performance
- Update existing gpt-5, gpt-5-mini, gpt-5-nano to match dated versions
- All models now support reasoning tokens and 400k context window
- Pricing updated per official OpenAI documentation

* fix conflicts

---------

Co-authored-by: Cole McIntosh <82463175+colesmcintosh@users.noreply.github.com>
2025-08-07 11:58:37 -07:00
Ishaan Jaff
729e1f530a
feat - add claude-opus-4-1 on cost map (#13384) 2025-08-07 11:52:44 -07:00
Oz Ben-Ami
0c85fe4b70 Merge remote-tracking branch 'origin/main' into fix_vertex_expired_tokens 2025-08-07 14:52:04 -04:00
Low Jian Sheng
9e0ba10f23
Add GPT 5 models (#13377)
* add gpt 5 modesl

* update max tokens
2025-08-07 11:36:16 -07:00
Ishaan Jaff
4d941c914e
[Feat] Responses API Session Handling - Multi media support (#13347)
* rename ResponsesSessionHandler

* use ResponsesSessionHandler

* test session handler

* refactor ResponsesSessionHandler

* fix get_proxy_server_request_from_spend_log

* use constant for LITELLM_TRUNCATED_PAYLOAD_FIELD

* add _should_check_cold_storage_for_full_payload

* add get_class_type_for_custom_logger_name

* get_active_custom_logger_for_callback_name

* add get_proxy_server_request_from_cold_storage to CustomLogger

* add ColdStorageHandler

* start using cold storage integration

* add get_proxy_server_request_from_cold_storage

* fixes from manual testing

* s3 v2 fix getting region name

* ChatCompletionImageUrlObject

* use _get_configured_cold_storage_custom_logger

* fixes for _should_check_cold_storage_for_full_payload

* fix _download_object_from_s3

* test_s3_v2_with_cold_storage

* add cold_storage_object_key to StandardLoggingMetadata

* use get_proxy_server_request_from_cold_storage_with_object_key

* add cold_storage_object_key to SpendLogsMetadata

* add cold_storage_object_key

* get_proxy_server_request_from_cold_storage_with_object_key

* use get_proxy_server_request_from_cold_storage_with_object_key

* test responses API

* add get_proxy_server_request_from_cold_storage_with_object_key

* session handler fixes

* test session handler

* fix ruff checks

* _download_object_from_s3

* cleanup

* test

* lint fix

* test_e2e_cold_storage_successful_retrieval

* test_e2e_generate_cold_storage_object_key_successful

* test_async_gcs_pub_sub_v1

* test fix

* test fix

* test fix

* test_standard_logging_metadata_has_cold_storage_object_key_field

* test_sanitize_request_body_for_spend_logs_payload_basic

* test_transform_input_image_item_to_image_item_with_image_data
2025-08-07 10:59:53 -07:00
Timothy Lowrimore
d3809a7813
Merge branch 'main' into heroku-llms 2025-08-07 11:06:24 -06:00
Cole McIntosh
938e9ace54 Fix unclosed aiohttp client session warnings during concurrent requests
Fixed MyPy type error in Ollama completion transformation where finish_reason
was set to None instead of expected string type. Changed finish_reason=None to
finish_reason="" to match GenericStreamingChunk TypedDict requirements.

Also updated corresponding test to expect empty string instead of None.
2025-08-07 10:55:33 -06:00
breno-aumo
e8b4b25774
Update OCI docs (#13336)
* add oci models to model_prices_and_context_window.json

* remove unsupported and unavailable oci models from docs
2025-08-07 09:45:17 -07:00
unique-jakub
f58807ff6e
Add labels to migrations job template (#13343)
* set labels on the migration job

* update comment to retrigger the pipeline
2025-08-07 09:41:24 -07:00
Cole McIntosh
e1a2bfb63a Fix Ollama GPT-OSS streaming with 'thinking' field
- Handle chunks containing 'thinking' field with empty 'response'
- Treat these as intermediate chunks that don't contain user content
- Add comprehensive tests for chunk parsing scenarios
- Resolves APIConnectionError for GPT-OSS model streaming

Fixes #13340
2025-08-07 09:49:33 -06:00
Anand Khinvasara
96dca4eff8
fix: 12152 - Redacted sensitive information logged in bedrock guardrails (#13356) 2025-08-07 08:42:11 -07:00
Edward D'Amato
30fc5b871c
feat(integrations): allow setting of braintrust callback base url (#13368)
* feat(integrations): allow setting of braintrust callback base url

* chore(misc): remove extra additions due to merge
2025-08-07 08:40:11 -07:00
Yikai Zhao
4fdeff8e1a Fix token_counter with special token input 2025-08-07 22:58:07 +08:00
tanjiro
7d978f0ffc
provider logos on usage page (#13372) 2025-08-07 07:41:30 -07:00
Ishaan Jaff
dfada882f1 vtx test fix gemini-2.5-flash-lite 2025-08-07 00:11:10 -07:00
Ishaan Jaff
9c5e9d7362
add groq/openai/gpt-oss (#13363) 2025-08-07 00:08:18 -07:00
Jugal D. Bhatt
043c12b11e
added token breakdown in ui (#13357) 2025-08-06 19:03:58 -07:00
Jugal D. Bhatt
b7325f4765
[MCP Gateway] Added route check for internal users (#13350)
* added route check

* fix ruff
2025-08-06 15:32:21 -07:00
Timothy Lowrimore
791c6126a4 updates price and context window for heroku models 2025-08-06 15:14:36 -06:00
Timothy Lowrimore
ecda9b1f22 removes redefinition of GroqChatCompletion 2025-08-06 14:30:14 -06:00
Timothy Lowrimore
555579f42b adds tool calling test 2025-08-06 14:23:55 -06:00
Jugal D. Bhatt
c3cc10387e
added new migration files (#13345) 2025-08-06 13:12:39 -07:00
yeahyung
a92bf8173e
Fix create, search vector store error (#13285)
* (#13284) add avector_store_create to route_type which doesn't require model

* (#13284) exclude hidden params in metadata when create vector store

* (#13284) fix lint error

* (#13284) keep metadata None if metadata is None(not empty dict)

* (#13284) add test code

* (#13284) change test code name

* (#13284) add avector_store_search to route_type which doesn't require model
2025-08-06 11:15:17 -07:00
Jugal D. Bhatt
b1a8968895
[MCP Gateway] fix auth on ui for bearer servers (#13312)
* fix auth on ui for bearer servers

* add tests and fixes

* fix tests
2025-08-06 09:46:10 -07:00
Ishaan Jaff
28a894cb06
[Feat] - New model - Add Bedrock gpt oss models - "openai.gpt-oss-20b-1:0", "openai.gpt-oss-120b-1:0" (#13342)
* add openai.gpt-oss-20b-1:0

* update BEDROCK_CONVERSE_MODELS

* openai.gpt-oss-20b-1:0 fixes

* fix PDF input
2025-08-06 09:24:04 -07:00
Timothy Lowrimore
1b2dc23e7a
Merge branch 'main' into heroku-llms 2025-08-06 10:11:52 -06:00
Ishaan Jaff
eeed03a78f test fix: gcp deprecated gemini-1.5-flash 2025-08-06 08:43:45 -07:00
Cole McIntosh
596592599a
feat: Add logo customization for LiteLLM admin UI (#12958)
* feat: Add logo customization for LiteLLM admin UI

- Add simple logo customization page under Settings > UI Theme
- Support custom logo URL with instant preview
- Clean reset to default functionality
- Wrap app with ThemeProvider for proper context
- Backend properly handles null/empty logo URLs

* style: Update save button to use indigo color and 'Save Changes' text for consistency

* fix: Restore CloudZero background job initialization

Address PR review feedback by restoring the _initialize_spend_tracking_background_jobs method
that handles both CloudZero and Prometheus background job initialization. This ensures
critical spend tracking functionality is not lost while preserving the logo customization feature.

Changes:
- Restore _initialize_spend_tracking_background_jobs method
- Replace inline Prometheus initialization with proper method call
- Maintain CloudZero background job setup for cost tracking
2025-08-06 08:10:08 -07:00
Krrish Dholakia
f74d9f1963 fix(pyproject.toml): fix version 2025-08-05 22:03:47 -07:00
Krish Dholakia
0da25fadc0
Exclude none fields on /chat/completion - fixes n8n bug + Allow calling /v1/models when end user over budget (#13320)
* fix(proxy_server.py): exclude none fields before returning

Fixes https://github.com/BerriAI/litellm/issues/13055

* test: add unit tests

* feat(auth_checks.py): allow info routes to work when end user over budget

Fixes https://github.com/BerriAI/litellm/issues/13286
2025-08-05 21:39:46 -07:00
Viktor Nagy
5702e5ee1f
Removed cache control 2025-08-06 06:18:12 +02:00
zjx20
92c525ddfe
feat(JinaAI): support multimodal embedding models (#13181)
* feat(JinaAI): support multimodal embedding models

* add test case

* add test

* fix test
2025-08-05 19:21:56 -07:00
Krish Dholakia
324cfe8bdc
fix(streaming_handler.py): include cost in streaming usage object (#13319)
Fixes https://github.com/BerriAI/litellm/issues/12689
2025-08-05 18:38:31 -07:00
Krrish Dholakia
2e3f564a39 fix: fix map 2025-08-05 18:33:36 -07:00
Ishaan Jaff
50c4a32c7d docs claude-opus-4-1-20250805 2025-08-05 18:02:22 -07:00
Ishaan Jaff
4c1adeaf67 bump: version 1.75.1 → 1.75.2 2025-08-05 17:53:15 -07:00
Krrish Dholakia
352b7ae913 build(model_prices_and_context_window.json): add vertex ai claude-opus-4.1
Add claude opus 4.1
2025-08-05 17:52:35 -07:00
Ishaan Jaff
da40b5ec47 bump litellm enterprise 2025-08-05 17:50:40 -07:00
Ishaan Jaff
0308a835b8 bump: version 0.1.17 → 0.1.18 2025-08-05 17:47:16 -07:00
Jugal D. Bhatt
b6fcda2f8a
[LLM Translation] Fix model group on clientside auth with API calls (#13314)
* fix unsupported operand type(s) for +=: 'NoneType' and 'str' on clientside auth creds for responses

* fix the client side auth to use correct metadata

* add more tests

* fix tests
2025-08-05 17:46:47 -07:00