Commit Graph

25451 Commits

Author SHA1 Message Date
Sameerlite
67e7ad5aa9 Add vertex live api passthrough with cost tracking 2025-09-27 00:55:47 +05:30
Sameerlite
9d4eb814d4 initial int live api 2025-09-25 22:40:54 +05:30
Krish Dholakia
d2f8787bdc
Merge pull request #14808 from eycjur/fix_load_credentials_in_token_counter_proxy
Fix load credentials in token counter proxy
2025-09-23 23:00:34 -07:00
Krish Dholakia
2e3e7de2eb
Merge pull request #14816 from leventov/no-streaming-logging
Fix concurrency/scaling when many Python threads do streaming using *sync* completions
2025-09-23 22:53:18 -07:00
Krish Dholakia
37ea89eff0
Merge pull request #14821 from hazyone/fix-13380
Fix: support claude code auth via subscription (anthropic)
2025-09-23 22:52:32 -07:00
Krish Dholakia
aede742db5
Merge pull request #14818 from akshoop/akshoop/fastuuid-dep-make-optional
Fix: make `fastuuid` an optional dependency for `proxy`, graceful fallback to stdlib `uuid`
2025-09-23 22:51:10 -07:00
Krish Dholakia
d59dec39d0
Merge pull request #14826 from Jetemple/sso-clear-button-fix
fix: SSO "Clear" button writes empty values instead of removing SSO config
2025-09-23 22:49:47 -07:00
Sameer Kankute
e132ad63f1
Merge pull request #14164 from TomeHirata/citation-supported-text-3
Add supported text field to anthropic citation response
2025-09-24 10:30:44 +05:30
Ishaan Jaff
f4ecf3ca72
[Feat] Fixes for LiteLLM Proxy CLI to Auth to Gateway (#14836)
* fix: error msg from updating key

* fix _create_new_cli_key

* fix validate_key_team_change

* fix interface for chat

* ruff fix

* fix auth for keys

* get_litellm_gateway_api_key

* fix chat

* test fix

* linting fix

* fix mypy

* test_validate_key_team_change_with_member_permissions
2025-09-23 19:43:32 -07:00
Ishaan Jaffer
e1b342604d test vertex test_get_token_url 2025-09-23 19:34:50 -07:00
Alex Shoop
ab2bd2a50f add check_fastuuid_usage.py script to check_code_and_doc_quality job 2025-09-24 10:45:59 +09:00
Alex Shoop
3573a36d71 isolated scope chngs 2025-09-24 10:33:39 +09:00
Alex Shoop
c919996470
Merge branch 'main' into akshoop/fastuuid-dep-make-optional 2025-09-24 10:31:09 +09:00
Krish Dholakia
e92a73d603
Merge pull request #14831 from otaviofbrito/minor/fix-context-caching-vertex
Vertex AI Context Caching: use Vertex ai API v1 instead of v1beta1 and accept 'cachedContent' param
2025-09-23 18:29:51 -07:00
Ishaan Jaffer
6964b5a67a test humanloop 2025-09-23 18:28:27 -07:00
Alex Shoop
b6247d0d77 code cov test script check_fastuuid_usage.py 2025-09-24 10:27:22 +09:00
Krish Dholakia
64a305f9dd
Merge pull request #14721 from dharamendrak/reuse-aiohttp-session-http-handler
feat: Add shared_session parameter for aiohttp ClientSession reuse
2025-09-23 18:07:32 -07:00
Krish Dholakia
d5ced7e068
Merge pull request #14639 from danielmklein/main
fix: update sonnet 4 configs to reflect million-token context window pricing
2025-09-23 18:06:15 -07:00
Ishaan Jaffer
a48273740d test fix 2025-09-23 17:46:09 -07:00
Ishaan Jaffer
ceb400eee9 Revert "Added model armor testing files basic"
This reverts commit 9d1878029d.
2025-09-23 17:45:44 -07:00
Ishaan Jaffer
79a6feb7ac generate_mock_mcp_server_config_record 2025-09-23 17:33:11 -07:00
Alexsander Hamir
8b9bd9bdb6
fix: added oracle to provider's list (#14835) 2025-09-23 17:21:19 -07:00
Ishaan Jaffer
eb72990aa6 test_get_valid_models_with_cli_pattern 2025-09-23 16:46:40 -07:00
Mubashir Osmani
fc1c39645a
docs: Letta Guide (#14798)
* fix: flaky passthrough tests

* Revert "fix: flaky passthrough tests"

This reverts commit ffe692e017600a8853ab7c31f95485958ab74c5f.

* fix: serialize prisma objects

* docs: added letta

* arranged endpoints in alphabetical order

* added user_api_key fields to custom auth docs

* user onboarding

* cleaning up

This reverts commit 40e2aade73632cea371c6092d766ba193f9ac4a3.

* cleaning up
This reverts commit ffe692e017600a8853ab7c31f95485958ab74c5f.

* Revert "fix: serialize prisma objects"

This reverts commit 1e7bd13c26dcac8bff1f818c39b2b78f22f0ba28.
2025-09-23 16:18:57 -07:00
Ishaan Jaff
fff1d1a9f9
Add Vertex AI Qwen3 models to pricing and context window (#14828)
Co-authored-by: Cursor Agent <cursoragent@cursor.com>
Co-authored-by: ishaan <ishaan@berri.ai>
2025-09-23 16:16:57 -07:00
Alexsander Hamir
bd0741fa22
fix: cache root cause (#14827)
* fix: cache root cause

Ensure values are set and retrieved with the expected type to avoid unnecessary checks and cache misses.

fix: undoing hard changes

* fix: removed unexpected errors

* fix: removed unnecessary changes
2025-09-23 16:15:15 -07:00
Ishaan Jaffer
aaebd83f31 test fixes 2025-09-23 16:07:01 -07:00
Ishaan Jaff
8443eff4a2
feat: add xai/grok-4-fast models (#14833) 2025-09-23 16:01:44 -07:00
Ishaan Jaffer
5fc70396ad test fix 2025-09-23 15:50:11 -07:00
Ishaan Jaff
e0526c4554
[Fix] Priority Reservation: keys without priority metadata receive higher priority than keys with explicit priority configurations. (#14832)
* add PriorityReservationSettings

* add priority_reservation_settings

* add _get_priority_weight

* docs update
2025-09-23 15:45:05 -07:00
Ishaan Jaffer
7e64df92a5 test_cli_sso_callback_regenerate_existing_key 2025-09-23 15:42:07 -07:00
Otavio Brito
2e7d9d1822 update example 2025-09-23 19:09:03 -03:00
Ishaan Jaffer
8d42eccc8a bump: version 1.77.3 → 1.77.4 2025-09-23 14:44:41 -07:00
Ishaan Jaffer
8016bcb1b9 test fix 2025-09-23 14:41:30 -07:00
Ishaan Jaffer
3f50196acf test fix 2025-09-23 14:40:11 -07:00
Ishaan Jaffer
bb6fb445c0 ui test fix 2025-09-23 14:34:08 -07:00
Otavio Brito
d6c9406608 update context cache param 2025-09-23 18:31:04 -03:00
Ishaan Jaffer
f8c1f519c9 test_aaamodel_prices_and_context_window_json_is_valid 2025-09-23 14:26:38 -07:00
Luiz Rennó Costa
620370e40c
fix: get metadata info from both metadata and litellm_metadata fields (#14783)
* fix: get metadata info from both metadata and litellm_metadata fields

* fix: implemented requested changes (metadata field doesnt always exist)

* chore: moved get_metadata_variable_name_from_kwargs to callback_utils so it can be used on get_model_group_from_litellm_kwargs

---------

Co-authored-by: Luiz Rennó Costa <luiz.renno@ifood.com.br>
2025-09-23 14:24:10 -07:00
Ishaan Jaffer
c87e6a849b fix mcp_servers_from_path 2025-09-23 14:21:23 -07:00
Ishaan Jaffer
45f835227b Revert "Merge pull request #14769 from TeddyAmkie/doc-updates-sept-2025"
This reverts commit 666bcac2af, reversing
changes made to b7803bcbb0.
2025-09-23 14:14:58 -07:00
Ishaan Jaffer
a88d774f94 Revert "Merge pull request #14720 from uc4w6c/feat/remove-servername-prefix-mcp_tools"
This reverts commit 7216983f48, reversing
changes made to e377e30e95.
2025-09-23 14:14:43 -07:00
Ishaan Jaffer
29a82c9773 fix ruff 2025-09-23 14:07:54 -07:00
Ishaan Jaffer
d91e533d8e refactor 2025-09-23 14:07:33 -07:00
Ishaan Jaffer
298b0a50a7 fix linting 2025-09-23 14:02:28 -07:00
Ishaan Jaffer
724d8b5afa fix linting 2025-09-23 14:01:48 -07:00
Ishaan Jaffer
426c6fea9f Revert "Merge pull request #14761 from uzaxirr/feat/sdk-additional-headers"
This reverts commit 8628c265b9, reversing
changes made to be193fbffd.
2025-09-23 13:59:54 -07:00
Jack Temple
1585a1ba8e fix: SSO clear button now properly clears settings instead of creating empty encrypted values 2025-09-23 14:35:53 -05:00
Ishaan Jaffer
38f54c79ea Revert "Merge pull request #14797 from BerriAI/litellm_anthopic_token_count_issue"
This reverts commit 8a012f9940, reversing
changes made to 7216983f48.
2025-09-23 12:31:02 -07:00
hazyone
96aed6a4d4 test added 2025-09-23 20:16:05 +02:00