Krish Dholakia
2563c0ab2d
Merge pull request #14534 from hula-la/fix/response-api-bugfixes
...
fix: improve response api handling and cold storage configuration
2025-09-16 22:46:03 -07:00
Krish Dholakia
fcf84027e8
Merge pull request #14555 from mubashir1osmani/dd_spend_metric
...
DataDog shows spend metrics
2025-09-16 22:44:47 -07:00
Krish Dholakia
635dc72211
Merge pull request #14604 from Sameerlite/litellm_gemini_api_base_update
...
Litellm gemini api base update
2025-09-16 22:38:44 -07:00
Krish Dholakia
701b4fffee
Merge pull request #14600 from mubashir1osmani/fix_all_docs
...
docs: helicone integration and mcp
2025-09-16 22:37:38 -07:00
Krish Dholakia
92c82a682e
Merge pull request #14613 from ronaldpereira/patch-1
...
Fix error message for missing OCI parameters
2025-09-16 22:36:00 -07:00
Krish Dholakia
6bccdcd530
Merge pull request #14620 from BerriAI/litellm_dev_09_16_2025_p2
...
(feat) Anthropic - document pricing for cache creation tokens above 1hr
2025-09-16 22:33:11 -07:00
Krish Dholakia
cd53f25427
Merge pull request #14622 from ARajan1084/guardrail-key-configuration-fix
...
Fix: 14473: Guardrail view, edit, and delete behavior
2025-09-16 22:32:12 -07:00
Krrish Dholakia
8273630e08
test: update tests
2025-09-16 22:30:40 -07:00
Tim Elfrink
7eecba6a85
Implement AWS Bedrock CountTokens API support
...
- Add support for both Converse and InvokeModel input formats
- Implement endpoint handling in pass_through_endpoints
- Add transformation logic for AWS Bedrock CountTokens API
- Simplify model resolution using existing router patterns
- Support token counting for messages and raw text inputs
2025-09-17 07:30:31 +02:00
Mubashir Osmani
0fde408e35
added langfuse logging for responses api ( #14597 )
...
* added langfuse logging for responses api
* tests added
2025-09-16 21:43:19 -07:00
Oleksandr Tereshchenko
f507bf8881
Fix AttributeError: NoneType object has no attribute 'get' ( #14609 )
2025-09-16 21:38:01 -07:00
mubashir1osmani
439577fd35
fixed lint errors
2025-09-17 00:31:29 -04:00
mubashir1osmani
e56b11cb54
added tests
2025-09-17 00:19:03 -04:00
mubashir1osmani
fc7de7a1c5
added user_api_key_spend
2025-09-17 00:10:02 -04:00
=
626c48b783
removed problematic tooltips; used generic GuardrailSelector component
2025-09-16 19:42:53 -07:00
Krrish Dholakia
0e747aaaf1
test: fix test
2025-09-16 19:20:12 -07:00
Ishaan Jaff
93524cf19b
[Feat] Batches - Add bedrock retrieve endpoint support ( #14618 )
...
* feat: add bedrock retrieve endpoint
* feat: feat: add bedrock retrieve endpoint
* test: batches mocked transform
* ruff fix
* refactor
* fix transform
* fix: parse_timestamp
2025-09-16 19:19:02 -07:00
Krrish Dholakia
22d3e492f9
fix(test_utils.py): fix test
2025-09-16 19:17:44 -07:00
Krrish Dholakia
c1a33dcc5f
fix(types/utils.py): add cache_creation_input_token_cost_above_1hr to modelinfobase
2025-09-16 19:15:26 -07:00
Krrish Dholakia
e735808614
test(test_utils.py): fix cache creation tokens
2025-09-16 19:03:16 -07:00
Krrish Dholakia
97cc5f55d6
build(model_prices_and_context_window.json): add claude-3-5 haiku, claude-3-5 sonnet, claude-opus 3, claude-haiku 3 "cache_creation_input_token_cost_above_1hr" pricing
2025-09-16 18:58:49 -07:00
Krrish Dholakia
3188ae9281
build(model_prices_and_context_window.json): add claude-opus-4, claude-3-7-sonnet, claude-sonnet-4 "cache_creation_input_token_cost_above_1hr" pricing
2025-09-16 18:56:24 -07:00
Krrish Dholakia
a2bfd3e476
build(model_prices_and_context_window.json): add claude-opus-4-1 "cache_creation_input_token_cost_above_1hr" pricing
2025-09-16 18:53:56 -07:00
Krrish Dholakia
0fa11c3c25
build(model_prices_and_context_window.json): add "cache_creation_input_token_cost_above_1hr" to all claude-3-5-sonnet models
2025-09-16 18:52:37 -07:00
Krrish Dholakia
1c855385c9
build(model_cost): add cache_creation_input_token_cost_above_1hr pricing
2025-09-16 18:43:57 -07:00
Krrish Dholakia
0341e7fc09
fix: fix test
2025-09-16 18:34:24 -07:00
Krrish Dholakia
e488312873
fix(utils.py): log cache_creation_tokens in prompt token details
...
Closes LIT-907
2025-09-16 18:24:10 -07:00
Krrish Dholakia
1162c52692
fix(anthropic/chat/transformation.py): include cache creation token count in final prompt token value
...
Closes LIT-907
2025-09-16 17:52:12 -07:00
Krrish Dholakia
32f634e305
test: add unit testing
2025-09-16 16:54:03 -07:00
Krrish Dholakia
e69d9fde8a
fix(key_management_endpoints.py): include created by keys in /key/list
...
Allow user to see service account keys they've created
Fixes https://github.com/BerriAI/litellm/issues/14183
2025-09-16 16:47:25 -07:00
Sameer Kankute
ab1fb2b2e7
Add Support for Bedrock Guardrails to supportive selective Guarding ( #14575 )
...
* Add Support for Bedrock Guardrails to supportive selective Guarding
* Add method for better handling
* Add guarded_text content type
* Add guarded_text content type
* Update Dockerfile
* Update Dockerfile
2025-09-16 16:43:34 -07:00
Ishaan Jaffer
7de8811c4c
test
2025-09-16 16:33:10 -07:00
Alexsander Hamir
02db2e8ae8
[Performance] RPS Improvement +500 RPS when sending the user field ( #14616 )
...
* perf tool
* fix: cache type issue
* fix: exception hanging & cache setting
1. Removed unhandled exceptions
2. Set cache value to dict
2025-09-16 16:18:23 -07:00
Ishaan Jaffer
68105ce1a7
fix type
2025-09-16 15:41:52 -07:00
Ronald Pereira
0f5ab261df
Fix error message for missing OCI parameters
2025-09-16 16:37:22 -03:00
Fabrício Ceschin
2a3d84e4be
Merge branch 'BerriAI:main' into LangfuseUsageDetails
2025-09-16 09:26:52 -04:00
xprilion
470e1b7d2d
tinyfix json error
2025-09-16 16:47:51 +05:30
Anubhav Singh
a9667e5930
Merge branch 'BerriAI:main' into wandb-inference
2025-09-16 16:46:58 +05:30
Sameerlite
5b896d2757
make model param optional
2025-09-16 15:47:23 +05:30
Sameerlite
573230348d
fix lint error
2025-09-16 15:21:48 +05:30
Sameerlite
f08fc45a0f
add base url support for gemini
2025-09-16 15:15:24 +05:30
mubashir1osmani
a2d5bde837
changed docs
2025-09-16 00:58:08 -04:00
Krish Dholakia
f34bbd1f35
Merge pull request #14569 from talesofai/volcengine-fix-thinking-parameters-missing-if-not-set
...
fix volcengine thinking parameters missing when it set disable
2025-09-15 21:33:31 -07:00
Krish Dholakia
3f90fe938d
Merge pull request #14514 from iabhi4/fix-13581
...
feat(proxy): Assign default budget to auto-generated JWT teams
2025-09-15 21:22:25 -07:00
Krish Dholakia
f4e2870490
Merge pull request #14532 from timelfrink/feat/issue-14476-compactifai-provider
...
Add CompactifAI provider support
2025-09-15 21:15:00 -07:00
mubashir1osmani
f5f00043ce
fixed tests
2025-09-16 00:14:48 -04:00
Krish Dholakia
e368a0895f
Merge pull request #14542 from uc4w6c/fix/mcp-server-delete-refresh
...
fix: recompute filters after deleting an MCP Server
2025-09-15 21:12:55 -07:00
LingXuanYin
f8c9009fe5
add more test
2025-09-16 12:11:10 +08:00
Krish Dholakia
784eb18366
Merge pull request #14558 from iabhi4/fix-14536
...
fix(proxy): Correctly parse multi-part MCP server aliases from URL paths
2025-09-15 21:05:22 -07:00
Krish Dholakia
9d2cce43ba
Merge pull request #14583 from pazevedo-hyland/fix/bedrock_convert_layer
...
Fix: handle empty arguments in Bedrock tool call invocation
2025-09-15 20:57:45 -07:00
