ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
30,881 Commits 9 Branches 7 Tags 935 MiB
12bc66aa5b
Commit Graph

30881 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Krrish Dholakia
bb5e71447d fix(spend_management_endpoints.py): add end user filtering 2025-09-13 18:15:34 -07:00
Yuta Saito
0c1abf1a55 fix: recompute filters after deleting an MCP Server 2025-09-14 09:19:23 +09:00
Boopesh Shanmugam
95da14cb96
Docs update on user header mapping (#14527) 2025-09-13 16:58:10 -07:00
Ishaan Jaff
6172145014
fix: org budget update fix (#14541) 2025-09-13 16:34:26 -07:00
Krrish Dholakia
b6bca6369f fix(constants.py): make default num workers 1 2025-09-13 13:57:58 -07:00
Ishaan Jaff
9110af37d0 bump: version 1.77.1 → 1.77.2 2025-09-13 13:55:30 -07:00
Krrish Dholakia
dc4b09e26e build(ui/): new ui build 2025-09-13 13:48:27 -07:00
Krish Dholakia
6efc898407
Merge pull request #14523 from BerriAI/litellm_dev_09_12_2025_p1 
VLLM - transcription endpoint support + Ollama_chat/ - images, thinking, and content as list handling +
 2025-09-13 13:39:28 -07:00
Krrish Dholakia
459e66a9cd fix: fix test 2025-09-13 13:38:35 -07:00
Ishaan Jaff
6c27e5ce43 fix: DEFAULT_NUM_WORKERS_LITELLM_PROXY 2025-09-13 12:11:33 -07:00
Ishaan Jaff
252ec8e1ae test_normal_router_call_tpm_v3 2025-09-13 12:04:56 -07:00
Alexsander Hamir
44d209622b
fix: remove dynamic creation of static value (#14538) 2025-09-13 11:58:38 -07:00
Krish Dholakia
d75c0ff2c4
Merge branch 'main' into litellm_dev_09_10_2025_p1 2025-09-13 11:55:13 -07:00
Krrish Dholakia
8443000ca4 fix(main.py): route vllm calls via the openai sdk route 
consistent with other openai-like implementations
 2025-09-13 11:49:05 -07:00
Ishaan Jaff
26dafdc493 test fix: note this does not play nice with circleCI, it passes on local 2025-09-13 11:37:19 -07:00
Ishaan Jaff
ea280e1a6e _transform_messages: google ai studio 2025-09-13 11:31:19 -07:00
dependabot[bot]
d89c7f0eb7
build(deps): bump hono from 4.6.5 to 4.9.7 in /litellm-js/spend-logs (#14513) 
Bumps [hono](https://github.com/honojs/hono) from 4.6.5 to 4.9.7.
- [Release notes](https://github.com/honojs/hono/releases)
- [Commits](https://github.com/honojs/hono/compare/v4.6.5...v4.9.7)

---
updated-dependencies:
- dependency-name: hono
  dependency-version: 4.9.7
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-09-13 11:10:37 -07:00
Krrish Dholakia
a8e2d24d3a fix: fix import 2025-09-13 10:12:32 -07:00
Krish Dholakia
269515e525
Merge branch 'main' into litellm_dev_09_12_2025_p1 2025-09-13 10:10:30 -07:00
Ishaan Jaff
ec32a0a7d7 fix: get_base_completion_call_args 2025-09-13 09:59:08 -07:00
Krrish Dholakia
9ee9745781 docs(vllm.md): document new endpoint 2025-09-13 09:46:39 -07:00
Ishaan Jaff
69e451458c test_logging_opentelemetry_context_propagation 2025-09-13 09:44:36 -07:00
Krish Dholakia
38efd358eb
Merge pull request #14401 from Noma-Security/noma_non_blocking_monitor_mode 
Noma non blocking monitor mode & anonymize input support
 2025-09-13 09:41:41 -07:00
Krish Dholakia
550feffeb9
Merge pull request #14512 from timelfrink/fix/lm-studio-bearer-header-14502 
fix(lm_studio): resolve illegal Bearer header value issue
 2025-09-13 09:40:30 -07:00
Krish Dholakia
a6ba744085
Merge pull request #14529 from BerriAI/litellm_contributor_prs_09_12_2025_p1 
Fixed Log Tab Key Alias
 2025-09-13 09:39:28 -07:00
Krish Dholakia
ad9515a81e
Merge branch 'main' into litellm_contributor_prs_09_12_2025_p1 2025-09-13 09:38:43 -07:00
soojin
488b373835 test: add unit tests for response api bug fixes 2025-09-13 23:10:15 +09:00
soojin
9fcad0382c fix: improve response api handling and cold storage configuration 
- Fix s3_path configuration in cold storage logging to use actual logger instance path
- Add proper null/empty response validation in session handler to prevent processing invalid responses
 2025-09-13 22:01:45 +09:00
Tim Elfrink
1987556a50 Add CompactifAI provider documentation and config 
- Create comprehensive provider documentation with usage examples
- Cover basic completion, streaming, async, and function calling
- Document AWS Marketplace subscription and API key setup process
- Include proxy configuration and advanced parameter examples
- Add error handling examples and model information
- Update website sidebar to include CompactifAI in provider list
- Update README.md with CompactifAI provider reference
 2025-09-13 08:42:56 +02:00
Tim Elfrink
9402dc35aa Integrate CompactifAI provider into LiteLLM core 
- Add COMPACTIFAI to LlmProviders enum for type safety
- Register CompactifAIChatConfig in ProviderConfigManager
- Import CompactifAIChatConfig in main __init__.py
- Add 'compactifai/' model prefix detection in get_llm_provider()
- Wire CompactifAI completion handler in main.py routing logic
- Support COMPACTIFAI_API_KEY environment variable
- Enable base_llm_http_handler for OpenAI-compatible requests
- Maintain consistency with existing provider integration patterns
 2025-09-13 08:42:04 +02:00
Tim Elfrink
6925c113af Implement CompactifAI chat completion provider 
- Create CompactifAIChatConfig extending OpenAIGPTConfig for compatibility
- Handle authentication via COMPACTIFAI_API_KEY environment variable
- Set default API base to https://api.compactif.ai/v1
- Support OpenAI-compatible request/response transformation
- Implement JSON mode handling for tool calls
- Add proper model name prefixing with 'compactifai/' provider
- Leverage existing OpenAI infrastructure for minimal code complexity
 2025-09-13 08:41:47 +02:00
Tim Elfrink
e1329b03c6 Add comprehensive tests for CompactifAI provider 
- Test basic and streaming completions with proper mocking
- Cover authentication, parameter handling, and error scenarios
- Test provider detection and async functionality
- Verify request headers and response transformation
- Follow LiteLLM testing patterns with respx/httpx mocking
- Ensure full compatibility with OpenAI-style responses
 2025-09-13 08:41:30 +02:00
mubashir1osmani
6156590190 added spend metrics 2025-09-13 01:38:08 -04:00
mubashir1osmani
3cca2e95a7 fix lint errors 2025-09-13 00:17:57 -04:00
mubashir1osmani
fd11159148 fix: DD tool calls passed in metadata 2025-09-13 00:11:18 -04:00
Krish Dholakia
a11f50d8ba
Merge branch 'main' into litellm_dev_09_11_2025_p1 2025-09-12 19:59:28 -07:00
Krish Dholakia
de8cf40ffa
Merge pull request #14482 from BerriAI/litellm_dev_09_11_2025_p3 
Feature - new `litellm_request_debug=true` flag, enables emitting raw request/response log on single request
 2025-09-12 19:56:53 -07:00
Krish Dholakia
663dbc6080
Merge pull request #14477 from BerriAI/litellm_dev_09_11_2025_p2 
`/v1/messages` - don't send content block after message w/ finish reason + usage block + `/key/unblock` - support hashed tokens
 2025-09-12 19:51:44 -07:00
Ishaan Jaff
8b3b943557 docs fix 2025-09-12 19:51:14 -07:00
Krish Dholakia
e254d9013b
Merge pull request #14469 from sashank5644/litellm_log_key_alias_filtering 
Fixed Log Tab Key Alias filtering inaccurately for failed logs
 2025-09-12 19:46:17 -07:00
Krrish Dholakia
05e3e3685b docs(forward_client_headers.md): document new forwarding client headers to llm api feature 2025-09-12 19:38:07 -07:00
Ishaan Jaff
93af8fd6ba
[QA] E2E - Testing for bedrock batches api (#14525) 
* add bedrock/batch-anthropic.claude-3-5-sonnet-20240620-v1:0

* test_bedrock_batches_api

* fix

* fix import

* test_bedrock_batches_api
 2025-09-12 19:31:19 -07:00
Ishaan Jaff
93d6e9bf49 pip install "google-genai==1.22.0" 2025-09-12 19:30:47 -07:00
Ishaan Jaff
20c390dc71
[Docs] - Bedrock Batches API (#14526) 
* docs bedrock batch

* docs fix

* docs bedrock batches

* fix Create Batch Request

* docs fix
 2025-09-12 19:08:13 -07:00
Krrish Dholakia
6596c24d5c fix(litellm_pre_call_utils.py): add wildcard model support for forwardable model group headers 2025-09-12 18:45:24 -07:00
Ishaan Jaff
075a089d82
[Feat] Bedrock Batches - Ensure correct transformation applied to incoming requests (#14522) 
* use is_batch_jsonl_file

* fix valid_content_type

* fix transform_create_file_request

* fix _transform_openai_jsonl_content_to_bedrock_jsonl_content

* test_transform_openai_jsonl_content_to_bedrock_jsonl_content

* fix mypy linting errors

* fix BEDROCK_BATCH_MODEL

* fix working sample

* fix comment

* fix model list

* fix: use with managed batches

* refactor
 2025-09-12 18:32:57 -07:00
Krrish Dholakia
7a5e5a12da fix: fix linting errors 2025-09-12 18:03:50 -07:00
Krrish Dholakia
bdd960c451 docs(admin_ui_sso.md): clarify sso usage on docs 2025-09-12 18:03:03 -07:00
Krrish Dholakia
8ec02a5bdc test: add unit tests for ollama chat request transformation 2025-09-12 17:59:59 -07:00
Krrish Dholakia
461e181450 fix(ollama/chat): support images 
Fixes https://github.com/BerriAI/litellm/issues/14217
 2025-09-12 17:49:42 -07:00