Commit Graph

20050 Commits

Author SHA1 Message Date
Ishaan Jaff
2ca2ecacb5 fix responses_api 2025-03-12 17:39:07 -07:00
Ishaan Jaff
d4ed384984 working spend tracking + logging for response api 2025-03-12 17:29:25 -07:00
Ishaan Jaff
98718f6f09 working responses_api 2025-03-12 17:26:12 -07:00
Ishaan Jaff
7546dfde41 use correct get custom headers 2025-03-12 17:16:51 -07:00
Ishaan Jaff
f2041762e6 add responses_api 2025-03-12 17:08:16 -07:00
Ishaan Jaff
b2d9935567 use ProxyBaseLLMRequestProcessing 2025-03-12 16:54:33 -07:00
Ishaan Jaff
d808fa3c23 test_openai_responses_litellm_router 2025-03-12 16:13:48 -07:00
Ishaan Jaff
89d30d39f6 factory_function 2025-03-12 15:27:34 -07:00
Ishaan Jaff
32688df0c2 _generic_api_call_with_fallbacks 2025-03-12 15:26:37 -07:00
Krrish Dholakia
450935b6b9 build(pyproject.toml): bump openai version for responses types 2025-03-12 15:00:35 -07:00
Krish Dholakia
87733a9d16
Merge pull request #9124 from BerriAI/litellm_dev_03_10_2025_p3
Support credential management on Proxy - via CRUD endpoints - `credentials/*`
2025-03-12 14:56:16 -07:00
Krish Dholakia
2d957a0ed9
Merge branch 'main' into litellm_dev_03_10_2025_p3 2025-03-12 14:56:01 -07:00
Ishaan Jaff
50926b386a
Merge pull request #9155 from BerriAI/litellm_responses_api_support
[Feat] Add OpenAI Responses API to litellm python SDK
2025-03-12 13:57:55 -07:00
Ishaan Jaff
aa72f95a06 "openai==1.66.1" in testing 2025-03-12 13:00:59 -07:00
Ishaan Jaff
2460f3cbab test_validate_environment 2025-03-12 12:57:40 -07:00
Ishaan Jaff
f88380cfdf TestResponseAPILoggingUtils 2025-03-12 12:45:03 -07:00
Ishaan Jaff
f6f5420f0a TestResponsesAPIRequestUtils 2025-03-12 12:42:20 -07:00
Krrish Dholakia
b8d1166e0c fix(llm_caching_handler.py): handle no current event loop error 2025-03-12 12:29:25 -07:00
Ishaan Jaff
39d391d8e7 Optional[Dict] 2025-03-12 12:29:13 -07:00
Krrish Dholakia
7a8165eaba fix(llm_caching_handler.py): Add event loop to llm client cache info
Fixes https://github.com/BerriAI/litellm/issues/7667
2025-03-12 12:24:24 -07:00
Ishaan Jaff
de473bee4b fix mypy linting errors 2025-03-12 12:13:19 -07:00
Ishaan Jaff
342741ede1 Merge branch 'main' into litellm_responses_api_support 2025-03-12 12:04:12 -07:00
Krrish Dholakia
c7ceeaa4d7 fix(pass_through_endpoints.py): fix linting error 2025-03-12 12:00:05 -07:00
Ishaan Jaff
c6a9e8cafe typing_extensions Annotated 2025-03-12 11:58:56 -07:00
Ishaan Jaff
6702e492f5 pip install openai==1.66.1 2025-03-12 11:56:34 -07:00
Ishaan Jaff
1f7c21fd1b remove infinit loop for streaming 2025-03-12 11:55:17 -07:00
Ishaan Jaff
9ea0c89a2d bump to openai==1.66.1 2025-03-12 11:52:03 -07:00
Ishaan Jaff
595af6898f llm_responses_api_testing 2025-03-12 11:51:22 -07:00
Ishaan Jaff
d2c79199b1 bump to 1.66.1 2025-03-12 11:48:53 -07:00
Ishaan Jaff
181072e15d fix code quality checks 2025-03-12 11:47:10 -07:00
Ishaan Jaff
1b50e6d65f openai 1.66.1 2025-03-12 11:44:16 -07:00
Ishaan Jaff
e6b696370b BaseLiteLLMOpenAIResponseObject 2025-03-12 11:39:51 -07:00
Ishaan Jaff
daea59a7b4 test openai responses streaming 2025-03-12 11:32:26 -07:00
Ishaan Jaff
accdaa4a74 fix ResponseAPILoggingUtils 2025-03-12 11:12:09 -07:00
Ishaan Jaff
d6351c3433 test_basic_openai_responses_api 2025-03-12 10:07:03 -07:00
Ishaan Jaff
35e9bba154 _handle_logging_completed_response 2025-03-12 09:42:48 -07:00
Ishaan Jaff
d6a49f6b66 explictly pass params to partial func 2025-03-12 09:37:38 -07:00
Ishaan Jaff
ffa4978f8a ResponsesAPIRequestUtils 2025-03-12 09:36:08 -07:00
Ishaan Jaff
58acf23c3e STREAM_SSE_DONE_STRING 2025-03-12 09:33:28 -07:00
Ishaan Jaff
aa250088b2 re-use base_llm_http_handler 2025-03-12 09:31:34 -07:00
Ishaan Jaff
047879c004 add aresponses 2025-03-12 09:22:44 -07:00
Ishaan Jaff
e4cda0a1b7 add SyncResponsesAPIStreamingIterator 2025-03-12 09:18:25 -07:00
Ishaan Jaff
3bf2fda128 add conftest 2025-03-12 09:17:27 -07:00
Ishaan Jaff
cc5c25a96c
Merge pull request #8019 from sfarthin/stevefarthing/bing-search-pass-thru
Bing Search Pass Thru
2025-03-12 07:30:29 -07:00
Ishaan Jaff
c2dbcb798f working streaming logging + cost tracking 2025-03-12 07:27:53 -07:00
Ishaan Jaff
46bc76d3e6 _get_assembled_streaming_response 2025-03-12 07:21:03 -07:00
Ishaan Jaff
122c11d346 revert to older logging implementation 2025-03-12 07:14:36 -07:00
Ishaan Jaff
fde75a068a working streaming logging 2025-03-12 00:02:39 -07:00
Ishaan Jaff
4ff6e41c15 ResponsesAPIStreamEvents 2025-03-11 23:42:35 -07:00
Krrish Dholakia
982d32ab91 docs(bedrock.md): add amazon nova to docs 2025-03-11 23:13:28 -07:00