litellm/litellm
Krish Dholakia 3a73309006
Add bedrock llama4 pricing + handle llama4 templating on bedrock invoke route (#10582)
* build(model_prices_and_context_window.json): add bedrock llama4 models to model cost map

* fix template conversion for Llama 4 models in Bedrock (#10557)

* test: add testing to repro https://github.com/BerriAI/litellm/pull/10557

* test: add unit testing

* test(test_main.py): refactor where test is kept

---------

Co-authored-by: aswny <87371411+aswny@users.noreply.github.com>
2025-05-06 16:06:24 -07:00
..
anthropic_interface docs anthropic messages interface 2025-03-31 16:53:39 -07:00
assistants Contributor PR - Support OPENAI_BASE_URL in addition to OPENAI_API_BASE (#9995) (#10423) 2025-04-29 21:27:37 -07:00
batch_completion
batches Contributor PR - Support OPENAI_BASE_URL in addition to OPENAI_API_BASE (#9995) (#10423) 2025-04-29 21:27:37 -07:00
caching Add customer + model per key level multi-instance tpm/rpm limiting (#10518) 2025-05-03 10:28:55 -07:00
experimental_mcp_client fix types on tools.py 2025-03-29 16:48:15 -07:00
files Contributor PR - Support OPENAI_BASE_URL in addition to OPENAI_API_BASE (#9995) (#10423) 2025-04-29 21:27:37 -07:00
fine_tuning Contributor PR - Support OPENAI_BASE_URL in addition to OPENAI_API_BASE (#9995) (#10423) 2025-04-29 21:27:37 -07:00
integrations fix typo (#10535) 2025-05-03 11:39:40 -07:00
litellm_core_utils Add bedrock llama4 pricing + handle llama4 templating on bedrock invoke route (#10582) 2025-05-06 16:06:24 -07:00
llms fix issue when databrick use external model, the delta could be empty content (#10540) 2025-05-05 21:18:45 -07:00
proxy Add litellm-proxy CLI (#10478) (#10578) 2025-05-05 21:29:57 -07:00
realtime_api Realtime API: Support 'base_model' cost tracking + show response in spend logs (if enabled) (#9897) 2025-04-10 21:24:45 -07:00
rerank_api build(pyproject.toml): add new dev dependencies - for type checking (#9631) 2025-03-29 11:02:13 -07:00
responses [Bug Fix] Responses API - fix for handling multiturn responses API sessions (#10415) 2025-04-29 17:22:47 -07:00
router_strategy Add key-level multi-instance tpm/rpm/max parallel request limiting (#10458) 2025-04-30 21:32:31 -07:00
router_utils [Feat] Add Support for DELETE /v1/responses/{response_id} on OpenAI, Azure OpenAI (#10205) 2025-04-22 18:27:03 -07:00
secret_managers Squashed commit of the following: (#9709) 2025-04-02 21:24:54 -07:00
types [Contributor PR] Support Llama-api as an LLM provider (#10451) (#10538) 2025-05-03 16:29:03 -07:00
vector_stores [Docs] Using LiteLLM with vector stores / knowledge bases (#10534) 2025-05-03 11:28:33 -07:00
__init__.py [Feat] v2 Custom Logger API Endpoints (#10575) 2025-05-05 16:57:55 -07:00
_logging.py fix debug logs 2025-05-06 14:28:20 -07:00
_redis.py Squashed commit of the following: (#9709) 2025-04-02 21:24:54 -07:00
_service_logger.py clean up service metrics 2025-04-02 17:50:41 -07:00
_version.py Virtual key based policies in Aim Guardrails (#9499) 2025-04-01 21:57:23 -07:00
budget_manager.py Squashed commit of the following: (#9709) 2025-04-02 21:24:54 -07:00
constants.py [Contributor PR] Support Llama-api as an LLM provider (#10451) (#10538) 2025-05-03 16:29:03 -07:00
cost_calculator.py Litellm dev 04 30 2025 p1 (#10462) 2025-04-30 22:11:12 -07:00
cost.json
exceptions.py Litellm dev 04 30 2025 p1 (#10462) 2025-04-30 22:11:12 -07:00
main.py [QA] Bedrock Vector Stores Integration - Allow using with registry + in OpenAI API spec with tools (#10516) 2025-05-03 08:30:38 -07:00
model_prices_and_context_window_backup.json Add bedrock llama4 pricing + handle llama4 templating on bedrock invoke route (#10582) 2025-05-06 16:06:24 -07:00
mypy.ini mypy tweaks (#10490) 2025-05-01 22:13:14 -07:00
py.typed
router.py [Feat] Add GET, DELETE Responses endpoints on LiteLLM Proxy (#10297) 2025-04-24 17:34:26 -07:00
scheduler.py Squashed commit of the following: (#9709) 2025-04-02 21:24:54 -07:00
timeout.py
utils.py [Feat] v2 Custom Logger API Endpoints (#10575) 2025-05-05 16:57:55 -07:00