litellm/litellm
Krish Dholakia a65bfab697
Fix calling claude via invoke route + response_format support for claude on invoke route (#8908)
* fix(anthropic_claude3_transformation.py): fix amazon anthropic claude 3 tool calling transformation on invoke route

move to using anthropic config as base

* fix(utils.py): expose anthropic config via providerconfigmanager

* fix(llm_http_handler.py): support json mode on async completion calls

* fix(invoke_handler/make_call): support json mode for anthropic called via bedrock invoke

* fix(anthropic/): handle 'response_format: {"type": "text"}` + migrate amazon claude 3 invoke config to inherit from anthropic config

Prevents error when passing in 'response_format: {"type": "text"}

* test: fix test

* fix(utils.py): fix base invoke provider check

* fix(anthropic_claude3_transformation.py): don't pass 'stream' param

* fix: fix linting errors

* fix(converse_transformation.py): handle response_format type=text for converse
2025-02-28 17:56:26 -08:00
..
adapters (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
assistants Revert "fix: add missing parameters order, limit, before, and after in get_as…" (#7542) 2025-01-03 16:32:12 -08:00
batch_completion (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
batches (Feat - Batches API) add support for retrieving vertex api batch jobs (#7661) 2025-01-09 18:35:03 -08:00
caching (Redis fix) - use mget_non_atomic (#8682) 2025-02-20 17:51:31 -08:00
files (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
fine_tuning fix linting 2025-02-14 21:42:51 -08:00
integrations Litellm contributor prs 02 24 2025 (#8775) 2025-02-24 18:55:48 -08:00
litellm_core_utils fix caching on main branch (#8858) 2025-02-26 19:16:34 -08:00
llms Fix calling claude via invoke route + response_format support for claude on invoke route (#8908) 2025-02-28 17:56:26 -08:00
proxy Fix calling claude via invoke route + response_format support for claude on invoke route (#8908) 2025-02-28 17:56:26 -08:00
realtime_api (Refactor) - Re use litellm.completion/litellm.embedding etc for health checks (#7455) 2024-12-28 18:38:54 -08:00
rerank_api Add new gpt-4.5-preview model + other updates (#8879) 2025-02-27 15:27:14 -08:00
router_strategy fix code quality 2025-02-18 21:29:23 -08:00
router_utils (Router) - If allowed_fails or allowed_fail_policy set, use that for single deployment cooldown logic (#8668) 2025-02-25 15:15:01 -08:00
secret_managers fix: add default credential for azure (#7095) (#7891) 2025-01-21 09:01:49 -08:00
types vertex ai anthropic thinking param support (#8853) 2025-02-26 21:37:18 -08:00
__init__.py Fix calling claude via invoke route + response_format support for claude on invoke route (#8908) 2025-02-28 17:56:26 -08:00
_logging.py (sdk perf fix) - only print args passed to litellm when debugging mode is on (#7708) 2025-01-11 22:56:20 -08:00
_redis.py (Redis Cluster) - Fixes for using redis cluster + pipeline (#8442) 2025-02-12 18:01:32 -08:00
_service_logger.py fix svc logger (#7727) 2025-01-12 22:00:25 -08:00
_version.py
budget_manager.py (code quality) run ruff rule to ban unused imports (#7313) 2024-12-19 12:33:42 -08:00
constants.py Fix calling claude via invoke route + response_format support for claude on invoke route (#8908) 2025-02-28 17:56:26 -08:00
cost_calculator.py Add cohere v2/rerank support (#8421) (#8605) 2025-02-22 22:25:29 -08:00
cost.json
exceptions.py fix(main.py): fix key leak error when unknown provider given (#8556) 2025-02-15 14:02:55 -08:00
main.py fix(main.py): pass 'thinking' param on async completion call 2025-02-26 23:16:39 -08:00
model_prices_and_context_window_backup.json Install Node.js 2025-02-27 21:09:04 -08:00
py.typed
router.py (Observability) - Add more detailed dd tracing on Proxy Auth, Bedrock Auth (#8693) 2025-02-20 18:00:41 -08:00
scheduler.py
timeout.py
utils.py Fix calling claude via invoke route + response_format support for claude on invoke route (#8908) 2025-02-28 17:56:26 -08:00