litellm/litellm/llms
ishaan-berri a302613eb5
feat(bedrock): add support for bedrock-mantle endpoint (Claude Mythos Preview) (#26196)
* add anthropic.claude-mythos-preview to model_prices_and_context_window.json

* add mantle route to bedrock common_utils: route detection, chat config, messages config dispatch

* add AmazonMantleConfig for bedrock/mantle /chat/completions endpoint

* add AmazonMantleMessagesConfig for bedrock/mantle /messages endpoint

* register AmazonMantleMessagesConfig in __init__.py and lazy imports registry

* add unit tests for bedrock mantle route and config dispatch

* add e2e tests for bedrock mantle: URL, body, SigV4 header, region routing
2026-04-21 15:41:58 -07:00
..
a2a style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
ai21/chat
aiml
aiohttp_openai/chat
amazon_nova style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
anthropic Litellm krrish staging 04 20 2026 (#26138) 2026-04-20 16:22:12 -07:00
aws_polly
azure style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
azure_ai Merge branch 'litellm_internal_staging' into litellm_pages_support_for_ocr 2026-04-17 19:29:45 -07:00
base_llm Litellm krrish staging 04 20 2026 (#26138) 2026-04-20 16:22:12 -07:00
baseten
bedrock feat(bedrock): add support for bedrock-mantle endpoint (Claude Mythos Preview) (#26196) 2026-04-21 15:41:58 -07:00
bedrock_mantle/chat
black_forest_labs
brave/search
bytez
cerebras
chatgpt style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
clarifai/chat
cloudflare/chat
codestral/completion
cohere fix(proxy): OpenAI Moderation post-call guardrail response not captured for logging 2026-03-23 15:39:22 +01:00
cometapi
compactifai
custom_httpx Prompt Compression - add it to the proxy (#25729) 2026-04-20 15:08:00 -07:00
dashscope style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
databricks style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
dataforseo/search style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
datarobot/chat
deepgram
deepinfra style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
deepseek style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
deprecated_providers style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
docker_model_runner/chat style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
duckduckgo/search style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
elevenlabs
empower/chat
exa_ai/search style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
fal_ai
featherless_ai/chat
firecrawl style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
fireworks_ai style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
friendliai/chat
galadriel/chat
gemini style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
gigachat
github/chat
github_copilot [Fix] Apply black formatting to fix CI lint failures 2026-04-20 15:53:12 -07:00
google_pse/search style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
gradient_ai/chat
groq style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
heroku/chat style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
hosted_vllm style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
huggingface style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
hyperbolic
infinity
jina_ai
lambda_ai
langgraph
lemonade style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
linkup style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
litellm_proxy Merge remote-tracking branch 'origin' into litellm_oss_staging_04_09_2026 2026-04-10 16:41:27 -07:00
llamafile/chat
lm_studio
manus
meta_llama/chat
milvus/vector_stores
minimax style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
mistral Merge pull request #25256 from BerriAI/litellm_ishaan_april6 2026-04-17 16:26:45 -07:00
moonshot/chat style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
morph
nebius
nlp_cloud
novita/chat
nscale/chat
nvidia_nim style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
oci style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
ollama style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
oobabooga
openai Litellm krrish staging 04 20 2026 (#26138) 2026-04-20 16:22:12 -07:00
openai_like style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
openrouter style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
ovhcloud style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
parallel_ai/search style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
pass_through fix(proxy): OpenAI Moderation post-call guardrail response not captured for logging 2026-03-23 15:39:22 +01:00
perplexity style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
petals style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
pg_vector/vector_stores
predibase style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
ragflow
recraft
replicate
runwayml style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
s3_vectors
sagemaker style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
sambanova style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
sap style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
scaleway/audio_transcription Feature/add audio support for scaleway (#26110) 2026-04-20 14:49:41 -07:00
searchapi style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
searxng style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
serper/search style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
snowflake
stability style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
tavily/search style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
together_ai [Fix] TogetherAIConfig.get_supported_openai_params recursion 2026-04-16 17:20:58 -07:00
topaz
triton feat(triton): add embedding usage estimation for self-hosted responses (#25345) 2026-04-08 21:14:27 -07:00
v0
vercel_ai_gateway style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
vertex_ai style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
vllm
volcengine
voyage style: run black formatter on files from main merge 2026-04-17 13:02:59 -07:00
wandb
watsonx
xai
xinference/image_generation
zai
__init__.py Litellm oss staging 04 02 2026 p1 (#25055) 2026-04-08 21:37:10 -07:00
base.py
custom_llm.py
maritalk.py
README.md

File Structure

August 27th, 2024

To make it easy to see how calls are transformed for each model/provider:

we are working on moving all supported litellm providers to a folder structure, where folder name is the supported litellm provider name.

Each folder will contain a *_transformation.py file, which has all the request/response transformation logic, making it easy to see how calls are modified.

E.g. cohere/, bedrock/.