litellm/docs/my-website
Ishaan Jaff 86cdb8382b
[Feat] Use aiohttp transport by default - 97% lower median latency (#11097)
* fix: add flag for disabling use_aiohttp_transport

* feat: add _create_async_transport

* feat: fixes for transport

* add httpx-aiohttp

* feat: fixes for transport

* refactor: fixes for transport

* build: fix deps

* fixes: test fixes

* fix: ensure aiohttp does not auto set content type

* test: test fixes

* feat: add LiteLLMAiohttpTransport

* fix: fixes for responses API handling

* test: fixes for responses API handling

* test: fixes for responses API handling

* feat: fixes for transport

* fix: base embedding handler

* test: test_async_http_handler_force_ipv4

* test: fix failing deepeval test

* fix: add YARL for bedrock urls

* fix: issues with transport

* fix: comment out linting issues

* test fix

* test: XAI is unstable

* test: fixes for using respx

* test: XAI fixes

* test: XAI fixes

* test: infinity testing fixes

* docs(config_settings.md): document param

* test: test_openai_image_edit_litellm_sdk

* test: remove deprecated test

* bump respx==0.22.0

* test: test_xai_message_name_filtering

* test: fix anthropic test after bumping httpx

* use n 4 for mapped tests (#11109)

* fix: use 1 session per event loop

* test: test_client_session_helper

* fix: linting error

* fix: resolving GET requests on httpx 0.28.1

* test fixes proxy unit tests

* fix: add ssl verify settings

* fix: proxy unit tests

* fix: refactor

* tests: basic unit tests for aiohttp transports

* tests: fixes xai

---------

Co-authored-by: Krrish Dholakia <krrishdholakia@gmail.com>
2025-05-23 22:55:35 -07:00
..
docs [Feat] Use aiohttp transport by default - 97% lower median latency (#11097) 2025-05-23 22:55:35 -07:00
img [feature] ConfidentAI logging enabled for proxy and sdk (#10649) 2025-05-23 11:40:48 -07:00
release_notes docs: cleanup 2025-05-19 22:10:04 -07:00
src Add new model provider Novita AI (#7582) (#9527) 2025-05-12 21:49:30 -07:00
static Add new documentation files for LiteLLM (#10961) 2025-05-19 15:17:44 -07:00
.gitignore Update contributing-to-documentation documentation to include pnpm guide (#10523) 2025-05-03 10:22:50 -07:00
babel.config.js
Dockerfile fix docs warning (#7419) 2024-12-25 16:42:14 -08:00
docusaurus.config.js docs(index.md): add release note for anthropic update 2025-03-05 23:50:26 -08:00
index.md
package-lock.json build(deps): bump undici from 6.21.1 to 6.21.3 in /docs/my-website (#10855) 2025-05-15 08:33:12 -07:00
package.json Revert "build(deps): bump axios, @docusaurus/core, @docusaurus/plugin-google-…" (#10421) 2025-04-29 17:33:47 -07:00
README.md
sidebars.js [feature] ConfidentAI logging enabled for proxy and sdk (#10649) 2025-05-23 11:40:48 -07:00

Website

This website is built using Docusaurus 2, a modern static website generator.

Installation

$ yarn

Local Development

$ yarn start

This command starts a local development server and opens up a browser window. Most changes are reflected live without having to restart the server.

Build

$ yarn build

This command generates static content into the build directory and can be served using any static contents hosting service.

Deployment

Using SSH:

$ USE_SSH=true yarn deploy

Not using SSH:

$ GIT_USER=<Your GitHub username> yarn deploy

If you are using GitHub pages for hosting, this command is a convenient way to build the website and push to the gh-pages branch.