litellm/docs/my-website/docs
Alexsander Hamir 30b28da2b7
Add pyroscope for observability (#21167)
* Pyroscope: require PYROSCOPE_APP_NAME and PYROSCOPE_SERVER_ADDRESS, add UTF-8 locale hint

- No defaults for PYROSCOPE_APP_NAME or PYROSCOPE_SERVER_ADDRESS; fail at startup if unset when Pyroscope is enabled
- Set LANG/LC_ALL to C.UTF-8 when unset to reduce malformed_profile (invalid UTF-8) rejections
- Startup message suggests PYTHONUTF8=1 if server rejects profiles
- Simplify LITELLM_ENABLE_PYROSCOPE in config_settings; document Pyroscope env vars as required with no default
- Add pyroscope_profiling to sidebar (Alerting & Monitoring)
- pyproject.toml: pyroscope-io as required dep on non-Windows (marker), in proxy extra

* proxy: add PYROSCOPE_SAMPLE_RATE env, use verbose logging, fix int type

- Add optional PYROSCOPE_SAMPLE_RATE env (integer, no default)
- Pass sample_rate to pyroscope.configure() as int for pyroscope-io
- Replace print with verbose_proxy_logger (info/warning)
- Document PYROSCOPE_SAMPLE_RATE in config_settings.md

* Address Greptile PR feedback: Pyroscope optional, docs, tests, docstring

- pyproject.toml: mark pyroscope-io as optional=true (proxy extra only)
- Add docs/my-website/docs/proxy/pyroscope_profiling.md (fix broken sidebar link)
- Add tests/test_litellm/proxy/test_pyroscope.py for _init_pyroscope()
- proxy_server: fix _init_pyroscope docstring (required server/app name, sample rate as int)

* Update litellm/proxy/proxy_server.py

Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>

---------

Co-authored-by: greptile-apps[bot] <165735046+greptile-apps[bot]@users.noreply.github.com>
2026-02-13 17:32:29 -08:00
..
adding_provider Generic Guardrails: Forward request headers + litellm_version to gene… (#20729) 2026-02-10 22:41:05 -08:00
anthropic_unified Add support for output formatfor bedrock invoke via v1/messages 2026-01-22 16:36:03 +05:30
caching docs: add redis initalization with kwargs 2026-01-15 23:15:54 -05:00
completion docs(web_search): add gpt-5-search-api usage examples for SDK and AI Gateway (#20616) 2026-02-12 19:58:12 +05:30
contribute_integration docs(community.md): add new integration partner doc 2025-12-09 18:17:14 -08:00
contributing [Feat] Allow adding OpenAI compatible chat providers using .json + add public ai provider (#17448) 2025-12-04 17:59:25 -08:00
debugging
embedding docs: improve Getting Started page and SDK documentation structure (#17614) 2025-12-08 13:05:50 -08:00
extras UI contributing and trouble shooting docs 2026-02-07 15:11:49 -08:00
guides Fix/per service ssl override v2 (#19538) 2026-01-21 20:10:04 -08:00
integrations Add doc for chat completion web search 2026-02-09 13:51:26 +05:30
langchain
observability langfuse doc update 2026-02-04 15:53:24 -08:00
pass_through Add support for langchain_aws via litellm passthrough 2026-02-10 13:37:17 +05:30
projects docs: add Microsoft GraphRAG to projects using LiteLLM (#17616) 2025-12-06 13:47:46 -08:00
provider_registration docs openai 2025-12-04 18:32:23 -08:00
providers feat(scaleway): add scaleway provider (#21121) 2026-02-13 08:37:58 -08:00
proxy Add pyroscope for observability (#21167) 2026-02-13 17:32:29 -08:00
search add search provider for brave search api (#19433) 2026-01-20 19:23:29 -08:00
secret_managers doc: improve secret manager settings 2025-12-19 07:06:26 +09:00
troubleshoot feat: MCP OAuth2 client-side debug headers (#21151) 2026-02-13 12:55:47 -08:00
tutorials docs: fix Claude Code MCP tutorial with correct config and URL patterns (#21145) 2026-02-13 12:12:38 -08:00
vector_stores Add vector store support for ragflow 2025-12-03 15:29:47 +05:30
a2a_agent_permissions.md [Docs] A2a - Permission management (#17515) 2025-12-04 17:29:47 -08:00
a2a_cost_tracking.md Importing Image in A2A Doc 2025-12-13 13:29:01 -08:00
a2a_invoking_agents.md [Feat] Use A2A registered agents with /chat/completions (#20362) 2026-02-03 15:25:38 -08:00
a2a.md [Feat] Use A2A registered agents with /chat/completions (#20362) 2026-02-03 15:25:38 -08:00
aiohttp_benchmarks.md
anthropic_count_tokens.md Handle not supported region for vertex ai count tokens - v1/messages/count_tokens (#18665) 2026-01-07 00:05:00 +05:30
apply_guardrail.md
assistants.md docs: improve Getting Started page and SDK documentation structure (#17614) 2025-12-08 13:05:50 -08:00
audio_transcription.md
batches.md add vllm batches 2025-12-14 12:36:07 -08:00
bedrock_converse.md
bedrock_invoke.md
benchmarks.md docs: add reference to example_openai_endpoint repo for self-hosting fake OpenAI proxy (#21006) 2026-02-11 18:00:21 -08:00
budget_manager.md
contact.md
container_files.md [Feat] Litellm new endpoint add container file upload (#18743) 2026-01-07 13:36:55 +05:30
containers.md [docs] add docs for containers files api + code interpreter on LiteLLM (#17749) 2025-12-09 18:11:28 -08:00
contributing.md docs: update UI contributing guide (#19353) 2026-01-19 06:18:45 -08:00
data_retention.md docs litellm cloud 2026-01-12 13:55:56 -08:00
data_security.md
default_code_snippet.md
enterprise.md docs: Add FAQ for setting up and verifying LITELLM_LICENSE (#20284) 2026-02-02 11:03:45 -08:00
exception_mapping.md
files_endpoints.md Add support for file content download for bedrock batches 2025-12-04 13:27:53 +05:30
fine_tuning.md
generateContent.md
image_edits.md Minor bug fixes: mask list 2025-12-19 23:04:53 +05:30
image_generation.md Add support for openrouter image generation endpoint 2026-01-14 10:15:02 +05:30
image_variations.md
index.md docs: replace ghcr link with docker.litellm.ai 2025-12-16 08:35:45 +05:30
interactions.md Litellm improve endpoint discovery (#18762) 2026-01-07 17:35:01 +05:30
load_test_advanced.md docs: add reference to example_openai_endpoint repo for self-hosting fake OpenAI proxy (#21006) 2026-02-11 18:00:21 -08:00
load_test_rpm.md
load_test_sdk.md
load_test.md docs: add reference to example_openai_endpoint repo for self-hosting fake OpenAI proxy (#21006) 2026-02-11 18:00:21 -08:00
mcp_control.md feat: add mcp registry 2026-01-09 15:07:39 +09:00
mcp_cost.md
mcp_guardrail.md feat: add support MCP guardrail to noma 2026-01-06 06:15:56 +09:00
mcp_oauth.md feat: MCP OAuth2 client-side debug headers (#21151) 2026-02-13 12:55:47 -08:00
mcp_public_internet.md docs 2026-02-06 18:30:17 -08:00
mcp_semantic_filter.md Litellm docs mcp filtering semantic (#20316) 2026-02-02 18:29:07 -08:00
mcp_troubleshoot.md feat: MCP OAuth2 client-side debug headers (#21151) 2026-02-13 12:55:47 -08:00
mcp_usage.md
mcp.md [Feat] MCP Oauth2 Fixes - Add support for MCP M2M Oauth2 support (#20788) 2026-02-09 17:35:11 -08:00
migration_policy.md
migration.md
moderation.md
ocr.md
oidc.md Fix CI: Revert security scan changes and add GitGuardian ignore rules (#18358) 2025-12-22 17:03:53 -08:00
old_guardrails.md
projects.md
proxy_api.md
proxy_auth.md docs: add SDK proxy authentication (OAuth2/JWT auto-refresh) documentation (#20680) 2026-02-07 22:57:04 -08:00
proxy_server.md
rag_ingest.md [Feat] RAG API - Add support for using s3 Vectors as Vector Store Provider for /rag/ingest (#19888) 2026-01-27 14:45:26 -08:00
rag_query.md [Feat] RAG query endpoint - Add RAG Search / Query endpoint (#18376) 2025-12-23 22:30:37 +05:30
realtime.md [Feat] Add xAI /realtime API Support - works with LiveKitSDK (#20381) 2026-02-03 19:58:28 -08:00
reasoning_content.md Put reasoning summary behind feat flag 2026-01-06 11:36:20 +05:30
rerank.md feat(voyage): add rerank API support (#17744) 2025-12-09 17:34:09 -08:00
response_api_compact.md [Feat] New API Endpoint - Responses API (v1/responses/compact) (#18697) 2026-01-06 16:24:04 +05:30
response_api.md [Feat] Adds Shell tool support for the OpenAI Responses API (#21063) 2026-02-12 13:04:29 -08:00
router_architecture.md
routing.md Fix: Slack alert issue 2026-02-02 16:49:10 +05:30
rules.md
scheduler.md
sdk_custom_pricing.md
secret.md
set_keys.md
skills.md
text_completion.md
text_to_speech.md docs: fix bad examples from sdk (#19322) 2026-01-19 10:27:25 -08:00
traffic_mirroring.md feat: add feature to make silent calls (#19544) 2026-01-27 09:16:53 -08:00
troubleshoot.md feat: MCP OAuth2 client-side debug headers (#21151) 2026-02-13 12:55:47 -08:00
vector_store_files.md
vertex_batch_passthrough.md
videos.md
wildcard_routing.md