litellm/litellm
Ishaan Jaff 1249385a99
[Feat] GEMINI CLI - Add Token Counter for VertexAI Models (#13558)
* add VertexAIModelInfo

* working API call to vertex ai

* add count_tokens MODE

* _construct_url

* test_vertex_ai_gemini_token_counting_with_contents
2025-08-12 20:53:47 -07:00
..
anthropic_interface
assistants
batch_completion
batches UI - Support 'batch' model health checks + make 'team-only' model concept clearer (#12770) 2025-07-19 14:30:38 -07:00
caching fix: fix check 2025-08-11 17:56:19 -07:00
completion_extras add support for reasoning_effort minimal (#13401) 2025-08-08 14:34:46 -07:00
endpoints/speech/speech_to_completion_bridge
experimental_mcp_client [MCP Gateway] Litellm mcp client list fail (#13114) 2025-07-30 15:23:19 -07:00
files
fine_tuning
google_genai [Bug Fix] Gemini-CLI Integration - ensure tool calling works as expected on generateContent (#13189) 2025-07-31 16:42:57 -07:00
images [Feat] Add Google AI Studio Imagen4 model family (#13065) 2025-07-28 21:25:40 -07:00
integrations [Feat] - Add key/team logging for Langfuse OTEL Logger (#13512) 2025-08-11 22:06:25 -07:00
litellm_core_utils Feat/sambanova embeddings (#13308) 2025-08-12 17:15:26 -07:00
llms [Feat] GEMINI CLI - Add Token Counter for VertexAI Models (#13558) 2025-08-12 20:53:47 -07:00
passthrough
proxy [Feat] GEMINI CLI - Add Token Counter for VertexAI Models (#13558) 2025-08-12 20:53:47 -07:00
realtime_api [LLM Translation] fix query params for realtime api intent (#12838) 2025-07-25 10:09:53 -07:00
rerank_api Add Hosted VLLM rerank provider integration (#12738) 2025-07-18 10:55:50 -07:00
responses [Feat] Working e2e flow for Responses API session management with media (#13456) 2025-08-08 18:28:10 -07:00
router_strategy [Feat] UI - Allow Adding LiteLLM Auto Router on UI (#12960) 2025-07-24 19:58:49 -07:00
router_utils Fix async retryer on .acompletion() + forward clientside headers - filter out content-type from clientside request (causes llm api call to hang) (#12886) 2025-07-22 19:50:05 -07:00
secret_managers Added handling for pwd protected cert files in AOAI CertificateCredential auth (#12995) 2025-07-28 21:34:54 -07:00
types [Feat] GEMINI CLI Integration - Add /countTokens endpoint support (#13545) 2025-08-12 16:19:58 -07:00
vector_stores [Feat] LLM API Endpoint - Expose OpenAI Compatible /vector_stores/{vector_store_id}/search endpoint (#12749) 2025-07-18 18:18:53 -07:00
__init__.py Feat/sambanova embeddings (#13308) 2025-08-12 17:15:26 -07:00
_logging.py [Proxy server] Add apscheduler log suppress (#13299) 2025-08-05 15:04:51 -07:00
_redis.py added redis iam auth (#13275) 2025-08-05 10:56:34 -07:00
_service_logger.py
_version.py
budget_manager.py
constants.py feat: add CometAPI provider support with chat completions and streaming (#13458) 2025-08-11 18:06:37 -07:00
cost_calculator.py [LLM Translation] Fix Model Usage not having text tokens (#13234) 2025-08-04 21:06:49 +05:30
cost.json
exceptions.py Anthropic - working mid-stream fallbacks (#13149) 2025-07-31 21:22:49 -07:00
main.py fix(main.py): add sambanova api base support to embeddings 2025-08-12 17:17:19 -07:00
model_prices_and_context_window_backup.json fix(main.py): add sambanova api base support to embeddings 2025-08-12 17:17:19 -07:00
mypy.ini
py.typed
router.py Litellm dev 08 07 2025 p1 (#13418) 2025-08-09 16:30:04 -07:00
scheduler.py
timeout.py
utils.py [Feat] GEMINI CLI - Add Token Counter for VertexAI Models (#13558) 2025-08-12 20:53:47 -07:00