Kyrylo Yefimenko
1946610efd
Fix Groq prices
2024-06-27 20:20:30 -07:00
corrm
2e7b0096d0
Improve ollama prompt: this formula give good result with AutoGen
2024-06-27 20:20:30 -07:00
corrm
ec36dd40d7
Rename ollama prompt:
...
- 'Function' word to 'FunctionName'
- 'Tool Call' to `FunctionCall`
- 'Tool Call Result' to 'FunctionCall Result'
_I found that changes make some models better_
2024-06-27 20:20:30 -07:00
Islam Nofl
cc261580ac
Rename ollama prompt 'Function' word to 'Name'
2024-06-27 20:20:30 -07:00
corrm
a7efb9c332
Added improved function name handling in ollama_async_streaming
2024-06-27 20:20:30 -07:00
corrm
5d5227294d
chore: Improved OllamaConfig get_required_params and ollama_acompletion and ollama_async_streaming functions
2024-06-27 20:20:30 -07:00
corrm
e1e8f5a00e
chore: Improved prompt generation in ollama_pt function
2024-06-27 20:20:30 -07:00
Krrish Dholakia
bb64c68daf
docs(routing.md): add quickstart
2024-06-27 20:20:30 -07:00
Krrish Dholakia
673696222d
fix(langfuse.py): cleanup
2024-06-27 20:20:30 -07:00
Ishaan Jaff
4d7b2e578c
bump: version 1.40.25 → 1.40.26
2024-06-27 20:20:30 -07:00
Ishaan Jaff
c5020878e4
/spend/calculate use model aliases on this endpoint
2024-06-27 20:20:30 -07:00
Ishaan Jaff
08f83e6392
test - aliases on /spend/calculate
2024-06-27 20:20:30 -07:00
Krrish Dholakia
690c7f6e47
fix(router.py): log rejected router requests to langfuse
...
Fixes issue where rejected requests weren't being logged
2024-06-27 20:20:30 -07:00
Ishaan Jaff
7a961e8a0b
docs control available public routes
2024-06-27 20:20:30 -07:00
Ishaan Jaff
412c1fc541
fix importing litellm
2024-06-27 20:20:29 -07:00
Ishaan Jaff
e7ff5014b1
example cofnig with public routes
2024-06-27 20:20:29 -07:00
Ishaan Jaff
fa5eb5c96f
add helper to check route_in_additonal_public_routes
2024-06-27 20:20:29 -07:00
Ishaan Jaff
556ef8dd18
test - spend/calculate endpoints
2024-06-27 20:20:29 -07:00
Ishaan Jaff
2cb4d845ae
feat - refactor /spend/calculate
2024-06-27 20:20:29 -07:00
Ishaan Jaff
bfae8c3da6
example config with public routes
2024-06-27 20:20:29 -07:00
Ishaan Jaff
e30410f700
feat - allow user to define public routes
2024-06-27 20:20:29 -07:00
Krrish Dholakia
a087596be0
fix(vertex_httpx.py): Return empty model response for content filter violations
2024-06-27 20:20:29 -07:00
Krrish Dholakia
6f2f89d7b2
fix(vertex_httpx.py): cover gemini content violation (on prompt)
2024-06-27 20:20:29 -07:00
Krrish Dholakia
438f65666b
fix(utils.py): catch 422-status errors
2024-06-27 20:20:29 -07:00
Krrish Dholakia
82c6f31095
test(test_router.py): add testing
2024-06-27 20:20:29 -07:00
Krrish Dholakia
2e588c0685
fix(router.py): use user-defined model_input_tokens for pre-call filter checks
2024-06-27 20:20:29 -07:00
Krrish Dholakia
247d71db7a
fix(utils.py): fix exception_mapping check for errors
...
If exception already mapped - don't attach traceback to it
2024-06-27 20:20:29 -07:00
Ishaan Jaff
6ac0f20099
docs - update telemetry
2024-06-27 20:20:29 -07:00
Ishaan Jaff
b2302bf224
fix ui login bug
2024-06-27 20:20:29 -07:00
7HR4IZ3
4e84147593
fix: Lunary integration
...
Fixes the bug of litellm not logging system messages to lunary
2024-06-27 20:20:29 -07:00
Krrish Dholakia
af21695f2b
test: skip unstable tests
2024-06-27 20:20:29 -07:00
Krrish Dholakia
d2fe2b30a9
test(test_completion.py): handle replicate api error
2024-06-27 20:20:29 -07:00
Krrish Dholakia
b577f65798
test(test_proxy_server_langfuse.py): cleanup tests causing OOM issues.
2024-06-27 20:20:29 -07:00
Krrish Dholakia
c450dee681
fix(redact_messages.py): fix pr
2024-06-27 20:20:29 -07:00
Krrish Dholakia
3c92467ae8
fix(test_dynamic_rate_limit_handler.py): cleanup
2024-06-27 20:20:29 -07:00
Krrish Dholakia
2834a6395a
fix(redact_messages.py): fix get
2024-06-27 20:20:29 -07:00
Krrish Dholakia
0971219470
docs(team_budgets.md): cleanup docs
2024-06-27 20:20:29 -07:00
Krrish Dholakia
544338bdf4
bump: version 1.40.24 → 1.40.25
2024-06-27 20:20:29 -07:00
Marc Abramowitz
379b834480
Document feature
2024-06-27 20:20:29 -07:00
Marc Abramowitz
d14138dbd9
Rename request header
2024-06-27 20:20:29 -07:00
Marc Abramowitz
efae9fa991
Turn on message logging via request header
2024-06-27 20:20:29 -07:00
Krrish Dholakia
7f54c90459
fix(add-exception-mapping-+-langfuse-exception-logging-for-streaming-exceptions): add exception mapping + langfuse exception logging for streaming exceptions
...
Fixes https://github.com/BerriAI/litellm/issues/4338
2024-06-27 20:20:29 -07:00
Krrish Dholakia
e20e8c2e74
fix(vertex_httpx.py): flush remaining chunks from stream
2024-06-27 20:20:18 -07:00
Krrish Dholakia
b23181779f
fix(vertex_httpx.py): ignore vertex finish reason - wait for stream to end
...
Fixes https://github.com/BerriAI/litellm/issues/4339
2024-06-27 20:20:18 -07:00
Krrish Dholakia
f479cd549f
fix(router.py): check if azure returns 'content_filter' response + fallback available -> fallback
...
Exception maps azure content filter response exceptions
2024-06-27 20:20:18 -07:00
Ishaan Jaff
7bedb5ca52
Merge pull request #4451 from BerriAI/litellm_azure_fix_pre_post_logging
...
[Fix] Azure Post-API Call occurs before Pre-API Call in CustomLogger
2024-06-27 20:18:14 -07:00
Krrish Dholakia
94c069e869
fix(cost_calculator.py): infer provider name if not given
...
Fixes https://github.com/BerriAI/litellm/issues/4452
2024-06-27 18:41:04 -07:00
Krrish Dholakia
2faa6f704a
fix(factory.py): get image type from response headers
...
Fixes https://github.com/BerriAI/litellm/issues/4441
2024-06-27 18:19:16 -07:00
Ishaan Jaff
96d3780a53
fix test secrets
2024-06-27 17:47:10 -07:00
Ishaan Jaff
eaa6441030
test fix secret detection
2024-06-27 17:42:44 -07:00
