Ishaan Jaff
13f4ecb7ec
docs - secret detection
2024-06-27 20:20:31 -07:00
Ishaan Jaff
1962a24802
test secret detection
2024-06-27 20:20:31 -07:00
Ishaan Jaff
92eed81077
clean up secret detection
2024-06-27 20:20:31 -07:00
Ishaan Jaff
8a7b16102c
fix async_pre_call_hook
2024-06-27 20:20:31 -07:00
Ishaan Jaff
350e87f1d6
init secret detection callback
2024-06-27 20:20:31 -07:00
Ishaan Jaff
d7643eb9f2
feat - add secret detection
2024-06-27 20:20:30 -07:00
Krrish Dholakia
9909b1d70a
fix(utils.py): add coverage for anthropic content policy error - vertex ai
2024-06-27 20:20:30 -07:00
Krrish Dholakia
c45d93b93a
fix(router.py): improve error message returned for fallbacks
2024-06-27 20:20:30 -07:00
Ishaan Jaff
b3ef4755c3
fix using mock completion
2024-06-27 20:20:30 -07:00
Ishaan Jaff
61b9ff9ac2
test - test_mock_request_n_greater_than_1
2024-06-27 20:20:30 -07:00
Ishaan Jaff
d07f8b6d3b
feat - use n in mock completion
2024-06-27 20:20:30 -07:00
Krrish Dholakia
81fd42258c
docs(reliability.md): add doc on mock testing fallbacks
2024-06-27 20:20:30 -07:00
Krrish Dholakia
9b47ba72cb
feat(router.py): support mock testing content policy + context window fallbacks
2024-06-27 20:20:30 -07:00
Ishaan Jaff
6a6b8613ea
ci/cd run again
2024-06-27 20:20:30 -07:00
Ishaan Jaff
48b8345ae6
docs nvidia_nim
2024-06-27 20:20:30 -07:00
Ishaan Jaff
22b7c0333d
docs - add nvidia nim
2024-06-27 20:20:30 -07:00
Ishaan Jaff
ee0d8341b0
test - nvidia nim
2024-06-27 20:20:30 -07:00
Ishaan Jaff
a9f17d141c
feat - add param mapping for nvidia nim
2024-06-27 20:20:30 -07:00
Ishaan Jaff
11ea1474b1
feat - add nvidia nim to main.py
2024-06-27 20:20:30 -07:00
Ishaan Jaff
b55c31ec3f
add nvidia nim to __init__
2024-06-27 20:20:30 -07:00
Ishaan Jaff
e471aca81f
feat - add debug_utils
2024-06-27 20:20:30 -07:00
Krish Dholakia
c18b8bb011
Update README.md
2024-06-27 20:20:30 -07:00
Krish Dholakia
43e42389d7
Update README.md
2024-06-27 20:20:30 -07:00
Kyrylo Yefimenko
1946610efd
Fix Groq prices
2024-06-27 20:20:30 -07:00
corrm
2e7b0096d0
Improve ollama prompt: this formula give good result with AutoGen
2024-06-27 20:20:30 -07:00
corrm
ec36dd40d7
Rename ollama prompt:
...
- 'Function' word to 'FunctionName'
- 'Tool Call' to `FunctionCall`
- 'Tool Call Result' to 'FunctionCall Result'
_I found that changes make some models better_
2024-06-27 20:20:30 -07:00
Islam Nofl
cc261580ac
Rename ollama prompt 'Function' word to 'Name'
2024-06-27 20:20:30 -07:00
corrm
a7efb9c332
Added improved function name handling in ollama_async_streaming
2024-06-27 20:20:30 -07:00
corrm
5d5227294d
chore: Improved OllamaConfig get_required_params and ollama_acompletion and ollama_async_streaming functions
2024-06-27 20:20:30 -07:00
corrm
e1e8f5a00e
chore: Improved prompt generation in ollama_pt function
2024-06-27 20:20:30 -07:00
Krrish Dholakia
bb64c68daf
docs(routing.md): add quickstart
2024-06-27 20:20:30 -07:00
Krrish Dholakia
673696222d
fix(langfuse.py): cleanup
2024-06-27 20:20:30 -07:00
Ishaan Jaff
4d7b2e578c
bump: version 1.40.25 → 1.40.26
2024-06-27 20:20:30 -07:00
Ishaan Jaff
c5020878e4
/spend/calculate use model aliases on this endpoint
2024-06-27 20:20:30 -07:00
Ishaan Jaff
08f83e6392
test - aliases on /spend/calculate
2024-06-27 20:20:30 -07:00
Krrish Dholakia
690c7f6e47
fix(router.py): log rejected router requests to langfuse
...
Fixes issue where rejected requests weren't being logged
2024-06-27 20:20:30 -07:00
Ishaan Jaff
7a961e8a0b
docs control available public routes
2024-06-27 20:20:30 -07:00
Ishaan Jaff
412c1fc541
fix importing litellm
2024-06-27 20:20:29 -07:00
Ishaan Jaff
e7ff5014b1
example cofnig with public routes
2024-06-27 20:20:29 -07:00
Ishaan Jaff
fa5eb5c96f
add helper to check route_in_additonal_public_routes
2024-06-27 20:20:29 -07:00
Ishaan Jaff
556ef8dd18
test - spend/calculate endpoints
2024-06-27 20:20:29 -07:00
Ishaan Jaff
2cb4d845ae
feat - refactor /spend/calculate
2024-06-27 20:20:29 -07:00
Ishaan Jaff
bfae8c3da6
example config with public routes
2024-06-27 20:20:29 -07:00
Ishaan Jaff
e30410f700
feat - allow user to define public routes
2024-06-27 20:20:29 -07:00
Krrish Dholakia
a087596be0
fix(vertex_httpx.py): Return empty model response for content filter violations
2024-06-27 20:20:29 -07:00
Krrish Dholakia
6f2f89d7b2
fix(vertex_httpx.py): cover gemini content violation (on prompt)
2024-06-27 20:20:29 -07:00
Krrish Dholakia
438f65666b
fix(utils.py): catch 422-status errors
2024-06-27 20:20:29 -07:00
Krrish Dholakia
82c6f31095
test(test_router.py): add testing
2024-06-27 20:20:29 -07:00
Krrish Dholakia
2e588c0685
fix(router.py): use user-defined model_input_tokens for pre-call filter checks
2024-06-27 20:20:29 -07:00
Krrish Dholakia
247d71db7a
fix(utils.py): fix exception_mapping check for errors
...
If exception already mapped - don't attach traceback to it
2024-06-27 20:20:29 -07:00
