Krrish Dholakia
5811d21094
test(test_amazing_vertex_completion.py): fix gemini tool calling test
2024-04-19 19:39:38 -07:00
Krrish Dholakia
e5b98814ad
test(test_proxy_server.py): fix test to use valid redis host
2024-04-19 19:22:24 -07:00
Ishaan Jaff
00a07a99cd
fix - backend logic for non admin flow
2024-04-19 17:36:29 -07:00
Ishaan Jaff
b81d66639b
ui - allow App user to see their own info
2024-04-19 17:31:36 -07:00
Krish Dholakia
9f21f87afd
Merge pull request #3173 from BerriAI/litellm_ssl_caching_fix
...
fix(caching.py): fix redis url parsing logic to work with ssl urls
2024-04-19 17:20:32 -07:00
Krish Dholakia
6d9f0f1839
Merge branch 'main' into litellm_ssl_caching_fix
2024-04-19 17:20:27 -07:00
Krrish Dholakia
432e81335b
bump: version 1.35.15 → 1.35.16
2024-04-19 17:03:27 -07:00
Krish Dholakia
cc7f27252b
Merge pull request #3179 from BerriAI/litellm_dual_caching_fix
...
fix(caching.py): dual cache async_batch_get_cache fix + testing
2024-04-19 17:02:47 -07:00
Krrish Dholakia
978c1a1976
test(test_caching.py): add sleep
2024-04-19 17:02:15 -07:00
Ishaan Jaff
4dcecde97a
ui - non admin flow
2024-04-19 16:45:13 -07:00
Krrish Dholakia
a9f3fd4030
test(test_function_calling.py): remove flaky groq test
2024-04-19 16:41:23 -07:00
Krrish Dholakia
62aab91186
test(test_prometheus_service.py): remove duplicate test
2024-04-19 16:23:47 -07:00
Ishaan Jaff
63632c907f
Merge pull request #3183 from BerriAI/langfuse_log_proxy_base_url
...
[Fix] - Langfuse log proxy_base_url to langfuse as a tag (if set by user)
2024-04-19 16:21:29 -07:00
Krrish Dholakia
41c81f6335
fix: fix tests
2024-04-19 16:21:15 -07:00
Ishaan Jaff
788394b1ec
fix - logging proxy base url to langfuse
2024-04-19 16:20:46 -07:00
Krrish Dholakia
0d9c96bebf
test(test_prometheus_services.py): fix testing to handle caching ping in init
2024-04-19 16:15:29 -07:00
Ishaan Jaff
def5ce4888
fix user needs to opt in to langfuse tags
2024-04-19 16:13:14 -07:00
Ishaan Jaff
c59051895b
fix - allow users to opt into langfuse default tags
2024-04-19 16:05:31 -07:00
Ishaan Jaff
2c76448756
fix - allow users to opt into langfuse default tags
2024-04-19 16:01:27 -07:00
frob
5fb5bce780
Merge branch 'BerriAI:main' into ollama-special-symbol
2024-04-20 00:49:57 +02:00
Ishaan Jaff
c0befe9bbb
feat - log base_url to langfuse as a tag
2024-04-19 15:48:00 -07:00
Krrish Dholakia
62a8bf134f
fix(http_handler.py): fix linting error
2024-04-19 15:45:24 -07:00
Krish Dholakia
dc932ac518
Merge pull request #3174 from jmandel/fix-claude-streaming
...
fix: Stream completion responses from anthropic. (Fix #3129 )
2024-04-19 15:37:29 -07:00
Ishaan Jaff
48e5de4f0e
Merge pull request #3175 from BerriAI/litellm_log_team_alias_langfuse
...
[FEAT] Log team alias to langfuse
2024-04-19 15:30:59 -07:00
Ishaan Jaff
c7b0d59bdc
Merge pull request #3180 from BerriAI/ui_create_user_flow
...
[UI] Show teams as dropdown in invite user flow
2024-04-19 15:27:27 -07:00
Krrish Dholakia
84685b5f34
fix(_redis.py): fix args passed to redis.from_url argument
2024-04-19 15:27:11 -07:00
Ishaan Jaff
5613f9b30a
UI - invite user flow
2024-04-19 15:26:29 -07:00
Ishaan Jaff
5d9f6282ce
create_user using user_email
2024-04-19 15:17:50 -07:00
Ishaan Jaff
559a312c9c
ui - show teams as dropdown in create user flow
2024-04-19 15:07:13 -07:00
Krrish Dholakia
01a1a8f731
fix(caching.py): dual cache async_batch_get_cache fix + testing
...
this fixes a bug in usage-based-routing-v2 which was caused b/c of how the result was being returned from dual cache async_batch_get_cache. it also adds unit testing for that function (and it's sync equivalent)
2024-04-19 15:03:25 -07:00
Ishaan Jaff
3167c9da9f
fix - use user_api_key_team_alias as the default tag on langfuse
2024-04-19 14:43:41 -07:00
Ishaan Jaff
f220a337bd
Merge pull request #3176 from BerriAI/add_llama3_groq
...
[FEAT] Add `groq/llama3`
2024-04-19 14:40:10 -07:00
Ishaan Jaff
e8de984b38
docs - add groq llama3
2024-04-19 14:34:45 -07:00
Ishaan Jaff
12bf4346ec
feat - add llama3 on groq
2024-04-19 14:34:38 -07:00
Ishaan Jaff
410d1f2d2c
langfuse - log team alias
2024-04-19 14:26:58 -07:00
Josh Mandel
f411443e58
fix: Stream completion responses from anthropic. (Fix 3129)
2024-04-19 16:13:19 -05:00
Krrish Dholakia
08cf77623b
fix(caching.py): remove url parsing logic - causing redis ssl connections to fail
...
this reverts a change that was causing redis url w/ ssl to fail. this also adds unit testing for this sc
enario, to prevent future regressions
2024-04-19 14:01:13 -07:00
Krrish Dholakia
3c6b6355c7
fix(ollama_chat.py): accept api key as a param for ollama calls
...
allows user to call hosted ollama endpoint using bearer token for auth
2024-04-19 13:02:13 -07:00
frob
3df7231fa5
Disable special tokens in ollama completion when counting tokens
...
Some(?) models (eg, codegemma) don't return a prompt_eval_count field, so ollama.py tries to compute the value based on encoding of the prompt. Unfortunately FIM symbols used in the prompt (eg, "<|fim_prefix|>") cause the encoder to throw an exception, so we disable special processing.
2024-04-19 21:38:42 +02:00
Ishaan Jaff
423121ff7d
feat - track team_alias is metadata for /chat, /embeddings
2024-04-19 10:52:54 -07:00
Ishaan Jaff
6d92b13c22
feat - log team_alias to langfuse
2024-04-19 10:29:42 -07:00
Ishaan Jaff
b2bdc99474
Merge pull request #2961 from Manouchehri/langfuse-add-region-2937
...
(feat) Langfuse - Add location logging, and add cache_hit to metadata.
2024-04-19 10:06:34 -07:00
Krrish Dholakia
717abfef98
build(interpret_load_test.py): add hosted proxy info on release notes
2024-04-18 22:40:10 -07:00
Krrish Dholakia
d10743a609
bump: version 1.35.14 → 1.35.15
2024-04-18 22:17:33 -07:00
Krrish Dholakia
9e91541b8a
refactor(main.py): trigger new build
2024-04-18 22:17:19 -07:00
Krish Dholakia
f1340b52dc
Merge pull request #3153 from BerriAI/litellm_usage_based_routing_v2_improvements
...
usage based routing v2 improvements - unit testing + *NEW* async + sync 'pre_call_checks'
2024-04-18 22:16:16 -07:00
Krrish Dholakia
9c42c847a5
fix(router.py): instrument pre-call-checks for all openai endpoints
2024-04-18 21:54:25 -07:00
Krrish Dholakia
3b9e2a58e2
fix(lowest_tpm_rpm_v2.py): ensure backwards compatibility for python 3.8
2024-04-18 21:42:35 -07:00
Krrish Dholakia
81573b2dd9
fix(test_lowest_tpm_rpm_routing_v2.py): unit testing for usage-based-routing-v2
2024-04-18 21:38:00 -07:00
Ishaan Jaff
c903b44849
(ci/cd) vertexai - skip 429 errors
2024-04-18 21:27:22 -07:00
