Ishaan Jaff
d54de58e31
Merge pull request #1197 from Rested/main
...
docker build and push on release
2023-12-21 07:28:17 +05:30
ishaan-jaff
3e5cfee1f4
(ci/cd) run again
2023-12-21 07:25:22 +05:30
ishaan-jaff
b701a356cc
(fix) vertex ai auth file
2023-12-21 07:22:25 +05:30
Krrish Dholakia
6795f0447a
fix(utils.py): fix non_default_param pop error for ollama
2023-12-21 06:59:13 +05:30
David Manouchehri
93c4556eb0
Add aws_bedrock_runtime_endpoint support.
2023-12-20 19:31:43 -05:00
Graham Neubig
6e9267ca66
Make vertex_chat work with generate_content
2023-12-20 15:32:44 -05:00
Mateo Cámara
b72d372aa7
feat: added explicit args to acomplete
2023-12-20 19:49:12 +01:00
Graham Neubig
482b3b5bc3
Add a default for safety settings in vertex AI
2023-12-20 13:12:50 -05:00
Krrish Dholakia
04bbd0649f
fix(router.py): only do sync image gen fallbacks for now
...
The customhttptransport we use for dall-e-2 only works for sync httpx calls, not async. Will need to spend some time writing the async version
n
2023-12-20 19:10:59 +05:30
Reuben Thomas-Davis
fe4427907d
🗑️ remove unused docker workflow for clarity
2023-12-20 12:41:23 +00:00
Reuben Thomas-Davis
50af89e853
💚 docker build and push on release
...
when a github release is published a docker image is pushed to ghcr avoiding manual workflow dispatch method (but still making it available as a fallback)
2023-12-20 12:40:43 +00:00
Krrish Dholakia
350389f501
fix(utils.py): add support for anyscale function calling
2023-12-20 17:48:33 +05:30
Krrish Dholakia
4040f60feb
feat(router.py): support async image generation on router
2023-12-20 17:24:20 +05:30
Krrish Dholakia
f355e03515
feat(main.py): add async image generation support
2023-12-20 16:58:40 +05:30
Krrish Dholakia
f59b9436be
feat(main.py): add async image generation support
2023-12-20 16:58:15 +05:30
Krrish Dholakia
b3962e483f
feat(azure.py): add support for azure image generations endpoint
2023-12-20 16:37:21 +05:30
AllentDan
6b19db0327
fix least_busy router by updating min_traffic
2023-12-20 18:16:00 +08:00
Krrish Dholakia
f0df28362a
feat(ollama.py): add support for ollama function calling
2023-12-20 14:59:55 +05:30
ishaan-jaff
bab8f3350d
(docs) openrouter
2023-12-20 13:42:49 +05:30
ishaan-jaff
7d20ea23d1
(docs) set openrouter params
2023-12-20 13:42:49 +05:30
ishaan-jaff
683a1ee979
(feat) proxy key/generate pass metadata in requests
2023-12-20 13:42:49 +05:30
ishaan-jaff
7ad21de441
(feat) proxy /key/generate add metadata to _types
2023-12-20 13:42:49 +05:30
ishaan-jaff
c4b7ab6579
(feat) proxy - add metadata for keys
2023-12-20 13:42:49 +05:30
Krish Dholakia
93c4efd715
Merge pull request #1190 from neubig/add_vertexai_safety_settings
...
Add partial support of VertexAI safety settings
2023-12-20 07:31:10 +00:00
Ishaan Jaff
9fa2fe0c37
Merge pull request #1185 from navidre/prevent_key_log_documentation
...
Sample code to prevent logging API key in callback to Slack
2023-12-20 09:09:10 +05:30
ishaan-jaff
229b56fc35
(docs) swagger - add embedding tag
2023-12-20 09:04:56 +05:30
Graham Neubig
2d15e5384b
Add partial support of vertexai safety settings
2023-12-19 22:26:55 -05:00
ishaan-jaff
aa78415894
(docs) swager - add embeddings tag
2023-12-20 06:29:36 +05:30
ishaan-jaff
9548334e2f
(docs) swagger docs add description
2023-12-20 06:27:26 +05:30
ishaan-jaff
8b26e64b5d
(fix) proxy: add link t swagger docs on startup
2023-12-20 06:02:05 +05:30
ishaan-jaff
cd34b859df
(docs) swagger endpoint
2023-12-20 05:49:45 +05:30
navidre
b8d7cafb8d
Sample code to prevent logging API key
...
Sample code in documentation to prevent logging API key. Ideally should be implemented in the codebase if not already
2023-12-19 14:04:20 -06:00
Krrish Dholakia
c5340b8709
fix(utils.py): vertex ai exception mapping
2023-12-19 15:25:29 +00:00
Krrish Dholakia
5936664a16
fix(ollama.py): raise async errors
2023-12-19 15:01:12 +00:00
ishaan-jaff
9eb487efb3
(docs) exception mapping
2023-12-19 19:29:05 +05:30
ishaan-jaff
8b0fa2322c
(docs) exception mapping azure openai
2023-12-19 19:23:52 +05:30
ishaan-jaff
dbcff752b3
(docs) exception mapping - add more details
2023-12-19 19:22:51 +05:30
ishaan-jaff
84fde01461
(fix) docs proxy + auth curl request
2023-12-19 19:11:35 +05:30
ishaan-jaff
9995229b97
(fix) proxy + ollama - raise exception correctly
2023-12-19 18:48:34 +05:30
Max Deichmann
b93fe99b74
debug langfuse on env variable
2023-12-19 12:20:58 +01:00
Max Deichmann
a05a955653
add log
2023-12-19 10:06:03 +01:00
Max Deichmann
dc8ae16d84
add users
2023-12-19 09:54:51 +01:00
Max Deichmann
c397da7c59
changes
2023-12-19 09:41:49 +01:00
sumanth
96e23daf4d
fix
2023-12-19 13:15:48 +05:30
ishaan-jaff
ce1b0b89ba
(fix) proxy - health checks support cli model
2023-12-19 12:55:20 +05:30
ishaan-jaff
b82fcd51d7
(docs) ollama/llava
2023-12-19 11:32:28 +05:30
Krrish Dholakia
f73c4b494c
docs(model_management.md): adding docs on how to add model metadata in the config.yaml
2023-12-18 17:57:29 -08:00
Krish Dholakia
67112ea81d
Merge pull request #1168 from clevcode/main
...
Fix for issue that occured when proxying to ollama
2023-12-18 17:54:59 -08:00
Krish Dholakia
408f232bd7
Merge branch 'main' into main
2023-12-18 17:54:34 -08:00
Krrish Dholakia
071283c102
fix(router.py): init deployment_latency_map even if model_list is empty
2023-12-18 17:50:26 -08:00
