ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
16,979 Commits 9 Branches 7 Tags 935 MiB
2cf149fbad
Commit Graph

16979 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Krrish Dholakia
2cf149fbad perf(sagemaker.py): asyncify hf prompt template check 
leads to 189% improvement in RPS @ 100 users
 2024-08-27 07:37:06 -07:00
Krrish Dholakia
b0f01e5b95 test: fix test 2024-08-27 07:14:14 -07:00
Krish Dholakia
ec2357f1d2
Merge pull request #5384 from miraclebakelaser/fix/cohere-tool-calls-content-field 
fix(factory.py): handle missing 'content' in cohere assistant messages
 2024-08-27 07:13:28 -07:00
miraclebakelaser
97f714d2b0 fix(factory.py): handle missing 'content' in cohere assistant messages 
Update cohere_messages_pt_v2 function to check for 'content' existence
 2024-08-27 19:38:37 +09:00
Krrish Dholakia
3ec8a0d25d fix: fix imports 2024-08-26 22:24:30 -07:00
Krish Dholakia
81e62aec16
Merge pull request #5381 from BerriAI/litellm_gemini_context_caching 
gemini context caching (openai format) support
 2024-08-26 22:22:23 -07:00
Krish Dholakia
08bd4788dc
Merge branch 'main' into litellm_gemini_context_caching 2024-08-26 22:22:17 -07:00
Krrish Dholakia
5aad9d2db7 fix: fix imports 2024-08-26 22:19:01 -07:00
Krrish Dholakia
4868a6cf55 fix: fix unbound var 2024-08-26 22:19:01 -07:00
Krrish Dholakia
0eea01dae9 feat(vertex_ai_context_caching.py): check gemini cache, if key already exists 2024-08-26 22:19:01 -07:00
Krrish Dholakia
b0cc1df2d6 feat(vertex_ai_context_caching.py): support making context caching calls to vertex ai in a normal chat completion call (anthropic caching format) 
Closes https://github.com/BerriAI/litellm/issues/5213
 2024-08-26 22:19:01 -07:00
Krish Dholakia
c503ff435e
Merge pull request #5368 from BerriAI/litellm_vertex_function_support 
feat(vertex_httpx.py): support 'functions' param for gemini google ai studio + vertex ai
 2024-08-26 22:11:42 -07:00
Krrish Dholakia
1a97362b6e fix(types/utils.py): map finish reason to openai compatible 2024-08-26 22:09:02 -07:00
Krish Dholakia
3a6412c9c3
Merge pull request #5376 from BerriAI/litellm_sagemaker_streaming_fix 
fix(sagemaker.py): support streaming for messages api
 2024-08-26 21:36:10 -07:00
Krrish Dholakia
75bb9ff7fe fix: fix imports 2024-08-26 21:36:04 -07:00
Krrish Dholakia
9ba1b78a8f fix(streaming_utils.py): fix generic_chunk_has_all_required_fields 2024-08-26 21:13:02 -07:00
Ishaan Jaff
7655b78623 run ci/cd again 2024-08-26 21:12:42 -07:00
Ishaan Jaff
a44596a067 fix created_at and updated_at not existing error 2024-08-26 21:04:39 -07:00
Krrish Dholakia
592d8e933d fix: fix unbound var 2024-08-26 20:49:08 -07:00
Ishaan Jaff
ace929b588 ci/cd run again 2024-08-26 20:38:13 -07:00
Ishaan Jaff
95455c8849 fix entrypoint 2024-08-26 20:32:23 -07:00
Krrish Dholakia
5d68f27a57 feat(vertex_ai_context_caching.py): check gemini cache, if key already exists 2024-08-26 20:28:18 -07:00
Ishaan Jaff
71e5b2df79
Merge pull request #5380 from BerriAI/dependabot/npm_and_yarn/ui/litellm-dashboard/micromatch-4.0.8 
build(deps): bump micromatch from 4.0.5 to 4.0.8 in /ui/litellm-dashboard
 2024-08-26 19:06:59 -07:00
dependabot[bot]
52e8405b40
build(deps): bump micromatch in /ui/litellm-dashboard 
Bumps [micromatch](https://github.com/micromatch/micromatch) from 4.0.5 to 4.0.8.
- [Release notes](https://github.com/micromatch/micromatch/releases)
- [Changelog](https://github.com/micromatch/micromatch/blob/master/CHANGELOG.md)
- [Commits](https://github.com/micromatch/micromatch/compare/4.0.5...4.0.8)

---
updated-dependencies:
- dependency-name: micromatch
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-08-27 02:04:05 +00:00
Ishaan Jaff
6c7b9dbb59 bump: version 1.44.6 → 1.44.7 2024-08-26 19:02:21 -07:00
Ishaan Jaff
f3b3f39eb5 ui new build 2024-08-26 19:01:35 -07:00
Ishaan Jaff
d963de4bf7
Merge pull request #5379 from BerriAI/litellm_regen_keys_ui 
[Feat-Proxy] Allow regenerating proxy virtual keys
 2024-08-26 18:59:42 -07:00
Ishaan Jaff
a043676dc4 fix regen api key flow 2024-08-26 18:59:29 -07:00
Ishaan Jaff
75cbbea071 enforce regenerating keys in enterprise tier 2024-08-26 18:54:50 -07:00
Ishaan Jaff
b0ae0101f4 make regenerating api keys enterprise 2024-08-26 18:53:28 -07:00
Krrish Dholakia
c83aa801f2 feat(vertex_ai_context_caching.py): support making context caching calls to vertex ai in a normal chat completion call (anthropic caching format) 
Closes https://github.com/BerriAI/litellm/issues/5213
 2024-08-26 18:47:45 -07:00
Ishaan Jaff
83813af0a2 regenerate key 2024-08-26 18:44:46 -07:00
Ishaan Jaff
5c2c316919 update ui regen key 2024-08-26 18:41:20 -07:00
Ishaan Jaff
4dc2eea58d update key name when regenerating a key 2024-08-26 18:40:51 -07:00
Ishaan Jaff
3527e47b59 ui regenerate an api key 2024-08-26 18:33:18 -07:00
Ishaan Jaff
40c018272c working regenerate key flow 2024-08-26 18:28:26 -07:00
Ishaan Jaff
2615edc468 allow using hashed api keys on regen key 2024-08-26 18:15:52 -07:00
Ishaan Jaff
6b8bb69af3 test test_regenerate_api_key 2024-08-26 18:00:51 -07:00
Ishaan Jaff
7230ee1f55 add regenerate_key_fn 2024-08-26 17:59:44 -07:00
Ishaan Jaff
a77ccea930
Merge pull request #5375 from ushuz/patch-1 
docs: Add pricing for imagen-3 and imagen-3-fast
 2024-08-26 17:54:45 -07:00
Ishaan Jaff
c02dc761e9
Merge pull request #5374 from BerriAI/litellm_refactor_cohere 
[Refactor] Refactor cohere provider to be in a folder
 2024-08-26 17:54:32 -07:00
Ishaan Jaff
5745f3d6cc fix schema 2024-08-26 17:27:06 -07:00
Ishaan Jaff
cbef0c0a0d add key_state created at to token 2024-08-26 16:52:33 -07:00
Ishaan Jaff
fb150f7ce5 update schema 2024-08-26 16:52:19 -07:00
Ishaan Jaff
4f8026f44d fix refactor cohere 2024-08-26 16:33:04 -07:00
Krrish Dholakia
0a15d3b3c3 fix(utils.py): fix message replace 2024-08-26 15:43:30 -07:00
Krrish Dholakia
8e9acd117b fix(sagemaker.py): support streaming for messages api 
Fixes https://github.com/BerriAI/litellm/issues/5372
 2024-08-26 15:08:08 -07:00
Ishaan Jaff
71bf5b31b2
Merge pull request #5371 from BerriAI/litellm_vertex_ft_models 
[Feat] Add support for fine tuned vertexai models
 2024-08-26 15:01:23 -07:00
John HU
9a18106745
Add pricing for imagen-3 and imagen-3-fast 2024-08-26 14:41:47 -07:00
Ishaan Jaff
da63775371 use common folder for cohere 2024-08-26 14:28:50 -07:00