ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
34,378 Commits 9 Branches 7 Tags 935 MiB
dd183a7fcb
Commit Graph

34378 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Ishaan Jaff
6b4b05b58f (fix) remove litellm.telemetry 2024-03-26 11:21:09 -07:00
Ishaan Jaff
4d81df3d6f (docs) switch of litellm telemetry 2024-03-26 11:19:55 -07:00
Krish Dholakia
f3f56204c5
Update README.md 2024-03-26 10:34:16 -07:00
Krrish Dholakia
b4d0a95cff test(test_router_debug_logs.py): add info statement to log test 2024-03-26 09:54:26 -07:00
Krrish Dholakia
584d187e0e fix(utils.py): check if message is pydantic object or dict before dereferencing 2024-03-26 09:47:44 -07:00
Ishaan Jaff
2ecdd92619
Merge pull request #2702 from BerriAI/litellm_cache_flush 
[Feat] Proxy - /cache/flushall - delete all elements from cache
 2024-03-26 09:34:39 -07:00
Ishaan Jaff
7409dcd222 (fix) doc string 2024-03-26 09:25:44 -07:00
Ishaan Jaff
75ef51b714 (fix) undo change from other branch 2024-03-26 09:24:12 -07:00
Ishaan Jaff
098a03facc (fix) undo changes from other branches 2024-03-26 09:22:19 -07:00
Ishaan Jaff
b8af946fb9 (feat) /cache/flushall 2024-03-26 09:18:58 -07:00
Ishaan Jaff
151b717ae2 (feat) support cache flush on redis 2024-03-26 09:12:30 -07:00
Ishaan Jaff
ade5d58331 (fix) in mem redis reads 2024-03-26 09:10:49 -07:00
Krrish Dholakia
2dd2b8a8e3 test(test_streaming.py): add unit testing for custom stream wrapper 2024-03-26 08:57:44 -07:00
Rob Mann
e80aae5c30 Updating the default Claude3 max tokens 2024-03-26 11:46:59 -04:00
Antonio Molner Domenech
c713648db1 Update print statements to use verbose logger and DEBUG level 2024-03-26 22:41:28 +07:00
Krish Dholakia
6f11f300fc
Merge pull request #2656 from TashaSkyUp/patch-1 
fix for: when using ModelResponse.json() to save and then reconstruct a ModelResponse the choices field ends up empty
 2024-03-26 08:36:55 -07:00
Krrish Dholakia
49e8cdbff9 fix(router.py): check for context window error when handling 400 status code errors 
was causing proxy context window fallbacks to not work as expected
 2024-03-26 08:08:15 -07:00
Ishaan Jaff
787c9b7df0 (test) claude-1 api is unstable 2024-03-26 08:07:16 -07:00
Ishaan Jaff
81b716d8da (fix) cache control logic 2024-03-26 07:36:45 -07:00
Ishaan Jaff
995c379a63 (fix) prod.md 2024-03-25 22:30:22 -07:00
Ishaan Jaff
5b2698a9ed (kub) always pull litellm image 2024-03-25 22:29:23 -07:00
Ishaan Jaff
965fb6eb2c (fix) cache control logic 2024-03-25 22:19:34 -07:00
Krrish Dholakia
a3617a6af6 bump: version 1.34.3 → 1.34.4 2024-03-25 21:58:49 -07:00
Krish Dholakia
eb859f5dba
Merge pull request #2692 from BerriAI/litellm_streaming_fixes 
fix(utils.py): ensure last chunk is always empty delta w/ finish reason
 2024-03-25 21:57:04 -07:00
Krrish Dholakia
643fd6ac96 test(test_caching.py): fix test_redis_cache_acompletion_stream 2024-03-25 21:36:47 -07:00
Krrish Dholakia
4d85387b5a test(test_azure_astreaming_and_function_calling): fix test to handle caching 2024-03-25 19:33:57 -07:00
Krrish Dholakia
1c55f2ccc5 fix(utils.py): persist system fingerprint across chunks 2024-03-25 19:24:09 -07:00
Krrish Dholakia
fa297b67ca fix(test_amazing_vertex_completion.py): fix test to check if content is none 2024-03-25 19:11:39 -07:00
Krish Dholakia
f702d49e00
Update README.md 2024-03-25 19:03:48 -07:00
Krrish Dholakia
bd75498913 fix(utils.py): log success event for streaming 2024-03-25 19:03:10 -07:00
Ishaan Jaff
ef93fcaa8e bump: version 1.34.2 → 1.34.3 2024-03-25 18:58:40 -07:00
Ishaan Jaff
ab8e264691
Merge pull request #2695 from BerriAI/litellm_fix_cache_controls 
(test) Using Cache controls with litellm - `no-cache=True`
 2024-03-25 18:58:05 -07:00
Ishaan Jaff
07fe08d8b5 (test) no cache hit 2024-03-25 18:56:36 -07:00
Ishaan Jaff
cf9b3bf462
Merge pull request #2694 from BerriAI/litellm_better_cache_debugging 
[Fix] better cache debugging/error statements
 2024-03-25 18:47:54 -07:00
Ishaan Jaff
08653aaf27
Merge pull request #2693 from BerriAI/litellm_batch_write_redis_cache 
[FEAT] batch write redis cache
 2024-03-25 18:47:24 -07:00
Krrish Dholakia
a5776a3054 test(test_custom_logger.py): cleanup test 2024-03-25 18:32:12 -07:00
Ishaan Jaff
553ac19f9f (feat) improve cache debugging litellm 2024-03-25 18:26:58 -07:00
Krrish Dholakia
1ac641165b fix(utils.py): persist response id across chunks 2024-03-25 18:20:43 -07:00
Ishaan Jaff
3fcab0137a (test) batch writing to cache 2024-03-25 18:04:04 -07:00
Ishaan Jaff
32d4756943 (fix) print verbose in batch writing redis 2024-03-25 18:02:31 -07:00
Krrish Dholakia
dc2c4af631 fix(utils.py): fix text completion streaming 2024-03-25 16:47:17 -07:00
Ishaan Jaff
7134d66fae
Merge branch 'main' into litellm_batch_write_redis_cache 2024-03-25 16:41:29 -07:00
Ishaan Jaff
abce689862 (feat) batch write redis cache output 2024-03-25 16:39:47 -07:00
Krrish Dholakia
9e1e97528d fix(utils.py): ensure last chunk is always empty delta w/ finish reason 
makes sure we're openai-compatible with our streaming. Adds stricter tests for this as well
 2024-03-25 16:33:41 -07:00
Ishaan Jaff
4ae51e9fd5 (fix) locust load test use uuid 2024-03-25 15:36:30 -07:00
Ishaan Jaff
37aadba959 (feat) v0 batch redis cache writes 2024-03-25 15:20:10 -07:00
Krrish Dholakia
f153889738 fix(utils.py): allow user to disable streaming logging 
fixes event loop issue for litellm.disable_streaming_logging
 2024-03-25 14:28:46 -07:00
Krrish Dholakia
16ade7e556 docs(proxy/caching.md): add ttl param to proxy/caching.md 2024-03-25 13:46:52 -07:00
Krrish Dholakia
591a0a376e fix(caching.py): support default ttl for caching 2024-03-25 13:40:17 -07:00
dependabot[bot]
9323f1439f
build(deps): bump express from 4.18.2 to 4.19.2 in /docs/my-website 
Bumps [express](https://github.com/expressjs/express) from 4.18.2 to 4.19.2.
- [Release notes](https://github.com/expressjs/express/releases)
- [Changelog](https://github.com/expressjs/express/blob/master/History.md)
- [Commits](https://github.com/expressjs/express/compare/4.18.2...4.19.2)

---
updated-dependencies:
- dependency-name: express
  dependency-type: indirect
...

Signed-off-by: dependabot[bot] <support@github.com>
 2024-03-25 20:31:36 +00:00