litellm/tests
Krish Dholakia 801ecb6517
Nova Canvas complete image generation tasks (#9177) (#9525)
* Nova Canvas complete image generation tasks (#9177)

* add initial support for Amazon Nova Canvas model

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* adjust name to AmazonNovaCanvas and map function variables to config

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* tighten model name check

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* fix quality mapping

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* add premium quality in config

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* support all Amazon Nova Canvas tasks

* remove unused import

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* add tests for image generation tasks and fix payload

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* add missing util file

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* update model prices backup file

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* remove image tasks other than text->image

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* add color guided generation task for Nova Canvas

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* fix merge

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* add nova canvas image generation documentation

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

* add nova canvas unit tests

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>

---------

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
Co-authored-by: Krish Dholakia <krrishdholakia@gmail.com>

* ci(config.yml): bump ci config

* test: fix test

---------

Signed-off-by: omrishiv <327609+omrishiv@users.noreply.github.com>
Co-authored-by: omrishiv <327609+omrishiv@users.noreply.github.com>
2025-03-26 11:28:20 -07:00
..
basic_proxy_startup_tests
batches_tests
code_coverage_tests fix ensure async client test 2025-03-18 17:29:10 -07:00
documentation_tests
image_gen_tests Nova Canvas complete image generation tasks (#9177) (#9525) 2025-03-26 11:28:20 -07:00
litellm Support litellm.api_base for vertex_ai + gemini/ across completion, embedding, image_generation (#9516) 2025-03-25 23:46:20 -07:00
litellm_utils_tests test_supports_web_search 2025-03-22 13:49:35 -07:00
llm_responses_api_testing test_openai_o1_pro_response_api_streaming 2025-03-20 13:04:49 -07:00
llm_translation Support litellm.api_base for vertex_ai + gemini/ across completion, embedding, image_generation (#9516) 2025-03-25 23:46:20 -07:00
load_tests fix vertex embedding perf test 2025-03-26 10:25:50 -07:00
local_testing run ci/cd again 2025-03-26 08:12:51 -07:00
logging_callback_tests Merge pull request #9508 from BerriAI/litellm_fix_gcs_pub_sub 2025-03-24 18:22:43 -07:00
mcp_tests ci_cd_server_path 2025-03-21 19:06:29 -07:00
multi_instance_e2e_tests
old_proxy_tests/tests
openai_endpoints_tests test_bad_request_bad_param_error 2025-03-13 16:02:21 -07:00
otel_tests test string checked for model access control 2025-03-10 20:04:18 -07:00
pass_through_tests add litellm mcp endpoints 2025-03-20 21:12:56 -07:00
pass_through_unit_tests test: update tests 2025-03-22 12:56:42 -07:00
proxy_admin_ui_tests test: update tests 2025-03-22 12:56:42 -07:00
proxy_security_tests
proxy_unit_tests test: fix test 2025-03-21 22:02:39 -07:00
router_unit_tests test: update tests 2025-03-22 12:56:42 -07:00
store_model_in_db_tests test_chat_completion_bad_model_with_spend_logs 2025-02-28 20:19:43 -08:00
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
README.MD add bedrock llama vision support + cohere / infinity rerank - 'return_documents' support (#8684) 2025-02-20 21:23:54 -08:00
test_callbacks_on_proxy.py
test_config.py
test_debug_warning.py
test_end_users.py
test_entrypoint.py
test_fallbacks.py test: fix test 2025-03-10 22:00:50 -07:00
test_health.py
test_keys.py
test_logging.conf
test_models.py
test_openai_endpoints.py test string checked for model access control 2025-03-10 20:04:18 -07:00
test_organizations.py
test_passthrough_endpoints.py
test_ratelimit.py
test_spend_logs.py
test_team_logging.py
test_team_members.py
test_team.py fix(team_endpoints.py): ensure 404 raised when team not found (#9038) 2025-03-06 22:04:36 -08:00
test_users.py

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/litellm

This folder can only run mock tests.