Krish Dholakia
54095a256a
Merge pull request #15015 from anthony-liner/fix/langfuse-total-tokens
...
fix: set usage_details.total in langfuse integration
2025-10-02 17:33:43 -07:00
Krish Dholakia
f6b67fd9bd
Merge pull request #14799 from tyler-liner/chore/generation-name-opentelemetry
...
fix (opentelemetry): use generation_name for span naming in logging method
2025-10-01 21:39:38 -07:00
Deepanshu Lulla
68adca04c8
Gitlab based Prompt manager ( #14988 )
...
* add prompt
* add prompt
* add prompt
* add prompt
* add prompt management via gitlab
* gitlab client
* gitlab client
* gitlab client
* fix lint issues
* fix lint issues
* remove router changes
---------
Co-authored-by: deepanshu <deepanshu.lulla@hq.bill.com>
2025-10-01 18:13:11 -07:00
anthony-liner
9ca73d5504
fix: set usage_details.total in langfuse integration
2025-09-29 16:30:44 +09:00
Sameer Kankute
1681bf7175
(Feat) Add BitBucket Integration for Prompt Management ( #14882 )
...
* Add bitbucket integration for prompt management
* remove not needed file
* remove not needed file
* Add the correct readme
* Add the correct readme
* fix test for bitbucket
* fix test for bitbucket
2025-09-25 15:51:00 -07:00
Alexsander Hamir
eaa04cd8ce
fix: use fastuuid helper ( #14903 )
...
* fix: use fastuuid helper across the codebase
First batch of changes, simple drop in replacement.
* second batch of changes
* fixed: script mistake on helper file
2025-09-25 15:47:01 -07:00
tyler-liner
47800757fd
feat(opentelemetry): use generation_name for span naming in logging method
2025-09-23 15:53:41 +09:00
Fabrício Ceschin
f0490ab60d
Merge branch 'BerriAI:main' into LangfuseUsageDetails
2025-09-19 13:54:56 -04:00
Krish Dholakia
664c83cfb5
Merge branch 'litellm_contributor_prs_09_18_2025_p2' into litellm_dev_09_17_2025_p2_v2
2025-09-18 19:50:55 -07:00
katsuhiro muto
ec61a7152a
Support for is_streamed_request widh datadog ( #14673 )
2025-09-18 15:55:16 -07:00
Krrish Dholakia
adc71ad2e7
fix(langsmith.py): add langsmith_sampling_rate as a dynamic param
...
Closes LIT-879
2025-09-17 17:32:26 -07:00
Fabrício Ceschin
9fdbdaf846
Merge branch 'BerriAI:main' into LangfuseUsageDetails
2025-09-17 09:36:08 -04:00
Krish Dholakia
fcf84027e8
Merge pull request #14555 from mubashir1osmani/dd_spend_metric
...
DataDog shows spend metrics
2025-09-16 22:44:47 -07:00
Mubashir Osmani
0fde408e35
added langfuse logging for responses api ( #14597 )
...
* added langfuse logging for responses api
* tests added
2025-09-16 21:43:19 -07:00
mubashir1osmani
e56b11cb54
added tests
2025-09-17 00:19:03 -04:00
mubashir1osmani
f5f00043ce
fixed tests
2025-09-16 00:14:48 -04:00
Fabrício Ceschin
c5aa6f540f
Merge branch 'BerriAI:main' into LangfuseUsageDetails
2025-09-15 15:51:38 -04:00
Mubashir Osmani
321d5299b2
s3_endpoint_url returned 404 ( #14559 )
...
* added spend metrics
* feat: Add Spend metrics in datadog
* fix: lint errors
* fix: s3 endpoint url logging
* fixed lint errors
* remove from branch
This reverts commit e123cae06ee694cc102a6156590190
2025-09-15 12:08:18 -07:00
Fabrício Ceschin
1a715b2eb3
Merge branch 'BerriAI:main' into LangfuseUsageDetails
2025-09-15 09:20:27 -04:00
mubashir1osmani
e694cc102a
feat: Add Spend metrics in datadog
2025-09-14 14:42:26 -04:00
Krish Dholakia
510332b886
Merge pull request #14491 from Rasmusafj/main
...
Resolve cache key collision issue where all soft budget alerts use identical cache keys
2025-09-14 00:51:27 -07:00
Krish Dholakia
dc4bbba0a5
Merge pull request #14520 from boopesh07/email_prometheus
...
Added user_email labels to the prometheus monitoring.
2025-09-13 23:19:46 -07:00
mubashir1osmani
6156590190
added spend metrics
2025-09-13 01:38:08 -04:00
mubashir1osmani
fd11159148
fix: DD tool calls passed in metadata
2025-09-13 00:11:18 -04:00
boopesh07
36299dbc73
Added user_email labels to the prometheus monitoring.
2025-09-12 15:38:23 -07:00
rasmus.arpe@gmail.com
b8c362e443
add tests for the fix
2025-09-12 12:07:08 +02:00
Fabricio Ceschin
faaae888f1
Merge conflicts
2025-09-08 11:34:45 -04:00
Ishaan Jaff
b1552cae46
fix mocked CZ tests
2025-09-06 14:33:02 -07:00
Ishaan Jaff
fc7accad74
test_dry_run_export_usage_data_cbf_transformation_failure
2025-09-06 13:59:28 -07:00
Ishaan Jaff
5310bba35b
[Feat] Litellm x CloudZero Integration - Cost Tracking ( #14296 )
...
* fix: just pull LiteLLM_DailyUserSpend
* get the team_id from user daily spend table
* cloudzero_dry_run_export
* fix CZ endpoints
* trace entity_id
* fix: get_usage_data
* fix get_usage_data
* fix _create_cbf_record
* fix get_usage_data
* ensure start and end time is used for exporting data
* fix init_cloudzero_background_job
* fix CloudZeroExportRequest
* fix initialize_cloudzero_export_job
* fix initialize_cloudzero_export_job
* allow init with env + config.yaml for cloudzero
* fix: init CZ through config.yaml
* fix DRY run on CZ
* TestCloudZeroDryRunEndpoint
* fix: CLOUDZERO_EXPORT_INTERVAL_MINUTES
* fix init_cloudzero_background_job
* fix exporting data
* fix transform
* stash cloudzero docs
* docs: CloudZero
* ruff fix
* fix rendering key alias
* fix polars
2025-09-05 21:29:41 -07:00
Ishaan Jaff
0a60390521
Revert "[Feat] LiteLLM CloudZero Integration updates - using LiteLLM_SpendLogs Table ( #12922 )"
...
This reverts commit e3b752d3dc
2025-09-05 10:04:07 -07:00
Krish Dholakia
62d4623d1c
Merge pull request #14107 from uc4w6c/feat/add_guardrails_anthropic
...
feat: Add guardrail to the Anthropic API endpoint
2025-09-04 20:50:43 -07:00
Ishaan Jaff
1352545617
[Fix] DD LLM Observability - Ensure apm_id is set on traces ( #14272 )
...
* add apm_id for DD LLM
* feat: add _get_apm_trace_id
2025-09-04 14:35:41 -07:00
Krish Dholakia
35b501b8d5
Merge pull request #14176 from mjmendo/feat/alert_type_in_slack_message
...
feat: added alert type to alert messate to slack for easier handling
2025-09-02 23:05:41 -07:00
Marcelo Mendoza
db1b418b15
fix: update alert type formatting to handle enum names in Slack messages
2025-09-02 17:54:54 +02:00
Keith Decker
5dcdbb35da
add metrics and logs (events) with semconv attributes
2025-09-02 09:20:25 -06:00
Marcelo Mendoza
92f631d57c
fix: correct formatting of alert messages in Slack notifications
2025-09-02 15:12:11 +00:00
Krrish Dholakia
4a422ca897
fix: support logging dynamic metadata values to braintrust
2025-09-01 17:38:15 -07:00
Yuta Saito
d83c420d48
feat: Add guardrail for the Anthropic API endpoint
2025-08-31 16:44:01 +09:00
Krish Dholakia
ead7e7259b
Merge pull request #13152 from betterthanbreakfast/bug-openmeter-user-id-from-token
...
[Bug]: Set user from token user_id for OpenMeter integration
2025-08-29 22:21:26 -07:00
Ishaan Jaff
165242e31f
[Feat] langfuse_otel logger - allow using LANGFUSE_OTEL_HOST for configuring host ( #14013 )
...
* feat - add _get_langfuse_otel_host
* test_get_langfuse_otel_config_with_otel_host_priority
* docs: LANGFUSE_OTEL_HOST
2025-08-27 14:43:47 -07:00
Cole French
6696955506
[Bug]: Fix tests to reference moved attributes in braintrust_logging module ( #13978 )
...
* Mock instance attribute moved from globals
* Support looking up mock message on mock choice
2025-08-26 18:58:16 -07:00
Krish Dholakia
ae678a6642
Merge pull request #13573 from Ivy-Interactive/feature/braintrust-span-name-metadata
...
Feature/braintrust span name metadata
2025-08-25 23:19:56 -07:00
Tomu Hirata
5879f6e930
comment
2025-08-20 15:46:53 +09:00
Tomu Hirata
d64b579131
Include predicted output in tracing
...
Signed-off-by: Tomu Hirata <tomu.hirata@gmail.com>
2025-08-20 15:39:32 +09:00
Ishaan Jaff
195ea6515e
[Feat] Datadog LLM Observability - Add support for tracing guardrail input/output ( #13767 )
...
* add guardrail information on DD LLM Obs
* test_guardrail_information_in_metadata
2025-08-19 10:26:25 -07:00
Ishaan Jaff
ba1d2e8749
[Feat] DD LLM Observability - Add time to first token, litellm overhead, guardrail overhead latency metrics ( #13734 )
...
* fixes for DDLLMObsLatencyMetrics
* use _get_latency_metrics
* DD LLM Obs - track latency metrics
* fixes for bedrock guardrails
* DD unit tests
* test DD
2025-08-18 17:38:04 -07:00
Ishaan Jaff
ef08e18c66
[Feat] Datadog LLM Observability - Add support for Failure Logging ( #13726 )
...
* add async_log_failure_event for DD LLM Obs
* update types
* DataDogLLMObsLogger add failure logging support
* test_async_log_failure_event
* dd test failure
2025-08-18 15:19:48 -07:00
TomuHirata
f6e53deacd
Update mlflow logger usage span attributes ( #13561 )
...
* test: sync mlflow request tags
* fix test
2025-08-14 15:20:50 -07:00
nielsbosma
fe54da79a1
test(braintrust-logging): add span_name tests for events
...
Add tests to verify custom and default span_name in BraintrustLogger,
including async, metadata merging, and span name behavior.
2025-08-13 12:26:14 +02:00
