Skip to content

feat(llmobs): add tag source:otel to evals if DD_TRACE_OTEL_ENABLED=true#15538

Merged
ZStriker19 merged 5 commits intomainfrom
zachg/llmobs_otel_evals_update
Dec 19, 2025
Merged

feat(llmobs): add tag source:otel to evals if DD_TRACE_OTEL_ENABLED=true#15538
ZStriker19 merged 5 commits intomainfrom
zachg/llmobs_otel_evals_update

Conversation

@ZStriker19
Copy link
Copy Markdown
Collaborator

@ZStriker19 ZStriker19 commented Dec 5, 2025 •
edited
Loading

Description

Auto-add source:otel tag to LLMObs evaluations when OTel tracing is enabled

When DD_TRACE_OTEL_ENABLED=true, automatically adds source:otel tag to all submitted evaluations. This allows the backend to wait ~3 minutes for OTel span conversion before discarding unmatched evaluations.

Changes

  • Add source:otel tag in submit_evaluation() when OTel tracing is enabled

Testing

Tested manually and also added tests:

  • test_submit_evaluation_adds_source_otel_when_otel_enabled
  • test_submit_evaluation_no_source_otel_when_otel_disabled

Risks

Additional Notes

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Dec 5, 2025 •
edited
Loading

CODEOWNERS have been resolved as:

releasenotes/notes/llmobs_otel_evals-b63e6f953b4c806c.yaml              @DataDog/apm-python
tests/llmobs/test_llmobs_otel_evaluation.py                             @DataDog/ml-observability
ddtrace/llmobs/_llmobs.py                                               @DataDog/ml-observability

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Dec 5, 2025 •
edited
Loading

Bootstrap import analysis

Comparison of import times between this PR and base.

Summary

The average import time from this PR is: 249 ± 3 ms.

The average import time from base is: 254 ± 4 ms.

The import time difference between this PR and base is: -4.4 ± 0.2 ms.

Import time breakdown

The following import paths have shrunk:

ddtrace.auto 2.827 ms (1.13%)
ddtrace.bootstrap.sitecustomize 1.450 ms (0.58%)
ddtrace.bootstrap.preload 1.450 ms (0.58%)
ddtrace.internal.remoteconfig.client 0.672 ms (0.27%)
ddtrace 1.377 ms (0.55%)
ddtrace._logger 0.690 ms (0.28%)
ddtrace.internal.telemetry 0.690 ms (0.28%)
ddtrace.internal.telemetry.writer 0.690 ms (0.28%)
ddtrace.internal.utils.version 0.690 ms (0.28%)
ddtrace.version 0.690 ms (0.28%)
ddtrace.internal._unpatched 0.031 ms (0.01%)
json 0.031 ms (0.01%)
json.decoder 0.031 ms (0.01%)
re 0.031 ms (0.01%)
enum 0.031 ms (0.01%)
types 0.031 ms (0.01%)

@pr-commenter
Copy link
Copy Markdown

pr-commenter Bot commented Dec 5, 2025 •
edited
Loading

Performance SLOs

Comparing candidate zachg/llmobs_otel_evals_update (6b4daa3) with baseline main (fd1f2f9)

📈 Performance Regressions (2 suites)
📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 5.137µs (SLO: <10.000µs 📉 -48.6%) vs baseline: 📈 +21.6%

Memory: ✅ 38.633MB (SLO: <41.000MB -5.8%) vs baseline: +5.1%

✅ ospathbasename_noaspect

Time: ✅ 1.079µs (SLO: <10.000µs 📉 -89.2%) vs baseline: -0.7%

Memory: ✅ 38.633MB (SLO: <41.000MB -5.8%) vs baseline: +5.9%

✅ ospathjoin_aspect

Time: ✅ 6.009µs (SLO: <10.000µs 📉 -39.9%) vs baseline: ~same

Memory: ✅ 38.633MB (SLO: <41.000MB -5.8%) vs baseline: +5.1%

✅ ospathjoin_noaspect

Time: ✅ 2.285µs (SLO: <10.000µs 📉 -77.1%) vs baseline: +0.3%

Memory: ✅ 38.614MB (SLO: <41.000MB -5.8%) vs baseline: +5.0%

✅ ospathnormcase_aspect

Time: ✅ 3.519µs (SLO: <10.000µs 📉 -64.8%) vs baseline: +1.0%

Memory: ✅ 38.614MB (SLO: <41.000MB -5.8%) vs baseline: +4.9%

✅ ospathnormcase_noaspect

Time: ✅ 0.568µs (SLO: <10.000µs 📉 -94.3%) vs baseline: -2.2%

Memory: ✅ 38.633MB (SLO: <41.000MB -5.8%) vs baseline: +5.9%

✅ ospathsplit_aspect

Time: ✅ 4.856µs (SLO: <10.000µs 📉 -51.4%) vs baseline: -0.3%

Memory: ✅ 38.653MB (SLO: <41.000MB -5.7%) vs baseline: +5.6%

✅ ospathsplit_noaspect

Time: ✅ 1.601µs (SLO: <10.000µs 📉 -84.0%) vs baseline: +0.5%

Memory: ✅ 38.633MB (SLO: <41.000MB -5.8%) vs baseline: +5.0%

✅ ospathsplitdrive_aspect

Time: ✅ 3.721µs (SLO: <10.000µs 📉 -62.8%) vs baseline: +0.4%

Memory: ✅ 38.594MB (SLO: <41.000MB -5.9%) vs baseline: +4.8%

✅ ospathsplitdrive_noaspect

Time: ✅ 0.701µs (SLO: <10.000µs 📉 -93.0%) vs baseline: +0.3%

Memory: ✅ 38.555MB (SLO: <41.000MB -6.0%) vs baseline: +4.8%

✅ ospathsplitext_aspect

Time: ✅ 4.622µs (SLO: <10.000µs 📉 -53.8%) vs baseline: ~same

Memory: ✅ 38.633MB (SLO: <41.000MB -5.8%) vs baseline: +5.1%

✅ ospathsplitext_noaspect

Time: ✅ 1.385µs (SLO: <10.000µs 📉 -86.1%) vs baseline: -0.5%

Memory: ✅ 38.535MB (SLO: <41.000MB -6.0%) vs baseline: +5.7%

📈 telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 3.522µs (SLO: <20.000µs 📉 -82.4%) vs baseline: 📈 +14.0%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.2%

✅ 1-count-metrics-100-times

Time: ✅ 207.495µs (SLO: <220.000µs -5.7%) vs baseline: -2.0%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +5.1%

✅ 1-distribution-metric-1-times

Time: ✅ 3.396µs (SLO: <20.000µs 📉 -83.0%) vs baseline: -1.3%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.2%

✅ 1-distribution-metrics-100-times

Time: ✅ 221.695µs (SLO: <230.000µs -3.6%) vs baseline: -0.5%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.9%

✅ 1-gauge-metric-1-times

Time: ✅ 2.228µs (SLO: <20.000µs 📉 -88.9%) vs baseline: -0.2%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.6%

✅ 1-gauge-metrics-100-times

Time: ✅ 137.966µs (SLO: <150.000µs -8.0%) vs baseline: +0.5%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.8%

✅ 1-rate-metric-1-times

Time: ✅ 3.215µs (SLO: <20.000µs 📉 -83.9%) vs baseline: -1.3%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +5.2%

✅ 1-rate-metrics-100-times

Time: ✅ 220.569µs (SLO: <250.000µs 📉 -11.8%) vs baseline: -0.7%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.9%

✅ 100-count-metrics-100-times

Time: ✅ 20.880ms (SLO: <22.000ms -5.1%) vs baseline: -0.3%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.4%

✅ 100-distribution-metrics-100-times

Time: ✅ 2.277ms (SLO: <2.550ms 📉 -10.7%) vs baseline: -0.9%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.7%

✅ 100-gauge-metrics-100-times

Time: ✅ 1.428ms (SLO: <1.550ms -7.9%) vs baseline: +0.9%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.6%

✅ 100-rate-metrics-100-times

Time: ✅ 2.275ms (SLO: <2.550ms 📉 -10.8%) vs baseline: +0.4%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.6%

✅ flush-1-metric

Time: ✅ 4.679µs (SLO: <20.000µs 📉 -76.6%) vs baseline: +0.2%

Memory: ✅ 35.114MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +4.7%

✅ flush-100-metrics

Time: ✅ 175.253µs (SLO: <250.000µs 📉 -29.9%) vs baseline: ~same

Memory: ✅ 35.193MB (SLO: <35.500MB 🟡 -0.9%) vs baseline: +4.8%

✅ flush-1000-metrics

Time: ✅ 2.168ms (SLO: <2.500ms 📉 -13.3%) vs baseline: -0.3%

Memory: ✅ 36.058MB (SLO: <36.500MB 🟡 -1.2%) vs baseline: +5.0%

🟡 Near SLO Breach (15 suites)
🟡 coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.218µs (SLO: <20.000µs 📉 -33.9%) vs baseline: -0.5%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.1%

✅ context_with_data_no_listeners

Time: ✅ 3.262µs (SLO: <10.000µs 📉 -67.4%) vs baseline: -0.5%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.6%

✅ get_item_exists

Time: ✅ 0.580µs (SLO: <10.000µs 📉 -94.2%) vs baseline: +0.7%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.2%

✅ get_item_missing

Time: ✅ 0.638µs (SLO: <10.000µs 📉 -93.6%) vs baseline: ~same

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.8%

✅ set_item

Time: ✅ 23.911µs (SLO: <30.000µs 📉 -20.3%) vs baseline: -0.8%

Memory: ✅ 34.760MB (SLO: <35.500MB -2.1%) vs baseline: +4.7%

🟡 djangosimple - 30/30

✅ appsec

Time: ✅ 19.572ms (SLO: <22.300ms 📉 -12.2%) vs baseline: +0.1%

Memory: ✅ 68.321MB (SLO: <70.500MB -3.1%) vs baseline: +5.0%

✅ exception-replay-enabled

Time: ✅ 1.363ms (SLO: <1.450ms -6.0%) vs baseline: -0.2%

Memory: ✅ 66.252MB (SLO: <67.500MB 🟡 -1.8%) vs baseline: +4.8%

✅ iast

Time: ✅ 19.659ms (SLO: <22.250ms 📉 -11.6%) vs baseline: +0.4%

Memory: ✅ 68.321MB (SLO: <70.000MB -2.4%) vs baseline: +5.0%

✅ profiler

Time: ✅ 15.424ms (SLO: <16.550ms -6.8%) vs baseline: +0.2%

Memory: ✅ 56.348MB (SLO: <57.500MB -2.0%) vs baseline: +4.9%

✅ resource-renaming

Time: ✅ 19.457ms (SLO: <21.750ms 📉 -10.5%) vs baseline: +0.2%

Memory: ✅ 68.321MB (SLO: <70.500MB -3.1%) vs baseline: +4.9%

✅ span-code-origin

Time: ✅ 19.871ms (SLO: <28.200ms 📉 -29.5%) vs baseline: +0.8%

Memory: ✅ 68.034MB (SLO: <71.000MB -4.2%) vs baseline: +4.6%

✅ tracer

Time: ✅ 19.604ms (SLO: <21.750ms -9.9%) vs baseline: +0.2%

Memory: ✅ 68.243MB (SLO: <70.000MB -2.5%) vs baseline: +4.7%

✅ tracer-and-profiler

Time: ✅ 21.742ms (SLO: <23.500ms -7.5%) vs baseline: -0.2%

Memory: ✅ 69.265MB (SLO: <71.000MB -2.4%) vs baseline: +4.8%

✅ tracer-dont-create-db-spans

Time: ✅ 19.677ms (SLO: <21.500ms -8.5%) vs baseline: ~same

Memory: ✅ 68.361MB (SLO: <70.000MB -2.3%) vs baseline: +5.0%

✅ tracer-minimal

Time: ✅ 16.772ms (SLO: <17.500ms -4.2%) vs baseline: +0.3%

Memory: ✅ 67.987MB (SLO: <70.000MB -2.9%) vs baseline: +4.9%

✅ tracer-native

Time: ✅ 19.515ms (SLO: <21.750ms 📉 -10.3%) vs baseline: ~same

Memory: ✅ 68.243MB (SLO: <72.500MB -5.9%) vs baseline: +4.8%

✅ tracer-no-caches

Time: ✅ 17.683ms (SLO: <19.650ms 📉 -10.0%) vs baseline: +0.3%

Memory: ✅ 67.839MB (SLO: <70.000MB -3.1%) vs baseline: +4.7%

✅ tracer-no-databases

Time: ✅ 19.182ms (SLO: <20.100ms -4.6%) vs baseline: +0.7%

Memory: ✅ 67.948MB (SLO: <70.000MB -2.9%) vs baseline: +4.9%

✅ tracer-no-middleware

Time: ✅ 19.342ms (SLO: <21.500ms 📉 -10.0%) vs baseline: +0.9%

Memory: ✅ 68.026MB (SLO: <70.000MB -2.8%) vs baseline: +4.6%

✅ tracer-no-templates

Time: ✅ 19.528ms (SLO: <22.000ms 📉 -11.2%) vs baseline: +0.9%

Memory: ✅ 68.141MB (SLO: <70.500MB -3.3%) vs baseline: +4.8%

🟡 errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 16.272ms (SLO: <19.850ms 📉 -18.0%) vs baseline: -0.2%

Memory: ✅ 69.855MB (SLO: <70.000MB 🟡 -0.2%) vs baseline: +4.9%

✅ errortracking-enabled-user

Time: ✅ 16.277ms (SLO: <19.400ms 📉 -16.1%) vs baseline: -0.5%

Memory: ✅ 69.933MB (SLO: <70.000MB 🟡 ~same) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 16.381ms (SLO: <19.450ms 📉 -15.8%) vs baseline: ~same

Memory: ✅ 69.796MB (SLO: <70.000MB 🟡 -0.3%) vs baseline: +4.7%

🟡 errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.067ms (SLO: <2.300ms 📉 -10.1%) vs baseline: -0.2%

Memory: ✅ 55.699MB (SLO: <56.500MB 🟡 -1.4%) vs baseline: +5.0%

✅ errortracking-enabled-user

Time: ✅ 2.074ms (SLO: <2.250ms -7.8%) vs baseline: +0.2%

Memory: ✅ 55.699MB (SLO: <56.500MB 🟡 -1.4%) vs baseline: +4.7%

✅ tracer-enabled

Time: ✅ 2.066ms (SLO: <2.300ms 📉 -10.2%) vs baseline: ~same

Memory: ✅ 55.699MB (SLO: <56.500MB 🟡 -1.4%) vs baseline: +4.9%

🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 3.384ms (SLO: <4.750ms 📉 -28.8%) vs baseline: +0.2%

Memory: ✅ 55.375MB (SLO: <66.500MB 📉 -16.7%) vs baseline: +4.8%

✅ appsec-post

Time: ✅ 2.855ms (SLO: <6.750ms 📉 -57.7%) vs baseline: ~same

Memory: ✅ 55.671MB (SLO: <66.500MB 📉 -16.3%) vs baseline: +4.8%

✅ appsec-telemetry

Time: ✅ 3.382ms (SLO: <4.750ms 📉 -28.8%) vs baseline: +0.6%

Memory: ✅ 55.393MB (SLO: <66.500MB 📉 -16.7%) vs baseline: +4.7%

✅ debugger

Time: ✅ 1.866ms (SLO: <2.000ms -6.7%) vs baseline: ~same

Memory: ✅ 47.885MB (SLO: <49.500MB -3.3%) vs baseline: +5.1%

✅ iast-get

Time: ✅ 1.854ms (SLO: <2.000ms -7.3%) vs baseline: ~same

Memory: ✅ 44.521MB (SLO: <49.000MB -9.1%) vs baseline: +4.7%

✅ profiler

Time: ✅ 1.906ms (SLO: <2.100ms -9.2%) vs baseline: -0.5%

Memory: ✅ 48.807MB (SLO: <50.000MB -2.4%) vs baseline: +4.8%

✅ resource-renaming

Time: ✅ 3.361ms (SLO: <3.650ms -7.9%) vs baseline: -0.3%

Memory: ✅ 55.431MB (SLO: <56.000MB 🟡 -1.0%) vs baseline: +4.9%

✅ tracer

Time: ✅ 3.369ms (SLO: <3.650ms -7.7%) vs baseline: ~same

Memory: ✅ 55.412MB (SLO: <56.500MB 🟡 -1.9%) vs baseline: +4.7%

✅ tracer-native

Time: ✅ 3.371ms (SLO: <3.650ms -7.7%) vs baseline: -0.1%

Memory: ✅ 55.492MB (SLO: <60.000MB -7.5%) vs baseline: +4.9%

🟡 flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 2.061ms (SLO: <4.200ms 📉 -50.9%) vs baseline: ~same

Memory: ✅ 55.719MB (SLO: <66.000MB 📉 -15.6%) vs baseline: +4.9%

✅ iast-enabled

Time: ✅ 2.064ms (SLO: <2.800ms 📉 -26.3%) vs baseline: -0.2%

Memory: ✅ 55.679MB (SLO: <62.500MB 📉 -10.9%) vs baseline: +4.8%

✅ tracer-enabled

Time: ✅ 2.056ms (SLO: <2.250ms -8.6%) vs baseline: ~same

Memory: ✅ 55.679MB (SLO: <56.500MB 🟡 -1.5%) vs baseline: +4.9%

🟡 httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 82.210µs (SLO: <100.000µs 📉 -17.8%) vs baseline: -0.5%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.9%

✅ b3_headers

Time: ✅ 14.239µs (SLO: <20.000µs 📉 -28.8%) vs baseline: -1.5%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.7%

✅ b3_single_headers

Time: ✅ 13.265µs (SLO: <20.000µs 📉 -33.7%) vs baseline: -1.5%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.0%

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 64.293µs (SLO: <80.000µs 📉 -19.6%) vs baseline: ~same

Memory: ✅ 35.016MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.3%

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 69.694µs (SLO: <80.000µs 📉 -12.9%) vs baseline: +4.4%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.9%

✅ empty_headers

Time: ✅ 1.631µs (SLO: <10.000µs 📉 -83.7%) vs baseline: +1.0%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.7%

✅ full_t_id_datadog_headers

Time: ✅ 22.845µs (SLO: <30.000µs 📉 -23.8%) vs baseline: ~same

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.1%

✅ invalid_priority_header

Time: ✅ 6.583µs (SLO: <10.000µs 📉 -34.2%) vs baseline: +0.5%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +5.1%

✅ invalid_span_id_header

Time: ✅ 6.543µs (SLO: <10.000µs 📉 -34.6%) vs baseline: -0.5%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +5.2%

✅ invalid_tags_header

Time: ✅ 6.529µs (SLO: <10.000µs 📉 -34.7%) vs baseline: ~same

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.6%

✅ invalid_trace_id_header

Time: ✅ 6.551µs (SLO: <10.000µs 📉 -34.5%) vs baseline: +0.7%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.9%

✅ large_header_no_matches

Time: ✅ 27.560µs (SLO: <30.000µs -8.1%) vs baseline: +0.2%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.6%

✅ large_valid_headers_all

Time: ✅ 28.712µs (SLO: <40.000µs 📉 -28.2%) vs baseline: ~same

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.0%

✅ medium_header_no_matches

Time: ✅ 9.874µs (SLO: <20.000µs 📉 -50.6%) vs baseline: -0.4%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.9%

✅ medium_valid_headers_all

Time: ✅ 11.276µs (SLO: <20.000µs 📉 -43.6%) vs baseline: +0.1%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.9%

✅ none_propagation_style

Time: ✅ 1.714µs (SLO: <10.000µs 📉 -82.9%) vs baseline: -1.6%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.3%

✅ tracecontext_headers

Time: ✅ 34.967µs (SLO: <40.000µs 📉 -12.6%) vs baseline: ~same

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.9%

✅ valid_headers_all

Time: ✅ 6.546µs (SLO: <10.000µs 📉 -34.5%) vs baseline: +0.7%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.0%

✅ valid_headers_basic

Time: ✅ 6.116µs (SLO: <10.000µs 📉 -38.8%) vs baseline: +0.1%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.7%

✅ wsgi_empty_headers

Time: ✅ 1.616µs (SLO: <10.000µs 📉 -83.8%) vs baseline: -0.2%

Memory: ✅ 34.898MB (SLO: <35.500MB 🟡 -1.7%) vs baseline: +4.6%

✅ wsgi_invalid_priority_header

Time: ✅ 6.565µs (SLO: <10.000µs 📉 -34.4%) vs baseline: -0.4%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +5.0%

✅ wsgi_invalid_span_id_header

Time: ✅ 1.623µs (SLO: <10.000µs 📉 -83.8%) vs baseline: +0.5%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.8%

✅ wsgi_invalid_tags_header

Time: ✅ 6.586µs (SLO: <10.000µs 📉 -34.1%) vs baseline: +0.1%

Memory: ✅ 35.016MB (SLO: <35.500MB 🟡 -1.4%) vs baseline: +5.4%

✅ wsgi_invalid_trace_id_header

Time: ✅ 6.541µs (SLO: <10.000µs 📉 -34.6%) vs baseline: ~same

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.7%

✅ wsgi_large_header_no_matches

Time: ✅ 28.899µs (SLO: <40.000µs 📉 -27.8%) vs baseline: +0.7%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.6%

✅ wsgi_large_valid_headers_all

Time: ✅ 29.859µs (SLO: <40.000µs 📉 -25.4%) vs baseline: +0.3%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +4.9%

✅ wsgi_medium_header_no_matches

Time: ✅ 10.045µs (SLO: <20.000µs 📉 -49.8%) vs baseline: -0.4%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.4%

✅ wsgi_medium_valid_headers_all

Time: ✅ 11.533µs (SLO: <20.000µs 📉 -42.3%) vs baseline: +0.2%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.0%

✅ wsgi_valid_headers_all

Time: ✅ 6.580µs (SLO: <10.000µs 📉 -34.2%) vs baseline: +0.6%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%

✅ wsgi_valid_headers_basic

Time: ✅ 6.148µs (SLO: <10.000µs 📉 -38.5%) vs baseline: +1.2%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.9%

🟡 httppropagationinject - 16/16

✅ ids_only

Time: ✅ 21.657µs (SLO: <30.000µs 📉 -27.8%) vs baseline: +4.3%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.8%

✅ with_all

Time: ✅ 27.717µs (SLO: <40.000µs 📉 -30.7%) vs baseline: +0.2%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.0%

✅ with_dd_origin

Time: ✅ 24.425µs (SLO: <30.000µs 📉 -18.6%) vs baseline: ~same

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.9%

✅ with_priority_and_origin

Time: ✅ 23.713µs (SLO: <40.000µs 📉 -40.7%) vs baseline: -0.3%

Memory: ✅ 34.957MB (SLO: <35.500MB 🟡 -1.5%) vs baseline: +4.9%

✅ with_sampling_priority

Time: ✅ 20.873µs (SLO: <30.000µs 📉 -30.4%) vs baseline: +1.1%

Memory: ✅ 34.839MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.4%

✅ with_tags

Time: ✅ 25.807µs (SLO: <40.000µs 📉 -35.5%) vs baseline: -0.1%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.8%

✅ with_tags_invalid

Time: ✅ 27.184µs (SLO: <40.000µs 📉 -32.0%) vs baseline: -0.4%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%

✅ with_tags_max_size

Time: ✅ 26.233µs (SLO: <40.000µs 📉 -34.4%) vs baseline: -0.4%

Memory: ✅ 34.937MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +4.7%

🟡 otelspan - 22/22

✅ add-event

Time: ✅ 40.182ms (SLO: <47.150ms 📉 -14.8%) vs baseline: -0.3%

Memory: ✅ 39.606MB (SLO: <47.000MB 📉 -15.7%) vs baseline: +4.9%

✅ add-metrics

Time: ✅ 259.243ms (SLO: <344.800ms 📉 -24.8%) vs baseline: -1.3%

Memory: ✅ 43.936MB (SLO: <47.500MB -7.5%) vs baseline: +5.1%

✅ add-tags

Time: ✅ 316.881ms (SLO: <321.000ms 🟡 -1.3%) vs baseline: ~same

Memory: ✅ 43.708MB (SLO: <47.500MB -8.0%) vs baseline: +4.7%

✅ get-context

Time: ✅ 79.980ms (SLO: <92.350ms 📉 -13.4%) vs baseline: -0.3%

Memory: ✅ 39.903MB (SLO: <46.500MB 📉 -14.2%) vs baseline: +4.8%

✅ is-recording

Time: ✅ 37.855ms (SLO: <44.500ms 📉 -14.9%) vs baseline: +0.5%

Memory: ✅ 39.524MB (SLO: <47.500MB 📉 -16.8%) vs baseline: +4.8%

✅ record-exception

Time: ✅ 58.711ms (SLO: <67.650ms 📉 -13.2%) vs baseline: -0.4%

Memory: ✅ 40.070MB (SLO: <47.000MB 📉 -14.7%) vs baseline: +5.0%

✅ set-status

Time: ✅ 44.175ms (SLO: <50.400ms 📉 -12.4%) vs baseline: -0.3%

Memory: ✅ 39.525MB (SLO: <47.000MB 📉 -15.9%) vs baseline: +4.6%

✅ start

Time: ✅ 38.158ms (SLO: <43.450ms 📉 -12.2%) vs baseline: +2.7%

Memory: ✅ 39.477MB (SLO: <47.000MB 📉 -16.0%) vs baseline: +4.5%

✅ start-finish

Time: ✅ 82.659ms (SLO: <88.000ms -6.1%) vs baseline: +0.5%

Memory: ✅ 37.375MB (SLO: <46.500MB 📉 -19.6%) vs baseline: +4.9%

✅ start-finish-telemetry

Time: ✅ 83.878ms (SLO: <89.000ms -5.8%) vs baseline: ~same

Memory: ✅ 37.356MB (SLO: <46.500MB 📉 -19.7%) vs baseline: +4.9%

✅ update-name

Time: ✅ 38.653ms (SLO: <45.150ms 📉 -14.4%) vs baseline: -0.3%

Memory: ✅ 39.535MB (SLO: <47.000MB 📉 -15.9%) vs baseline: +4.3%

🟡 ratelimiter - 12/12

✅ defaults

Time: ✅ 2.340µs (SLO: <10.000µs 📉 -76.6%) vs baseline: -1.1%

Memory: ✅ 35.095MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +4.9%

✅ high_rate_limit

Time: ✅ 2.419µs (SLO: <10.000µs 📉 -75.8%) vs baseline: ~same

Memory: ✅ 35.114MB (SLO: <35.500MB 🟡 -1.1%) vs baseline: +5.2%

✅ long_window

Time: ✅ 2.353µs (SLO: <10.000µs 📉 -76.5%) vs baseline: -0.5%

Memory: ✅ 35.075MB (SLO: <35.500MB 🟡 -1.2%) vs baseline: +4.8%

✅ low_rate_limit

Time: ✅ 2.350µs (SLO: <10.000µs 📉 -76.5%) vs baseline: -0.4%

Memory: ✅ 35.193MB (SLO: <35.500MB 🟡 -0.9%) vs baseline: +5.2%

✅ no_rate_limit

Time: ✅ 0.823µs (SLO: <10.000µs 📉 -91.8%) vs baseline: ~same

Memory: ✅ 35.055MB (SLO: <35.500MB 🟡 -1.3%) vs baseline: +4.7%

✅ short_window

Time: ✅ 2.467µs (SLO: <10.000µs 📉 -75.3%) vs baseline: -0.8%

Memory: ✅ 35.134MB (SLO: <35.500MB 🟡 -1.0%) vs baseline: +4.8%

🟡 recursivecomputation - 8/8

✅ deep

Time: ✅ 308.735ms (SLO: <320.950ms -3.8%) vs baseline: -0.1%

Memory: ✅ 35.960MB (SLO: <36.500MB 🟡 -1.5%) vs baseline: +4.7%

✅ deep-profiled

Time: ✅ 327.675ms (SLO: <359.150ms -8.8%) vs baseline: -0.4%

Memory: ✅ 39.931MB (SLO: <40.500MB 🟡 -1.4%) vs baseline: +4.8%

✅ medium

Time: ✅ 6.986ms (SLO: <7.400ms -5.6%) vs baseline: -0.1%

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.7%

✅ shallow

Time: ✅ 0.948ms (SLO: <1.050ms -9.8%) vs baseline: +1.1%

Memory: ✅ 34.859MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.0%

🟡 samplingrules - 8/8

✅ average_match

Time: ✅ 136.608µs (SLO: <290.000µs 📉 -52.9%) vs baseline: -0.5%

Memory: ✅ 34.819MB (SLO: <35.500MB 🟡 -1.9%) vs baseline: +4.7%

✅ high_match

Time: ✅ 173.718µs (SLO: <480.000µs 📉 -63.8%) vs baseline: +0.3%

Memory: ✅ 34.741MB (SLO: <35.500MB -2.1%) vs baseline: +4.6%

✅ low_match

Time: ✅ 98.980µs (SLO: <120.000µs 📉 -17.5%) vs baseline: -0.6%

Memory: ✅ 603.575MB (SLO: <700.000MB 📉 -13.8%) vs baseline: +4.9%

✅ very_low_match

Time: ✅ 2.656ms (SLO: <8.500ms 📉 -68.7%) vs baseline: -0.1%

Memory: ✅ 71.133MB (SLO: <75.000MB -5.2%) vs baseline: +4.9%

🟡 sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.670µs (SLO: <20.000µs 📉 -46.7%) vs baseline: +1.4%

Memory: ✅ 35.448MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +4.9%

✅ all-enabled

Time: ✅ 41.049µs (SLO: <50.000µs 📉 -17.9%) vs baseline: +2.9%

Memory: ✅ 35.488MB (SLO: <36.000MB 🟡 -1.4%) vs baseline: +5.2%

✅ collectipvariant_exists

Time: ✅ 40.915µs (SLO: <50.000µs 📉 -18.2%) vs baseline: +0.2%

Memory: ✅ 35.468MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +5.1%

✅ no-collectipvariant

Time: ✅ 40.250µs (SLO: <50.000µs 📉 -19.5%) vs baseline: +0.5%

Memory: ✅ 35.330MB (SLO: <36.000MB 🟡 -1.9%) vs baseline: +4.6%

✅ no-useragentvariant

Time: ✅ 38.803µs (SLO: <50.000µs 📉 -22.4%) vs baseline: -0.4%

Memory: ✅ 35.566MB (SLO: <36.000MB 🟡 -1.2%) vs baseline: +5.3%

✅ obfuscation-no-query

Time: ✅ 40.594µs (SLO: <50.000µs 📉 -18.8%) vs baseline: +0.2%

Memory: ✅ 35.389MB (SLO: <36.000MB 🟡 -1.7%) vs baseline: +5.0%

✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.685µs (SLO: <90.000µs 📉 -15.9%) vs baseline: -0.2%

Memory: ✅ 35.704MB (SLO: <36.500MB -2.2%) vs baseline: +5.0%

✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.393µs (SLO: <90.000µs 📉 -15.1%) vs baseline: ~same

Memory: ✅ 35.822MB (SLO: <36.500MB 🟡 -1.9%) vs baseline: +5.3%

✅ obfuscation-send-querystring-disabled

Time: ✅ 154.282µs (SLO: <170.000µs -9.2%) vs baseline: +0.1%

Memory: ✅ 35.566MB (SLO: <36.500MB -2.6%) vs baseline: +4.5%

✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.691µs (SLO: <160.000µs -7.1%) vs baseline: ~same

Memory: ✅ 35.783MB (SLO: <36.500MB 🟡 -2.0%) vs baseline: +5.1%

✅ obfuscation-worst-case-implicit-query

Time: ✅ 154.827µs (SLO: <170.000µs -8.9%) vs baseline: ~same

Memory: ✅ 35.704MB (SLO: <36.500MB -2.2%) vs baseline: +4.7%

✅ useragentvariant_exists_1

Time: ✅ 39.636µs (SLO: <50.000µs 📉 -20.7%) vs baseline: +0.5%

Memory: ✅ 35.429MB (SLO: <36.000MB 🟡 -1.6%) vs baseline: +4.7%

✅ useragentvariant_exists_2

Time: ✅ 40.784µs (SLO: <50.000µs 📉 -18.4%) vs baseline: +0.2%

Memory: ✅ 35.488MB (SLO: <36.000MB 🟡 -1.4%) vs baseline: +5.2%

✅ useragentvariant_exists_3

Time: ✅ 40.121µs (SLO: <50.000µs 📉 -19.8%) vs baseline: +0.3%

Memory: ✅ 35.389MB (SLO: <36.000MB 🟡 -1.7%) vs baseline: +5.0%

✅ useragentvariant_not_exists_1

Time: ✅ 39.687µs (SLO: <50.000µs 📉 -20.6%) vs baseline: +0.4%

Memory: ✅ 35.448MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +5.1%

✅ useragentvariant_not_exists_2

Time: ✅ 39.666µs (SLO: <50.000µs 📉 -20.7%) vs baseline: +0.3%

Memory: ✅ 35.468MB (SLO: <36.000MB 🟡 -1.5%) vs baseline: +4.9%

🟡 span - 26/26

✅ add-event

Time: ✅ 18.246ms (SLO: <22.500ms 📉 -18.9%) vs baseline: +0.4%

Memory: ✅ 36.940MB (SLO: <53.000MB 📉 -30.3%) vs baseline: +4.9%

✅ add-metrics

Time: ✅ 88.197ms (SLO: <93.500ms -5.7%) vs baseline: +0.7%

Memory: ✅ 41.229MB (SLO: <53.000MB 📉 -22.2%) vs baseline: +5.1%

✅ add-tags

Time: ✅ 142.104ms (SLO: <155.000ms -8.3%) vs baseline: -0.7%

Memory: ✅ 41.127MB (SLO: <53.000MB 📉 -22.4%) vs baseline: +4.7%

✅ get-context

Time: ✅ 16.973ms (SLO: <20.500ms 📉 -17.2%) vs baseline: ~same

Memory: ✅ 36.853MB (SLO: <53.000MB 📉 -30.5%) vs baseline: +4.7%

✅ is-recording

Time: ✅ 17.375ms (SLO: <20.500ms 📉 -15.2%) vs baseline: +1.5%

Memory: ✅ 36.763MB (SLO: <53.000MB 📉 -30.6%) vs baseline: +4.9%

✅ record-exception

Time: ✅ 36.674ms (SLO: <40.000ms -8.3%) vs baseline: +0.4%

Memory: ✅ 37.307MB (SLO: <53.000MB 📉 -29.6%) vs baseline: +4.8%

✅ set-status

Time: ✅ 18.615ms (SLO: <22.000ms 📉 -15.4%) vs baseline: +0.1%

Memory: ✅ 36.874MB (SLO: <53.000MB 📉 -30.4%) vs baseline: +5.1%

✅ start

Time: ✅ 17.396ms (SLO: <20.500ms 📉 -15.1%) vs baseline: +3.3%

Memory: ✅ 36.814MB (SLO: <53.000MB 📉 -30.5%) vs baseline: +4.8%

✅ start-finish

Time: ✅ 51.116ms (SLO: <52.500ms -2.6%) vs baseline: -0.1%

Memory: ✅ 34.918MB (SLO: <35.500MB 🟡 -1.6%) vs baseline: +5.2%

✅ start-finish-telemetry

Time: ✅ 52.283ms (SLO: <54.500ms -4.1%) vs baseline: -0.7%

Memory: ✅ 34.780MB (SLO: <35.500MB -2.0%) vs baseline: +4.9%

✅ start-finish-traceid128

Time: ✅ 54.597ms (SLO: <57.000ms -4.2%) vs baseline: +0.8%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.6%

✅ start-traceid128

Time: ✅ 17.334ms (SLO: <22.500ms 📉 -23.0%) vs baseline: +0.5%

Memory: ✅ 36.780MB (SLO: <53.000MB 📉 -30.6%) vs baseline: +4.6%

✅ update-name

Time: ✅ 17.454ms (SLO: <22.000ms 📉 -20.7%) vs baseline: +0.6%

Memory: ✅ 36.817MB (SLO: <53.000MB 📉 -30.5%) vs baseline: +4.8%

🟡 tracer - 6/6

✅ large

Time: ✅ 29.086ms (SLO: <32.950ms 📉 -11.7%) vs baseline: -0.4%

Memory: ✅ 35.999MB (SLO: <36.500MB 🟡 -1.4%) vs baseline: +4.9%

✅ medium

Time: ✅ 2.890ms (SLO: <3.200ms -9.7%) vs baseline: +0.3%

Memory: ✅ 34.800MB (SLO: <35.500MB 🟡 -2.0%) vs baseline: +4.9%

✅ small

Time: ✅ 331.611µs (SLO: <370.000µs 📉 -10.4%) vs baseline: +1.5%

Memory: ✅ 34.878MB (SLO: <35.500MB 🟡 -1.8%) vs baseline: +5.2%

⚠️ Unstable Tests (1 suite)
⚠️ packagesupdateimporteddependencies - 24/24 (1 unstable)

✅ import_many

Time: ✅ 154.692µs (SLO: <170.000µs -9.0%) vs baseline: -0.4%

Memory: ✅ 39.797MB (SLO: <41.000MB -2.9%) vs baseline: +4.8%

✅ import_many_cached

Time: ✅ 120.753µs (SLO: <130.000µs -7.1%) vs baseline: ~same

Memory: ✅ 39.705MB (SLO: <41.000MB -3.2%) vs baseline: +4.7%

✅ import_many_stdlib

Time: ✅ 0.756ms (SLO: <1.750ms 📉 -56.8%) vs baseline: +0.2%

Memory: ✅ 39.483MB (SLO: <41.000MB -3.7%) vs baseline: +4.5%

⚠️ import_many_stdlib_cached

Time: ⚠️ 0.173ms (SLO: <1.100ms 📉 -84.3%) vs baseline: ~same

Memory: ✅ 39.846MB (SLO: <41.000MB -2.8%) vs baseline: +4.4%

✅ import_many_unknown

Time: ✅ 833.273µs (SLO: <890.000µs -6.4%) vs baseline: -0.7%

Memory: ✅ 39.838MB (SLO: <41.000MB -2.8%) vs baseline: +5.2%

✅ import_many_unknown_cached

Time: ✅ 802.829µs (SLO: <870.000µs -7.7%) vs baseline: +0.8%

Memory: ✅ 39.883MB (SLO: <41.000MB -2.7%) vs baseline: +5.2%

✅ import_one

Time: ✅ 19.790µs (SLO: <30.000µs 📉 -34.0%) vs baseline: +0.4%

Memory: ✅ 39.698MB (SLO: <41.000MB -3.2%) vs baseline: +5.2%

✅ import_one_cache

Time: ✅ 6.260µs (SLO: <10.000µs 📉 -37.4%) vs baseline: -1.2%

Memory: ✅ 39.851MB (SLO: <41.000MB -2.8%) vs baseline: +4.8%

✅ import_one_stdlib

Time: ✅ 18.742µs (SLO: <20.000µs -6.3%) vs baseline: +0.8%

Memory: ✅ 39.763MB (SLO: <41.000MB -3.0%) vs baseline: +4.7%

✅ import_one_stdlib_cache

Time: ✅ 6.295µs (SLO: <10.000µs 📉 -37.0%) vs baseline: +0.3%

Memory: ✅ 39.783MB (SLO: <41.000MB -3.0%) vs baseline: +4.5%

✅ import_one_unknown

Time: ✅ 45.400µs (SLO: <50.000µs -9.2%) vs baseline: +0.2%

Memory: ✅ 39.891MB (SLO: <41.000MB -2.7%) vs baseline: +5.6%

✅ import_one_unknown_cache

Time: ✅ 6.295µs (SLO: <10.000µs 📉 -37.0%) vs baseline: ~same

Memory: ✅ 39.897MB (SLO: <41.000MB -2.7%) vs baseline: +4.8%

✅ All Tests Passing (6 suites)
✅ iast_aspects - 40/40

✅ re_expand_aspect

Time: ✅ 33.913µs (SLO: <40.000µs 📉 -15.2%) vs baseline: +5.7%

Memory: ✅ 38.574MB (SLO: <41.000MB -5.9%) vs baseline: +4.7%

✅ re_expand_noaspect

Time: ✅ 28.755µs (SLO: <40.000µs 📉 -28.1%) vs baseline: ~same

Memory: ✅ 38.633MB (SLO: <41.000MB -5.8%) vs baseline: +4.6%

✅ re_findall_aspect

Time: ✅ 2.911µs (SLO: <10.000µs 📉 -70.9%) vs baseline: +0.2%

Memory: ✅ 38.673MB (SLO: <41.000MB -5.7%) vs baseline: +5.1%

✅ re_findall_noaspect

Time: ✅ 1.428µs (SLO: <10.000µs 📉 -85.7%) vs baseline: +1.1%

Memory: ✅ 38.378MB (SLO: <41.000MB -6.4%) vs baseline: +4.1%

✅ re_finditer_aspect

Time: ✅ 4.422µs (SLO: <10.000µs 📉 -55.8%) vs baseline: -0.1%

Memory: ✅ 38.476MB (SLO: <41.000MB -6.2%) vs baseline: +4.9%

✅ re_finditer_noaspect

Time: ✅ 1.395µs (SLO: <10.000µs 📉 -86.0%) vs baseline: -0.8%

Memory: ✅ 38.398MB (SLO: <41.000MB -6.3%) vs baseline: +4.2%

✅ re_fullmatch_aspect

Time: ✅ 2.703µs (SLO: <10.000µs 📉 -73.0%) vs baseline: +2.0%

Memory: ✅ 38.594MB (SLO: <41.000MB -5.9%) vs baseline: +5.3%

✅ re_fullmatch_noaspect

Time: ✅ 1.324µs (SLO: <10.000µs 📉 -86.8%) vs baseline: +1.1%

Memory: ✅ 38.476MB (SLO: <41.000MB -6.2%) vs baseline: +4.8%

✅ re_group_aspect

Time: ✅ 3.026µs (SLO: <10.000µs 📉 -69.7%) vs baseline: +0.1%

Memory: ✅ 38.594MB (SLO: <41.000MB -5.9%) vs baseline: +5.0%

✅ re_group_noaspect

Time: ✅ 1.606µs (SLO: <10.000µs 📉 -83.9%) vs baseline: -1.5%

Memory: ✅ 38.594MB (SLO: <41.000MB -5.9%) vs baseline: +4.8%

✅ re_groups_aspect

Time: ✅ 3.119µs (SLO: <10.000µs 📉 -68.8%) vs baseline: ~same

Memory: ✅ 38.673MB (SLO: <41.000MB -5.7%) vs baseline: +5.0%

✅ re_groups_noaspect

Time: ✅ 1.701µs (SLO: <10.000µs 📉 -83.0%) vs baseline: -0.6%

Memory: ✅ 38.594MB (SLO: <41.000MB -5.9%) vs baseline: +4.8%

✅ re_match_aspect

Time: ✅ 2.773µs (SLO: <10.000µs 📉 -72.3%) vs baseline: +0.6%

Memory: ✅ 38.633MB (SLO: <41.000MB -5.8%) vs baseline: +4.6%

✅ re_match_noaspect

Time: ✅ 1.299µs (SLO: <10.000µs 📉 -87.0%) vs baseline: -2.2%

Memory: ✅ 38.555MB (SLO: <41.000MB -6.0%) vs baseline: +4.5%

✅ re_search_aspect

Time: ✅ 2.527µs (SLO: <10.000µs 📉 -74.7%) vs baseline: +0.4%

Memory: ✅ 38.574MB (SLO: <41.000MB -5.9%) vs baseline: +4.8%

✅ re_search_noaspect

Time: ✅ 1.186µs (SLO: <10.000µs 📉 -88.1%) vs baseline: -1.4%

Memory: ✅ 38.633MB (SLO: <41.000MB -5.8%) vs baseline: +4.8%

✅ re_sub_aspect

Time: ✅ 3.360µs (SLO: <10.000µs 📉 -66.4%) vs baseline: -0.9%

Memory: ✅ 38.614MB (SLO: <41.000MB -5.8%) vs baseline: +4.8%

✅ re_sub_noaspect

Time: ✅ 1.552µs (SLO: <10.000µs 📉 -84.5%) vs baseline: +1.0%

Memory: ✅ 38.574MB (SLO: <41.000MB -5.9%) vs baseline: +4.7%

✅ re_subn_aspect

Time: ✅ 3.593µs (SLO: <10.000µs 📉 -64.1%) vs baseline: +0.4%

Memory: ✅ 38.633MB (SLO: <41.000MB -5.8%) vs baseline: +4.7%

✅ re_subn_noaspect

Time: ✅ 1.611µs (SLO: <10.000µs 📉 -83.9%) vs baseline: -0.3%

Memory: ✅ 38.653MB (SLO: <41.000MB -5.7%) vs baseline: +5.0%

✅ iastaspects - 118/118

✅ add_aspect

Time: ✅ 0.382µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -1.2%

Memory: ✅ 38.480MB (SLO: <41.500MB -7.3%) vs baseline: +4.7%

✅ add_inplace_aspect

Time: ✅ 0.385µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.7%

Memory: ✅ 38.449MB (SLO: <41.500MB -7.4%) vs baseline: +4.5%

✅ add_inplace_noaspect

Time: ✅ 0.288µs (SLO: <10.000µs 📉 -97.1%) vs baseline: +1.2%

Memory: ✅ 38.715MB (SLO: <41.500MB -6.7%) vs baseline: +5.6%

✅ add_noaspect

Time: ✅ 0.356µs (SLO: <10.000µs 📉 -96.4%) vs baseline: +0.7%

Memory: ✅ 38.423MB (SLO: <41.500MB -7.4%) vs baseline: +4.8%

✅ bytearray_aspect

Time: ✅ 1.269µs (SLO: <10.000µs 📉 -87.3%) vs baseline: -2.8%

Memory: ✅ 38.444MB (SLO: <41.500MB -7.4%) vs baseline: +4.4%

✅ bytearray_extend_aspect

Time: ✅ 1.529µs (SLO: <10.000µs 📉 -84.7%) vs baseline: +2.5%

Memory: ✅ 38.365MB (SLO: <41.500MB -7.6%) vs baseline: +4.3%

✅ bytearray_extend_noaspect

Time: ✅ 0.617µs (SLO: <10.000µs 📉 -93.8%) vs baseline: -0.1%

Memory: ✅ 38.526MB (SLO: <41.500MB -7.2%) vs baseline: +4.3%

✅ bytearray_noaspect

Time: ✅ 0.489µs (SLO: <10.000µs 📉 -95.1%) vs baseline: +1.8%

Memory: ✅ 38.592MB (SLO: <41.500MB -7.0%) vs baseline: +4.8%

✅ bytes_aspect

Time: ✅ 1.274µs (SLO: <10.000µs 📉 -87.3%) vs baseline: +0.5%

Memory: ✅ 38.678MB (SLO: <41.500MB -6.8%) vs baseline: +5.3%

✅ bytes_noaspect

Time: ✅ 0.494µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.6%

Memory: ✅ 38.626MB (SLO: <41.500MB -6.9%) vs baseline: +5.3%

✅ bytesio_aspect

Time: ✅ 1.301µs (SLO: <10.000µs 📉 -87.0%) vs baseline: +0.8%

Memory: ✅ 38.514MB (SLO: <41.500MB -7.2%) vs baseline: +4.3%

✅ bytesio_noaspect

Time: ✅ 0.499µs (SLO: <10.000µs 📉 -95.0%) vs baseline: -0.4%

Memory: ✅ 38.556MB (SLO: <41.500MB -7.1%) vs baseline: +4.8%

✅ capitalize_aspect

Time: ✅ 0.739µs (SLO: <10.000µs 📉 -92.6%) vs baseline: -0.3%

Memory: ✅ 38.497MB (SLO: <41.500MB -7.2%) vs baseline: +5.0%

✅ capitalize_noaspect

Time: ✅ 0.440µs (SLO: <10.000µs 📉 -95.6%) vs baseline: ~same

Memory: ✅ 38.497MB (SLO: <41.500MB -7.2%) vs baseline: +4.5%

✅ casefold_aspect

Time: ✅ 0.741µs (SLO: <10.000µs 📉 -92.6%) vs baseline: +0.3%

Memory: ✅ 38.599MB (SLO: <41.500MB -7.0%) vs baseline: +5.1%

✅ casefold_noaspect

Time: ✅ 0.372µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.6%

Memory: ✅ 38.578MB (SLO: <41.500MB -7.0%) vs baseline: +4.8%

✅ decode_aspect

Time: ✅ 0.732µs (SLO: <10.000µs 📉 -92.7%) vs baseline: +0.9%

Memory: ✅ 38.578MB (SLO: <41.500MB -7.0%) vs baseline: +4.7%

✅ decode_noaspect

Time: ✅ 0.422µs (SLO: <10.000µs 📉 -95.8%) vs baseline: +0.7%

Memory: ✅ 38.605MB (SLO: <41.500MB -7.0%) vs baseline: +5.0%

✅ encode_aspect

Time: ✅ 0.707µs (SLO: <10.000µs 📉 -92.9%) vs baseline: -0.8%

Memory: ✅ 38.451MB (SLO: <41.500MB -7.3%) vs baseline: +4.5%

✅ encode_noaspect

Time: ✅ 0.402µs (SLO: <10.000µs 📉 -96.0%) vs baseline: -0.5%

Memory: ✅ 38.408MB (SLO: <41.500MB -7.5%) vs baseline: +4.3%

✅ format_aspect

Time: ✅ 3.410µs (SLO: <10.000µs 📉 -65.9%) vs baseline: +0.8%

Memory: ✅ 38.607MB (SLO: <41.500MB -7.0%) vs baseline: +5.1%

✅ format_map_aspect

Time: ✅ 3.615µs (SLO: <10.000µs 📉 -63.8%) vs baseline: -0.8%

Memory: ✅ 38.707MB (SLO: <41.500MB -6.7%) vs baseline: +5.1%

✅ format_map_noaspect

Time: ✅ 0.826µs (SLO: <10.000µs 📉 -91.7%) vs baseline: +0.6%

Memory: ✅ 38.465MB (SLO: <41.500MB -7.3%) vs baseline: +4.4%

✅ format_noaspect

Time: ✅ 0.591µs (SLO: <10.000µs 📉 -94.1%) vs baseline: -0.2%

Memory: ✅ 38.724MB (SLO: <41.500MB -6.7%) vs baseline: +5.5%

✅ index_aspect

Time: ✅ 0.348µs (SLO: <10.000µs 📉 -96.5%) vs baseline: +1.9%

Memory: ✅ 38.638MB (SLO: <41.500MB -6.9%) vs baseline: +4.8%

✅ index_noaspect

Time: ✅ 0.317µs (SLO: <10.000µs 📉 -96.8%) vs baseline: +1.3%

Memory: ✅ 38.667MB (SLO: <41.500MB -6.8%) vs baseline: +5.3%

✅ join_aspect

Time: ✅ 1.271µs (SLO: <10.000µs 📉 -87.3%) vs baseline: -2.3%

Memory: ✅ 38.472MB (SLO: <41.500MB -7.3%) vs baseline: +4.6%

✅ join_noaspect

Time: ✅ 0.536µs (SLO: <10.000µs 📉 -94.6%) vs baseline: -0.8%

Memory: ✅ 38.703MB (SLO: <41.500MB -6.7%) vs baseline: +5.1%

✅ ljust_aspect

Time: ✅ 2.774µs (SLO: <20.000µs 📉 -86.1%) vs baseline: +8.9%

Memory: ✅ 38.540MB (SLO: <41.500MB -7.1%) vs baseline: +4.9%

✅ ljust_noaspect

Time: ✅ 0.406µs (SLO: <10.000µs 📉 -95.9%) vs baseline: ~same

Memory: ✅ 38.596MB (SLO: <41.500MB -7.0%) vs baseline: +4.9%

✅ lower_aspect

Time: ✅ 2.245µs (SLO: <10.000µs 📉 -77.5%) vs baseline: -0.4%

Memory: ✅ 38.505MB (SLO: <41.500MB -7.2%) vs baseline: +5.0%

✅ lower_noaspect

Time: ✅ 0.371µs (SLO: <10.000µs 📉 -96.3%) vs baseline: +0.2%

Memory: ✅ 38.601MB (SLO: <41.500MB -7.0%) vs baseline: +4.6%

✅ lstrip_aspect

Time: ✅ 2.215µs (SLO: <20.000µs 📉 -88.9%) vs baseline: +2.6%

Memory: ✅ 38.534MB (SLO: <41.500MB -7.1%) vs baseline: +4.8%

✅ lstrip_noaspect

Time: ✅ 0.383µs (SLO: <10.000µs 📉 -96.2%) vs baseline: -1.1%

Memory: ✅ 38.569MB (SLO: <41.500MB -7.1%) vs baseline: +4.3%

✅ modulo_aspect

Time: ✅ 0.971µs (SLO: <10.000µs 📉 -90.3%) vs baseline: -0.3%

Memory: ✅ 38.731MB (SLO: <41.500MB -6.7%) vs baseline: +5.3%

✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 1.490µs (SLO: <10.000µs 📉 -85.1%) vs baseline: +0.6%

Memory: ✅ 38.577MB (SLO: <41.500MB -7.0%) vs baseline: +5.4%

✅ modulo_aspect_for_bytes

Time: ✅ 0.953µs (SLO: <10.000µs 📉 -90.5%) vs baseline: -0.6%

Memory: ✅ 38.680MB (SLO: <41.500MB -6.8%) vs baseline: +5.4%

✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 1.167µs (SLO: <10.000µs 📉 -88.3%) vs baseline: -0.3%

Memory: ✅ 38.541MB (SLO: <41.500MB -7.1%) vs baseline: +4.6%

✅ modulo_noaspect

Time: ✅ 0.671µs (SLO: <10.000µs 📉 -93.3%) vs baseline: ~same

Memory: ✅ 38.753MB (SLO: <41.500MB -6.6%) vs baseline: +5.8%

✅ replace_aspect

Time: ✅ 5.039µs (SLO: <10.000µs 📉 -49.6%) vs baseline: +1.4%

Memory: ✅ 38.654MB (SLO: <41.500MB -6.9%) vs baseline: +5.5%

✅ replace_noaspect

Time: ✅ 0.468µs (SLO: <10.000µs 📉 -95.3%) vs baseline: +0.7%

Memory: ✅ 38.508MB (SLO: <41.500MB -7.2%) vs baseline: +5.0%

✅ repr_aspect

Time: ✅ 0.944µs (SLO: <10.000µs 📉 -90.6%) vs baseline: -0.3%

Memory: ✅ 38.537MB (SLO: <41.500MB -7.1%) vs baseline: +4.5%

✅ repr_noaspect

Time: ✅ 0.453µs (SLO: <10.000µs 📉 -95.5%) vs baseline: -0.9%

Memory: ✅ 38.450MB (SLO: <41.500MB -7.3%) vs baseline: +4.4%

✅ rstrip_aspect

Time: ✅ 1.838µs (SLO: <20.000µs 📉 -90.8%) vs baseline: -0.3%

Memory: ✅ 38.695MB (SLO: <41.500MB -6.8%) vs baseline: +5.5%

✅ rstrip_noaspect

Time: ✅ 0.384µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.6%

Memory: ✅ 38.482MB (SLO: <41.500MB -7.3%) vs baseline: +5.2%

✅ slice_aspect

Time: ✅ 0.488µs (SLO: <10.000µs 📉 -95.1%) vs baseline: -0.8%

Memory: ✅ 38.603MB (SLO: <41.500MB -7.0%) vs baseline: +4.7%

✅ slice_noaspect

Time: ✅ 0.451µs (SLO: <10.000µs 📉 -95.5%) vs baseline: +0.3%

Memory: ✅ 38.604MB (SLO: <41.500MB -7.0%) vs baseline: +5.3%

✅ stringio_aspect

Time: ✅ 1.699µs (SLO: <10.000µs 📉 -83.0%) vs baseline: +1.2%

Memory: ✅ 38.506MB (SLO: <41.500MB -7.2%) vs baseline: +5.0%

✅ stringio_noaspect

Time: ✅ 0.918µs (SLO: <10.000µs 📉 -90.8%) vs baseline: -0.3%

Memory: ✅ 38.583MB (SLO: <41.500MB -7.0%) vs baseline: +4.9%

✅ strip_aspect

Time: ✅ 2.173µs (SLO: <20.000µs 📉 -89.1%) vs baseline: +0.3%

Memory: ✅ 38.504MB (SLO: <41.500MB -7.2%) vs baseline: +4.9%

✅ strip_noaspect

Time: ✅ 0.387µs (SLO: <10.000µs 📉 -96.1%) vs baseline: -0.2%

Memory: ✅ 38.569MB (SLO: <41.500MB -7.1%) vs baseline: +4.8%

✅ swapcase_aspect

Time: ✅ 2.458µs (SLO: <10.000µs 📉 -75.4%) vs baseline: +0.6%

Memory: ✅ 38.522MB (SLO: <41.500MB -7.2%) vs baseline: +4.7%

✅ swapcase_noaspect

Time: ✅ 0.540µs (SLO: <10.000µs 📉 -94.6%) vs baseline: +0.2%

Memory: ✅ 38.598MB (SLO: <41.500MB -7.0%) vs baseline: +4.7%

✅ title_aspect

Time: ✅ 2.402µs (SLO: <10.000µs 📉 -76.0%) vs baseline: +1.5%

Memory: ✅ 38.638MB (SLO: <41.500MB -6.9%) vs baseline: +4.8%

✅ title_noaspect

Time: ✅ 0.504µs (SLO: <10.000µs 📉 -95.0%) vs baseline: +0.5%

Memory: ✅ 38.520MB (SLO: <41.500MB -7.2%) vs baseline: +4.9%

✅ translate_aspect

Time: ✅ 3.257µs (SLO: <10.000µs 📉 -67.4%) vs baseline: -0.3%

Memory: ✅ 38.511MB (SLO: <41.500MB -7.2%) vs baseline: +4.7%

✅ translate_noaspect

Time: ✅ 1.044µs (SLO: <10.000µs 📉 -89.6%) vs baseline: +0.4%

Memory: ✅ 38.533MB (SLO: <41.500MB -7.1%) vs baseline: +5.0%

✅ upper_aspect

Time: ✅ 2.246µs (SLO: <10.000µs 📉 -77.5%) vs baseline: -1.2%

Memory: ✅ 38.485MB (SLO: <41.500MB -7.3%) vs baseline: +4.7%

✅ upper_noaspect

Time: ✅ 0.376µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +1.8%

Memory: ✅ 38.612MB (SLO: <41.500MB -7.0%) vs baseline: +5.4%

✅ iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 1.518µs (SLO: <10.000µs 📉 -84.8%) vs baseline: +6.2%

Memory: ✅ 38.633MB (SLO: <41.000MB -5.8%) vs baseline: +4.8%

✅ rsplit_noaspect

Time: ✅ 0.575µs (SLO: <10.000µs 📉 -94.2%) vs baseline: +0.2%

Memory: ✅ 38.614MB (SLO: <41.000MB -5.8%) vs baseline: +4.9%

✅ split_aspect

Time: ✅ 1.393µs (SLO: <10.000µs 📉 -86.1%) vs baseline: -0.9%

Memory: ✅ 38.574MB (SLO: <41.000MB -5.9%) vs baseline: +4.6%

✅ split_noaspect

Time: ✅ 0.570µs (SLO: <10.000µs 📉 -94.3%) vs baseline: -0.9%

Memory: ✅ 38.633MB (SLO: <41.000MB -5.8%) vs baseline: +4.9%

✅ splitlines_aspect

Time: ✅ 1.419µs (SLO: <10.000µs 📉 -85.8%) vs baseline: +1.7%

Memory: ✅ 38.594MB (SLO: <41.000MB -5.9%) vs baseline: +5.1%

✅ splitlines_noaspect

Time: ✅ 0.586µs (SLO: <10.000µs 📉 -94.1%) vs baseline: +0.9%

Memory: ✅ 38.574MB (SLO: <41.000MB -5.9%) vs baseline: +4.9%

✅ iastpropagation - 8/8

✅ no-propagation

Time: ✅ 48.685µs (SLO: <60.000µs 📉 -18.9%) vs baseline: +0.1%

Memory: ✅ 38.319MB (SLO: <42.000MB -8.8%) vs baseline: +4.9%

✅ propagation_enabled

Time: ✅ 135.573µs (SLO: <190.000µs 📉 -28.6%) vs baseline: -0.4%

Memory: ✅ 38.398MB (SLO: <42.000MB -8.6%) vs baseline: +5.3%

✅ propagation_enabled_100

Time: ✅ 1.551ms (SLO: <2.300ms 📉 -32.6%) vs baseline: +0.7%

Memory: ✅ 38.358MB (SLO: <42.000MB -8.7%) vs baseline: +5.3%

✅ propagation_enabled_1000

Time: ✅ 28.930ms (SLO: <34.550ms 📉 -16.3%) vs baseline: +0.2%

Memory: ✅ 38.614MB (SLO: <42.000MB -8.1%) vs baseline: +4.9%

✅ otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.350ms (SLO: <42.000ms -3.9%) vs baseline: ~same

Memory: ✅ 37.611MB (SLO: <39.000MB -3.6%) vs baseline: +4.8%

✅ add-link

Time: ✅ 36.261ms (SLO: <38.550ms -5.9%) vs baseline: -0.3%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.9%

✅ add-metrics

Time: ✅ 220.189ms (SLO: <232.000ms -5.1%) vs baseline: +0.1%

Memory: ✅ 37.631MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%

✅ add-tags

Time: ✅ 212.764ms (SLO: <221.600ms -4.0%) vs baseline: +0.3%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.8%

✅ get-context

Time: ✅ 29.132ms (SLO: <31.300ms -6.9%) vs baseline: -0.7%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%

✅ is-recording

Time: ✅ 29.322ms (SLO: <31.000ms -5.4%) vs baseline: +0.1%

Memory: ✅ 37.670MB (SLO: <39.000MB -3.4%) vs baseline: +4.8%

✅ record-exception

Time: ✅ 63.183ms (SLO: <65.850ms -4.1%) vs baseline: +0.4%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.7%

✅ set-status

Time: ✅ 32.194ms (SLO: <34.150ms -5.7%) vs baseline: +0.9%

Memory: ✅ 37.513MB (SLO: <39.000MB -3.8%) vs baseline: +4.4%

✅ start

Time: ✅ 29.440ms (SLO: <30.150ms -2.4%) vs baseline: +1.8%

Memory: ✅ 37.690MB (SLO: <39.000MB -3.4%) vs baseline: +4.7%

✅ start-finish

Time: ✅ 34.126ms (SLO: <35.350ms -3.5%) vs baseline: +0.2%

Memory: ✅ 37.591MB (SLO: <39.000MB -3.6%) vs baseline: +4.9%

✅ start-finish-telemetry

Time: ✅ 34.089ms (SLO: <35.450ms -3.8%) vs baseline: +0.3%

Memory: ✅ 37.650MB (SLO: <39.000MB -3.5%) vs baseline: +4.6%

✅ update-name

Time: ✅ 31.221ms (SLO: <33.400ms -6.5%) vs baseline: +0.2%

Memory: ✅ 37.572MB (SLO: <39.000MB -3.7%) vs baseline: +4.4%

✅ packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 343.323ms (SLO: <354.300ms -3.1%) vs baseline: -1.0%

Memory: ✅ 40.659MB (SLO: <41.500MB -2.0%) vs baseline: +5.2%

✅ cache_on

Time: ✅ 0.384µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.6%

Memory: ✅ 39.403MB (SLO: <41.000MB -3.9%) vs baseline: +5.1%

ℹ️ Scenarios Missing SLO Configuration (10 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

  • coreapiscenario-core_dispatch_listeners
  • coreapiscenario-core_dispatch_no_listeners
  • coreapiscenario-core_dispatch_with_results_listeners
  • coreapiscenario-core_dispatch_with_results_no_listeners
  • djangosimple-baseline
  • errortrackingdjangosimple-baseline
  • errortrackingflasksqli-baseline
  • flasksimple-baseline
  • flasksqli-baseline
  • sethttpmeta-obfuscation-disabled

@ZStriker19 ZStriker19 changed the title feat(llmobs): add tag if envar detected feat(llmobs): add tag source:otel to evals if DD_TRACE_OTEL_ENABLED=true Dec 8, 2025
@ZStriker19 ZStriker19 marked this pull request as ready for review December 11, 2025 19:25
@ZStriker19 ZStriker19 requested review from a team as code owners December 11, 2025 19:25
@ZStriker19 ZStriker19 mentioned this pull request Dec 11, 2025
Merged
1 task
@PROFeNoM
Copy link
Copy Markdown
Contributor

PROFeNoM commented Dec 12, 2025

@codex review

@chatgpt-codex-connector
Copy link
Copy Markdown

chatgpt-codex-connector Bot commented Dec 12, 2025

To use Codex here, create a Codex account and connect to github.

@ZStriker19 ZStriker19 enabled auto-merge (squash) December 12, 2025 16:35
brettlangdon
brettlangdon approved these changes Dec 15, 2025
View reviewed changes
Copy link
Copy Markdown
Member

@brettlangdon brettlangdon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

release note lgtm

@ZStriker19 ZStriker19 mentioned this pull request Dec 15, 2025
Merged
7 tasks
PROFeNoM
PROFeNoM approved these changes Dec 18, 2025
View reviewed changes
Copy link
Copy Markdown
Contributor

@PROFeNoM PROFeNoM left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM :shipit: Just left one question

Comment thread ddtrace/llmobs/_llmobs.py
@ZStriker19 ZStriker19 merged commit 6e79527 into main Dec 19, 2025
479 checks passed
@ZStriker19 ZStriker19 deleted the zachg/llmobs_otel_evals_update branch December 19, 2025 21:22
brettlangdon pushed a commit that referenced this pull request Jan 6, 2026
@ZStriker19 @brettlangdon
feat(llmobs): add tag source:otel to evals if DD_TRACE_OTEL_ENABLED=t…
f080459 
…rue (#15538)

## Description
Auto-add `source:otel` tag to LLMObs evaluations when OTel tracing is
enabled

When `DD_TRACE_OTEL_ENABLED=true`, automatically adds `source:otel` tag
to all submitted evaluations. This allows the backend to wait ~3 minutes
for OTel span conversion before discarding unmatched evaluations.

### Changes
- Add `source:otel` tag in `submit_evaluation()` when OTel tracing is
enabled

## Testing
Tested manually and also added tests:
- `test_submit_evaluation_adds_source_otel_when_otel_enabled`
- `test_submit_evaluation_no_source_otel_when_otel_disabled`
## Risks

<!-- Note any risks associated with this change, or "None" if no risks
-->

## Additional Notes

<!-- Any other information that would be helpful for reviewers -->
kianjones9 pushed a commit to kianjones9/dd-trace-py that referenced this pull request Jan 9, 2026
@ZStriker19 @kianjones9
feat(llmobs): add tag source:otel to evals if DD_TRACE_OTEL_ENABLED=t…
ff993ef 
…rue (DataDog#15538)

## Description
Auto-add `source:otel` tag to LLMObs evaluations when OTel tracing is
enabled

When `DD_TRACE_OTEL_ENABLED=true`, automatically adds `source:otel` tag
to all submitted evaluations. This allows the backend to wait ~3 minutes
for OTel span conversion before discarding unmatched evaluations.

### Changes
- Add `source:otel` tag in `submit_evaluation()` when OTel tracing is
enabled

## Testing
Tested manually and also added tests:
- `test_submit_evaluation_adds_source_otel_when_otel_enabled`
- `test_submit_evaluation_no_source_otel_when_otel_disabled`
## Risks

<!-- Note any risks associated with this change, or "None" if no risks
-->

## Additional Notes

<!-- Any other information that would be helpful for reviewers -->
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@brettlangdon brettlangdon brettlangdon approved these changes

@PROFeNoM PROFeNoM PROFeNoM approved these changes

@duncanista duncanista Awaiting requested review from duncanista duncanista is a code owner automatically assigned from DataDog/apm-python

@florentinl florentinl Awaiting requested review from florentinl florentinl is a code owner automatically assigned from DataDog/apm-python

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@ZStriker19 @PROFeNoM @brettlangdon