Skip to content

ci: update system tests to latest#16882

Merged
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit intomainfrom
yunkim/update-system-tests
Mar 12, 2026
Merged

ci: update system tests to latest#16882
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit intomainfrom
yunkim/update-system-tests

Conversation

@Yun-Kim
Copy link
Contributor

@Yun-Kim Yun-Kim commented Mar 12, 2026

Description

Ran ./scripts/update-system-tests-version.py to update system tests version following the missing_feature marking in DataDog/system-tests#6484

Testing

Risks

Additional Notes

@Yun-Kim Yun-Kim requested review from a team as code owners March 12, 2026 18:32
@Yun-Kim Yun-Kim added the changelog/no-changelog A changelog entry is not required for this PR. label Mar 12, 2026
@Yun-Kim
Copy link
Contributor Author

Yun-Kim commented Mar 12, 2026

/merge

@gh-worker-devflow-routing-ef8351
Copy link

gh-worker-devflow-routing-ef8351 bot commented Mar 12, 2026 •
edited
Loading

View all feedbacks in Devflow UI.

2026-03-12 18:40:52 UTC ℹ️ Start processing command /merge

2026-03-12 18:41:05 UTC ℹ️ MergeQueue: waiting for PR to be ready

This pull request is not mergeable according to GitHub. Common reasons include pending required checks, missing approvals, or merge conflicts — but it could also be blocked by other repository rules or settings.
It will be added to the queue as soon as checks pass and/or get approvals. View in MergeQueue UI.
Note: if you pushed new commits since the last approval, you may need additional approval.
You can remove it from the waiting list with /remove command.

2026-03-12 19:11:09 UTC ℹ️ MergeQueue: merge request added to the queue

The expected merge time in main is approximately 3h (p90).

2026-03-12 22:33:24 UTC ℹ️ MergeQueue: This merge request was merged

@pr-commenter
Copy link

pr-commenter bot commented Mar 12, 2026

Performance SLOs

Comparing candidate yunkim/update-system-tests (0cb53c8) with baseline main (4f7c157)

📈 Performance Regressions (2 suites)
📈 iastaspects - 118/118

✅ add_aspect

Time: ✅ 103.272µs (SLO: <130.000µs 📉 -20.6%) vs baseline: +0.5%

Memory: ✅ 43.824MB (SLO: <46.000MB -4.7%) vs baseline: +5.7%

✅ add_inplace_aspect

Time: ✅ 101.611µs (SLO: <130.000µs 📉 -21.8%) vs baseline: -1.2%

Memory: ✅ 43.686MB (SLO: <46.000MB -5.0%) vs baseline: +5.4%

✅ add_inplace_noaspect

Time: ✅ 28.045µs (SLO: <40.000µs 📉 -29.9%) vs baseline: -0.4%

Memory: ✅ 43.765MB (SLO: <46.000MB -4.9%) vs baseline: +5.2%

✅ add_noaspect

Time: ✅ 48.941µs (SLO: <70.000µs 📉 -30.1%) vs baseline: -0.6%

Memory: ✅ 43.765MB (SLO: <46.000MB -4.9%) vs baseline: +5.6%

✅ bytearray_aspect

Time: ✅ 253.736µs (SLO: <400.000µs 📉 -36.6%) vs baseline: +1.3%

Memory: ✅ 43.686MB (SLO: <46.000MB -5.0%) vs baseline: +5.4%

✅ bytearray_extend_aspect

Time: ✅ 642.064µs (SLO: <800.000µs 📉 -19.7%) vs baseline: -1.5%

Memory: ✅ 43.726MB (SLO: <46.000MB -4.9%) vs baseline: +5.7%

✅ bytearray_extend_noaspect

Time: ✅ 270.697µs (SLO: <400.000µs 📉 -32.3%) vs baseline: +0.9%

Memory: ✅ 43.647MB (SLO: <46.000MB -5.1%) vs baseline: +5.3%

✅ bytearray_noaspect

Time: ✅ 141.651µs (SLO: <300.000µs 📉 -52.8%) vs baseline: +1.7%

Memory: ✅ 43.883MB (SLO: <46.000MB -4.6%) vs baseline: +5.8%

✅ bytes_aspect

Time: ✅ 216.521µs (SLO: <300.000µs 📉 -27.8%) vs baseline: -0.4%

Memory: ✅ 43.686MB (SLO: <46.000MB -5.0%) vs baseline: +5.5%

✅ bytes_noaspect

Time: ✅ 134.108µs (SLO: <200.000µs 📉 -32.9%) vs baseline: -0.4%

Memory: ✅ 43.765MB (SLO: <46.000MB -4.9%) vs baseline: +5.2%

✅ bytesio_aspect

Time: ✅ 3.777ms (SLO: <5.000ms 📉 -24.5%) vs baseline: -0.5%

Memory: ✅ 43.706MB (SLO: <46.000MB -5.0%) vs baseline: +5.3%

✅ bytesio_noaspect

Time: ✅ 315.793µs (SLO: <420.000µs 📉 -24.8%) vs baseline: +0.7%

Memory: ✅ 43.785MB (SLO: <46.000MB -4.8%) vs baseline: +5.7%

✅ capitalize_aspect

Time: ✅ 88.666µs (SLO: <300.000µs 📉 -70.4%) vs baseline: -0.4%

Memory: ✅ 43.745MB (SLO: <46.000MB -4.9%) vs baseline: +4.6%

✅ capitalize_noaspect

Time: ✅ 251.457µs (SLO: <300.000µs 📉 -16.2%) vs baseline: +0.7%

Memory: ✅ 43.804MB (SLO: <46.000MB -4.8%) vs baseline: +5.5%

✅ casefold_aspect

Time: ✅ 91.601µs (SLO: <500.000µs 📉 -81.7%) vs baseline: +3.1%

Memory: ✅ 43.785MB (SLO: <46.000MB -4.8%) vs baseline: +5.7%

✅ casefold_noaspect

Time: ✅ 307.062µs (SLO: <500.000µs 📉 -38.6%) vs baseline: +1.3%

Memory: ✅ 43.745MB (SLO: <46.000MB -4.9%) vs baseline: +5.0%

✅ decode_aspect

Time: ✅ 86.437µs (SLO: <100.000µs 📉 -13.6%) vs baseline: -0.8%

Memory: ✅ 43.686MB (SLO: <46.000MB -5.0%) vs baseline: +5.5%

✅ decode_noaspect

Time: ✅ 153.122µs (SLO: <210.000µs 📉 -27.1%) vs baseline: -0.3%

Memory: ✅ 43.686MB (SLO: <46.000MB -5.0%) vs baseline: +4.9%

✅ encode_aspect

Time: ✅ 84.942µs (SLO: <200.000µs 📉 -57.5%) vs baseline: +0.6%

Memory: ✅ 43.667MB (SLO: <46.000MB -5.1%) vs baseline: +5.1%

✅ encode_noaspect

Time: ✅ 142.005µs (SLO: <200.000µs 📉 -29.0%) vs baseline: +1.3%

Memory: ✅ 43.922MB (SLO: <46.000MB -4.5%) vs baseline: +5.6%

✅ format_aspect

Time: ✅ 14.566ms (SLO: <19.200ms 📉 -24.1%) vs baseline: -1.0%

Memory: ✅ 43.883MB (SLO: <46.000MB -4.6%) vs baseline: +5.7%

✅ format_map_aspect

Time: ✅ 16.456ms (SLO: <21.500ms 📉 -23.5%) vs baseline: +0.6%

Memory: ✅ 43.745MB (SLO: <46.000MB -4.9%) vs baseline: +4.5%

✅ format_map_noaspect

Time: ✅ 367.411µs (SLO: <500.000µs 📉 -26.5%) vs baseline: -2.1%

Memory: ✅ 43.883MB (SLO: <46.000MB -4.6%) vs baseline: +5.7%

✅ format_noaspect

Time: ✅ 305.865µs (SLO: <500.000µs 📉 -38.8%) vs baseline: -2.1%

Memory: ✅ 43.667MB (SLO: <46.000MB -5.1%) vs baseline: +5.0%

✅ index_aspect

Time: ✅ 124.558µs (SLO: <300.000µs 📉 -58.5%) vs baseline: ~same

Memory: ✅ 43.726MB (SLO: <46.000MB -4.9%) vs baseline: +5.5%

✅ index_noaspect

Time: ✅ 40.787µs (SLO: <300.000µs 📉 -86.4%) vs baseline: -0.2%

Memory: ✅ 43.785MB (SLO: <46.000MB -4.8%) vs baseline: +4.9%

✅ join_aspect

Time: ✅ 211.381µs (SLO: <300.000µs 📉 -29.5%) vs baseline: -0.8%

Memory: ✅ 43.903MB (SLO: <46.000MB -4.6%) vs baseline: +5.8%

✅ join_noaspect

Time: ✅ 145.540µs (SLO: <300.000µs 📉 -51.5%) vs baseline: +1.2%

Memory: ✅ 43.765MB (SLO: <46.000MB -4.9%) vs baseline: +5.8%

✅ ljust_aspect

Time: ✅ 496.677µs (SLO: <700.000µs 📉 -29.0%) vs baseline: +0.6%

Memory: ✅ 43.765MB (SLO: <46.000MB -4.9%) vs baseline: +5.5%

✅ ljust_noaspect

Time: ✅ 257.621µs (SLO: <300.000µs 📉 -14.1%) vs baseline: +0.2%

Memory: ✅ 43.647MB (SLO: <46.000MB -5.1%) vs baseline: +4.8%

✅ lower_aspect

Time: ✅ 295.768µs (SLO: <500.000µs 📉 -40.8%) vs baseline: +0.5%

Memory: ✅ 43.765MB (SLO: <46.000MB -4.9%) vs baseline: +5.7%

✅ lower_noaspect

Time: ✅ 235.820µs (SLO: <300.000µs 📉 -21.4%) vs baseline: +1.1%

Memory: ✅ 43.706MB (SLO: <46.000MB -5.0%) vs baseline: +4.9%

✅ lstrip_aspect

Time: ✅ 0.341ms (SLO: <3.000ms 📉 -88.6%) vs baseline: 📈 +24.5%

Memory: ✅ 43.706MB (SLO: <46.000MB -5.0%) vs baseline: +5.4%

✅ lstrip_noaspect

Time: ✅ 0.177ms (SLO: <3.000ms 📉 -94.1%) vs baseline: -0.7%

Memory: ✅ 43.863MB (SLO: <46.000MB -4.6%) vs baseline: +5.8%

✅ modulo_aspect

Time: ✅ 14.295ms (SLO: <18.750ms 📉 -23.8%) vs baseline: -0.3%

Memory: ✅ 43.726MB (SLO: <46.000MB -4.9%) vs baseline: +5.2%

✅ modulo_aspect_for_bytearray_bytearray

Time: ✅ 14.827ms (SLO: <19.350ms 📉 -23.4%) vs baseline: ~same

Memory: ✅ 43.765MB (SLO: <46.000MB -4.9%) vs baseline: +5.0%

✅ modulo_aspect_for_bytes

Time: ✅ 14.387ms (SLO: <18.900ms 📉 -23.9%) vs baseline: ~same

Memory: ✅ 43.745MB (SLO: <46.000MB -4.9%) vs baseline: +5.2%

✅ modulo_aspect_for_bytes_bytearray

Time: ✅ 14.587ms (SLO: <19.150ms 📉 -23.8%) vs baseline: -0.3%

Memory: ✅ 43.844MB (SLO: <46.000MB -4.7%) vs baseline: +5.4%

✅ modulo_noaspect

Time: ✅ 0.360ms (SLO: <3.000ms 📉 -88.0%) vs baseline: -1.2%

Memory: ✅ 43.844MB (SLO: <46.000MB -4.7%) vs baseline: +5.3%

✅ replace_aspect

Time: ✅ 18.897ms (SLO: <24.000ms 📉 -21.3%) vs baseline: +2.7%

Memory: ✅ 43.765MB (SLO: <46.000MB -4.9%) vs baseline: +5.4%

✅ replace_noaspect

Time: ✅ 283.724µs (SLO: <300.000µs -5.4%) vs baseline: +1.6%

Memory: ✅ 43.785MB (SLO: <46.000MB -4.8%) vs baseline: +4.8%

✅ repr_aspect

Time: ✅ 317.660µs (SLO: <420.000µs 📉 -24.4%) vs baseline: -0.7%

Memory: ✅ 43.844MB (SLO: <46.000MB -4.7%) vs baseline: +5.7%

✅ repr_noaspect

Time: ✅ 46.578µs (SLO: <90.000µs 📉 -48.2%) vs baseline: -1.1%

Memory: ✅ 43.765MB (SLO: <46.000MB -4.9%) vs baseline: +5.7%

✅ rstrip_aspect

Time: ✅ 387.005µs (SLO: <500.000µs 📉 -22.6%) vs baseline: -0.9%

Memory: ✅ 43.706MB (SLO: <46.000MB -5.0%) vs baseline: +5.2%

✅ rstrip_noaspect

Time: ✅ 184.740µs (SLO: <300.000µs 📉 -38.4%) vs baseline: +0.7%

Memory: ✅ 43.903MB (SLO: <46.000MB -4.6%) vs baseline: +5.8%

✅ slice_aspect

Time: ✅ 180.552µs (SLO: <300.000µs 📉 -39.8%) vs baseline: -1.9%

Memory: ✅ 43.804MB (SLO: <46.000MB -4.8%) vs baseline: +5.7%

✅ slice_noaspect

Time: ✅ 54.030µs (SLO: <90.000µs 📉 -40.0%) vs baseline: +0.2%

Memory: ✅ 43.844MB (SLO: <46.000MB -4.7%) vs baseline: +5.8%

✅ stringio_aspect

Time: ✅ 3.833ms (SLO: <5.000ms 📉 -23.3%) vs baseline: +0.3%

Memory: ✅ 43.765MB (SLO: <46.000MB -4.9%) vs baseline: +5.6%

✅ stringio_noaspect

Time: ✅ 346.394µs (SLO: <500.000µs 📉 -30.7%) vs baseline: -0.3%

Memory: ✅ 43.863MB (SLO: <46.000MB -4.6%) vs baseline: +5.8%

✅ strip_aspect

Time: ✅ 270.117µs (SLO: <350.000µs 📉 -22.8%) vs baseline: -0.5%

Memory: ✅ 43.863MB (SLO: <46.000MB -4.6%) vs baseline: +5.7%

✅ strip_noaspect

Time: ✅ 176.873µs (SLO: <240.000µs 📉 -26.3%) vs baseline: +0.6%

Memory: ✅ 43.686MB (SLO: <46.000MB -5.0%) vs baseline: +4.7%

✅ swapcase_aspect

Time: ✅ 334.404µs (SLO: <500.000µs 📉 -33.1%) vs baseline: +0.9%

Memory: ✅ 43.686MB (SLO: <46.000MB -5.0%) vs baseline: +5.3%

✅ swapcase_noaspect

Time: ✅ 271.136µs (SLO: <400.000µs 📉 -32.2%) vs baseline: +1.4%

Memory: ✅ 43.785MB (SLO: <46.000MB -4.8%) vs baseline: +5.3%

✅ title_aspect

Time: ✅ 317.917µs (SLO: <500.000µs 📉 -36.4%) vs baseline: -1.3%

Memory: ✅ 43.706MB (SLO: <46.000MB -5.0%) vs baseline: +5.5%

✅ title_noaspect

Time: ✅ 260.154µs (SLO: <400.000µs 📉 -35.0%) vs baseline: +0.3%

Memory: ✅ 43.745MB (SLO: <46.000MB -4.9%) vs baseline: +5.4%

✅ translate_aspect

Time: ✅ 554.543µs (SLO: <700.000µs 📉 -20.8%) vs baseline: 📈 +11.5%

Memory: ✅ 43.706MB (SLO: <46.000MB -5.0%) vs baseline: +5.4%

✅ translate_noaspect

Time: ✅ 420.778µs (SLO: <500.000µs 📉 -15.8%) vs baseline: -2.1%

Memory: ✅ 43.804MB (SLO: <46.000MB -4.8%) vs baseline: +5.6%

✅ upper_aspect

Time: ✅ 295.191µs (SLO: <500.000µs 📉 -41.0%) vs baseline: -1.0%

Memory: ✅ 43.765MB (SLO: <46.000MB -4.9%) vs baseline: +5.6%

✅ upper_noaspect

Time: ✅ 238.648µs (SLO: <400.000µs 📉 -40.3%) vs baseline: +3.2%

Memory: ✅ 43.706MB (SLO: <46.000MB -5.0%) vs baseline: +5.2%

📈 iastaspectsospath - 24/24

✅ ospathbasename_aspect

Time: ✅ 527.337µs (SLO: <700.000µs 📉 -24.7%) vs baseline: 📈 +25.3%

Memory: ✅ 43.704MB (SLO: <46.000MB -5.0%) vs baseline: +5.9%

✅ ospathbasename_noaspect

Time: ✅ 434.119µs (SLO: <700.000µs 📉 -38.0%) vs baseline: +1.8%

Memory: ✅ 43.756MB (SLO: <46.000MB -4.9%) vs baseline: +5.8%

✅ ospathjoin_aspect

Time: ✅ 630.114µs (SLO: <700.000µs -10.0%) vs baseline: +1.2%

Memory: ✅ 43.667MB (SLO: <46.000MB -5.1%) vs baseline: +5.4%

✅ ospathjoin_noaspect

Time: ✅ 634.611µs (SLO: <700.000µs -9.3%) vs baseline: +1.4%

Memory: ✅ 43.732MB (SLO: <46.000MB -4.9%) vs baseline: +5.4%

✅ ospathnormcase_aspect

Time: ✅ 350.542µs (SLO: <700.000µs 📉 -49.9%) vs baseline: +0.6%

Memory: ✅ 43.701MB (SLO: <46.000MB -5.0%) vs baseline: +5.6%

✅ ospathnormcase_noaspect

Time: ✅ 359.756µs (SLO: <700.000µs 📉 -48.6%) vs baseline: +1.3%

Memory: ✅ 43.670MB (SLO: <46.000MB -5.1%) vs baseline: +5.3%

✅ ospathsplit_aspect

Time: ✅ 489.158µs (SLO: <700.000µs 📉 -30.1%) vs baseline: +1.3%

Memory: ✅ 43.648MB (SLO: <46.000MB -5.1%) vs baseline: +5.2%

✅ ospathsplit_noaspect

Time: ✅ 496.714µs (SLO: <700.000µs 📉 -29.0%) vs baseline: +1.1%

Memory: ✅ 43.607MB (SLO: <46.000MB -5.2%) vs baseline: +5.6%

✅ ospathsplitdrive_aspect

Time: ✅ 376.924µs (SLO: <700.000µs 📉 -46.2%) vs baseline: +1.0%

Memory: ✅ 43.624MB (SLO: <46.000MB -5.2%) vs baseline: +5.7%

✅ ospathsplitdrive_noaspect

Time: ✅ 72.570µs (SLO: <700.000µs 📉 -89.6%) vs baseline: -1.0%

Memory: ✅ 43.710MB (SLO: <46.000MB -5.0%) vs baseline: +5.7%

✅ ospathsplitext_aspect

Time: ✅ 455.037µs (SLO: <700.000µs 📉 -35.0%) vs baseline: +0.6%

Memory: ✅ 43.636MB (SLO: <46.000MB -5.1%) vs baseline: +5.3%

✅ ospathsplitext_noaspect

Time: ✅ 464.459µs (SLO: <700.000µs 📉 -33.6%) vs baseline: +0.4%

Memory: ✅ 43.689MB (SLO: <46.000MB -5.0%) vs baseline: +5.6%

🟡 Near SLO Breach (2 suites)
🟡 djangosimple - 29/29

✅ appsec

Time: ✅ 19.720ms (SLO: <22.300ms 📉 -11.6%) vs baseline: +0.2%

Memory: ✅ 68.734MB (SLO: <73.500MB -6.5%) vs baseline: +5.0%

✅ exception-replay-enabled

Time: ✅ 1.388ms (SLO: <1.450ms -4.2%) vs baseline: +0.4%

Memory: ✅ 66.695MB (SLO: <71.500MB -6.7%) vs baseline: +5.2%

✅ iast

Time: ✅ 19.737ms (SLO: <22.250ms 📉 -11.3%) vs baseline: +0.6%

Memory: ✅ 68.793MB (SLO: <75.000MB -8.3%) vs baseline: +5.1%

✅ profiler

Time: ✅ 15.199ms (SLO: <16.550ms -8.2%) vs baseline: -0.2%

Memory: ✅ 60.184MB (SLO: <61.000MB 🟡 -1.3%) vs baseline: +5.4%

✅ resource-renaming

Time: ✅ 19.605ms (SLO: <21.750ms -9.9%) vs baseline: +0.1%

Memory: ✅ 68.793MB (SLO: <73.500MB -6.4%) vs baseline: +5.1%

✅ span-code-origin

Time: ✅ 20.010ms (SLO: <28.200ms 📉 -29.0%) vs baseline: +0.9%

Memory: ✅ 68.778MB (SLO: <75.000MB -8.3%) vs baseline: +5.0%

✅ tracer

Time: ✅ 19.765ms (SLO: <21.750ms -9.1%) vs baseline: +0.6%

Memory: ✅ 68.754MB (SLO: <75.000MB -8.3%) vs baseline: +5.0%

✅ tracer-and-profiler

Time: ✅ 21.073ms (SLO: <23.500ms 📉 -10.3%) vs baseline: -0.7%

Memory: ✅ 70.307MB (SLO: <75.000MB -6.3%) vs baseline: +4.8%

✅ tracer-dont-create-db-spans

Time: ✅ 19.756ms (SLO: <21.500ms -8.1%) vs baseline: ~same

✅ tracer-minimal

Time: ✅ 16.811ms (SLO: <17.500ms -3.9%) vs baseline: +0.4%

Memory: ✅ 68.773MB (SLO: <75.000MB -8.3%) vs baseline: +5.0%

✅ tracer-native

Time: ✅ 19.492ms (SLO: <21.750ms 📉 -10.4%) vs baseline: -0.1%

Memory: ✅ 68.793MB (SLO: <72.500MB -5.1%) vs baseline: +5.0%

✅ tracer-no-caches

Time: ✅ 17.593ms (SLO: <19.650ms 📉 -10.5%) vs baseline: +0.1%

Memory: ✅ 68.754MB (SLO: <75.000MB -8.3%) vs baseline: +5.0%

✅ tracer-no-databases

Time: ✅ 19.319ms (SLO: <20.100ms -3.9%) vs baseline: +0.7%

Memory: ✅ 68.754MB (SLO: <75.000MB -8.3%) vs baseline: +4.9%

✅ tracer-no-middleware

Time: ✅ 19.397ms (SLO: <21.500ms -9.8%) vs baseline: ~same

Memory: ✅ 68.754MB (SLO: <75.000MB -8.3%) vs baseline: +5.0%

✅ tracer-no-templates

Time: ✅ 19.574ms (SLO: <22.000ms 📉 -11.0%) vs baseline: +1.0%

Memory: ✅ 68.754MB (SLO: <73.500MB -6.5%) vs baseline: +5.1%

🟡 flasksimple - 18/18

✅ appsec-get

Time: ✅ 3.434ms (SLO: <4.750ms 📉 -27.7%) vs baseline: -0.7%

Memory: ✅ 56.326MB (SLO: <66.500MB 📉 -15.3%) vs baseline: +5.1%

✅ appsec-post

Time: ✅ 2.900ms (SLO: <6.750ms 📉 -57.0%) vs baseline: +0.1%

Memory: ✅ 56.267MB (SLO: <66.500MB 📉 -15.4%) vs baseline: +5.0%

✅ appsec-telemetry

Time: ✅ 3.469ms (SLO: <4.750ms 📉 -27.0%) vs baseline: +1.7%

Memory: ✅ 56.130MB (SLO: <66.500MB 📉 -15.6%) vs baseline: +4.8%

✅ debugger

Time: ✅ 1.873ms (SLO: <2.000ms -6.3%) vs baseline: +0.1%

Memory: ✅ 49.407MB (SLO: <51.500MB -4.1%) vs baseline: +5.0%

✅ iast-get

Time: ✅ 1.860ms (SLO: <2.000ms -7.0%) vs baseline: ~same

Memory: ✅ 46.162MB (SLO: <49.000MB -5.8%) vs baseline: +5.4%

✅ profiler

Time: ✅ 1.902ms (SLO: <2.100ms -9.5%) vs baseline: +0.2%

Memory: ✅ 52.493MB (SLO: <52.500MB 🟡 ~same) vs baseline: +5.2%

✅ resource-renaming

Time: ✅ 3.400ms (SLO: <3.650ms -6.8%) vs baseline: +0.1%

Memory: ✅ 56.248MB (SLO: <60.000MB -6.3%) vs baseline: +4.9%

✅ tracer

Time: ✅ 3.423ms (SLO: <3.650ms -6.2%) vs baseline: ~same

Memory: ✅ 56.210MB (SLO: <60.000MB -6.3%) vs baseline: +5.0%

✅ tracer-native

Time: ✅ 3.416ms (SLO: <3.650ms -6.4%) vs baseline: ~same

Memory: ✅ 56.209MB (SLO: <60.000MB -6.3%) vs baseline: +5.0%

⚠️ Unstable Tests (2 suites)
⚠️ coreapiscenario - 10/10 (1 unstable)

⚠️ context_with_data_listeners

Time: ⚠️ 13.318µs (SLO: <20.000µs 📉 -33.4%) vs baseline: -0.2%

Memory: ✅ 36.471MB (SLO: <38.000MB -4.0%) vs baseline: +5.8%

✅ context_with_data_no_listeners

Time: ✅ 3.329µs (SLO: <10.000µs 📉 -66.7%) vs baseline: -0.2%

Memory: ✅ 36.372MB (SLO: <38.000MB -4.3%) vs baseline: +5.7%

✅ get_item_exists

Time: ✅ 0.584µs (SLO: <10.000µs 📉 -94.2%) vs baseline: +1.0%

Memory: ✅ 36.313MB (SLO: <38.000MB -4.4%) vs baseline: +5.4%

✅ get_item_missing

Time: ✅ 0.647µs (SLO: <10.000µs 📉 -93.5%) vs baseline: +1.7%

Memory: ✅ 36.372MB (SLO: <38.000MB -4.3%) vs baseline: +5.6%

✅ set_item

Time: ✅ 24.052µs (SLO: <30.000µs 📉 -19.8%) vs baseline: -1.1%

Memory: ✅ 36.274MB (SLO: <38.000MB -4.5%) vs baseline: +5.5%

⚠️ packagesupdateimporteddependencies - 24/24 (1 unstable)

✅ import_many

Time: ✅ 155.745µs (SLO: <170.000µs -8.4%) vs baseline: +0.7%

Memory: ✅ 41.434MB (SLO: <46.000MB -9.9%) vs baseline: +6.2%

✅ import_many_cached

Time: ✅ 121.443µs (SLO: <130.000µs -6.6%) vs baseline: ~same

Memory: ✅ 41.466MB (SLO: <46.000MB -9.9%) vs baseline: +6.4%

✅ import_many_stdlib

Time: ✅ 0.773ms (SLO: <1.750ms 📉 -55.8%) vs baseline: +1.0%

Memory: ✅ 41.873MB (SLO: <46.000MB -9.0%) vs baseline: +7.9%

⚠️ import_many_stdlib_cached

Time: ⚠️ 0.175ms (SLO: <1.100ms 📉 -84.1%) vs baseline: ~same

Memory: ✅ 41.341MB (SLO: <46.000MB 📉 -10.1%) vs baseline: +6.0%

✅ import_many_unknown

Time: ✅ 832.151µs (SLO: <890.000µs -6.5%) vs baseline: +0.4%

Memory: ✅ 41.569MB (SLO: <46.000MB -9.6%) vs baseline: +6.2%

✅ import_many_unknown_cached

Time: ✅ 789.235µs (SLO: <870.000µs -9.3%) vs baseline: -0.4%

Memory: ✅ 41.761MB (SLO: <46.000MB -9.2%) vs baseline: +7.0%

✅ import_one

Time: ✅ 19.808µs (SLO: <30.000µs 📉 -34.0%) vs baseline: +0.4%

Memory: ✅ 41.305MB (SLO: <46.000MB 📉 -10.2%) vs baseline: +5.6%

✅ import_one_cache

Time: ✅ 6.297µs (SLO: <10.000µs 📉 -37.0%) vs baseline: ~same

Memory: ✅ 41.312MB (SLO: <46.000MB 📉 -10.2%) vs baseline: +5.8%

✅ import_one_stdlib

Time: ✅ 18.808µs (SLO: <20.000µs -6.0%) vs baseline: +0.7%

Memory: ✅ 41.387MB (SLO: <46.000MB 📉 -10.0%) vs baseline: +5.9%

✅ import_one_stdlib_cache

Time: ✅ 6.295µs (SLO: <10.000µs 📉 -37.1%) vs baseline: +0.8%

Memory: ✅ 41.242MB (SLO: <46.000MB 📉 -10.3%) vs baseline: +6.0%

✅ import_one_unknown

Time: ✅ 45.146µs (SLO: <50.000µs -9.7%) vs baseline: -0.1%

Memory: ✅ 41.504MB (SLO: <46.000MB -9.8%) vs baseline: +6.5%

✅ import_one_unknown_cache

Time: ✅ 6.322µs (SLO: <10.000µs 📉 -36.8%) vs baseline: +0.7%

Memory: ✅ 41.504MB (SLO: <43.000MB -3.5%) vs baseline: +6.5%

✅ All Tests Passing (20 suites)
✅ codeprovenancefork - 2/2

✅ fork-10

Time: ✅ 2.138s (SLO: <2.300s -7.1%) vs baseline: +2.5%

Memory: ✅ 17.400MB (SLO: <20.000MB 📉 -13.0%) vs baseline: +5.1%

✅ errortrackingdjangosimple - 6/6

✅ errortracking-enabled-all

Time: ✅ 16.372ms (SLO: <19.850ms 📉 -17.5%) vs baseline: ~same

Memory: ✅ 68.164MB (SLO: <75.000MB -9.1%) vs baseline: +4.9%

✅ errortracking-enabled-user

Time: ✅ 16.392ms (SLO: <19.400ms 📉 -15.5%) vs baseline: +0.2%

Memory: ✅ 68.184MB (SLO: <75.000MB -9.1%) vs baseline: +4.9%

✅ tracer-enabled

Time: ✅ 16.330ms (SLO: <19.450ms 📉 -16.0%) vs baseline: -0.2%

Memory: ✅ 68.243MB (SLO: <75.000MB -9.0%) vs baseline: +5.1%

✅ errortrackingflasksqli - 6/6

✅ errortracking-enabled-all

Time: ✅ 2.108ms (SLO: <2.300ms -8.4%) vs baseline: ~same

Memory: ✅ 55.904MB (SLO: <60.000MB -6.8%) vs baseline: +4.7%

✅ errortracking-enabled-user

Time: ✅ 2.122ms (SLO: <2.250ms -5.7%) vs baseline: +0.1%

Memory: ✅ 55.856MB (SLO: <60.000MB -6.9%) vs baseline: +4.7%

✅ tracer-enabled

Time: ✅ 2.107ms (SLO: <2.300ms -8.4%) vs baseline: -0.3%

Memory: ✅ 55.937MB (SLO: <60.000MB -6.8%) vs baseline: +4.9%

✅ flasksqli - 6/6

✅ appsec-enabled

Time: ✅ 2.111ms (SLO: <4.200ms 📉 -49.7%) vs baseline: +0.2%

Memory: ✅ 55.989MB (SLO: <66.000MB 📉 -15.2%) vs baseline: +4.6%

✅ iast-enabled

Time: ✅ 2.117ms (SLO: <2.800ms 📉 -24.4%) vs baseline: +0.1%

Memory: ✅ 55.938MB (SLO: <62.500MB 📉 -10.5%) vs baseline: +4.6%

✅ tracer-enabled

Time: ✅ 2.105ms (SLO: <2.250ms -6.4%) vs baseline: -0.3%

Memory: ✅ 55.985MB (SLO: <60.000MB -6.7%) vs baseline: +4.7%

✅ forktime - 4/4

✅ baseline

Time: ✅ 1.952ms (SLO: <3.000ms 📉 -34.9%) vs baseline: +4.1%

Memory: ✅ 29.216MB (SLO: <33.000MB 📉 -11.5%) vs baseline: +4.8%

✅ configured

Time: ✅ 8.616ms (SLO: <13.000ms 📉 -33.7%) vs baseline: -0.2%

Memory: ✅ 56.191MB (SLO: <60.000MB -6.3%) vs baseline: +5.8%

✅ httppropagationextract - 60/60

✅ all_styles_all_headers

Time: ✅ 80.230µs (SLO: <100.000µs 📉 -19.8%) vs baseline: +4.7%

Memory: ✅ 36.353MB (SLO: <38.000MB -4.3%) vs baseline: +5.4%

✅ b3_headers

Time: ✅ 12.779µs (SLO: <20.000µs 📉 -36.1%) vs baseline: -0.4%

Memory: ✅ 36.510MB (SLO: <38.000MB -3.9%) vs baseline: +5.8%

✅ b3_single_headers

Time: ✅ 11.742µs (SLO: <20.000µs 📉 -41.3%) vs baseline: -1.3%

Memory: ✅ 36.451MB (SLO: <38.000MB -4.1%) vs baseline: +5.4%

✅ datadog_tracecontext_tracestate_not_propagated_on_trace_id_no_match

Time: ✅ 61.299µs (SLO: <80.000µs 📉 -23.4%) vs baseline: -0.2%

Memory: ✅ 36.353MB (SLO: <38.000MB -4.3%) vs baseline: +5.7%

✅ datadog_tracecontext_tracestate_propagated_on_trace_id_match

Time: ✅ 62.926µs (SLO: <80.000µs 📉 -21.3%) vs baseline: -0.2%

Memory: ✅ 36.412MB (SLO: <38.000MB -4.2%) vs baseline: +5.3%

✅ empty_headers

Time: ✅ 1.312µs (SLO: <10.000µs 📉 -86.9%) vs baseline: +0.3%

Memory: ✅ 36.392MB (SLO: <38.000MB -4.2%) vs baseline: +5.1%

✅ full_t_id_datadog_headers

Time: ✅ 21.316µs (SLO: <30.000µs 📉 -28.9%) vs baseline: +0.9%

Memory: ✅ 36.412MB (SLO: <38.000MB -4.2%) vs baseline: +5.3%

✅ invalid_priority_header

Time: ✅ 5.904µs (SLO: <10.000µs 📉 -41.0%) vs baseline: -0.2%

Memory: ✅ 36.372MB (SLO: <38.000MB -4.3%) vs baseline: +5.3%

✅ invalid_span_id_header

Time: ✅ 5.870µs (SLO: <10.000µs 📉 -41.3%) vs baseline: -0.7%

Memory: ✅ 36.608MB (SLO: <38.000MB -3.7%) vs baseline: +6.1%

✅ invalid_tags_header

Time: ✅ 5.914µs (SLO: <10.000µs 📉 -40.9%) vs baseline: +0.2%

Memory: ✅ 36.510MB (SLO: <38.000MB -3.9%) vs baseline: +5.7%

✅ invalid_trace_id_header

Time: ✅ 5.902µs (SLO: <10.000µs 📉 -41.0%) vs baseline: -0.2%

Memory: ✅ 36.392MB (SLO: <38.000MB -4.2%) vs baseline: +5.7%

✅ large_header_no_matches

Time: ✅ 27.234µs (SLO: <30.000µs -9.2%) vs baseline: -0.3%

Memory: ✅ 36.471MB (SLO: <38.000MB -4.0%) vs baseline: +5.8%

✅ large_valid_headers_all

Time: ✅ 28.311µs (SLO: <40.000µs 📉 -29.2%) vs baseline: -0.4%

Memory: ✅ 36.353MB (SLO: <38.000MB -4.3%) vs baseline: +5.3%

✅ medium_header_no_matches

Time: ✅ 9.236µs (SLO: <20.000µs 📉 -53.8%) vs baseline: -0.2%

Memory: ✅ 36.667MB (SLO: <38.000MB -3.5%) vs baseline: +6.2%

✅ medium_valid_headers_all

Time: ✅ 10.603µs (SLO: <20.000µs 📉 -47.0%) vs baseline: -0.6%

Memory: ✅ 36.451MB (SLO: <38.000MB -4.1%) vs baseline: +5.8%

✅ none_propagation_style

Time: ✅ 1.399µs (SLO: <10.000µs 📉 -86.0%) vs baseline: +2.0%

Memory: ✅ 36.372MB (SLO: <38.000MB -4.3%) vs baseline: +5.2%

✅ tracecontext_headers

Time: ✅ 32.674µs (SLO: <40.000µs 📉 -18.3%) vs baseline: -0.2%

Memory: ✅ 36.372MB (SLO: <38.000MB -4.3%) vs baseline: +5.1%

✅ valid_headers_all

Time: ✅ 5.899µs (SLO: <10.000µs 📉 -41.0%) vs baseline: -0.2%

Memory: ✅ 36.569MB (SLO: <38.000MB -3.8%) vs baseline: +5.9%

✅ valid_headers_basic

Time: ✅ 5.462µs (SLO: <10.000µs 📉 -45.4%) vs baseline: -0.3%

Memory: ✅ 36.471MB (SLO: <38.000MB -4.0%) vs baseline: +5.5%

✅ wsgi_empty_headers

Time: ✅ 1.314µs (SLO: <10.000µs 📉 -86.9%) vs baseline: +1.4%

Memory: ✅ 36.333MB (SLO: <38.000MB -4.4%) vs baseline: +5.3%

✅ wsgi_invalid_priority_header

Time: ✅ 5.981µs (SLO: <10.000µs 📉 -40.2%) vs baseline: +0.4%

Memory: ✅ 36.589MB (SLO: <38.000MB -3.7%) vs baseline: +5.9%

✅ wsgi_invalid_span_id_header

Time: ✅ 1.310µs (SLO: <10.000µs 📉 -86.9%) vs baseline: +0.9%

Memory: ✅ 36.372MB (SLO: <38.000MB -4.3%) vs baseline: +5.5%

✅ wsgi_invalid_tags_header

Time: ✅ 5.969µs (SLO: <10.000µs 📉 -40.3%) vs baseline: +0.4%

Memory: ✅ 36.549MB (SLO: <38.000MB -3.8%) vs baseline: +5.7%

✅ wsgi_invalid_trace_id_header

Time: ✅ 5.935µs (SLO: <10.000µs 📉 -40.7%) vs baseline: -0.6%

Memory: ✅ 36.490MB (SLO: <38.000MB -4.0%) vs baseline: +5.6%

✅ wsgi_large_header_no_matches

Time: ✅ 28.116µs (SLO: <40.000µs 📉 -29.7%) vs baseline: +0.3%

Memory: ✅ 36.372MB (SLO: <38.000MB -4.3%) vs baseline: +5.4%

✅ wsgi_large_valid_headers_all

Time: ✅ 29.184µs (SLO: <40.000µs 📉 -27.0%) vs baseline: +0.1%

Memory: ✅ 36.490MB (SLO: <38.000MB -4.0%) vs baseline: +5.7%

✅ wsgi_medium_header_no_matches

Time: ✅ 9.443µs (SLO: <20.000µs 📉 -52.8%) vs baseline: +0.3%

Memory: ✅ 36.530MB (SLO: <38.000MB -3.9%) vs baseline: +5.7%

✅ wsgi_medium_valid_headers_all

Time: ✅ 10.992µs (SLO: <20.000µs 📉 -45.0%) vs baseline: +0.6%

Memory: ✅ 36.510MB (SLO: <38.000MB -3.9%) vs baseline: +5.8%

✅ wsgi_valid_headers_all

Time: ✅ 5.954µs (SLO: <10.000µs 📉 -40.5%) vs baseline: ~same

Memory: ✅ 36.412MB (SLO: <38.000MB -4.2%) vs baseline: +5.5%

✅ wsgi_valid_headers_basic

Time: ✅ 5.503µs (SLO: <10.000µs 📉 -45.0%) vs baseline: ~same

Memory: ✅ 36.353MB (SLO: <38.000MB -4.3%) vs baseline: +5.5%

✅ httppropagationinject - 16/16

✅ ids_only

Time: ✅ 20.925µs (SLO: <30.000µs 📉 -30.3%) vs baseline: +4.3%

Memory: ✅ 36.372MB (SLO: <38.000MB -4.3%) vs baseline: +5.7%

✅ with_all

Time: ✅ 26.969µs (SLO: <40.000µs 📉 -32.6%) vs baseline: +0.2%

Memory: ✅ 36.431MB (SLO: <38.000MB -4.1%) vs baseline: +5.4%

✅ with_dd_origin

Time: ✅ 23.854µs (SLO: <30.000µs 📉 -20.5%) vs baseline: ~same

Memory: ✅ 36.353MB (SLO: <38.000MB -4.3%) vs baseline: +5.4%

✅ with_priority_and_origin

Time: ✅ 23.425µs (SLO: <40.000µs 📉 -41.4%) vs baseline: +0.4%

Memory: ✅ 36.274MB (SLO: <38.000MB -4.5%) vs baseline: +5.2%

✅ with_sampling_priority

Time: ✅ 20.001µs (SLO: <30.000µs 📉 -33.3%) vs baseline: +0.2%

Memory: ✅ 36.431MB (SLO: <38.000MB -4.1%) vs baseline: +5.5%

✅ with_tags

Time: ✅ 24.955µs (SLO: <40.000µs 📉 -37.6%) vs baseline: -0.4%

Memory: ✅ 36.471MB (SLO: <38.000MB -4.0%) vs baseline: +5.8%

✅ with_tags_invalid

Time: ✅ 26.320µs (SLO: <40.000µs 📉 -34.2%) vs baseline: +0.2%

Memory: ✅ 36.333MB (SLO: <38.000MB -4.4%) vs baseline: +5.1%

✅ with_tags_max_size

Time: ✅ 25.515µs (SLO: <40.000µs 📉 -36.2%) vs baseline: +0.5%

Memory: ✅ 36.451MB (SLO: <38.000MB -4.1%) vs baseline: +5.6%

✅ iastaspectssplit - 12/12

✅ rsplit_aspect

Time: ✅ 156.795µs (SLO: <250.000µs 📉 -37.3%) vs baseline: +8.2%

Memory: ✅ 43.670MB (SLO: <46.000MB -5.1%) vs baseline: +5.3%

✅ rsplit_noaspect

Time: ✅ 158.112µs (SLO: <250.000µs 📉 -36.8%) vs baseline: +5.0%

Memory: ✅ 43.628MB (SLO: <46.000MB -5.2%) vs baseline: +5.3%

✅ split_aspect

Time: ✅ 150.049µs (SLO: <250.000µs 📉 -40.0%) vs baseline: +3.1%

Memory: ✅ 43.632MB (SLO: <46.000MB -5.1%) vs baseline: +5.4%

✅ split_noaspect

Time: ✅ 154.446µs (SLO: <250.000µs 📉 -38.2%) vs baseline: +3.0%

Memory: ✅ 43.647MB (SLO: <46.000MB -5.1%) vs baseline: +5.7%

✅ splitlines_aspect

Time: ✅ 144.724µs (SLO: <250.000µs 📉 -42.1%) vs baseline: -0.6%

Memory: ✅ 43.644MB (SLO: <46.000MB -5.1%) vs baseline: +5.5%

✅ splitlines_noaspect

Time: ✅ 149.923µs (SLO: <250.000µs 📉 -40.0%) vs baseline: +0.4%

Memory: ✅ 43.647MB (SLO: <46.000MB -5.1%) vs baseline: +5.5%

✅ iastpropagation - 8/8

✅ no-propagation

Time: ✅ 48.060µs (SLO: <60.000µs 📉 -19.9%) vs baseline: -0.2%

Memory: ✅ 40.088MB (SLO: <42.000MB -4.6%) vs baseline: +5.3%

✅ propagation_enabled

Time: ✅ 134.677µs (SLO: <190.000µs 📉 -29.1%) vs baseline: -1.6%

Memory: ✅ 40.187MB (SLO: <42.000MB -4.3%) vs baseline: +5.7%

✅ propagation_enabled_100

Time: ✅ 1.561ms (SLO: <2.300ms 📉 -32.1%) vs baseline: -0.5%

Memory: ✅ 40.187MB (SLO: <42.000MB -4.3%) vs baseline: +5.6%

✅ propagation_enabled_1000

Time: ✅ 29.247ms (SLO: <34.550ms 📉 -15.3%) vs baseline: +0.1%

Memory: ✅ 40.147MB (SLO: <42.000MB -4.4%) vs baseline: +5.5%

✅ otelsdkspan - 24/24

✅ add-event

Time: ✅ 40.353ms (SLO: <42.000ms -3.9%) vs baseline: -0.3%

Memory: ✅ 39.145MB (SLO: <40.750MB -3.9%) vs baseline: +6.1%

✅ add-link

Time: ✅ 36.259ms (SLO: <38.550ms -5.9%) vs baseline: ~same

Memory: ✅ 39.105MB (SLO: <40.750MB -4.0%) vs baseline: +6.4%

✅ add-metrics

Time: ✅ 218.441ms (SLO: <232.000ms -5.8%) vs baseline: +0.7%

Memory: ✅ 39.145MB (SLO: <40.750MB -3.9%) vs baseline: +6.2%

✅ add-tags

Time: ✅ 211.274ms (SLO: <221.600ms -4.7%) vs baseline: -0.2%

Memory: ✅ 39.164MB (SLO: <40.750MB -3.9%) vs baseline: +6.7%

✅ get-context

Time: ✅ 28.803ms (SLO: <31.300ms -8.0%) vs baseline: -0.4%

Memory: ✅ 39.145MB (SLO: <40.750MB -3.9%) vs baseline: +6.5%

✅ is-recording

Time: ✅ 29.150ms (SLO: <31.000ms -6.0%) vs baseline: +0.8%

Memory: ✅ 39.105MB (SLO: <40.750MB -4.0%) vs baseline: +6.4%

✅ record-exception

Time: ✅ 63.056ms (SLO: <65.850ms -4.2%) vs baseline: +0.6%

Memory: ✅ 39.125MB (SLO: <40.750MB -4.0%) vs baseline: +6.2%

✅ set-status

Time: ✅ 31.817ms (SLO: <34.150ms -6.8%) vs baseline: +0.5%

Memory: ✅ 39.125MB (SLO: <40.750MB -4.0%) vs baseline: +6.3%

✅ start

Time: ✅ 29.143ms (SLO: <30.150ms -3.3%) vs baseline: +1.1%

Memory: ✅ 39.164MB (SLO: <40.750MB -3.9%) vs baseline: +6.4%

✅ start-finish

Time: ✅ 34.108ms (SLO: <35.350ms -3.5%) vs baseline: +0.6%

Memory: ✅ 39.105MB (SLO: <40.750MB -4.0%) vs baseline: +6.0%

✅ start-finish-telemetry

Time: ✅ 33.903ms (SLO: <35.450ms -4.4%) vs baseline: -0.4%

Memory: ✅ 39.066MB (SLO: <40.750MB -4.1%) vs baseline: +6.1%

✅ update-name

Time: ✅ 31.053ms (SLO: <33.400ms -7.0%) vs baseline: +0.5%

Memory: ✅ 39.125MB (SLO: <40.750MB -4.0%) vs baseline: +6.5%

✅ otelspan - 22/22

✅ add-event

Time: ✅ 40.360ms (SLO: <47.150ms 📉 -14.4%) vs baseline: ~same

Memory: ✅ 41.553MB (SLO: <47.000MB 📉 -11.6%) vs baseline: +6.2%

✅ add-metrics

Time: ✅ 251.773ms (SLO: <344.800ms 📉 -27.0%) vs baseline: -0.3%

Memory: ✅ 45.895MB (SLO: <47.500MB -3.4%) vs baseline: +6.0%

✅ add-tags

Time: ✅ 308.006ms (SLO: <330.000ms -6.7%) vs baseline: +0.6%

Memory: ✅ 45.922MB (SLO: <47.500MB -3.3%) vs baseline: +5.5%

✅ get-context

Time: ✅ 81.341ms (SLO: <92.350ms 📉 -11.9%) vs baseline: +0.6%

Memory: ✅ 41.593MB (SLO: <46.500MB 📉 -10.6%) vs baseline: +5.3%

✅ is-recording

Time: ✅ 36.579ms (SLO: <44.500ms 📉 -17.8%) vs baseline: -0.4%

Memory: ✅ 41.185MB (SLO: <47.500MB 📉 -13.3%) vs baseline: +5.7%

✅ record-exception

Time: ✅ 59.110ms (SLO: <67.650ms 📉 -12.6%) vs baseline: ~same

Memory: ✅ 41.843MB (SLO: <47.000MB 📉 -11.0%) vs baseline: +5.8%

✅ set-status

Time: ✅ 43.175ms (SLO: <50.400ms 📉 -14.3%) vs baseline: -0.6%

Memory: ✅ 41.226MB (SLO: <47.000MB 📉 -12.3%) vs baseline: +5.5%

✅ start

Time: ✅ 37.388ms (SLO: <43.450ms 📉 -14.0%) vs baseline: +3.2%

Memory: ✅ 41.332MB (SLO: <47.000MB 📉 -12.1%) vs baseline: +5.6%

✅ start-finish

Time: ✅ 84.995ms (SLO: <90.000ms -5.6%) vs baseline: -0.1%

Memory: ✅ 38.889MB (SLO: <46.500MB 📉 -16.4%) vs baseline: +5.6%

✅ start-finish-telemetry

Time: ✅ 86.400ms (SLO: <91.000ms -5.1%) vs baseline: ~same

Memory: ✅ 38.712MB (SLO: <46.500MB 📉 -16.7%) vs baseline: +5.2%

✅ update-name

Time: ✅ 37.635ms (SLO: <45.150ms 📉 -16.6%) vs baseline: -0.6%

Memory: ✅ 41.231MB (SLO: <47.000MB 📉 -12.3%) vs baseline: +5.6%

✅ packagespackageforrootmodulemapping - 4/4

✅ cache_off

Time: ✅ 346.773ms (SLO: <354.300ms -2.1%) vs baseline: -1.4%

Memory: ✅ 43.680MB (SLO: <46.000MB -5.0%) vs baseline: +6.0%

✅ cache_on

Time: ✅ 0.385µs (SLO: <10.000µs 📉 -96.2%) vs baseline: +0.6%

Memory: ✅ 41.280MB (SLO: <46.000MB 📉 -10.3%) vs baseline: +3.5%

✅ rand - 2/2

✅ rand128bits

Time: ✅ 0.181µs (SLO: <21.000µs 📉 -99.1%) vs baseline: -1.1%

✅ rand64bits

Time: ✅ 0.122µs (SLO: <15.000µs 📉 -99.2%) vs baseline: +6.8%

✅ ratelimiter - 12/12

✅ defaults

Time: ✅ 2.344µs (SLO: <10.000µs 📉 -76.6%) vs baseline: +0.4%

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.4%

✅ high_rate_limit

Time: ✅ 2.411µs (SLO: <10.000µs 📉 -75.9%) vs baseline: -0.1%

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +5.3%

✅ long_window

Time: ✅ 2.343µs (SLO: <10.000µs 📉 -76.6%) vs baseline: ~same

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +5.1%

✅ low_rate_limit

Time: ✅ 2.373µs (SLO: <10.000µs 📉 -76.3%) vs baseline: +0.4%

Memory: ✅ 36.313MB (SLO: <38.000MB -4.4%) vs baseline: +5.8%

✅ no_rate_limit

Time: ✅ 0.835µs (SLO: <10.000µs 📉 -91.7%) vs baseline: +1.9%

Memory: ✅ 36.294MB (SLO: <38.000MB -4.5%) vs baseline: +5.3%

✅ short_window

Time: ✅ 2.468µs (SLO: <10.000µs 📉 -75.3%) vs baseline: -0.9%

Memory: ✅ 36.353MB (SLO: <38.000MB -4.3%) vs baseline: +4.9%

✅ recursivecomputation - 8/8

✅ deep

Time: ✅ 309.177ms (SLO: <320.950ms -3.7%) vs baseline: -0.2%

Memory: ✅ 37.493MB (SLO: <38.750MB -3.2%) vs baseline: +5.4%

✅ deep-profiled

Time: ✅ 326.021ms (SLO: <359.150ms -9.2%) vs baseline: -0.2%

Memory: ✅ 43.549MB (SLO: <46.000MB -5.3%) vs baseline: +6.4%

✅ medium

Time: ✅ 7.147ms (SLO: <7.400ms -3.4%) vs baseline: ~same

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +5.3%

✅ shallow

Time: ✅ 0.985ms (SLO: <1.050ms -6.2%) vs baseline: +1.9%

Memory: ✅ 36.215MB (SLO: <38.000MB -4.7%) vs baseline: +5.1%

✅ samplingrules - 8/8

✅ average_match

Time: ✅ 147.587µs (SLO: <290.000µs 📉 -49.1%) vs baseline: +0.6%

Memory: ✅ 36.333MB (SLO: <38.000MB -4.4%) vs baseline: +5.3%

✅ high_match

Time: ✅ 191.379µs (SLO: <480.000µs 📉 -60.1%) vs baseline: -0.3%

Memory: ✅ 36.235MB (SLO: <38.000MB -4.6%) vs baseline: +5.0%

✅ low_match

Time: ✅ 100.363µs (SLO: <120.000µs 📉 -16.4%) vs baseline: -1.5%

Memory: ✅ 701.707MB (SLO: <780.000MB 📉 -10.0%) vs baseline: +4.9%

✅ very_low_match

Time: ✅ 2.895ms (SLO: <8.500ms 📉 -65.9%) vs baseline: -0.2%

Memory: ✅ 78.797MB (SLO: <85.000MB -7.3%) vs baseline: +5.0%

✅ sethttpmeta - 32/32

✅ all-disabled

Time: ✅ 10.544µs (SLO: <20.000µs 📉 -47.3%) vs baseline: ~same

Memory: ✅ 37.100MB (SLO: <38.750MB -4.3%) vs baseline: +5.4%

✅ all-enabled

Time: ✅ 40.863µs (SLO: <50.000µs 📉 -18.3%) vs baseline: +2.3%

Memory: ✅ 37.218MB (SLO: <38.750MB -4.0%) vs baseline: +5.6%

✅ collectipvariant_exists

Time: ✅ 40.731µs (SLO: <50.000µs 📉 -18.5%) vs baseline: ~same

Memory: ✅ 37.159MB (SLO: <38.750MB -4.1%) vs baseline: +5.4%

✅ no-collectipvariant

Time: ✅ 40.196µs (SLO: <50.000µs 📉 -19.6%) vs baseline: +0.3%

Memory: ✅ 37.198MB (SLO: <38.750MB -4.0%) vs baseline: +5.7%

✅ no-useragentvariant

Time: ✅ 38.892µs (SLO: <50.000µs 📉 -22.2%) vs baseline: +0.5%

Memory: ✅ 37.061MB (SLO: <38.750MB -4.4%) vs baseline: +5.2%

✅ obfuscation-no-query

Time: ✅ 40.466µs (SLO: <50.000µs 📉 -19.1%) vs baseline: ~same

Memory: ✅ 37.179MB (SLO: <38.750MB -4.1%) vs baseline: +5.8%

✅ obfuscation-regular-case-explicit-query

Time: ✅ 75.957µs (SLO: <90.000µs 📉 -15.6%) vs baseline: +0.2%

Memory: ✅ 37.238MB (SLO: <38.750MB -3.9%) vs baseline: +5.6%

✅ obfuscation-regular-case-implicit-query

Time: ✅ 76.465µs (SLO: <90.000µs 📉 -15.0%) vs baseline: ~same

Memory: ✅ 37.179MB (SLO: <38.750MB -4.1%) vs baseline: +5.4%

✅ obfuscation-send-querystring-disabled

Time: ✅ 154.616µs (SLO: <170.000µs -9.0%) vs baseline: +0.2%

Memory: ✅ 37.238MB (SLO: <38.750MB -3.9%) vs baseline: +5.4%

✅ obfuscation-worst-case-explicit-query

Time: ✅ 148.844µs (SLO: <160.000µs -7.0%) vs baseline: +0.2%

Memory: ✅ 37.218MB (SLO: <38.750MB -4.0%) vs baseline: +5.6%

✅ obfuscation-worst-case-implicit-query

Time: ✅ 155.130µs (SLO: <170.000µs -8.7%) vs baseline: ~same

Memory: ✅ 37.198MB (SLO: <38.750MB -4.0%) vs baseline: +5.1%

✅ useragentvariant_exists_1

Time: ✅ 39.433µs (SLO: <50.000µs 📉 -21.1%) vs baseline: -0.2%

Memory: ✅ 37.139MB (SLO: <38.750MB -4.2%) vs baseline: +5.5%

✅ useragentvariant_exists_2

Time: ✅ 40.495µs (SLO: <50.000µs 📉 -19.0%) vs baseline: ~same

Memory: ✅ 37.139MB (SLO: <38.750MB -4.2%) vs baseline: +5.5%

✅ useragentvariant_exists_3

Time: ✅ 39.955µs (SLO: <50.000µs 📉 -20.1%) vs baseline: ~same

Memory: ✅ 37.139MB (SLO: <38.750MB -4.2%) vs baseline: +5.6%

✅ useragentvariant_not_exists_1

Time: ✅ 39.393µs (SLO: <50.000µs 📉 -21.2%) vs baseline: +0.2%

Memory: ✅ 37.139MB (SLO: <38.750MB -4.2%) vs baseline: +5.1%

✅ useragentvariant_not_exists_2

Time: ✅ 39.437µs (SLO: <50.000µs 📉 -21.1%) vs baseline: +0.5%

Memory: ✅ 37.179MB (SLO: <38.750MB -4.1%) vs baseline: +5.5%

✅ span - 26/26

✅ add-event

Time: ✅ 18.377ms (SLO: <22.500ms 📉 -18.3%) vs baseline: +1.0%

Memory: ✅ 38.604MB (SLO: <53.000MB 📉 -27.2%) vs baseline: +5.1%

✅ add-metrics

Time: ✅ 88.633ms (SLO: <93.500ms -5.2%) vs baseline: +0.7%

Memory: ✅ 42.959MB (SLO: <53.000MB 📉 -18.9%) vs baseline: +5.1%

✅ add-tags

Time: ✅ 144.321ms (SLO: <155.000ms -6.9%) vs baseline: -0.2%

Memory: ✅ 43.104MB (SLO: <53.000MB 📉 -18.7%) vs baseline: +5.4%

✅ get-context

Time: ✅ 16.680ms (SLO: <20.500ms 📉 -18.6%) vs baseline: -0.3%

Memory: ✅ 38.771MB (SLO: <53.000MB 📉 -26.8%) vs baseline: +6.6%

✅ is-recording

Time: ✅ 16.911ms (SLO: <20.500ms 📉 -17.5%) vs baseline: +0.2%

Memory: ✅ 38.653MB (SLO: <53.000MB 📉 -27.1%) vs baseline: +6.5%

✅ record-exception

Time: ✅ 37.432ms (SLO: <41.000ms -8.7%) vs baseline: +0.5%

Memory: ✅ 39.066MB (SLO: <53.000MB 📉 -26.3%) vs baseline: +5.6%

✅ set-status

Time: ✅ 18.579ms (SLO: <22.000ms 📉 -15.6%) vs baseline: +1.1%

Memory: ✅ 38.673MB (SLO: <53.000MB 📉 -27.0%) vs baseline: +6.4%

✅ start

Time: ✅ 17.424ms (SLO: <20.500ms 📉 -15.0%) vs baseline: +5.1%

Memory: ✅ 38.653MB (SLO: <53.000MB 📉 -27.1%) vs baseline: +6.0%

✅ start-finish

Time: ✅ 53.454ms (SLO: <56.000ms -4.5%) vs baseline: ~same

Memory: ✅ 36.274MB (SLO: <38.000MB -4.5%) vs baseline: +5.3%

✅ start-finish-telemetry

Time: ✅ 54.960ms (SLO: <58.000ms -5.2%) vs baseline: +0.5%

Memory: ✅ 36.255MB (SLO: <38.000MB -4.6%) vs baseline: +5.3%

✅ start-finish-traceid128

Time: ✅ 56.156ms (SLO: <60.000ms -6.4%) vs baseline: +0.3%

Memory: ✅ 36.353MB (SLO: <38.000MB -4.3%) vs baseline: +5.4%

✅ start-traceid128

Time: ✅ 16.795ms (SLO: <22.500ms 📉 -25.4%) vs baseline: +0.4%

Memory: ✅ 38.673MB (SLO: <53.000MB 📉 -27.0%) vs baseline: +6.1%

✅ update-name

Time: ✅ 17.221ms (SLO: <22.000ms 📉 -21.7%) vs baseline: +0.4%

Memory: ✅ 38.732MB (SLO: <53.000MB 📉 -26.9%) vs baseline: +6.3%

✅ telemetryaddmetric - 30/30

✅ 1-count-metric-1-times

Time: ✅ 2.369µs (SLO: <20.000µs 📉 -88.2%) vs baseline: +8.8%

Memory: ✅ 36.667MB (SLO: <38.000MB -3.5%) vs baseline: +6.5%

✅ 1-count-metrics-100-times

Time: ✅ 154.657µs (SLO: <220.000µs 📉 -29.7%) vs baseline: -1.2%

Memory: ✅ 36.707MB (SLO: <38.000MB -3.4%) vs baseline: +6.6%

✅ 1-distribution-metric-1-times

Time: ✅ 2.465µs (SLO: <20.000µs 📉 -87.7%) vs baseline: +0.7%

Memory: ✅ 36.648MB (SLO: <38.000MB -3.6%) vs baseline: +6.2%

✅ 1-distribution-metrics-100-times

Time: ✅ 164.267µs (SLO: <230.000µs 📉 -28.6%) vs baseline: -3.3%

Memory: ✅ 36.589MB (SLO: <38.000MB -3.7%) vs baseline: +5.9%

✅ 1-gauge-metric-1-times

Time: ✅ 1.979µs (SLO: <20.000µs 📉 -90.1%) vs baseline: -1.6%

Memory: ✅ 36.648MB (SLO: <38.000MB -3.6%) vs baseline: +6.7%

✅ 1-gauge-metrics-100-times

Time: ✅ 136.862µs (SLO: <150.000µs -8.8%) vs baseline: -3.7%

Memory: ✅ 36.589MB (SLO: <38.000MB -3.7%) vs baseline: +6.5%

✅ 1-rate-metric-1-times

Time: ✅ 2.274µs (SLO: <20.000µs 📉 -88.6%) vs baseline: -2.8%

Memory: ✅ 36.707MB (SLO: <38.000MB -3.4%) vs baseline: +6.3%

✅ 1-rate-metrics-100-times

Time: ✅ 168.054µs (SLO: <250.000µs 📉 -32.8%) vs baseline: -2.0%

Memory: ✅ 36.608MB (SLO: <38.000MB -3.7%) vs baseline: +6.6%

✅ 100-count-metrics-100-times

Time: ✅ 15.669ms (SLO: <22.000ms 📉 -28.8%) vs baseline: -2.6%

Memory: ✅ 36.353MB (SLO: <38.000MB -4.3%) vs baseline: +5.4%

✅ 100-distribution-metrics-100-times

Time: ✅ 1.739ms (SLO: <2.550ms 📉 -31.8%) vs baseline: -3.2%

Memory: ✅ 36.648MB (SLO: <38.000MB -3.6%) vs baseline: +6.6%

✅ 100-gauge-metrics-100-times

Time: ✅ 1.404ms (SLO: <1.550ms -9.5%) vs baseline: -4.4%

Memory: ✅ 36.353MB (SLO: <38.000MB -4.3%) vs baseline: +5.5%

✅ 100-rate-metrics-100-times

Time: ✅ 1.771ms (SLO: <2.550ms 📉 -30.6%) vs baseline: -2.2%

Memory: ✅ 36.412MB (SLO: <38.000MB -4.2%) vs baseline: +5.8%

✅ flush-1-metric

Time: ✅ 3.633µs (SLO: <20.000µs 📉 -81.8%) vs baseline: +1.3%

Memory: ✅ 36.667MB (SLO: <38.000MB -3.5%) vs baseline: +5.8%

✅ flush-100-metrics

Time: ✅ 177.645µs (SLO: <250.000µs 📉 -28.9%) vs baseline: +1.4%

Memory: ✅ 36.785MB (SLO: <38.000MB -3.2%) vs baseline: +5.6%

✅ flush-1000-metrics

Time: ✅ 2.184ms (SLO: <2.500ms 📉 -12.6%) vs baseline: -0.7%

Memory: ✅ 37.454MB (SLO: <38.750MB -3.3%) vs baseline: +6.4%

✅ tracer - 6/6

✅ large

Time: ✅ 31.240ms (SLO: <32.950ms -5.2%) vs baseline: ~same

Memory: ✅ 37.532MB (SLO: <39.250MB -4.4%) vs baseline: +5.2%

✅ medium

Time: ✅ 3.104ms (SLO: <3.200ms -3.0%) vs baseline: +0.6%

Memory: ✅ 36.274MB (SLO: <38.750MB -6.4%) vs baseline: +5.3%

✅ small

Time: ✅ 361.254µs (SLO: <370.000µs -2.4%) vs baseline: +3.8%

Memory: ✅ 36.255MB (SLO: <38.750MB -6.4%) vs baseline: +5.1%

ℹ️ Scenarios Missing SLO Configuration (46 scenarios)

The following scenarios exist in candidate data but have no SLO thresholds configured:

  • coreapiscenario-core_dispatch_listeners
  • coreapiscenario-core_dispatch_no_listeners
  • coreapiscenario-core_dispatch_with_results_listeners
  • coreapiscenario-core_dispatch_with_results_no_listeners
  • djangosimple-baseline
  • errortrackingdjangosimple-baseline
  • errortrackingflasksqli-baseline
  • flasksimple-baseline
  • flasksqli-baseline
  • iast_aspects-re_expand_aspect
  • iast_aspects-re_expand_noaspect
  • iast_aspects-re_findall_aspect
  • iast_aspects-re_findall_noaspect
  • iast_aspects-re_finditer_aspect
  • iast_aspects-re_finditer_noaspect
  • iast_aspects-re_fullmatch_aspect
  • iast_aspects-re_fullmatch_noaspect
  • iast_aspects-re_group_aspect
  • iast_aspects-re_group_noaspect
  • iast_aspects-re_groups_aspect
  • iast_aspects-re_groups_noaspect
  • iast_aspects-re_match_aspect
  • iast_aspects-re_match_noaspect
  • iast_aspects-re_search_aspect
  • iast_aspects-re_search_noaspect
  • iast_aspects-re_sub_aspect
  • iast_aspects-re_sub_noaspect
  • iast_aspects-re_subn_aspect
  • iast_aspects-re_subn_noaspect
  • sethttpmeta-obfuscation-disabled
  • startup-baseline
  • startup-baseline_django
  • startup-baseline_flask
  • startup-ddtrace_run
  • startup-ddtrace_run_appsec
  • startup-ddtrace_run_profiling
  • startup-ddtrace_run_runtime_metrics
  • startup-ddtrace_run_send_span
  • startup-ddtrace_run_telemetry_disabled
  • startup-ddtrace_run_telemetry_enabled
  • startup-import_ddtrace
  • startup-import_ddtrace_auto
  • startup-import_ddtrace_auto_django
  • startup-import_ddtrace_auto_flask
  • startup-import_ddtrace_django
  • startup-import_ddtrace_flask

@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d bot merged commit 2138b05 into main Mar 12, 2026
1026 checks passed
@gh-worker-dd-mergequeue-cf854d gh-worker-dd-mergequeue-cf854d bot deleted the yunkim/update-system-tests branch March 12, 2026 22:33
@cit-pr-commenter-54b7da
Copy link

cit-pr-commenter-54b7da bot commented Mar 12, 2026

Codeowners resolved as

.github/workflows/system-tests.yml                                      @DataDog/python-guild @DataDog/apm-core-python
.gitlab-ci.yml                                                          @DataDog/python-guild @DataDog/apm-core-python

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Kyle-Verhoog Kyle-Verhoog Kyle-Verhoog approved these changes

@emmettbutler emmettbutler Awaiting requested review from emmettbutler emmettbutler is a code owner automatically assigned from DataDog/apm-core-python

Assignees

No one assigned

Labels

changelog/no-changelog A changelog entry is not required for this PR.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@Yun-Kim @Kyle-Verhoog