Skip to content

Update docker base image #9550

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
sarahchen6 merged 3 commits into from
Sep 17, 2025
Merged

Update docker base image #9550

sarahchen6 merged 3 commits into from
Sep 17, 2025

Conversation

@sarahchen6
Copy link
Contributor

@sarahchen6 sarahchen6 commented Sep 16, 2025 •
edited
Loading

What Does This Do

Upgrade to the latest docker base image from DataDog/dd-trace-java-docker-build#118. This should reference the same base image, as the latest LTS ubuntu image is what we had pinned - 24.04.

This PR also disables a few failing agent-debugger kotlin compilation tests for Java 25. These are currently being investigated by the Debugger team.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@sarahchen6 sarahchen6 added the tag: do not merge Do not merge changes label Sep 16, 2025
@datadog-datadog-prod-us1
Copy link
Contributor

datadog-datadog-prod-us1 bot commented Sep 16, 2025 •
edited
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.65% (-0.02%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 1f06872 | Docs | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Sep 16, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/test-new-base-image
git_commit_date 1758120266 1758126844
git_commit_sha ce2679f 1f06872
release_version 1.54.0-SNAPSHOT~ce2679fcca 1.54.0-SNAPSHOT~1f06872747
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1758128678 1758128678
ci_job_id 1134447964 1134447964
ci_pipeline_id 76772599 76772599
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-49ujep0k 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-49ujep0k 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 11 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~1f06872747, baseline=1.54.0-SNAPSHOT~ce2679fcca

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.071 s) : 0, 1070881
Total [baseline] (10.882 s) : 0, 10882246
Agent [candidate] (1.07 s) : 0, 1070106
Total [candidate] (10.838 s) : 0, 10837534
section appsec
Agent [baseline] (1.248 s) : 0, 1248235
Total [baseline] (11.031 s) : 0, 11031372
Agent [candidate] (1.239 s) : 0, 1239171
Total [candidate] (11.04 s) : 0, 11039827
section iast
Agent [baseline] (1.194 s) : 0, 1193900
Total [baseline] (11.121 s) : 0, 11121037
Agent [candidate] (1.193 s) : 0, 1192928
Total [candidate] (11.12 s) : 0, 11119677
section profiling
Agent [baseline] (1.218 s) : 0, 1218479
Total [baseline] (11.029 s) : 0, 11029005
Agent [candidate] (1.209 s) : 0, 1209205
Total [candidate] (11.044 s) : 0, 11044191
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.071 s -
Agent appsec 1.248 s 177.353 ms (16.6%)
Agent iast 1.194 s 123.019 ms (11.5%)
Agent profiling 1.218 s 147.597 ms (13.8%)
Total tracing 10.882 s -
Total appsec 11.031 s 149.125 ms (1.4%)
Total iast 11.121 s 238.791 ms (2.2%)
Total profiling 11.029 s 146.758 ms (1.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.07 s -
Agent appsec 1.239 s 169.065 ms (15.8%)
Agent iast 1.193 s 122.822 ms (11.5%)
Agent profiling 1.209 s 139.099 ms (13.0%)
Total tracing 10.838 s -
Total appsec 11.04 s 202.293 ms (1.9%)
Total iast 11.12 s 282.143 ms (2.6%)
Total profiling 11.044 s 206.657 ms (1.9%) 
gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~1f06872747, baseline=1.54.0-SNAPSHOT~ce2679fcca

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.472 ms) : 0, 1472
crashtracking [candidate] (1.457 ms) : 0, 1457
BytebuddyAgent [baseline] (739.613 ms) : 0, 739613
BytebuddyAgent [candidate] (738.815 ms) : 0, 738815
GlobalTracer [baseline] (254.974 ms) : 0, 254974
GlobalTracer [candidate] (254.471 ms) : 0, 254471
AppSec [baseline] (30.828 ms) : 0, 30828
AppSec [candidate] (30.632 ms) : 0, 30632
Debugger [baseline] (6.515 ms) : 0, 6515
Debugger [candidate] (6.401 ms) : 0, 6401
Remote Config [baseline] (705.984 µs) : 0, 706
Remote Config [candidate] (699.174 µs) : 0, 699
Telemetry [baseline] (15.566 ms) : 0, 15566
Telemetry [candidate] (16.477 ms) : 0, 16477
section appsec
crashtracking [baseline] (1.472 ms) : 0, 1472
crashtracking [candidate] (1.458 ms) : 0, 1458
BytebuddyAgent [baseline] (763.245 ms) : 0, 763245
BytebuddyAgent [candidate] (760.387 ms) : 0, 760387
GlobalTracer [baseline] (249.649 ms) : 0, 249649
GlobalTracer [candidate] (245.819 ms) : 0, 245819
AppSec [baseline] (172.936 ms) : 0, 172936
AppSec [candidate] (170.567 ms) : 0, 170567
Debugger [baseline] (6.077 ms) : 0, 6077
Debugger [candidate] (6.017 ms) : 0, 6017
Remote Config [baseline] (637.303 µs) : 0, 637
Remote Config [candidate] (636.393 µs) : 0, 636
Telemetry [baseline] (8.624 ms) : 0, 8624
Telemetry [candidate] (9.25 ms) : 0, 9250
IAST [baseline] (24.173 ms) : 0, 24173
IAST [candidate] (23.77 ms) : 0, 23770
section iast
crashtracking [baseline] (1.455 ms) : 0, 1455
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (854.305 ms) : 0, 854305
BytebuddyAgent [candidate] (854.205 ms) : 0, 854205
GlobalTracer [baseline] (248.355 ms) : 0, 248355
GlobalTracer [candidate] (244.026 ms) : 0, 244026
AppSec [baseline] (27.341 ms) : 0, 27341
AppSec [candidate] (26.304 ms) : 0, 26304
Debugger [baseline] (6.093 ms) : 0, 6093
Debugger [candidate] (6.121 ms) : 0, 6121
Remote Config [baseline] (606.909 µs) : 0, 607
Remote Config [candidate] (584.732 µs) : 0, 585
Telemetry [baseline] (8.284 ms) : 0, 8284
Telemetry [candidate] (8.162 ms) : 0, 8162
IAST [baseline] (26.411 ms) : 0, 26411
IAST [candidate] (31.053 ms) : 0, 31053
section profiling
crashtracking [baseline] (1.446 ms) : 0, 1446
crashtracking [candidate] (1.449 ms) : 0, 1449
BytebuddyAgent [baseline] (767.535 ms) : 0, 767535
BytebuddyAgent [candidate] (762.145 ms) : 0, 762145
GlobalTracer [baseline] (234.534 ms) : 0, 234534
GlobalTracer [candidate] (232.818 ms) : 0, 232818
AppSec [baseline] (30.632 ms) : 0, 30632
AppSec [candidate] (30.469 ms) : 0, 30469
Debugger [baseline] (12.31 ms) : 0, 12310
Debugger [candidate] (12.096 ms) : 0, 12096
Remote Config [baseline] (715.967 µs) : 0, 716
Remote Config [candidate] (1.533 ms) : 0, 1533
Telemetry [baseline] (11.039 ms) : 0, 11039
Telemetry [candidate] (10.117 ms) : 0, 10117
ProfilingAgent [baseline] (108.818 ms) : 0, 108818
ProfilingAgent [candidate] (107.409 ms) : 0, 107409
Profiling [baseline] (109.454 ms) : 0, 109454
Profiling [candidate] (108.079 ms) : 0, 108079
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~1f06872747, baseline=1.54.0-SNAPSHOT~ce2679fcca

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.064 s) : 0, 1063588
Total [baseline] (8.643 s) : 0, 8643032
Agent [candidate] (1.066 s) : 0, 1065848
Total [candidate] (8.65 s) : 0, 8649672
section iast
Agent [baseline] (1.192 s) : 0, 1191987
Total [baseline] (9.327 s) : 0, 9326907
Agent [candidate] (1.208 s) : 0, 1207603
Total [candidate] (9.321 s) : 0, 9320735
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.192 s 128.399 ms (12.1%)
Total tracing 8.643 s -
Total iast 9.327 s 683.875 ms (7.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent iast 1.208 s 141.755 ms (13.3%)
Total tracing 8.65 s -
Total iast 9.321 s 671.063 ms (7.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~1f06872747, baseline=1.54.0-SNAPSHOT~ce2679fcca

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.472 ms) : 0, 1472
crashtracking [candidate] (1.461 ms) : 0, 1461
BytebuddyAgent [baseline] (734.046 ms) : 0, 734046
BytebuddyAgent [candidate] (735.966 ms) : 0, 735966
GlobalTracer [baseline] (253.119 ms) : 0, 253119
GlobalTracer [candidate] (253.913 ms) : 0, 253913
AppSec [baseline] (30.543 ms) : 0, 30543
AppSec [candidate] (30.749 ms) : 0, 30749
Debugger [baseline] (6.424 ms) : 0, 6424
Debugger [candidate] (6.414 ms) : 0, 6414
Remote Config [baseline] (694.016 µs) : 0, 694
Remote Config [candidate] (696.958 µs) : 0, 697
Telemetry [baseline] (16.275 ms) : 0, 16275
Telemetry [candidate] (15.593 ms) : 0, 15593
section iast
crashtracking [baseline] (1.473 ms) : 0, 1473
crashtracking [candidate] (1.475 ms) : 0, 1475
BytebuddyAgent [baseline] (853.076 ms) : 0, 853076
BytebuddyAgent [candidate] (866.653 ms) : 0, 866653
GlobalTracer [baseline] (246.106 ms) : 0, 246106
GlobalTracer [candidate] (246.506 ms) : 0, 246506
AppSec [baseline] (26.362 ms) : 0, 26362
AppSec [candidate] (26.386 ms) : 0, 26386
Debugger [baseline] (6.124 ms) : 0, 6124
Debugger [candidate] (6.116 ms) : 0, 6116
Remote Config [baseline] (672.11 µs) : 0, 672
Remote Config [candidate] (599.001 µs) : 0, 599
Telemetry [baseline] (8.286 ms) : 0, 8286
Telemetry [candidate] (8.212 ms) : 0, 8212
IAST [baseline] (28.894 ms) : 0, 28894
IAST [candidate] (30.547 ms) : 0, 30547
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/test-new-base-image
git_commit_date 1758120266 1758126844
git_commit_sha ce2679f 1f06872
release_version 1.54.0-SNAPSHOT~ce2679fcca 1.54.0-SNAPSHOT~1f06872747
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1758128344 1758128344
ci_job_id 1134447966 1134447966
ci_pipeline_id 76772599 76772599
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-6g7wj4jt 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-6g7wj4jt 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:tracing:high_load better
[-1.886ms; -1.058ms] or [-4.099%; -2.299%]		 unstable
[-3.925op/s; +10.525op/s] or [-3.860%; +10.350%]		 44.548ms 104.987op/s 46.020ms 101.688op/s
scenario:load:petclinic:profiling:high_load worse
[+2.136ms; +3.151ms] or [+4.438%; +6.545%]		 unstable
[-11.929op/s; +1.929op/s] or [-12.273%; +1.985%]		 50.776ms 92.200op/s 48.133ms 97.200op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~1f06872747, baseline=1.54.0-SNAPSHOT~ce2679fcca
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.247 ms) : 35945, 36549
.   : milestone, 36247,
appsec (49.017 ms) : 48589, 49444
.   : milestone, 49017,
code_origins (44.66 ms) : 44284, 45035
.   : milestone, 44660,
iast (44.701 ms) : 44320, 45082
.   : milestone, 44701,
profiling (48.133 ms) : 47674, 48592
.   : milestone, 48133,
tracing (46.02 ms) : 45638, 46403
.   : milestone, 46020,
section candidate
no_agent (36.738 ms) : 36447, 37029
.   : milestone, 36738,
appsec (49.162 ms) : 48742, 49581
.   : milestone, 49162,
code_origins (45.744 ms) : 45362, 46126
.   : milestone, 45744,
iast (44.506 ms) : 44111, 44902
.   : milestone, 44506,
profiling (50.776 ms) : 50293, 51260
.   : milestone, 50776,
tracing (44.548 ms) : 44161, 44935
.   : milestone, 44548,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.247 ms [35.945 ms, 36.549 ms] -
appsec 49.017 ms [48.589 ms, 49.444 ms] 12.77 ms (35.2%)
code_origins 44.66 ms [44.284 ms, 45.035 ms] 8.413 ms (23.2%)
iast 44.701 ms [44.32 ms, 45.082 ms] 8.454 ms (23.3%)
profiling 48.133 ms [47.674 ms, 48.592 ms] 11.886 ms (32.8%)
tracing 46.02 ms [45.638 ms, 46.403 ms] 9.773 ms (27.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.738 ms [36.447 ms, 37.029 ms] -
appsec 49.162 ms [48.742 ms, 49.581 ms] 12.424 ms (33.8%)
code_origins 45.744 ms [45.362 ms, 46.126 ms] 9.006 ms (24.5%)
iast 44.506 ms [44.111 ms, 44.902 ms] 7.768 ms (21.1%)
profiling 50.776 ms [50.293 ms, 51.26 ms] 14.038 ms (38.2%)
tracing 44.548 ms [44.161 ms, 44.935 ms] 7.81 ms (21.3%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~1f06872747, baseline=1.54.0-SNAPSHOT~ce2679fcca
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.587 ms) : 4536, 4638
.   : milestone, 4587,
iast (9.618 ms) : 9458, 9777
.   : milestone, 9618,
iast_FULL (14.082 ms) : 13805, 14360
.   : milestone, 14082,
iast_GLOBAL (10.237 ms) : 10044, 10431
.   : milestone, 10237,
profiling (9.129 ms) : 8988, 9270
.   : milestone, 9129,
tracing (7.988 ms) : 7859, 8116
.   : milestone, 7988,
section candidate
no_agent (4.466 ms) : 4414, 4517
.   : milestone, 4466,
iast (9.736 ms) : 9573, 9899
.   : milestone, 9736,
iast_FULL (14.45 ms) : 14159, 14740
.   : milestone, 14450,
iast_GLOBAL (10.562 ms) : 10375, 10749
.   : milestone, 10562,
profiling (9.142 ms) : 8998, 9285
.   : milestone, 9142,
tracing (7.783 ms) : 7663, 7903
.   : milestone, 7783,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.587 ms [4.536 ms, 4.638 ms] -
iast 9.618 ms [9.458 ms, 9.777 ms] 5.031 ms (109.7%)
iast_FULL 14.082 ms [13.805 ms, 14.36 ms] 9.495 ms (207.0%)
iast_GLOBAL 10.237 ms [10.044 ms, 10.431 ms] 5.651 ms (123.2%)
profiling 9.129 ms [8.988 ms, 9.27 ms] 4.542 ms (99.0%)
tracing 7.988 ms [7.859 ms, 8.116 ms] 3.401 ms (74.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.466 ms [4.414 ms, 4.517 ms] -
iast 9.736 ms [9.573 ms, 9.899 ms] 5.271 ms (118.0%)
iast_FULL 14.45 ms [14.159 ms, 14.74 ms] 9.984 ms (223.6%)
iast_GLOBAL 10.562 ms [10.375 ms, 10.749 ms] 6.096 ms (136.5%)
profiling 9.142 ms [8.998 ms, 9.285 ms] 4.676 ms (104.7%)
tracing 7.783 ms [7.663 ms, 7.903 ms] 3.318 ms (74.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/test-new-base-image
git_commit_date 1758120266 1758126844
git_commit_sha ce2679f 1f06872
release_version 1.54.0-SNAPSHOT~ce2679fcca 1.54.0-SNAPSHOT~1f06872747
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1758128826 1758128826
ci_job_id 1134447968 1134447968
ci_pipeline_id 76772599 76772599
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-qv65qkev 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-qv65qkev 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~1f06872747, baseline=1.54.0-SNAPSHOT~ce2679fcca
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.932 s) : 14932000, 14932000
.   : milestone, 14932000,
appsec (15.011 s) : 15011000, 15011000
.   : milestone, 15011000,
iast (18.397 s) : 18397000, 18397000
.   : milestone, 18397000,
iast_GLOBAL (17.837 s) : 17837000, 17837000
.   : milestone, 17837000,
profiling (15.226 s) : 15226000, 15226000
.   : milestone, 15226000,
tracing (14.855 s) : 14855000, 14855000
.   : milestone, 14855000,
section candidate
no_agent (15.221 s) : 15221000, 15221000
.   : milestone, 15221000,
appsec (15.008 s) : 15008000, 15008000
.   : milestone, 15008000,
iast (18.473 s) : 18473000, 18473000
.   : milestone, 18473000,
iast_GLOBAL (18.238 s) : 18238000, 18238000
.   : milestone, 18238000,
profiling (15.681 s) : 15681000, 15681000
.   : milestone, 15681000,
tracing (15.151 s) : 15151000, 15151000
.   : milestone, 15151000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.932 s [14.932 s, 14.932 s] -
appsec 15.011 s [15.011 s, 15.011 s] 79.0 ms (0.5%)
iast 18.397 s [18.397 s, 18.397 s] 3.465 s (23.2%)
iast_GLOBAL 17.837 s [17.837 s, 17.837 s] 2.905 s (19.5%)
profiling 15.226 s [15.226 s, 15.226 s] 294.0 ms (2.0%)
tracing 14.855 s [14.855 s, 14.855 s] -77.0 ms (-0.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.221 s [15.221 s, 15.221 s] -
appsec 15.008 s [15.008 s, 15.008 s] -213.0 ms (-1.4%)
iast 18.473 s [18.473 s, 18.473 s] 3.252 s (21.4%)
iast_GLOBAL 18.238 s [18.238 s, 18.238 s] 3.017 s (19.8%)
profiling 15.681 s [15.681 s, 15.681 s] 460.0 ms (3.0%)
tracing 15.151 s [15.151 s, 15.151 s] -70.0 ms (-0.5%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~1f06872747, baseline=1.54.0-SNAPSHOT~ce2679fcca
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.486 ms) : 1474, 1497
.   : milestone, 1486,
appsec (3.732 ms) : 3513, 3951
.   : milestone, 3732,
iast (2.212 ms) : 2149, 2274
.   : milestone, 2212,
iast_GLOBAL (2.261 ms) : 2198, 2325
.   : milestone, 2261,
profiling (2.064 ms) : 2013, 2115
.   : milestone, 2064,
tracing (2.033 ms) : 1984, 2083
.   : milestone, 2033,
section candidate
no_agent (1.482 ms) : 1470, 1493
.   : milestone, 1482,
appsec (3.726 ms) : 3507, 3946
.   : milestone, 3726,
iast (2.217 ms) : 2154, 2280
.   : milestone, 2217,
iast_GLOBAL (2.25 ms) : 2187, 2314
.   : milestone, 2250,
profiling (2.059 ms) : 2008, 2110
.   : milestone, 2059,
tracing (2.049 ms) : 1999, 2098
.   : milestone, 2049,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.486 ms [1.474 ms, 1.497 ms] -
appsec 3.732 ms [3.513 ms, 3.951 ms] 2.246 ms (151.2%)
iast 2.212 ms [2.149 ms, 2.274 ms] 726.317 µs (48.9%)
iast_GLOBAL 2.261 ms [2.198 ms, 2.325 ms] 775.784 µs (52.2%)
profiling 2.064 ms [2.013 ms, 2.115 ms] 578.783 µs (39.0%)
tracing 2.033 ms [1.984 ms, 2.083 ms] 547.814 µs (36.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.47 ms, 1.493 ms] -
appsec 3.726 ms [3.507 ms, 3.946 ms] 2.245 ms (151.5%)
iast 2.217 ms [2.154 ms, 2.28 ms] 735.403 µs (49.6%)
iast_GLOBAL 2.25 ms [2.187 ms, 2.314 ms] 768.909 µs (51.9%)
profiling 2.059 ms [2.008 ms, 2.11 ms] 577.109 µs (39.0%)
tracing 2.049 ms [1.999 ms, 2.098 ms] 567.355 µs (38.3%)

@sarahchen6 sarahchen6 mentioned this pull request Sep 16, 2025
Merged
@sarahchen6 sarahchen6 force-pushed the sarahchen6/test-new-base-image branch from d6145e5 to b22b07f Compare September 16, 2025 18:50
@pr-commenter
Copy link

pr-commenter bot commented Sep 16, 2025 •
edited
Loading

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1758127476 1758127822
end_time 2025-09-17T16:45:57 2025-09-17T16:51:43
git_branch master sarahchen6/test-new-base-image
git_commit_sha ce2679f 1f06872
start_time 2025-09-17T16:44:37 2025-09-17T16:50:23
See matching parameters
Baseline Candidate
ci_job_id 1134447977 1134447977
ci_pipeline_id 76772599 76772599
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1758126844 1758126844

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 6 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-40.649µs; +22.266µs] or [-14.266%; +7.814%]		 unstable
[-56.189µs; +30.983µs] or [-17.164%; +9.464%]		 unstable
[-65.523µs; +40.772µs] or [-19.182%; +11.936%]		 unstable
[-88.211µs; +275.297µs] or [-9.174%; +28.632%]		 same
scenario:basic same same same unstable
[-1.028µs; +244.290µs] or [-0.142%; +33.691%]		 unstable
[-205.730op/s; +205.730op/s] or [-7.818%; +7.818%]
scenario:loop unsure
[+6.183µs; +13.622µs] or [+0.070%; +0.154%]		 same same same same
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (327.369 µs) : 275, 380
.   : milestone, 327,
basic (275.287 µs) : 269, 282
.   : milestone, 275,
loop (8.959 ms) : 8956, 8963
.   : milestone, 8959,
section candidate
noprobe (314.766 µs) : 289, 340
.   : milestone, 315,
basic (279.036 µs) : 273, 285
.   : milestone, 279,
loop (8.963 ms) : 8958, 8968
.   : milestone, 8963,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 327.369 µs [274.588 µs, 380.151 µs]
basic 275.287 µs [268.858 µs, 281.716 µs]
loop 8.959 ms [8.956 ms, 8.963 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 314.766 µs [289.126 µs, 340.407 µs]
basic 279.036 µs [273.121 µs, 284.952 µs]
loop 8.963 ms [8.958 ms, 8.968 ms]

@sarahchen6 sarahchen6 force-pushed the sarahchen6/test-new-base-image branch from fa1594f to b22b07f Compare September 16, 2025 20:35
@sarahchen6 sarahchen6 changed the title Test new base image Update docker base image Sep 17, 2025
@sarahchen6 sarahchen6 added type: enhancement Enhancements and improvements tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling and removed tag: do not merge Do not merge changes labels Sep 17, 2025
@sarahchen6 sarahchen6 marked this pull request as ready for review September 17, 2025 18:21
@sarahchen6 sarahchen6 requested review from a team as code owners September 17, 2025 18:21
@sarahchen6 sarahchen6 requested review from evanchooly, jpbempel and pawelchcki and removed request for a team September 17, 2025 18:21
@sarahchen6 sarahchen6 added tag: no release notes Changes to exclude from release notes and removed tag: no release notes Changes to exclude from release notes labels Sep 17, 2025
@sarahchen6 sarahchen6 merged commit c2aec92 into master Sep 17, 2025
521 of 523 checks passed
@sarahchen6 sarahchen6 deleted the sarahchen6/test-new-base-image branch September 17, 2025 18:40
@github-actions github-actions bot added this to the 1.54.0 milestone Sep 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@jpbempel jpbempel jpbempel approved these changes

@evanchooly evanchooly Awaiting requested review from evanchooly evanchooly is a code owner automatically assigned from DataDog/debugger-java

@pawelchcki pawelchcki Awaiting requested review from pawelchcki pawelchcki is a code owner automatically assigned from DataDog/apm-release-platform

Assignees

No one assigned

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.54.0

Development

Successfully merging this pull request may close these issues.

3 participants

@sarahchen6 @jpbempel