Skip to content

Disable backend requests for impacted tests data #8391

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
nikita-tkachenko-datadog merged 1 commit into from
Feb 14, 2025
Merged

Disable backend requests for impacted tests data #8391

nikita-tkachenko-datadog merged 1 commit into from
Feb 14, 2025

Conversation

@nikita-tkachenko-datadog
Copy link
Contributor

@nikita-tkachenko-datadog nikita-tkachenko-datadog commented Feb 14, 2025 •
edited by atlassian bot
Loading

What Does This Do

Disables requests to ci/tests/diffs backend endpoint, unless they are explicitly enabled with a config property.

Motivation

The endpoint is not implemented in the backend yet.

Additional Notes

This is a part of the Impacted Tests Detection feature (#8188) that is currently disabled for everyone by org 2.

Contributor Checklist

Jira ticket: SDTEST-1389

@nikita-tkachenko-datadog nikita-tkachenko-datadog added tag: no release notes Changes to exclude from release notes type: refactoring comp: ci visibility Continuous Integration Visibility labels Feb 14, 2025
@pr-commenter
Copy link

pr-commenter bot commented Feb 14, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/disable-impacted-tests-backend
git_commit_date 1739520992 1739533303
git_commit_sha 053a36f 7a0b153
release_version 1.47.0-SNAPSHOT~053a36f28a 1.47.0-SNAPSHOT~7a0b1534d4
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1739535819 1739535819
ci_job_id 808635761 808635761
ci_pipeline_id 55920775 55920775
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-yrr1pra-project-304-concurrent-0-2j6sigyt 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-yrr1pra-project-304-concurrent-0-2j6sigyt 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 5 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~7a0b1534d4, baseline=1.47.0-SNAPSHOT~053a36f28a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.049 s) : 0, 1048979
Total [baseline] (8.707 s) : 0, 8706509
Agent [candidate] (1.05 s) : 0, 1049565
Total [candidate] (8.658 s) : 0, 8658244
section iast
Agent [baseline] (1.172 s) : 0, 1171962
Total [baseline] (9.267 s) : 0, 9266984
Agent [candidate] (1.17 s) : 0, 1170046
Total [candidate] (9.302 s) : 0, 9302413
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.178 s) : 0, 1178119
Total [baseline] (9.233 s) : 0, 9232632
Agent [candidate] (1.171 s) : 0, 1171491
Total [candidate] (9.257 s) : 0, 9256876
section iast_TELEMETRY_OFF
Agent [baseline] (1.166 s) : 0, 1165872
Total [baseline] (9.282 s) : 0, 9281923
Agent [candidate] (1.179 s) : 0, 1179342
Total [candidate] (9.263 s) : 0, 9263141
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent iast 1.172 s 122.983 ms (11.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.178 s 129.14 ms (12.3%)
Agent iast_TELEMETRY_OFF 1.166 s 116.893 ms (11.1%)
Total tracing 8.707 s -
Total iast 9.267 s 560.475 ms (6.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.233 s 526.123 ms (6.0%)
Total iast_TELEMETRY_OFF 9.282 s 575.414 ms (6.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.05 s -
Agent iast 1.17 s 120.481 ms (11.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.171 s 121.925 ms (11.6%)
Agent iast_TELEMETRY_OFF 1.179 s 129.776 ms (12.4%)
Total tracing 8.658 s -
Total iast 9.302 s 644.168 ms (7.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.257 s 598.632 ms (6.9%)
Total iast_TELEMETRY_OFF 9.263 s 604.897 ms (7.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~7a0b1534d4, baseline=1.47.0-SNAPSHOT~053a36f28a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (723.428 ms) : 0, 723428
BytebuddyAgent [candidate] (722.062 ms) : 0, 722062
GlobalTracer [baseline] (240.828 ms) : 0, 240828
GlobalTracer [candidate] (241.925 ms) : 0, 241925
AppSec [baseline] (55.77 ms) : 0, 55770
AppSec [candidate] (55.868 ms) : 0, 55868
Remote Config [baseline] (700.124 µs) : 0, 700
Remote Config [candidate] (709.896 µs) : 0, 710
Telemetry [baseline] (12.835 ms) : 0, 12835
Telemetry [candidate] (13.696 ms) : 0, 13696
section iast
BytebuddyAgent [baseline] (836.688 ms) : 0, 836688
BytebuddyAgent [candidate] (834.498 ms) : 0, 834498
GlobalTracer [baseline] (230.802 ms) : 0, 230802
GlobalTracer [candidate] (230.368 ms) : 0, 230368
IAST [baseline] (22.788 ms) : 0, 22788
IAST [candidate] (22.886 ms) : 0, 22886
AppSec [baseline] (57.147 ms) : 0, 57147
AppSec [candidate] (57.669 ms) : 0, 57669
Remote Config [baseline] (612.762 µs) : 0, 613
Remote Config [candidate] (616.169 µs) : 0, 616
Telemetry [baseline] (8.639 ms) : 0, 8639
Telemetry [candidate] (8.752 ms) : 0, 8752
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (841.586 ms) : 0, 841586
BytebuddyAgent [candidate] (835.602 ms) : 0, 835602
GlobalTracer [baseline] (231.261 ms) : 0, 231261
GlobalTracer [candidate] (230.895 ms) : 0, 230895
IAST [baseline] (22.954 ms) : 0, 22954
IAST [candidate] (22.932 ms) : 0, 22932
AppSec [baseline] (57.644 ms) : 0, 57644
AppSec [candidate] (57.421 ms) : 0, 57421
Remote Config [baseline] (633.086 µs) : 0, 633
Remote Config [candidate] (626.907 µs) : 0, 627
Telemetry [baseline] (8.727 ms) : 0, 8727
Telemetry [candidate] (8.753 ms) : 0, 8753
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (831.948 ms) : 0, 831948
BytebuddyAgent [candidate] (843.646 ms) : 0, 843646
GlobalTracer [baseline] (230.703 ms) : 0, 230703
GlobalTracer [candidate] (231.629 ms) : 0, 231629
IAST [baseline] (25.895 ms) : 0, 25895
IAST [candidate] (23.84 ms) : 0, 23840
AppSec [baseline] (52.923 ms) : 0, 52923
AppSec [candidate] (55.617 ms) : 0, 55617
Remote Config [baseline] (611.755 µs) : 0, 612
Remote Config [candidate] (612.727 µs) : 0, 613
Telemetry [baseline] (8.52 ms) : 0, 8520
Telemetry [candidate] (8.591 ms) : 0, 8591
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~7a0b1534d4, baseline=1.47.0-SNAPSHOT~053a36f28a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.046 s) : 0, 1045503
Total [baseline] (10.624 s) : 0, 10623565
Agent [candidate] (1.049 s) : 0, 1048516
Total [candidate] (10.527 s) : 0, 10527089
section appsec
Agent [baseline] (1.181 s) : 0, 1181406
Total [baseline] (10.728 s) : 0, 10728174
Agent [candidate] (1.188 s) : 0, 1187875
Total [candidate] (10.831 s) : 0, 10831482
section iast
Agent [baseline] (1.171 s) : 0, 1171141
Total [baseline] (10.975 s) : 0, 10974558
Agent [candidate] (1.181 s) : 0, 1180944
Total [candidate] (10.979 s) : 0, 10978884
section profiling
Agent [baseline] (1.262 s) : 0, 1261921
Total [baseline] (10.984 s) : 0, 10983642
Agent [candidate] (1.262 s) : 0, 1262243
Total [candidate] (10.903 s) : 0, 10903386
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.046 s -
Agent appsec 1.181 s 135.903 ms (13.0%)
Agent iast 1.171 s 125.637 ms (12.0%)
Agent profiling 1.262 s 216.418 ms (20.7%)
Total tracing 10.624 s -
Total appsec 10.728 s 104.609 ms (1.0%)
Total iast 10.975 s 350.993 ms (3.3%)
Total profiling 10.984 s 360.077 ms (3.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.049 s -
Agent appsec 1.188 s 139.359 ms (13.3%)
Agent iast 1.181 s 132.428 ms (12.6%)
Agent profiling 1.262 s 213.728 ms (20.4%)
Total tracing 10.527 s -
Total appsec 10.831 s 304.394 ms (2.9%)
Total iast 10.979 s 451.795 ms (4.3%)
Total profiling 10.903 s 376.297 ms (3.6%) 
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~7a0b1534d4, baseline=1.47.0-SNAPSHOT~053a36f28a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (719.361 ms) : 0, 719361
BytebuddyAgent [candidate] (722.797 ms) : 0, 722797
GlobalTracer [baseline] (241.492 ms) : 0, 241492
GlobalTracer [candidate] (241.513 ms) : 0, 241513
AppSec [baseline] (55.752 ms) : 0, 55752
AppSec [candidate] (55.749 ms) : 0, 55749
Remote Config [baseline] (701.184 µs) : 0, 701
Remote Config [candidate] (700.978 µs) : 0, 701
Telemetry [baseline] (12.908 ms) : 0, 12908
Telemetry [candidate] (12.303 ms) : 0, 12303
section appsec
BytebuddyAgent [baseline] (733.778 ms) : 0, 733778
BytebuddyAgent [candidate] (737.599 ms) : 0, 737599
GlobalTracer [baseline] (236.541 ms) : 0, 236541
GlobalTracer [candidate] (237.506 ms) : 0, 237506
IAST [baseline] (21.253 ms) : 0, 21253
IAST [candidate] (21.426 ms) : 0, 21426
AppSec [baseline] (176.261 ms) : 0, 176261
AppSec [candidate] (177.776 ms) : 0, 177776
Remote Config [baseline] (663.016 µs) : 0, 663
Remote Config [candidate] (669.623 µs) : 0, 670
Telemetry [baseline] (8.287 ms) : 0, 8287
Telemetry [candidate] (8.321 ms) : 0, 8321
section iast
BytebuddyAgent [baseline] (835.661 ms) : 0, 835661
BytebuddyAgent [candidate] (843.932 ms) : 0, 843932
GlobalTracer [baseline] (230.823 ms) : 0, 230823
GlobalTracer [candidate] (232.01 ms) : 0, 232010
IAST [baseline] (22.946 ms) : 0, 22946
IAST [candidate] (22.958 ms) : 0, 22958
AppSec [baseline] (57.129 ms) : 0, 57129
AppSec [candidate] (57.285 ms) : 0, 57285
Remote Config [baseline] (623.197 µs) : 0, 623
Remote Config [candidate] (615.148 µs) : 0, 615
Telemetry [baseline] (8.702 ms) : 0, 8702
Telemetry [candidate] (8.717 ms) : 0, 8717
section profiling
BytebuddyAgent [baseline] (707.061 ms) : 0, 707061
BytebuddyAgent [candidate] (708.277 ms) : 0, 708277
GlobalTracer [baseline] (350.697 ms) : 0, 350697
GlobalTracer [candidate] (351.155 ms) : 0, 351155
AppSec [baseline] (55.386 ms) : 0, 55386
AppSec [candidate] (54.771 ms) : 0, 54771
Remote Config [baseline] (677.567 µs) : 0, 678
Remote Config [candidate] (668.578 µs) : 0, 669
Telemetry [baseline] (9.02 ms) : 0, 9020
Telemetry [candidate] (8.949 ms) : 0, 8949
ProfilingAgent [baseline] (96.908 ms) : 0, 96908
ProfilingAgent [candidate] (96.065 ms) : 0, 96065
Profiling [baseline] (96.932 ms) : 0, 96932
Profiling [candidate] (96.089 ms) : 0, 96089
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-02-14T11:51:24 2025-02-14T11:58:30
git_branch master nikita-tkachenko/disable-impacted-tests-backend
git_commit_date 1739520992 1739533303
git_commit_sha 053a36f 7a0b153
release_version 1.47.0-SNAPSHOT~053a36f28a 1.47.0-SNAPSHOT~7a0b1534d4
start_time 2025-02-14T11:51:10 2025-02-14T11:58:16
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1739534670 1739534670
ci_job_id 808635762 808635762
ci_pipeline_id 55920775 55920775
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-inwry3gs-project-304-concurrent-0-fmygz3fh 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-inwry3gs-project-304-concurrent-0-fmygz3fh 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~7a0b1534d4, baseline=1.47.0-SNAPSHOT~053a36f28a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.37 ms) : 1351, 1388
.   : milestone, 1370,
appsec (1.749 ms) : 1725, 1773
.   : milestone, 1749,
appsec_no_iast (1.756 ms) : 1733, 1780
.   : milestone, 1756,
iast (1.514 ms) : 1490, 1538
.   : milestone, 1514,
profiling (1.503 ms) : 1479, 1527
.   : milestone, 1503,
tracing (1.505 ms) : 1480, 1529
.   : milestone, 1505,
section candidate
no_agent (1.37 ms) : 1350, 1389
.   : milestone, 1370,
appsec (1.766 ms) : 1742, 1789
.   : milestone, 1766,
appsec_no_iast (1.76 ms) : 1736, 1783
.   : milestone, 1760,
iast (1.499 ms) : 1475, 1523
.   : milestone, 1499,
profiling (1.529 ms) : 1503, 1554
.   : milestone, 1529,
tracing (1.511 ms) : 1486, 1536
.   : milestone, 1511,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.37 ms [1.351 ms, 1.388 ms] -
appsec 1.749 ms [1.725 ms, 1.773 ms] 379.705 µs (27.7%)
appsec_no_iast 1.756 ms [1.733 ms, 1.78 ms] 386.825 µs (28.2%)
iast 1.514 ms [1.49 ms, 1.538 ms] 144.021 µs (10.5%)
profiling 1.503 ms [1.479 ms, 1.527 ms] 133.279 µs (9.7%)
tracing 1.505 ms [1.48 ms, 1.529 ms] 134.994 µs (9.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.37 ms [1.35 ms, 1.389 ms] -
appsec 1.766 ms [1.742 ms, 1.789 ms] 396.239 µs (28.9%)
appsec_no_iast 1.76 ms [1.736 ms, 1.783 ms] 390.001 µs (28.5%)
iast 1.499 ms [1.475 ms, 1.523 ms] 129.248 µs (9.4%)
profiling 1.529 ms [1.503 ms, 1.554 ms] 159.221 µs (11.6%)
tracing 1.511 ms [1.486 ms, 1.536 ms] 141.698 µs (10.3%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~7a0b1534d4, baseline=1.47.0-SNAPSHOT~053a36f28a
    dateFormat X
    axisFormat %s
section baseline
no_agent (377.075 µs) : 357, 397
.   : milestone, 377,
iast (512.595 µs) : 491, 534
.   : milestone, 513,
iast_FULL (748.529 µs) : 727, 770
.   : milestone, 749,
iast_GLOBAL (562.671 µs) : 541, 584
.   : milestone, 563,
iast_HARDCODED_SECRET_DISABLED (520.553 µs) : 498, 543
.   : milestone, 521,
iast_INACTIVE (474.065 µs) : 452, 496
.   : milestone, 474,
iast_TELEMETRY_OFF (500.906 µs) : 478, 524
.   : milestone, 501,
tracing (452.983 µs) : 432, 474
.   : milestone, 453,
section candidate
no_agent (379.674 µs) : 360, 400
.   : milestone, 380,
iast (512.253 µs) : 490, 535
.   : milestone, 512,
iast_FULL (754.63 µs) : 732, 777
.   : milestone, 755,
iast_GLOBAL (556.804 µs) : 535, 578
.   : milestone, 557,
iast_HARDCODED_SECRET_DISABLED (516.465 µs) : 493, 540
.   : milestone, 516,
iast_INACTIVE (468.458 µs) : 447, 490
.   : milestone, 468,
iast_TELEMETRY_OFF (502.129 µs) : 479, 525
.   : milestone, 502,
tracing (457.847 µs) : 437, 479
.   : milestone, 458,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 377.075 µs [357.065 µs, 397.085 µs] -
iast 512.595 µs [490.701 µs, 534.489 µs] 135.52 µs (35.9%)
iast_FULL 748.529 µs [726.662 µs, 770.395 µs] 371.454 µs (98.5%)
iast_GLOBAL 562.671 µs [541.188 µs, 584.155 µs] 185.596 µs (49.2%)
iast_HARDCODED_SECRET_DISABLED 520.553 µs [498.097 µs, 543.009 µs] 143.478 µs (38.1%)
iast_INACTIVE 474.065 µs [451.925 µs, 496.204 µs] 96.99 µs (25.7%)
iast_TELEMETRY_OFF 500.906 µs [477.625 µs, 524.188 µs] 123.831 µs (32.8%)
tracing 452.983 µs [432.385 µs, 473.58 µs] 75.907 µs (20.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 379.674 µs [359.586 µs, 399.761 µs] -
iast 512.253 µs [489.665 µs, 534.84 µs] 132.579 µs (34.9%)
iast_FULL 754.63 µs [732.181 µs, 777.08 µs] 374.956 µs (98.8%)
iast_GLOBAL 556.804 µs [535.187 µs, 578.421 µs] 177.13 µs (46.7%)
iast_HARDCODED_SECRET_DISABLED 516.465 µs [493.306 µs, 539.623 µs] 136.791 µs (36.0%)
iast_INACTIVE 468.458 µs [446.571 µs, 490.346 µs] 88.785 µs (23.4%)
iast_TELEMETRY_OFF 502.129 µs [478.764 µs, 525.495 µs] 122.456 µs (32.3%)
tracing 457.847 µs [437.008 µs, 478.687 µs] 78.174 µs (20.6%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/disable-impacted-tests-backend
git_commit_date 1739520992 1739533303
git_commit_sha 053a36f 7a0b153
release_version 1.47.0-SNAPSHOT~053a36f28a 1.47.0-SNAPSHOT~7a0b1534d4
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1739535353 1739535353
ci_job_id 808635763 808635763
ci_pipeline_id 55920775 55920775
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-sf9mtlkb-project-304-concurrent-0-6m8vm7iy 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-sf9mtlkb-project-304-concurrent-0-6m8vm7iy 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~7a0b1534d4, baseline=1.47.0-SNAPSHOT~053a36f28a
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.849 s) : 14849000, 14849000
.   : milestone, 14849000,
appsec (15.224 s) : 15224000, 15224000
.   : milestone, 15224000,
iast (18.595 s) : 18595000, 18595000
.   : milestone, 18595000,
iast_GLOBAL (17.909 s) : 17909000, 17909000
.   : milestone, 17909000,
profiling (15.584 s) : 15584000, 15584000
.   : milestone, 15584000,
tracing (15.054 s) : 15054000, 15054000
.   : milestone, 15054000,
section candidate
no_agent (14.69 s) : 14690000, 14690000
.   : milestone, 14690000,
appsec (15.227 s) : 15227000, 15227000
.   : milestone, 15227000,
iast (18.703 s) : 18703000, 18703000
.   : milestone, 18703000,
iast_GLOBAL (17.78 s) : 17780000, 17780000
.   : milestone, 17780000,
profiling (15.068 s) : 15068000, 15068000
.   : milestone, 15068000,
tracing (14.693 s) : 14693000, 14693000
.   : milestone, 14693000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.849 s [14.849 s, 14.849 s] -
appsec 15.224 s [15.224 s, 15.224 s] 375.0 ms (2.5%)
iast 18.595 s [18.595 s, 18.595 s] 3.746 s (25.2%)
iast_GLOBAL 17.909 s [17.909 s, 17.909 s] 3.06 s (20.6%)
profiling 15.584 s [15.584 s, 15.584 s] 735.0 ms (4.9%)
tracing 15.054 s [15.054 s, 15.054 s] 205.0 ms (1.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.69 s [14.69 s, 14.69 s] -
appsec 15.227 s [15.227 s, 15.227 s] 537.0 ms (3.7%)
iast 18.703 s [18.703 s, 18.703 s] 4.013 s (27.3%)
iast_GLOBAL 17.78 s [17.78 s, 17.78 s] 3.09 s (21.0%)
profiling 15.068 s [15.068 s, 15.068 s] 378.0 ms (2.6%)
tracing 14.693 s [14.693 s, 14.693 s] 3.0 ms (0.0%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~7a0b1534d4, baseline=1.47.0-SNAPSHOT~053a36f28a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (2.369 ms) : 2325, 2412
.   : milestone, 2369,
iast (2.116 ms) : 2061, 2172
.   : milestone, 2116,
iast_GLOBAL (2.158 ms) : 2102, 2213
.   : milestone, 2158,
profiling (1.955 ms) : 1912, 1999
.   : milestone, 1955,
tracing (1.955 ms) : 1913, 1997
.   : milestone, 1955,
section candidate
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (2.372 ms) : 2329, 2415
.   : milestone, 2372,
iast (2.113 ms) : 2058, 2168
.   : milestone, 2113,
iast_GLOBAL (2.165 ms) : 2110, 2221
.   : milestone, 2165,
profiling (2.266 ms) : 2118, 2414
.   : milestone, 2266,
tracing (1.96 ms) : 1918, 2003
.   : milestone, 1960,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.484 ms] -
appsec 2.369 ms [2.325 ms, 2.412 ms] 896.468 µs (60.9%)
iast 2.116 ms [2.061 ms, 2.172 ms] 644.3 µs (43.8%)
iast_GLOBAL 2.158 ms [2.102 ms, 2.213 ms] 685.411 µs (46.6%)
profiling 1.955 ms [1.912 ms, 1.999 ms] 483.15 µs (32.8%)
tracing 1.955 ms [1.913 ms, 1.997 ms] 482.844 µs (32.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.485 ms] -
appsec 2.372 ms [2.329 ms, 2.415 ms] 898.592 µs (61.0%)
iast 2.113 ms [2.058 ms, 2.168 ms] 639.195 µs (43.4%)
iast_GLOBAL 2.165 ms [2.11 ms, 2.221 ms] 691.86 µs (47.0%)
profiling 2.266 ms [2.118 ms, 2.414 ms] 792.569 µs (53.8%)
tracing 1.96 ms [1.918 ms, 2.003 ms] 486.53 µs (33.0%)

@nikita-tkachenko-datadog nikita-tkachenko-datadog marked this pull request as ready for review February 14, 2025 12:39
@nikita-tkachenko-datadog nikita-tkachenko-datadog merged commit acf173a into master Feb 14, 2025
206 of 207 checks passed
@nikita-tkachenko-datadog nikita-tkachenko-datadog deleted the nikita-tkachenko/disable-impacted-tests-backend branch February 14, 2025 12:45
@github-actions github-actions bot added this to the 1.47.0 milestone Feb 14, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@daniel-mohedano daniel-mohedano daniel-mohedano approved these changes

@anmarchenko anmarchenko Awaiting requested review from anmarchenko anmarchenko is a code owner automatically assigned from DataDog/ci-app-libraries-java

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-java

Assignees

No one assigned

Labels

comp: ci visibility Continuous Integration Visibility tag: no release notes Changes to exclude from release notes type: refactoring

Projects

None yet

Milestone

1.47.0

Development

Successfully merging this pull request may close these issues.

3 participants

@nikita-tkachenko-datadog @daniel-mohedano