Skip to content

Attempt to debug CI flaky timeout. DO NOT MERGE! #9249

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 41 commits into from
Closed

Attempt to debug CI flaky timeout. DO NOT MERGE! #9249

wants to merge 41 commits into from
+166 −12

Conversation

AlexeyKuznetsov-DD
Copy link
Contributor

What Does This Do

Attempt to debug CI flaky timeout. DO NOT MERGE!

Motivation

Green CI

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD self-assigned this Jul 25, 2025
@AlexeyKuznetsov-DD AlexeyKuznetsov-DD added tag: do not merge Do not merge changes comp: testing Testing labels Jul 25, 2025
@pr-commenter
Copy link

pr-commenter bot commented Jul 25, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/debug-ci-timeout
git_commit_date 1754494113 1754508562
git_commit_sha 86fb978 9bf1b6b
release_version 1.53.0-SNAPSHOT~86fb978afd 1.52.0-SNAPSHOT~9bf1b6bc3a
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1754510533 1754510533
ci_job_id 1068006933 1068006933
ci_pipeline_id 72904861 72904861
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-qn3553sw 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-qn3553sw 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 46 metrics, 13 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.52.0-SNAPSHOT~9bf1b6bc3a, baseline=1.53.0-SNAPSHOT~86fb978afd

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.047 s) : 0, 1047180
Total [baseline] (10.729 s) : 0, 10728777
Agent [candidate] (1.054 s) : 0, 1053820
Total [candidate] (10.784 s) : 0, 10784407
section appsec
Agent [baseline] (1.233 s) : 0, 1232618
Total [baseline] (10.916 s) : 0, 10915727
Agent [candidate] (1.226 s) : 0, 1225621
Total [candidate] (10.758 s) : 0, 10757998
section iast
Agent [baseline] (1.185 s) : 0, 1184837
Total [baseline] (10.967 s) : 0, 10967192
Agent [candidate] (1.176 s) : 0, 1176042
Total [candidate] (10.955 s) : 0, 10954983
section profiling
Agent [baseline] (1.19 s) : 0, 1190316
Total [baseline] (10.824 s) : 0, 10823686
Agent [candidate] (1.213 s) : 0, 1212837
Total [candidate] (11.01 s) : 0, 11010218
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.047 s -
Agent appsec 1.233 s 185.437 ms (17.7%)
Agent iast 1.185 s 137.657 ms (13.1%)
Agent profiling 1.19 s 143.135 ms (13.7%)
Total tracing 10.729 s -
Total appsec 10.916 s 186.95 ms (1.7%)
Total iast 10.967 s 238.415 ms (2.2%)
Total profiling 10.824 s 94.91 ms (0.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.054 s -
Agent appsec 1.226 s 171.801 ms (16.3%)
Agent iast 1.176 s 122.222 ms (11.6%)
Agent profiling 1.213 s 159.017 ms (15.1%)
Total tracing 10.784 s -
Total appsec 10.758 s -26.409 ms (-0.2%)
Total iast 10.955 s 170.576 ms (1.6%)
Total profiling 11.01 s 225.811 ms (2.1%) 
gantt
    title petclinic - break down per module: candidate=1.52.0-SNAPSHOT~9bf1b6bc3a, baseline=1.53.0-SNAPSHOT~86fb978afd

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.442 ms) : 0, 1442
crashtracking [candidate] (1.442 ms) : 0, 1442
BytebuddyAgent [baseline] (733.472 ms) : 0, 733472
BytebuddyAgent [candidate] (737.699 ms) : 0, 737699
GlobalTracer [baseline] (241.743 ms) : 0, 241743
GlobalTracer [candidate] (244.774 ms) : 0, 244774
AppSec [baseline] (30.009 ms) : 0, 30009
AppSec [candidate] (30.606 ms) : 0, 30606
Debugger [baseline] (6.022 ms) : 0, 6022
Debugger [candidate] (6.081 ms) : 0, 6081
Remote Config [baseline] (655.23 µs) : 0, 655
Remote Config [candidate] (669.288 µs) : 0, 669
Telemetry [baseline] (12.807 ms) : 0, 12807
Telemetry [candidate] (11.46 ms) : 0, 11460
section appsec
crashtracking [baseline] (1.456 ms) : 0, 1456
crashtracking [candidate] (1.454 ms) : 0, 1454
BytebuddyAgent [baseline] (761.643 ms) : 0, 761643
BytebuddyAgent [candidate] (757.03 ms) : 0, 757030
GlobalTracer [baseline] (237.53 ms) : 0, 237530
GlobalTracer [candidate] (235.887 ms) : 0, 235887
IAST [baseline] (23.946 ms) : 0, 23946
IAST [candidate] (23.719 ms) : 0, 23719
AppSec [baseline] (170.59 ms) : 0, 170590
AppSec [candidate] (169.455 ms) : 0, 169455
Debugger [baseline] (6.511 ms) : 0, 6511
Debugger [candidate] (7.878 ms) : 0, 7878
Remote Config [baseline] (612.711 µs) : 0, 613
Remote Config [candidate] (644.573 µs) : 0, 645
Telemetry [baseline] (9.11 ms) : 0, 9110
Telemetry [candidate] (8.383 ms) : 0, 8383
section iast
crashtracking [baseline] (1.439 ms) : 0, 1439
crashtracking [candidate] (1.431 ms) : 0, 1431
BytebuddyAgent [baseline] (856.123 ms) : 0, 856123
BytebuddyAgent [candidate] (849.214 ms) : 0, 849214
GlobalTracer [baseline] (233.819 ms) : 0, 233819
GlobalTracer [candidate] (233.22 ms) : 0, 233220
IAST [baseline] (27.634 ms) : 0, 27634
IAST [candidate] (29.842 ms) : 0, 29842
AppSec [baseline] (27.443 ms) : 0, 27443
AppSec [candidate] (24.252 ms) : 0, 24252
Debugger [baseline] (8.332 ms) : 0, 8332
Debugger [candidate] (8.237 ms) : 0, 8237
Remote Config [baseline] (598.526 µs) : 0, 599
Remote Config [candidate] (583.173 µs) : 0, 583
Telemetry [baseline] (8.337 ms) : 0, 8337
Telemetry [candidate] (8.211 ms) : 0, 8211
section profiling
crashtracking [baseline] (1.395 ms) : 0, 1395
crashtracking [candidate] (1.419 ms) : 0, 1419
BytebuddyAgent [baseline] (758.056 ms) : 0, 758056
BytebuddyAgent [candidate] (772.613 ms) : 0, 772613
GlobalTracer [baseline] (221.239 ms) : 0, 221239
GlobalTracer [candidate] (225.133 ms) : 0, 225133
AppSec [baseline] (29.928 ms) : 0, 29928
AppSec [candidate] (30.775 ms) : 0, 30775
Debugger [baseline] (6.268 ms) : 0, 6268
Debugger [candidate] (6.415 ms) : 0, 6415
Remote Config [baseline] (717.693 µs) : 0, 718
Remote Config [candidate] (717.864 µs) : 0, 718
Telemetry [baseline] (16.019 ms) : 0, 16019
Telemetry [candidate] (16.227 ms) : 0, 16227
ProfilingAgent [baseline] (107.494 ms) : 0, 107494
ProfilingAgent [candidate] (109.468 ms) : 0, 109468
Profiling [baseline] (108.119 ms) : 0, 108119
Profiling [candidate] (110.118 ms) : 0, 110118
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.52.0-SNAPSHOT~9bf1b6bc3a, baseline=1.53.0-SNAPSHOT~86fb978afd

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.053 s) : 0, 1053467
Total [baseline] (8.64 s) : 0, 8639831
Agent [candidate] (1.048 s) : 0, 1048226
Total [candidate] (8.615 s) : 0, 8615462
section iast
Agent [baseline] (1.176 s) : 0, 1176382
Total [baseline] (9.347 s) : 0, 9347489
Agent [candidate] (1.173 s) : 0, 1172978
Total [candidate] (9.303 s) : 0, 9303069
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent iast 1.176 s 122.915 ms (11.7%)
Total tracing 8.64 s -
Total iast 9.347 s 707.658 ms (8.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.048 s -
Agent iast 1.173 s 124.752 ms (11.9%)
Total tracing 8.615 s -
Total iast 9.303 s 687.607 ms (8.0%) 
gantt
    title insecure-bank - break down per module: candidate=1.52.0-SNAPSHOT~9bf1b6bc3a, baseline=1.53.0-SNAPSHOT~86fb978afd

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.439 ms) : 0, 1439
crashtracking [candidate] (1.446 ms) : 0, 1446
BytebuddyAgent [baseline] (737.437 ms) : 0, 737437
BytebuddyAgent [candidate] (734.61 ms) : 0, 734610
GlobalTracer [baseline] (243.761 ms) : 0, 243761
GlobalTracer [candidate] (242.928 ms) : 0, 242928
AppSec [baseline] (30.731 ms) : 0, 30731
AppSec [candidate] (30.175 ms) : 0, 30175
Debugger [baseline] (6.104 ms) : 0, 6104
Debugger [candidate] (6.037 ms) : 0, 6037
Remote Config [baseline] (665.371 µs) : 0, 665
Remote Config [candidate] (650.729 µs) : 0, 651
Telemetry [baseline] (12.268 ms) : 0, 12268
Telemetry [candidate] (11.383 ms) : 0, 11383
section iast
crashtracking [baseline] (1.429 ms) : 0, 1429
crashtracking [candidate] (1.422 ms) : 0, 1422
BytebuddyAgent [baseline] (848.661 ms) : 0, 848661
BytebuddyAgent [candidate] (847.096 ms) : 0, 847096
GlobalTracer [baseline] (233.896 ms) : 0, 233896
GlobalTracer [candidate] (231.899 ms) : 0, 231899
IAST [baseline] (26.791 ms) : 0, 26791
IAST [candidate] (28.23 ms) : 0, 28230
AppSec [baseline] (29.326 ms) : 0, 29326
AppSec [candidate] (27.238 ms) : 0, 27238
Debugger [baseline] (6.516 ms) : 0, 6516
Debugger [candidate] (7.323 ms) : 0, 7323
Remote Config [baseline] (573.72 µs) : 0, 574
Remote Config [candidate] (586.832 µs) : 0, 587
Telemetry [baseline] (8.288 ms) : 0, 8288
Telemetry [candidate] (8.26 ms) : 0, 8260
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/debug-ci-timeout
git_commit_date 1754494113 1754508562
git_commit_sha 86fb978 9bf1b6b
release_version 1.53.0-SNAPSHOT~86fb978afd 1.52.0-SNAPSHOT~9bf1b6bc3a
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1754510202 1754510202
ci_job_id 1068006934 1068006934
ci_pipeline_id 72904861 72904861
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-uedbq8yv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-uedbq8yv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 1 performance regressions! Performance is the same for 9 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:tracing:high_load better
[-655.033µs; -408.243µs] or [-8.099%; -5.048%]		 unstable
[-38.935op/s; +118.435op/s] or [-6.796%; +20.673%]		 7.556ms 612.656op/s 8.088ms 572.906op/s
scenario:load:petclinic:profiling:high_load worse
[+2.368ms; +3.368ms] or [+4.922%; +6.999%]		 unstable
[-12.361op/s; +1.386op/s] or [-12.704%; +1.425%]		 50.985ms 91.812op/s 48.117ms 97.300op/s
scenario:load:petclinic:code_origins:high_load better
[-2.297ms; -1.454ms] or [-4.967%; -3.145%]		 unstable
[-2.998op/s; +11.398op/s] or [-2.962%; +11.260%]		 44.364ms 105.425op/s 46.240ms 101.225op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~9bf1b6bc3a, baseline=1.53.0-SNAPSHOT~86fb978afd
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.445 ms) : 4392, 4497
.   : milestone, 4445,
iast (9.296 ms) : 9145, 9447
.   : milestone, 9296,
iast_FULL (13.91 ms) : 13636, 14184
.   : milestone, 13910,
iast_GLOBAL (10.365 ms) : 10174, 10555
.   : milestone, 10365,
profiling (9.626 ms) : 9460, 9793
.   : milestone, 9626,
tracing (8.088 ms) : 7971, 8204
.   : milestone, 8088,
section candidate
no_agent (4.419 ms) : 4367, 4471
.   : milestone, 4419,
iast (9.276 ms) : 9123, 9428
.   : milestone, 9276,
iast_FULL (13.761 ms) : 13486, 14036
.   : milestone, 13761,
iast_GLOBAL (10.565 ms) : 10380, 10751
.   : milestone, 10565,
profiling (9.298 ms) : 9130, 9466
.   : milestone, 9298,
tracing (7.556 ms) : 7443, 7669
.   : milestone, 7556,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.445 ms [4.392 ms, 4.497 ms] -
iast 9.296 ms [9.145 ms, 9.447 ms] 4.852 ms (109.2%)
iast_FULL 13.91 ms [13.636 ms, 14.184 ms] 9.466 ms (213.0%)
iast_GLOBAL 10.365 ms [10.174 ms, 10.555 ms] 5.92 ms (133.2%)
profiling 9.626 ms [9.46 ms, 9.793 ms] 5.182 ms (116.6%)
tracing 8.088 ms [7.971 ms, 8.204 ms] 3.643 ms (82.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.419 ms [4.367 ms, 4.471 ms] -
iast 9.276 ms [9.123 ms, 9.428 ms] 4.857 ms (109.9%)
iast_FULL 13.761 ms [13.486 ms, 14.036 ms] 9.341 ms (211.4%)
iast_GLOBAL 10.565 ms [10.38 ms, 10.751 ms] 6.146 ms (139.1%)
profiling 9.298 ms [9.13 ms, 9.466 ms] 4.879 ms (110.4%)
tracing 7.556 ms [7.443 ms, 7.669 ms] 3.137 ms (71.0%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~9bf1b6bc3a, baseline=1.53.0-SNAPSHOT~86fb978afd
    dateFormat X
    axisFormat %s
section baseline
no_agent (38.415 ms) : 38107, 38723
.   : milestone, 38415,
appsec (47.11 ms) : 46699, 47520
.   : milestone, 47110,
code_origins (46.24 ms) : 45839, 46642
.   : milestone, 46240,
iast (45.239 ms) : 44850, 45629
.   : milestone, 45239,
profiling (48.117 ms) : 47660, 48573
.   : milestone, 48117,
tracing (43.886 ms) : 43521, 44251
.   : milestone, 43886,
section candidate
no_agent (38.934 ms) : 38616, 39251
.   : milestone, 38934,
appsec (47.304 ms) : 46893, 47714
.   : milestone, 47304,
code_origins (44.364 ms) : 43983, 44746
.   : milestone, 44364,
iast (44.989 ms) : 44594, 45385
.   : milestone, 44989,
profiling (50.985 ms) : 50512, 51457
.   : milestone, 50985,
tracing (43.346 ms) : 42967, 43725
.   : milestone, 43346,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 38.415 ms [38.107 ms, 38.723 ms] -
appsec 47.11 ms [46.699 ms, 47.52 ms] 8.695 ms (22.6%)
code_origins 46.24 ms [45.839 ms, 46.642 ms] 7.825 ms (20.4%)
iast 45.239 ms [44.85 ms, 45.629 ms] 6.824 ms (17.8%)
profiling 48.117 ms [47.66 ms, 48.573 ms] 9.701 ms (25.3%)
tracing 43.886 ms [43.521 ms, 44.251 ms] 5.471 ms (14.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 38.934 ms [38.616 ms, 39.251 ms] -
appsec 47.304 ms [46.893 ms, 47.714 ms] 8.37 ms (21.5%)
code_origins 44.364 ms [43.983 ms, 44.746 ms] 5.431 ms (13.9%)
iast 44.989 ms [44.594 ms, 45.385 ms] 6.056 ms (15.6%)
profiling 50.985 ms [50.512 ms, 51.457 ms] 12.051 ms (31.0%)
tracing 43.346 ms [42.967 ms, 43.725 ms] 4.412 ms (11.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master alexeyk/debug-ci-timeout
git_commit_date 1754494113 1754508562
git_commit_sha 86fb978 9bf1b6b
release_version 1.53.0-SNAPSHOT~86fb978afd 1.52.0-SNAPSHOT~9bf1b6bc3a
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1754510729 1754510729
ci_job_id 1068006935 1068006935
ci_pipeline_id 72904861 72904861
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-dp5nvfkh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-dp5nvfkh 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~9bf1b6bc3a, baseline=1.53.0-SNAPSHOT~86fb978afd
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.483 ms) : 1471, 1495
.   : milestone, 1483,
appsec (3.586 ms) : 3370, 3803
.   : milestone, 3586,
iast (2.194 ms) : 2132, 2256
.   : milestone, 2194,
iast_GLOBAL (2.251 ms) : 2189, 2313
.   : milestone, 2251,
profiling (2.47 ms) : 2250, 2689
.   : milestone, 2470,
tracing (2.02 ms) : 1972, 2069
.   : milestone, 2020,
section candidate
no_agent (1.481 ms) : 1469, 1492
.   : milestone, 1481,
appsec (3.584 ms) : 3367, 3800
.   : milestone, 3584,
iast (2.198 ms) : 2136, 2260
.   : milestone, 2198,
iast_GLOBAL (2.245 ms) : 2182, 2308
.   : milestone, 2245,
profiling (2.058 ms) : 2006, 2109
.   : milestone, 2058,
tracing (2.017 ms) : 1969, 2065
.   : milestone, 2017,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.471 ms, 1.495 ms] -
appsec 3.586 ms [3.37 ms, 3.803 ms] 2.103 ms (141.8%)
iast 2.194 ms [2.132 ms, 2.256 ms] 710.532 µs (47.9%)
iast_GLOBAL 2.251 ms [2.189 ms, 2.313 ms] 768.113 µs (51.8%)
profiling 2.47 ms [2.25 ms, 2.689 ms] 986.476 µs (66.5%)
tracing 2.02 ms [1.972 ms, 2.069 ms] 537.109 µs (36.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.481 ms [1.469 ms, 1.492 ms] -
appsec 3.584 ms [3.367 ms, 3.8 ms] 2.103 ms (142.0%)
iast 2.198 ms [2.136 ms, 2.26 ms] 717.011 µs (48.4%)
iast_GLOBAL 2.245 ms [2.182 ms, 2.308 ms] 764.252 µs (51.6%)
profiling 2.058 ms [2.006 ms, 2.109 ms] 576.682 µs (38.9%)
tracing 2.017 ms [1.969 ms, 2.065 ms] 536.288 µs (36.2%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~9bf1b6bc3a, baseline=1.53.0-SNAPSHOT~86fb978afd
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.311 s) : 15311000, 15311000
.   : milestone, 15311000,
appsec (14.961 s) : 14961000, 14961000
.   : milestone, 14961000,
iast (18.418 s) : 18418000, 18418000
.   : milestone, 18418000,
iast_GLOBAL (18.263 s) : 18263000, 18263000
.   : milestone, 18263000,
profiling (15.651 s) : 15651000, 15651000
.   : milestone, 15651000,
tracing (14.714 s) : 14714000, 14714000
.   : milestone, 14714000,
section candidate
no_agent (15.536 s) : 15536000, 15536000
.   : milestone, 15536000,
appsec (14.857 s) : 14857000, 14857000
.   : milestone, 14857000,
iast (18.429 s) : 18429000, 18429000
.   : milestone, 18429000,
iast_GLOBAL (17.909 s) : 17909000, 17909000
.   : milestone, 17909000,
profiling (15.323 s) : 15323000, 15323000
.   : milestone, 15323000,
tracing (15.033 s) : 15033000, 15033000
.   : milestone, 15033000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.311 s [15.311 s, 15.311 s] -
appsec 14.961 s [14.961 s, 14.961 s] -350.0 ms (-2.3%)
iast 18.418 s [18.418 s, 18.418 s] 3.107 s (20.3%)
iast_GLOBAL 18.263 s [18.263 s, 18.263 s] 2.952 s (19.3%)
profiling 15.651 s [15.651 s, 15.651 s] 340.0 ms (2.2%)
tracing 14.714 s [14.714 s, 14.714 s] -597.0 ms (-3.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.536 s [15.536 s, 15.536 s] -
appsec 14.857 s [14.857 s, 14.857 s] -679.0 ms (-4.4%)
iast 18.429 s [18.429 s, 18.429 s] 2.893 s (18.6%)
iast_GLOBAL 17.909 s [17.909 s, 17.909 s] 2.373 s (15.3%)
profiling 15.323 s [15.323 s, 15.323 s] -213.0 ms (-1.4%)
tracing 15.033 s [15.033 s, 15.033 s] -503.0 ms (-3.2%)

bric3
bric3 reviewed Jul 30, 2025
View reviewed changes
@datadog-datadog-prod-us1
Copy link
Contributor

datadog-datadog-prod-us1 bot commented Jul 31, 2025 •
edited
Loading

Code coverage: total 57.25%, patch 100.00% (view details)

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 9bf1b6b | Docs | Was this helpful? Give us feedback!

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD deleted the alexeyk/debug-ci-timeout branch August 11, 2025 16:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@bric3 bric3 Awaiting requested review from bric3

Assignees

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD

Labels
comp: testing Testing tag: do not merge Do not merge changes
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@AlexeyKuznetsov-DD @bric3