Skip to content

Update Gradle dependencies #8906

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 47 commits into
base: master
Choose a base branch
from

Conversation

github-actions[bot]
Copy link
Contributor

@github-actions github-actions bot commented Jun 1, 2025

This PR updates the Gradle dependencies. ⚠️ Don't forget to squash commits before merging. ⚠️

  • Update PR title if a code change is needed to support one of those new dependencies

@github-actions github-actions bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels Jun 1, 2025
@github-actions github-actions bot requested review from a team as code owners June 1, 2025 04:35
@pr-commenter
Copy link

pr-commenter bot commented Jun 1, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1748753303 1748753675
end_time 2025-06-01T04:49:43 2025-06-01T04:55:56
git_branch master ci/update-gradle-dependencies-20250601
git_commit_sha ad6d5fe 714f013
start_time 2025-06-01T04:48:24 2025-06-01T04:54:36
See matching parameters
Baseline Candidate
ci_job_id 962182292 962182292
ci_pipeline_id 66615365 66615365
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1748752507 1748752507

Summary

Found 0 performance improvements and 5 performance regressions! Performance is the same for 4 metrics, 6 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:loop worse
[+445.115µs; +574.258µs] or [+4.388%; +5.661%]
worse
[+450.488µs; +595.583µs] or [+4.372%; +5.780%]
worse
[+406.798µs; +577.652µs] or [+3.903%; +5.542%]
worse
[+395.601µs; +726.944µs] or [+3.701%; +6.801%]
worse
[-5.714op/s; -3.946op/s] or [-5.942%; -4.104%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-16636.401ns; +16721.152ns] or [-6.072%; +6.103%]
unstable
[-25564.427ns; +27409.386ns] or [-8.152%; +8.740%]
unstable
[-34.974µs; +37.737µs] or [-10.696%; +11.541%]
unstable
[-109.056µs; +92.608µs] or [-10.603%; +9.004%]
same
scenario:basic unsure
[+0.738µs; +9.682µs] or [+0.261%; +3.425%]
same same unstable
[-76.764µs; +137.136µs] or [-8.418%; +15.039%]
unstable
[-186.092op/s; +69.948op/s] or [-7.630%; +2.868%]
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (313.611 µs) : 288, 339
.   : milestone, 314,
basic (313.883 µs) : 306, 322
.   : milestone, 314,
loop (10.305 ms) : 10212, 10398
.   : milestone, 10305,
section candidate
noprobe (314.533 µs) : 289, 340
.   : milestone, 315,
basic (317.418 µs) : 309, 326
.   : milestone, 317,
loop (10.828 ms) : 10806, 10850
.   : milestone, 10828,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 313.611 µs [288.332 µs, 338.89 µs]
basic 313.883 µs [305.567 µs, 322.2 µs]
loop 10.305 ms [10.212 ms, 10.398 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 314.533 µs [289.375 µs, 339.692 µs]
basic 317.418 µs [309.313 µs, 325.522 µs]
loop 10.828 ms [10.806 ms, 10.85 ms]

@pr-commenter
Copy link

pr-commenter bot commented Jun 1, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250601
git_commit_date 1746789389 1748752510
git_commit_sha ad6d5fe 20b13a7
release_version 1.50.0-SNAPSHOT~ad6d5fef42 1.50.0-SNAPSHOT~20b13a7000
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1748755165 1748755165
ci_job_id 962182463 962182463
ci_pipeline_id 66615372 66615372
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-6qnhxxvc-project-304-concurrent-8-kctdq3k3 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-6qnhxxvc-project-304-concurrent-8-kctdq3k3 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 53 metrics, 14 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:AppSec better
[-8.733ms; -4.077ms] or [-15.889%; -7.417%]
48.558ms 54.963ms
scenario:startup:petclinic:profiling:GlobalTracer better
[-21.983ms; -13.522ms] or [-5.791%; -3.562%]
361.886ms 379.638ms
scenario:startup:petclinic:profiling:AppSec worse
[+6.482ms; +9.684ms] or [+11.935%; +17.829%]
62.396ms 54.313ms
scenario:startup:petclinic:tracing:Remote Config worse
[+21.556µs; +58.210µs] or [+3.084%; +8.329%]
738.754µs 698.871µs
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~20b13a7000, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.021 s) : 0, 1020554
Total [baseline] (8.684 s) : 0, 8684042
Agent [candidate] (1.022 s) : 0, 1021999
Total [candidate] (8.668 s) : 0, 8668293
section iast
Agent [baseline] (1.148 s) : 0, 1148279
Total [baseline] (9.236 s) : 0, 9236085
Agent [candidate] (1.162 s) : 0, 1161850
Total [candidate] (9.321 s) : 0, 9321375
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.151 s) : 0, 1151032
Total [baseline] (9.226 s) : 0, 9225903
Agent [candidate] (1.155 s) : 0, 1154982
Total [candidate] (9.278 s) : 0, 9277635
section iast_TELEMETRY_OFF
Agent [baseline] (1.144 s) : 0, 1144314
Total [baseline] (9.222 s) : 0, 9222230
Agent [candidate] (1.147 s) : 0, 1147268
Total [candidate] (9.287 s) : 0, 9287016
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.021 s -
Agent iast 1.148 s 127.725 ms (12.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.151 s 130.478 ms (12.8%)
Agent iast_TELEMETRY_OFF 1.144 s 123.759 ms (12.1%)
Total tracing 8.684 s -
Total iast 9.236 s 552.043 ms (6.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.226 s 541.861 ms (6.2%)
Total iast_TELEMETRY_OFF 9.222 s 538.187 ms (6.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.022 s -
Agent iast 1.162 s 139.852 ms (13.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.155 s 132.983 ms (13.0%)
Agent iast_TELEMETRY_OFF 1.147 s 125.27 ms (12.3%)
Total tracing 8.668 s -
Total iast 9.321 s 653.082 ms (7.5%)
Total iast_HARDCODED_SECRET_DISABLED 9.278 s 609.342 ms (7.0%)
Total iast_TELEMETRY_OFF 9.287 s 618.724 ms (7.1%)
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~20b13a7000, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.403 ms) : 0, 682403
BytebuddyAgent [candidate] (683.265 ms) : 0, 683265
GlobalTracer [baseline] (239.739 ms) : 0, 239739
GlobalTracer [candidate] (240.735 ms) : 0, 240735
AppSec [baseline] (56.037 ms) : 0, 56037
AppSec [candidate] (57.234 ms) : 0, 57234
Debugger [baseline] (7.628 ms) : 0, 7628
Debugger [candidate] (6.894 ms) : 0, 6894
Remote Config [baseline] (685.92 µs) : 0, 686
Remote Config [candidate] (724.731 µs) : 0, 725
Telemetry [baseline] (10.557 ms) : 0, 10557
Telemetry [candidate] (9.658 ms) : 0, 9658
section iast
BytebuddyAgent [baseline] (801.568 ms) : 0, 801568
BytebuddyAgent [candidate] (810.996 ms) : 0, 810996
GlobalTracer [baseline] (230.059 ms) : 0, 230059
GlobalTracer [candidate] (233.112 ms) : 0, 233112
AppSec [baseline] (50.142 ms) : 0, 50142
AppSec [candidate] (53.171 ms) : 0, 53171
Debugger [baseline] (5.947 ms) : 0, 5947
Debugger [candidate] (5.937 ms) : 0, 5937
Remote Config [baseline] (599.149 µs) : 0, 599
Remote Config [candidate] (586.727 µs) : 0, 587
Telemetry [baseline] (7.854 ms) : 0, 7854
Telemetry [candidate] (7.896 ms) : 0, 7896
IAST [baseline] (28.62 ms) : 0, 28620
IAST [candidate] (26.454 ms) : 0, 26454
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (803.394 ms) : 0, 803394
BytebuddyAgent [candidate] (806.156 ms) : 0, 806156
GlobalTracer [baseline] (230.768 ms) : 0, 230768
GlobalTracer [candidate] (231.677 ms) : 0, 231677
AppSec [baseline] (51.852 ms) : 0, 51852
AppSec [candidate] (50.796 ms) : 0, 50796
Debugger [baseline] (5.949 ms) : 0, 5949
Debugger [candidate] (5.939 ms) : 0, 5939
Remote Config [baseline] (598.816 µs) : 0, 599
Remote Config [candidate] (600.665 µs) : 0, 601
Telemetry [baseline] (7.955 ms) : 0, 7955
Telemetry [candidate] (7.925 ms) : 0, 7925
IAST [baseline] (27.036 ms) : 0, 27036
IAST [candidate] (28.482 ms) : 0, 28482
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (797.894 ms) : 0, 797894
BytebuddyAgent [candidate] (800.351 ms) : 0, 800351
GlobalTracer [baseline] (230.433 ms) : 0, 230433
GlobalTracer [candidate] (231.271 ms) : 0, 231271
AppSec [baseline] (54.963 ms) : 0, 54963
AppSec [candidate] (48.558 ms) : 0, 48558
Debugger [baseline] (5.966 ms) : 0, 5966
Debugger [candidate] (5.892 ms) : 0, 5892
Remote Config [baseline] (598.281 µs) : 0, 598
Remote Config [candidate] (577.488 µs) : 0, 577
Telemetry [baseline] (7.775 ms) : 0, 7775
Telemetry [candidate] (7.747 ms) : 0, 7747
IAST [baseline] (23.268 ms) : 0, 23268
IAST [candidate] (29.359 ms) : 0, 29359
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~20b13a7000, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.019 s) : 0, 1018607
Total [baseline] (10.549 s) : 0, 10549365
Agent [candidate] (1.022 s) : 0, 1021699
Total [candidate] (10.522 s) : 0, 10522188
section appsec
Agent [baseline] (1.161 s) : 0, 1160762
Total [baseline] (10.696 s) : 0, 10695518
Agent [candidate] (1.172 s) : 0, 1171789
Total [candidate] (10.807 s) : 0, 10807212
section iast
Agent [baseline] (1.151 s) : 0, 1150705
Total [baseline] (10.835 s) : 0, 10834774
Agent [candidate] (1.161 s) : 0, 1161047
Total [candidate] (10.993 s) : 0, 10993192
section profiling
Agent [baseline] (1.281 s) : 0, 1281121
Total [baseline] (10.984 s) : 0, 10983632
Agent [candidate] (1.278 s) : 0, 1277945
Total [candidate] (10.869 s) : 0, 10869479
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.019 s -
Agent appsec 1.161 s 142.155 ms (14.0%)
Agent iast 1.151 s 132.098 ms (13.0%)
Agent profiling 1.281 s 262.514 ms (25.8%)
Total tracing 10.549 s -
Total appsec 10.696 s 146.153 ms (1.4%)
Total iast 10.835 s 285.408 ms (2.7%)
Total profiling 10.984 s 434.267 ms (4.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.022 s -
Agent appsec 1.172 s 150.09 ms (14.7%)
Agent iast 1.161 s 139.348 ms (13.6%)
Agent profiling 1.278 s 256.246 ms (25.1%)
Total tracing 10.522 s -
Total appsec 10.807 s 285.024 ms (2.7%)
Total iast 10.993 s 471.004 ms (4.5%)
Total profiling 10.869 s 347.292 ms (3.3%)
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~20b13a7000, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.502 ms) : 0, 682502
BytebuddyAgent [candidate] (683.94 ms) : 0, 683940
GlobalTracer [baseline] (239.906 ms) : 0, 239906
GlobalTracer [candidate] (240.868 ms) : 0, 240868
AppSec [baseline] (54.331 ms) : 0, 54331
AppSec [candidate] (55.882 ms) : 0, 55882
Debugger [baseline] (7.74 ms) : 0, 7740
Debugger [candidate] (6.222 ms) : 0, 6222
Remote Config [baseline] (698.871 µs) : 0, 699
Remote Config [candidate] (738.754 µs) : 0, 739
Telemetry [baseline] (9.915 ms) : 0, 9915
Telemetry [candidate] (10.514 ms) : 0, 10514
section appsec
BytebuddyAgent [baseline] (700.076 ms) : 0, 700076
BytebuddyAgent [candidate] (705.293 ms) : 0, 705293
GlobalTracer [baseline] (236.213 ms) : 0, 236213
GlobalTracer [candidate] (240.022 ms) : 0, 240022
AppSec [baseline] (175.442 ms) : 0, 175442
AppSec [candidate] (177.749 ms) : 0, 177749
Debugger [baseline] (6.322 ms) : 0, 6322
Debugger [candidate] (6.016 ms) : 0, 6016
Remote Config [baseline] (628.352 µs) : 0, 628
Remote Config [candidate] (657.969 µs) : 0, 658
Telemetry [baseline] (7.728 ms) : 0, 7728
Telemetry [candidate] (7.429 ms) : 0, 7429
IAST [baseline] (21.683 ms) : 0, 21683
IAST [candidate] (22.018 ms) : 0, 22018
section iast
BytebuddyAgent [baseline] (802.868 ms) : 0, 802868
BytebuddyAgent [candidate] (810.47 ms) : 0, 810470
GlobalTracer [baseline] (230.738 ms) : 0, 230738
GlobalTracer [candidate] (233.099 ms) : 0, 233099
AppSec [baseline] (49.605 ms) : 0, 49605
AppSec [candidate] (53.866 ms) : 0, 53866
Debugger [baseline] (5.963 ms) : 0, 5963
Debugger [candidate] (5.937 ms) : 0, 5937
Remote Config [baseline] (617.929 µs) : 0, 618
Remote Config [candidate] (604.547 µs) : 0, 605
Telemetry [baseline] (7.913 ms) : 0, 7913
Telemetry [candidate] (7.877 ms) : 0, 7877
IAST [baseline] (27.882 ms) : 0, 27882
IAST [candidate] (25.516 ms) : 0, 25516
section profiling
BytebuddyAgent [baseline] (672.198 ms) : 0, 672198
BytebuddyAgent [candidate] (680.593 ms) : 0, 680593
GlobalTracer [baseline] (379.638 ms) : 0, 379638
GlobalTracer [candidate] (361.886 ms) : 0, 361886
AppSec [baseline] (54.313 ms) : 0, 54313
AppSec [candidate] (62.396 ms) : 0, 62396
Debugger [baseline] (6.072 ms) : 0, 6072
Debugger [candidate] (6.24 ms) : 0, 6240
Remote Config [baseline] (638.936 µs) : 0, 639
Remote Config [candidate] (656.612 µs) : 0, 657
Telemetry [baseline] (8.085 ms) : 0, 8085
Telemetry [candidate] (8.343 ms) : 0, 8343
ProfilingAgent [baseline] (109.693 ms) : 0, 109693
ProfilingAgent [candidate] (106.574 ms) : 0, 106574
Profiling [baseline] (109.72 ms) : 0, 109720
Profiling [candidate] (106.599 ms) : 0, 106599
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-06-01T04:49:46 2025-06-01T04:57:33
git_branch master ci/update-gradle-dependencies-20250601
git_commit_date 1746789389 1748752510
git_commit_sha ad6d5fe 20b13a7
release_version 1.50.0-SNAPSHOT~ad6d5fef42 1.50.0-SNAPSHOT~20b13a7000
start_time 2025-06-01T04:49:32 2025-06-01T04:57:19
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1748754253 1748754253
ci_job_id 962182464 962182464
ci_pipeline_id 66615372 66615372
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-6qnhxxvc-project-304-concurrent-9-0ie8yyap 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-6qnhxxvc-project-304-concurrent-9-0ie8yyap 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~20b13a7000, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.369 ms) : 1349, 1389
.   : milestone, 1369,
appsec (1.74 ms) : 1716, 1763
.   : milestone, 1740,
appsec_no_iast (1.75 ms) : 1726, 1773
.   : milestone, 1750,
code_origins (1.695 ms) : 1668, 1722
.   : milestone, 1695,
iast (1.514 ms) : 1489, 1540
.   : milestone, 1514,
profiling (1.521 ms) : 1497, 1544
.   : milestone, 1521,
tracing (1.51 ms) : 1487, 1533
.   : milestone, 1510,
section candidate
no_agent (1.362 ms) : 1343, 1381
.   : milestone, 1362,
appsec (1.739 ms) : 1716, 1762
.   : milestone, 1739,
appsec_no_iast (1.739 ms) : 1715, 1762
.   : milestone, 1739,
code_origins (1.688 ms) : 1662, 1714
.   : milestone, 1688,
iast (1.522 ms) : 1497, 1547
.   : milestone, 1522,
profiling (1.531 ms) : 1508, 1555
.   : milestone, 1531,
tracing (1.5 ms) : 1475, 1524
.   : milestone, 1500,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.369 ms [1.349 ms, 1.389 ms] -
appsec 1.74 ms [1.716 ms, 1.763 ms] 370.909 µs (27.1%)
appsec_no_iast 1.75 ms [1.726 ms, 1.773 ms] 380.774 µs (27.8%)
code_origins 1.695 ms [1.668 ms, 1.722 ms] 326.344 µs (23.8%)
iast 1.514 ms [1.489 ms, 1.54 ms] 145.559 µs (10.6%)
profiling 1.521 ms [1.497 ms, 1.544 ms] 151.672 µs (11.1%)
tracing 1.51 ms [1.487 ms, 1.533 ms] 141.076 µs (10.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.362 ms [1.343 ms, 1.381 ms] -
appsec 1.739 ms [1.716 ms, 1.762 ms] 377.055 µs (27.7%)
appsec_no_iast 1.739 ms [1.715 ms, 1.762 ms] 376.557 µs (27.6%)
code_origins 1.688 ms [1.662 ms, 1.714 ms] 325.959 µs (23.9%)
iast 1.522 ms [1.497 ms, 1.547 ms] 159.992 µs (11.7%)
profiling 1.531 ms [1.508 ms, 1.555 ms] 169.387 µs (12.4%)
tracing 1.5 ms [1.475 ms, 1.524 ms] 137.87 µs (10.1%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~20b13a7000, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (382.212 µs) : 362, 402
.   : milestone, 382,
iast (518.651 µs) : 497, 540
.   : milestone, 519,
iast_FULL (740.915 µs) : 719, 763
.   : milestone, 741,
iast_GLOBAL (566.766 µs) : 544, 589
.   : milestone, 567,
iast_HARDCODED_SECRET_DISABLED (519.106 µs) : 496, 542
.   : milestone, 519,
iast_INACTIVE (476.188 µs) : 454, 499
.   : milestone, 476,
iast_TELEMETRY_OFF (510.654 µs) : 487, 534
.   : milestone, 511,
tracing (472.699 µs) : 450, 495
.   : milestone, 473,
section candidate
no_agent (390.314 µs) : 369, 411
.   : milestone, 390,
iast (527.06 µs) : 505, 549
.   : milestone, 527,
iast_FULL (748.545 µs) : 725, 772
.   : milestone, 749,
iast_GLOBAL (572.409 µs) : 550, 594
.   : milestone, 572,
iast_HARDCODED_SECRET_DISABLED (530.535 µs) : 509, 552
.   : milestone, 531,
iast_INACTIVE (470.789 µs) : 448, 493
.   : milestone, 471,
iast_TELEMETRY_OFF (516.143 µs) : 495, 538
.   : milestone, 516,
tracing (470.01 µs) : 448, 492
.   : milestone, 470,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 382.212 µs [362.175 µs, 402.248 µs] -
iast 518.651 µs [497.025 µs, 540.278 µs] 136.44 µs (35.7%)
iast_FULL 740.915 µs [718.902 µs, 762.928 µs] 358.703 µs (93.8%)
iast_GLOBAL 566.766 µs [544.42 µs, 589.112 µs] 184.554 µs (48.3%)
iast_HARDCODED_SECRET_DISABLED 519.106 µs [496.209 µs, 542.003 µs] 136.894 µs (35.8%)
iast_INACTIVE 476.188 µs [453.525 µs, 498.85 µs] 93.976 µs (24.6%)
iast_TELEMETRY_OFF 510.654 µs [487.408 µs, 533.901 µs] 128.443 µs (33.6%)
tracing 472.699 µs [449.929 µs, 495.47 µs] 90.488 µs (23.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 390.314 µs [369.261 µs, 411.366 µs] -
iast 527.06 µs [505.234 µs, 548.885 µs] 136.746 µs (35.0%)
iast_FULL 748.545 µs [725.266 µs, 771.824 µs] 358.231 µs (91.8%)
iast_GLOBAL 572.409 µs [550.353 µs, 594.465 µs] 182.095 µs (46.7%)
iast_HARDCODED_SECRET_DISABLED 530.535 µs [508.652 µs, 552.418 µs] 140.221 µs (35.9%)
iast_INACTIVE 470.789 µs [448.131 µs, 493.447 µs] 80.475 µs (20.6%)
iast_TELEMETRY_OFF 516.143 µs [494.748 µs, 537.538 µs] 125.829 µs (32.2%)
tracing 470.01 µs [447.95 µs, 492.071 µs] 79.696 µs (20.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250601
git_commit_date 1746789389 1748752510
git_commit_sha ad6d5fe 20b13a7
release_version 1.50.0-SNAPSHOT~ad6d5fef42 1.50.0-SNAPSHOT~20b13a7000
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1748754704 1748754704
ci_job_id 962182465 962182465
ci_pipeline_id 66615372 66615372
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-6qnhxxvc-project-304-concurrent-10-808ioq81 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-6qnhxxvc-project-304-concurrent-10-808ioq81 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~20b13a7000, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.484 ms) : 1472, 1495
.   : milestone, 1484,
appsec (2.421 ms) : 2372, 2470
.   : milestone, 2421,
iast (2.185 ms) : 2124, 2247
.   : milestone, 2185,
iast_GLOBAL (2.227 ms) : 2165, 2288
.   : milestone, 2227,
profiling (2.037 ms) : 1988, 2086
.   : milestone, 2037,
tracing (2.012 ms) : 1964, 2060
.   : milestone, 2012,
section candidate
no_agent (1.484 ms) : 1472, 1496
.   : milestone, 1484,
appsec (2.405 ms) : 2357, 2454
.   : milestone, 2405,
iast (2.204 ms) : 2142, 2265
.   : milestone, 2204,
iast_GLOBAL (2.238 ms) : 2176, 2299
.   : milestone, 2238,
profiling (2.038 ms) : 1989, 2088
.   : milestone, 2038,
tracing (2.024 ms) : 1976, 2072
.   : milestone, 2024,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.484 ms [1.472 ms, 1.495 ms] -
appsec 2.421 ms [2.372 ms, 2.47 ms] 937.76 µs (63.2%)
iast 2.185 ms [2.124 ms, 2.247 ms] 701.653 µs (47.3%)
iast_GLOBAL 2.227 ms [2.165 ms, 2.288 ms] 742.902 µs (50.1%)
profiling 2.037 ms [1.988 ms, 2.086 ms] 553.36 µs (37.3%)
tracing 2.012 ms [1.964 ms, 2.06 ms] 528.297 µs (35.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.484 ms [1.472 ms, 1.496 ms] -
appsec 2.405 ms [2.357 ms, 2.454 ms] 921.264 µs (62.1%)
iast 2.204 ms [2.142 ms, 2.265 ms] 719.407 µs (48.5%)
iast_GLOBAL 2.238 ms [2.176 ms, 2.299 ms] 753.598 µs (50.8%)
profiling 2.038 ms [1.989 ms, 2.088 ms] 553.927 µs (37.3%)
tracing 2.024 ms [1.976 ms, 2.072 ms] 539.916 µs (36.4%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~20b13a7000, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.962 s) : 14962000, 14962000
.   : milestone, 14962000,
appsec (15.193 s) : 15193000, 15193000
.   : milestone, 15193000,
iast (18.682 s) : 18682000, 18682000
.   : milestone, 18682000,
iast_GLOBAL (18.282 s) : 18282000, 18282000
.   : milestone, 18282000,
profiling (14.789 s) : 14789000, 14789000
.   : milestone, 14789000,
tracing (14.987 s) : 14987000, 14987000
.   : milestone, 14987000,
section candidate
no_agent (14.915 s) : 14915000, 14915000
.   : milestone, 14915000,
appsec (14.801 s) : 14801000, 14801000
.   : milestone, 14801000,
iast (18.431 s) : 18431000, 18431000
.   : milestone, 18431000,
iast_GLOBAL (18.174 s) : 18174000, 18174000
.   : milestone, 18174000,
profiling (15.154 s) : 15154000, 15154000
.   : milestone, 15154000,
tracing (15.318 s) : 15318000, 15318000
.   : milestone, 15318000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.962 s [14.962 s, 14.962 s] -
appsec 15.193 s [15.193 s, 15.193 s] 231.0 ms (1.5%)
iast 18.682 s [18.682 s, 18.682 s] 3.72 s (24.9%)
iast_GLOBAL 18.282 s [18.282 s, 18.282 s] 3.32 s (22.2%)
profiling 14.789 s [14.789 s, 14.789 s] -173.0 ms (-1.2%)
tracing 14.987 s [14.987 s, 14.987 s] 25.0 ms (0.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.915 s [14.915 s, 14.915 s] -
appsec 14.801 s [14.801 s, 14.801 s] -114.0 ms (-0.8%)
iast 18.431 s [18.431 s, 18.431 s] 3.516 s (23.6%)
iast_GLOBAL 18.174 s [18.174 s, 18.174 s] 3.259 s (21.9%)
profiling 15.154 s [15.154 s, 15.154 s] 239.0 ms (1.6%)
tracing 15.318 s [15.318 s, 15.318 s] 403.0 ms (2.7%)

@pr-commenter
Copy link

pr-commenter bot commented Jun 1, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250601
git_commit_date 1748619962 1748752537
git_commit_sha 16284fa e389015
See matching parameters
Baseline Candidate
ci_job_date 1748753793 1748753793
ci_job_id 962184179 962184179
ci_pipeline_id 66615445 66615445
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Jun 1, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250601
git_commit_date 1748619962 1748752551
git_commit_sha 16284fa 5ba5a68
See matching parameters
Baseline Candidate
ci_job_date 1748753828 1748753828
ci_job_id 962184955 962184955
ci_pipeline_id 66615450 66615450
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

0 participants