Skip to content

Introduce environment component #8919

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Draft
wants to merge 16 commits into
base: master
Choose a base branch
from
Draft

Introduce environment component #8919

wants to merge 16 commits into from

Conversation

PerfectSlayer
Copy link
Contributor

What Does This Do

DRAFT ONLY

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@PerfectSlayer PerfectSlayer added the tag: do not merge Do not merge changes label Jun 4, 2025
@pr-commenter
Copy link

pr-commenter bot commented Jun 4, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1749018965 1749019346
end_time 2025-06-04T06:37:25 2025-06-04T06:43:46
git_branch master bbujon/environment
git_commit_sha ad6d5fe 20485c8
start_time 2025-06-04T06:36:06 2025-06-04T06:42:27
See matching parameters
Baseline Candidate
ci_job_id 966790642 966790642
ci_pipeline_id 66893095 66893095
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1749018215 1749018215

Summary

Found 5 performance improvements and 0 performance regressions! Performance is the same for 4 metrics, 6 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:loop better
[-541.530µs; -471.826µs] or [-5.153%; -4.490%]		 better
[-566.260µs; -459.132µs] or [-5.300%; -4.297%]		 better
[-578.079µs; -430.119µs] or [-5.361%; -3.989%]		 better
[-738.335µs; -361.914µs] or [-6.641%; -3.255%]		 better
[+3.466op/s; +5.524op/s] or [+3.743%; +5.966%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-36.916µs; +27.000µs] or [-13.092%; +9.576%]		 unstable
[-53.215µs; +36.794µs] or [-16.306%; +11.274%]		 unstable
[-65.645µs; +48.210µs] or [-19.189%; +14.093%]		 unstable
[-78.039µs; +205.328µs] or [-8.443%; +22.213%]		 same
scenario:basic same same same unstable
[-23.410µs; +160.084µs] or [-2.837%; +19.403%]		 unstable
[-134.726op/s; +134.726op/s] or [-5.524%; +5.524%]
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (326.354 µs) : 276, 376
.   : milestone, 326,
basic (311.799 µs) : 304, 320
.   : milestone, 312,
loop (10.684 ms) : 10626, 10742
.   : milestone, 10684,
section candidate
noprobe (318.143 µs) : 284, 353
.   : milestone, 318,
basic (315.703 µs) : 307, 325
.   : milestone, 316,
loop (10.171 ms) : 10132, 10211
.   : milestone, 10171,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 326.354 µs [276.443 µs, 376.266 µs]
basic 311.799 µs [303.762 µs, 319.836 µs]
loop 10.684 ms [10.626 ms, 10.742 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 318.143 µs [283.761 µs, 352.526 µs]
basic 315.703 µs [306.557 µs, 324.85 µs]
loop 10.171 ms [10.132 ms, 10.211 ms]

@pr-commenter
Copy link

pr-commenter bot commented Jun 4, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/environment
git_commit_date 1746789389 1749018215
git_commit_sha ad6d5fe 20485c8
release_version 1.50.0-SNAPSHOT~ad6d5fef42 1.50.0-SNAPSHOT~20485c8d4c
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1749020857 1749020857
ci_job_id 966790636 966790636
ci_pipeline_id 66893095 66893095
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-spbqwyzc-project-304-concurrent-0-qxr4c6lt 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-spbqwyzc-project-304-concurrent-0-qxr4c6lt 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 12 performance improvements and 9 performance regressions! Performance is the same for 38 metrics, 12 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:BytebuddyAgent worse
[+22.593ms; +27.242ms] or [+2.830%; +3.412%]		 823.387ms 798.469ms
scenario:startup:insecure-bank:iast:Debugger better
[-500.190µs; -257.531µs] or [-8.373%; -4.311%]		 5.595ms 5.974ms
scenario:startup:insecure-bank:iast:Remote Config better
[-61.978µs; -31.677µs] or [-10.286%; -5.257%]		 555.720µs 602.548µs
scenario:startup:insecure-bank:iast:Telemetry better
[-472.326µs; -210.058µs] or [-6.021%; -2.678%]		 7.503ms 7.844ms
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:BytebuddyAgent worse
[+23.252ms; +27.921ms] or [+2.908%; +3.492%]		 825.174ms 799.588ms
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Debugger better
[-298.617µs; -162.493µs] or [-5.032%; -2.738%]		 5.703ms 5.934ms
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Remote Config better
[-50.792µs; -16.512µs] or [-8.505%; -2.765%]		 563.572µs 597.225µs
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:BytebuddyAgent worse
[+21.156ms; +26.743ms] or [+2.656%; +3.357%]		 820.605ms 796.656ms
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:AppSec better
[-9.730ms; -8.447ms] or [-17.448%; -15.148%]		 46.676ms 55.765ms
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Debugger better
[-481.093µs; -309.739µs] or [-7.956%; -5.122%]		 5.652ms 6.047ms
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Remote Config better
[-73.431µs; -40.140µs] or [-11.946%; -6.530%]		 557.886µs 614.671µs
scenario:startup:petclinic:appsec:BytebuddyAgent worse
[+14.539ms; +27.969ms] or [+2.078%; +3.998%]		 720.881ms 699.627ms
scenario:startup:petclinic:iast:BytebuddyAgent worse
[+19.105ms; +31.049ms] or [+2.385%; +3.876%]		 826.200ms 801.124ms
scenario:startup:petclinic:iast:Remote Config better
[-71.340µs; -25.775µs] or [-11.698%; -4.226%]		 561.301µs 609.859µs
scenario:startup:petclinic:profiling:ProfilingAgent better
[-8.727ms; -3.039ms] or [-8.044%; -2.801%]		 102.610ms 108.494ms
scenario:startup:petclinic:profiling:BytebuddyAgent worse
[+21.024ms; +24.500ms] or [+3.126%; +3.643%]		 695.273ms 672.510ms
scenario:startup:petclinic:profiling:GlobalTracer better
[-21.389ms; -18.056ms] or [-5.670%; -4.787%]		 357.509ms 377.232ms
scenario:startup:petclinic:profiling:AppSec worse
[+5.114ms; +8.181ms] or [+9.367%; +14.985%]		 61.241ms 54.594ms
scenario:startup:petclinic:profiling:Profiling better
[-8.729ms; -3.038ms] or [-8.044%; -2.799%]		 102.636ms 108.520ms
scenario:startup:petclinic:tracing:BytebuddyAgent worse
[+19.637ms; +39.057ms] or [+2.886%; +5.740%]		 709.770ms 680.423ms
scenario:startup:petclinic:tracing:Remote Config worse
[+34.683µs; +69.299µs] or [+5.138%; +10.267%]		 726.967µs 674.976µs
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~20485c8d4c, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.019 s) : 0, 1019052
Total [baseline] (8.503 s) : 0, 8502994
Agent [candidate] (1.042 s) : 0, 1041921
Total [candidate] (8.537 s) : 0, 8536732
section iast
Agent [baseline] (1.143 s) : 0, 1143219
Total [baseline] (9.13 s) : 0, 9129739
Agent [candidate] (1.168 s) : 0, 1167760
Total [candidate] (9.145 s) : 0, 9144982
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.146 s) : 0, 1145944
Total [baseline] (9.074 s) : 0, 9073741
Agent [candidate] (1.172 s) : 0, 1171578
Total [candidate] (9.148 s) : 0, 9148192
section iast_TELEMETRY_OFF
Agent [baseline] (1.142 s) : 0, 1142331
Total [baseline] (9.189 s) : 0, 9189068
Agent [candidate] (1.165 s) : 0, 1165485
Total [candidate] (9.175 s) : 0, 9175281
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.019 s -
Agent iast 1.143 s 124.166 ms (12.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.146 s 126.892 ms (12.5%)
Agent iast_TELEMETRY_OFF 1.142 s 123.279 ms (12.1%)
Total tracing 8.503 s -
Total iast 9.13 s 626.744 ms (7.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.074 s 570.747 ms (6.7%)
Total iast_TELEMETRY_OFF 9.189 s 686.074 ms (8.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.042 s -
Agent iast 1.168 s 125.839 ms (12.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.172 s 129.657 ms (12.4%)
Agent iast_TELEMETRY_OFF 1.165 s 123.564 ms (11.9%)
Total tracing 8.537 s -
Total iast 9.145 s 608.25 ms (7.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.148 s 611.461 ms (7.2%)
Total iast_TELEMETRY_OFF 9.175 s 638.549 ms (7.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~20485c8d4c, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (683.583 ms) : 0, 683583
BytebuddyAgent [candidate] (704.749 ms) : 0, 704749
GlobalTracer [baseline] (238.223 ms) : 0, 238223
GlobalTracer [candidate] (242.364 ms) : 0, 242364
AppSec [baseline] (54.244 ms) : 0, 54244
AppSec [candidate] (54.313 ms) : 0, 54313
Debugger [baseline] (8.978 ms) : 0, 8978
Debugger [candidate] (6.079 ms) : 0, 6079
Remote Config [baseline] (691.647 µs) : 0, 692
Remote Config [candidate] (737.698 µs) : 0, 738
Telemetry [baseline] (9.804 ms) : 0, 9804
Telemetry [candidate] (10.361 ms) : 0, 10361
section iast
BytebuddyAgent [baseline] (798.469 ms) : 0, 798469
BytebuddyAgent [candidate] (823.387 ms) : 0, 823387
GlobalTracer [baseline] (228.593 ms) : 0, 228593
GlobalTracer [candidate] (230.593 ms) : 0, 230593
IAST [baseline] (29.792 ms) : 0, 29792
IAST [candidate] (29.881 ms) : 0, 29881
AppSec [baseline] (47.809 ms) : 0, 47809
AppSec [candidate] (46.558 ms) : 0, 46558
Debugger [baseline] (5.974 ms) : 0, 5974
Debugger [candidate] (5.595 ms) : 0, 5595
Remote Config [baseline] (602.548 µs) : 0, 603
Remote Config [candidate] (555.72 µs) : 0, 556
Telemetry [baseline] (7.844 ms) : 0, 7844
Telemetry [candidate] (7.503 ms) : 0, 7503
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (799.588 ms) : 0, 799588
BytebuddyAgent [candidate] (825.174 ms) : 0, 825174
GlobalTracer [baseline] (229.424 ms) : 0, 229424
GlobalTracer [candidate] (231.668 ms) : 0, 231668
IAST [baseline] (30.168 ms) : 0, 30168
IAST [candidate] (29.406 ms) : 0, 29406
AppSec [baseline] (48.928 ms) : 0, 48928
AppSec [candidate] (47.603 ms) : 0, 47603
Debugger [baseline] (5.934 ms) : 0, 5934
Debugger [candidate] (5.703 ms) : 0, 5703
Remote Config [baseline] (597.225 µs) : 0, 597
Remote Config [candidate] (563.572 µs) : 0, 564
Telemetry [baseline] (7.844 ms) : 0, 7844
Telemetry [candidate] (7.632 ms) : 0, 7632
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (796.656 ms) : 0, 796656
BytebuddyAgent [candidate] (820.605 ms) : 0, 820605
GlobalTracer [baseline] (229.545 ms) : 0, 229545
GlobalTracer [candidate] (231.147 ms) : 0, 231147
IAST [baseline] (22.432 ms) : 0, 22432
IAST [candidate] (29.57 ms) : 0, 29570
AppSec [baseline] (55.765 ms) : 0, 55765
AppSec [candidate] (46.676 ms) : 0, 46676
Debugger [baseline] (6.047 ms) : 0, 6047
Debugger [candidate] (5.652 ms) : 0, 5652
Remote Config [baseline] (614.671 µs) : 0, 615
Remote Config [candidate] (557.886 µs) : 0, 558
Telemetry [baseline] (7.802 ms) : 0, 7802
Telemetry [candidate] (7.478 ms) : 0, 7478
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~20485c8d4c, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.019 s) : 0, 1018999
Total [baseline] (11.051 s) : 0, 11051075
Agent [candidate] (1.047 s) : 0, 1046586
Total [candidate] (11.141 s) : 0, 11140837
section appsec
Agent [baseline] (1.16 s) : 0, 1159832
Total [baseline] (11.205 s) : 0, 11205052
Agent [candidate] (1.181 s) : 0, 1180744
Total [candidate] (11.201 s) : 0, 11201375
section iast
Agent [baseline] (1.148 s) : 0, 1148319
Total [baseline] (11.237 s) : 0, 11237390
Agent [candidate] (1.174 s) : 0, 1173594
Total [candidate] (11.375 s) : 0, 11375345
section profiling
Agent [baseline] (1.278 s) : 0, 1278018
Total [baseline] (11.332 s) : 0, 11331858
Agent [candidate] (1.281 s) : 0, 1281349
Total [candidate] (11.36 s) : 0, 11360033
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.019 s -
Agent appsec 1.16 s 140.834 ms (13.8%)
Agent iast 1.148 s 129.32 ms (12.7%)
Agent profiling 1.278 s 259.02 ms (25.4%)
Total tracing 11.051 s -
Total appsec 11.205 s 153.977 ms (1.4%)
Total iast 11.237 s 186.315 ms (1.7%)
Total profiling 11.332 s 280.783 ms (2.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.047 s -
Agent appsec 1.181 s 134.158 ms (12.8%)
Agent iast 1.174 s 127.007 ms (12.1%)
Agent profiling 1.281 s 234.762 ms (22.4%)
Total tracing 11.141 s -
Total appsec 11.201 s 60.538 ms (0.5%)
Total iast 11.375 s 234.508 ms (2.1%)
Total profiling 11.36 s 219.196 ms (2.0%) 
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~20485c8d4c, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (680.423 ms) : 0, 680423
BytebuddyAgent [candidate] (709.77 ms) : 0, 709770
GlobalTracer [baseline] (238.835 ms) : 0, 238835
GlobalTracer [candidate] (241.169 ms) : 0, 241169
AppSec [baseline] (54.351 ms) : 0, 54351
AppSec [candidate] (53.589 ms) : 0, 53589
Debugger [baseline] (9.108 ms) : 0, 9108
Debugger [candidate] (6.044 ms) : 0, 6044
Remote Config [baseline] (674.976 µs) : 0, 675
Remote Config [candidate] (726.967 µs) : 0, 727
Telemetry [baseline] (12.121 ms) : 0, 12121
Telemetry [candidate] (11.78 ms) : 0, 11780
section appsec
BytebuddyAgent [baseline] (699.627 ms) : 0, 699627
BytebuddyAgent [candidate] (720.881 ms) : 0, 720881
GlobalTracer [baseline] (236.189 ms) : 0, 236189
GlobalTracer [candidate] (237.994 ms) : 0, 237994
AppSec [baseline] (175.277 ms) : 0, 175277
AppSec [candidate] (172.888 ms) : 0, 172888
Debugger [baseline] (6.296 ms) : 0, 6296
Debugger [candidate] (5.94 ms) : 0, 5940
Remote Config [baseline] (615.85 µs) : 0, 616
Remote Config [candidate] (616.79 µs) : 0, 617
Telemetry [baseline] (7.398 ms) : 0, 7398
Telemetry [candidate] (8.028 ms) : 0, 8028
IAST [baseline] (21.851 ms) : 0, 21851
IAST [candidate] (21.838 ms) : 0, 21838
section iast
BytebuddyAgent [baseline] (801.124 ms) : 0, 801124
BytebuddyAgent [candidate] (826.2 ms) : 0, 826200
GlobalTracer [baseline] (230.857 ms) : 0, 230857
GlobalTracer [candidate] (232.298 ms) : 0, 232298
AppSec [baseline] (47.825 ms) : 0, 47825
AppSec [candidate] (47.137 ms) : 0, 47137
Debugger [baseline] (5.925 ms) : 0, 5925
Debugger [candidate] (5.702 ms) : 0, 5702
Remote Config [baseline] (609.859 µs) : 0, 610
Remote Config [candidate] (561.301 µs) : 0, 561
Telemetry [baseline] (7.832 ms) : 0, 7832
Telemetry [candidate] (7.587 ms) : 0, 7587
IAST [baseline] (29.252 ms) : 0, 29252
IAST [candidate] (29.505 ms) : 0, 29505
section profiling
BytebuddyAgent [baseline] (672.51 ms) : 0, 672510
BytebuddyAgent [candidate] (695.273 ms) : 0, 695273
GlobalTracer [baseline] (377.232 ms) : 0, 377232
GlobalTracer [candidate] (357.509 ms) : 0, 357509
AppSec [baseline] (54.594 ms) : 0, 54594
AppSec [candidate] (61.241 ms) : 0, 61241
Debugger [baseline] (6.105 ms) : 0, 6105
Debugger [candidate] (6.035 ms) : 0, 6035
Remote Config [baseline] (686.924 µs) : 0, 687
Remote Config [candidate] (623.488 µs) : 0, 623
Telemetry [baseline] (7.994 ms) : 0, 7994
Telemetry [candidate] (7.874 ms) : 0, 7874
ProfilingAgent [baseline] (108.494 ms) : 0, 108494
ProfilingAgent [candidate] (102.61 ms) : 0, 102610
Profiling [baseline] (108.52 ms) : 0, 108520
Profiling [candidate] (102.636 ms) : 0, 102636
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-06-04T06:45:08 2025-06-04T06:47:30
git_branch master bbujon/environment
git_commit_date 1746789389 1749018215
git_commit_sha ad6d5fe 20485c8
release_version 1.50.0-SNAPSHOT~ad6d5fef42 1.50.0-SNAPSHOT~20485c8d4c
start_time 2025-06-04T06:42:15 2025-06-04T06:46:44
See matching parameters
Baseline Candidate
application petclinic petclinic
ci_job_date 1749019650 1749019650
ci_job_id 966790637 966790637
ci_pipeline_id 66893095 66893095
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-sukzute8-project-304-concurrent-0-v0q796sa 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-sukzute8-project-304-concurrent-0-v0q796sa 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
thresholds_or_results results results
variant appsec appsec

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 0 metrics, 13 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:no_agent unstable
[+85.308ms; +88.294ms] or [+867.718%; +898.085%]		 worse
[-473.240op/s; -431.674op/s] or [-94.057%; -85.795%]		 96.632ms 50.688op/s 9.831ms 503.145op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~20485c8d4c, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (9.831 ms) : 9790, 9873
.   : milestone, 9831,
appsec (11.936 ms) : 11854, 12018
.   : milestone, 11936,
appsec_no_iast (42.046 ms) : 41525, 42567
.   : milestone, 42046,
code_origins (58.254 ms) : 57499, 59008
.   : milestone, 58254,
iast (50.388 ms) : 49808, 50968
.   : milestone, 50388,
profiling (342.711 µs) : 310, 375
.   : milestone, 343,
tracing (1.026 ms) : 976, 1076
.   : milestone, 1026,
section candidate
no_agent (96.632 ms) : 94671, 98594
.   : milestone, 96632,
appsec (114.192 ms) : 111316, 117068
.   : milestone, 114192,
appsec_no_iast (122.142 ms) : 118448, 125836
.   : milestone, 122142,
code_origins (131.016 ms) : 123845, 138188
.   : milestone, 131016,
iast (127.212 ms) : 122361, 132063
.   : milestone, 127212,
profiling (108.751 ms) : 106187, 111315
.   : milestone, 108751,
tracing (102.449 ms) : 100253, 104645
.   : milestone, 102449,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 9.831 ms [9.79 ms, 9.873 ms] -
appsec 11.936 ms [11.854 ms, 12.018 ms] 2.105 ms (21.4%)
appsec_no_iast 42.046 ms [41.525 ms, 42.567 ms] 32.214 ms (327.7%)
code_origins 58.254 ms [57.499 ms, 59.008 ms] 48.422 ms (492.5%)
iast 50.388 ms [49.808 ms, 50.968 ms] 40.557 ms (412.5%)
profiling 342.711 µs [310.482 µs, 374.941 µs] -9.489 ms (-96.5%)
tracing 1.026 ms [975.918 µs, 1.076 ms] -8.806 ms (-89.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 96.632 ms [94.671 ms, 98.594 ms] -
appsec 114.192 ms [111.316 ms, 117.068 ms] 17.56 ms (18.2%)
appsec_no_iast 122.142 ms [118.448 ms, 125.836 ms] 25.51 ms (26.4%)
code_origins 131.016 ms [123.845 ms, 138.188 ms] 34.384 ms (35.6%)
iast 127.212 ms [122.361 ms, 132.063 ms] 30.579 ms (31.6%)
profiling 108.751 ms [106.187 ms, 111.315 ms] 12.119 ms (12.5%)
tracing 102.449 ms [100.253 ms, 104.645 ms] 5.816 ms (6.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/environment
git_commit_date 1746789389 1749018215
git_commit_sha ad6d5fe 20485c8
release_version 1.50.0-SNAPSHOT~ad6d5fef42 1.50.0-SNAPSHOT~20485c8d4c
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1749020433 1749020433
ci_job_id 966790638 966790638
ci_pipeline_id 66893095 66893095
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-spbqwyzc-project-304-concurrent-1-9d5fn5po 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-spbqwyzc-project-304-concurrent-1-9d5fn5po 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~20485c8d4c, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.893 s) : 14893000, 14893000
.   : milestone, 14893000,
appsec (14.87 s) : 14870000, 14870000
.   : milestone, 14870000,
iast (18.495 s) : 18495000, 18495000
.   : milestone, 18495000,
iast_GLOBAL (17.876 s) : 17876000, 17876000
.   : milestone, 17876000,
profiling (15.643 s) : 15643000, 15643000
.   : milestone, 15643000,
tracing (15.108 s) : 15108000, 15108000
.   : milestone, 15108000,
section candidate
no_agent (15.638 s) : 15638000, 15638000
.   : milestone, 15638000,
appsec (14.843 s) : 14843000, 14843000
.   : milestone, 14843000,
iast (19.21 s) : 19210000, 19210000
.   : milestone, 19210000,
iast_GLOBAL (17.906 s) : 17906000, 17906000
.   : milestone, 17906000,
profiling (15.904 s) : 15904000, 15904000
.   : milestone, 15904000,
tracing (14.629 s) : 14629000, 14629000
.   : milestone, 14629000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.893 s [14.893 s, 14.893 s] -
appsec 14.87 s [14.87 s, 14.87 s] -23.0 ms (-0.2%)
iast 18.495 s [18.495 s, 18.495 s] 3.602 s (24.2%)
iast_GLOBAL 17.876 s [17.876 s, 17.876 s] 2.983 s (20.0%)
profiling 15.643 s [15.643 s, 15.643 s] 750.0 ms (5.0%)
tracing 15.108 s [15.108 s, 15.108 s] 215.0 ms (1.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.638 s [15.638 s, 15.638 s] -
appsec 14.843 s [14.843 s, 14.843 s] -795.0 ms (-5.1%)
iast 19.21 s [19.21 s, 19.21 s] 3.572 s (22.8%)
iast_GLOBAL 17.906 s [17.906 s, 17.906 s] 2.268 s (14.5%)
profiling 15.904 s [15.904 s, 15.904 s] 266.0 ms (1.7%)
tracing 14.629 s [14.629 s, 14.629 s] -1.009 s (-6.5%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~20485c8d4c, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.483 ms) : 1471, 1494
.   : milestone, 1483,
appsec (2.406 ms) : 2358, 2454
.   : milestone, 2406,
iast (2.187 ms) : 2127, 2248
.   : milestone, 2187,
iast_GLOBAL (2.238 ms) : 2177, 2299
.   : milestone, 2238,
profiling (2.035 ms) : 1986, 2084
.   : milestone, 2035,
tracing (2.021 ms) : 1973, 2068
.   : milestone, 2021,
section candidate
no_agent (1.48 ms) : 1469, 1492
.   : milestone, 1480,
appsec (2.426 ms) : 2377, 2475
.   : milestone, 2426,
iast (2.209 ms) : 2148, 2270
.   : milestone, 2209,
iast_GLOBAL (2.245 ms) : 2183, 2307
.   : milestone, 2245,
profiling (2.045 ms) : 1995, 2095
.   : milestone, 2045,
tracing (2.006 ms) : 1958, 2053
.   : milestone, 2006,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.471 ms, 1.494 ms] -
appsec 2.406 ms [2.358 ms, 2.454 ms] 923.286 µs (62.3%)
iast 2.187 ms [2.127 ms, 2.248 ms] 704.933 µs (47.5%)
iast_GLOBAL 2.238 ms [2.177 ms, 2.299 ms] 755.532 µs (51.0%)
profiling 2.035 ms [1.986 ms, 2.084 ms] 552.49 µs (37.3%)
tracing 2.021 ms [1.973 ms, 2.068 ms] 538.271 µs (36.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.48 ms [1.469 ms, 1.492 ms] -
appsec 2.426 ms [2.377 ms, 2.475 ms] 945.286 µs (63.9%)
iast 2.209 ms [2.148 ms, 2.27 ms] 728.68 µs (49.2%)
iast_GLOBAL 2.245 ms [2.183 ms, 2.307 ms] 764.294 µs (51.6%)
profiling 2.045 ms [1.995 ms, 2.095 ms] 564.781 µs (38.1%)
tracing 2.006 ms [1.958 ms, 2.053 ms] 525.218 µs (35.5%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
tag: do not merge Do not merge changes
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@PerfectSlayer