Skip to content

Reduces Maven smoke test timeout for better feedback on failures #9142

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

daniel-mohedano
Copy link
Contributor

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@daniel-mohedano daniel-mohedano added tag: do not merge Do not merge changes tag: no release notes Changes to exclude from release notes comp: ci visibility Continuous Integration Visibility labels Jul 10, 2025
@pr-commenter
Copy link

pr-commenter bot commented Jul 10, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/maven-smoke-feedback
git_commit_date 1752667115 1752677766
git_commit_sha 2fe6aa2 e633223
release_version 1.52.0-SNAPSHOT~2fe6aa2d23 1.52.0-SNAPSHOT~e633223c5f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1752680245 1752680245
ci_job_id 1031780469 1031780469
ci_pipeline_id 70731484 70731484
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-gftemsqo 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-gftemsqo 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 10 performance improvements and 3 performance regressions! Performance is the same for 26 metrics, 14 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent.start better
[-64.757ms; -31.808ms] or [-5.479%; -2.691%]
1.134s 1.182s
scenario:startup:insecure-bank:iast:BytebuddyAgent better
[-58.993ms; -33.453ms] or [-6.906%; -3.916%]
808.031ms 854.254ms
scenario:startup:insecure-bank:tracing:Agent.start better
[-55.704ms; -42.478ms] or [-5.331%; -4.065%]
0.996s 1.045s
scenario:startup:insecure-bank:tracing:BytebuddyAgent better
[-53.856ms; -41.348ms] or [-7.330%; -5.627%]
687.164ms 734.766ms
scenario:startup:petclinic:appsec:BytebuddyAgent better
[-45.586ms; -23.966ms] or [-6.066%; -3.189%]
716.756ms 751.532ms
scenario:startup:petclinic:iast:Agent.start better
[-55.186ms; -39.695ms] or [-4.685%; -3.370%]
1.131s 1.178s
scenario:startup:petclinic:iast:BytebuddyAgent better
[-48.882ms; -39.801ms] or [-5.750%; -4.682%]
805.821ms 850.162ms
scenario:startup:petclinic:profiling:Agent.start worse
[+56.246ms; +66.939ms] or [+4.753%; +5.656%]
1.245s 1.183s
scenario:startup:petclinic:profiling:BytebuddyAgent better
[-84.575ms; -78.648ms] or [-11.132%; -10.352%]
678.155ms 759.766ms
scenario:startup:petclinic:profiling:GlobalTracer worse
[+139.561ms; +142.819ms] or [+63.332%; +64.811%]
361.553ms 220.363ms
scenario:startup:petclinic:tracing:Agent.start better
[-49.811ms; -37.595ms] or [-4.792%; -3.617%]
0.996s 1.040s
scenario:startup:petclinic:tracing:BytebuddyAgent better
[-43.897ms; -38.584ms] or [-6.024%; -5.295%]
687.501ms 728.741ms
scenario:startup:petclinic:tracing:Remote Config worse
[+13.654µs; +54.826µs] or [+2.115%; +8.493%]
679.755µs 645.515µs
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.52.0-SNAPSHOT~e633223c5f, baseline=1.52.0-SNAPSHOT~2fe6aa2d23

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.04 s) : 0, 1039549
Total [baseline] (10.716 s) : 0, 10716303
Agent [candidate] (995.846 ms) : 0, 995846
Total [candidate] (10.617 s) : 0, 10617106
section appsec
Agent [baseline] (1.218 s) : 0, 1217821
Total [baseline] (10.737 s) : 0, 10736924
Agent [candidate] (1.184 s) : 0, 1183994
Total [candidate] (10.843 s) : 0, 10842954
section iast
Agent [baseline] (1.178 s) : 0, 1178040
Total [baseline] (10.975 s) : 0, 10974730
Agent [candidate] (1.131 s) : 0, 1130600
Total [candidate] (10.807 s) : 0, 10807442
section profiling
Agent [baseline] (1.183 s) : 0, 1183425
Total [baseline] (10.821 s) : 0, 10821429
Agent [candidate] (1.245 s) : 0, 1245018
Total [candidate] (10.948 s) : 0, 10947855
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.04 s -
Agent appsec 1.218 s 178.272 ms (17.1%)
Agent iast 1.178 s 138.491 ms (13.3%)
Agent profiling 1.183 s 143.877 ms (13.8%)
Total tracing 10.716 s -
Total appsec 10.737 s 20.622 ms (0.2%)
Total iast 10.975 s 258.428 ms (2.4%)
Total profiling 10.821 s 105.126 ms (1.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 995.846 ms -
Agent appsec 1.184 s 188.149 ms (18.9%)
Agent iast 1.131 s 134.754 ms (13.5%)
Agent profiling 1.245 s 249.172 ms (25.0%)
Total tracing 10.617 s -
Total appsec 10.843 s 225.848 ms (2.1%)
Total iast 10.807 s 190.336 ms (1.8%)
Total profiling 10.948 s 330.749 ms (3.1%)
gantt
    title petclinic - break down per module: candidate=1.52.0-SNAPSHOT~e633223c5f, baseline=1.52.0-SNAPSHOT~2fe6aa2d23

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (728.741 ms) : 0, 728741
BytebuddyAgent [candidate] (687.501 ms) : 0, 687501
GlobalTracer [baseline] (242.157 ms) : 0, 242157
GlobalTracer [candidate] (242.3 ms) : 0, 242300
AppSec [baseline] (30.589 ms) : 0, 30589
AppSec [candidate] (30.298 ms) : 0, 30298
Debugger [baseline] (6.058 ms) : 0, 6058
Debugger [candidate] (5.972 ms) : 0, 5972
Remote Config [baseline] (645.515 µs) : 0, 646
Remote Config [candidate] (679.755 µs) : 0, 680
Telemetry [baseline] (9.002 ms) : 0, 9002
Telemetry [candidate] (8.184 ms) : 0, 8184
crashtracking [baseline] (1.436 ms) : 0, 1436
section appsec
BytebuddyAgent [baseline] (751.532 ms) : 0, 751532
BytebuddyAgent [candidate] (716.756 ms) : 0, 716756
GlobalTracer [baseline] (234.6 ms) : 0, 234600
GlobalTracer [candidate] (236.745 ms) : 0, 236745
IAST [baseline] (23.579 ms) : 0, 23579
IAST [candidate] (23.527 ms) : 0, 23527
AppSec [baseline] (167.224 ms) : 0, 167224
AppSec [candidate] (171.644 ms) : 0, 171644
Debugger [baseline] (8.71 ms) : 0, 8710
Debugger [candidate] (5.691 ms) : 0, 5691
Remote Config [baseline] (604.603 µs) : 0, 605
Remote Config [candidate] (601.141 µs) : 0, 601
Telemetry [baseline] (8.825 ms) : 0, 8825
Telemetry [candidate] (8.092 ms) : 0, 8092
crashtracking [baseline] (1.431 ms) : 0, 1431
section iast
BytebuddyAgent [baseline] (850.162 ms) : 0, 850162
BytebuddyAgent [candidate] (805.821 ms) : 0, 805821
GlobalTracer [baseline] (232.801 ms) : 0, 232801
GlobalTracer [candidate] (232.191 ms) : 0, 232191
IAST [baseline] (28.482 ms) : 0, 28482
IAST [candidate] (27.104 ms) : 0, 27104
AppSec [baseline] (28.118 ms) : 0, 28118
AppSec [candidate] (29.784 ms) : 0, 29784
Debugger [baseline] (7.387 ms) : 0, 7387
Debugger [candidate] (6.519 ms) : 0, 6519
Remote Config [baseline] (599.503 µs) : 0, 600
Remote Config [candidate] (579.019 µs) : 0, 579
Telemetry [baseline] (7.994 ms) : 0, 7994
Telemetry [candidate] (7.864 ms) : 0, 7864
crashtracking [baseline] (1.445 ms) : 0, 1445
section profiling
BytebuddyAgent [baseline] (759.766 ms) : 0, 759766
BytebuddyAgent [candidate] (678.155 ms) : 0, 678155
GlobalTracer [baseline] (220.363 ms) : 0, 220363
GlobalTracer [candidate] (361.553 ms) : 0, 361553
AppSec [baseline] (30.319 ms) : 0, 30319
AppSec [candidate] (32.359 ms) : 0, 32359
Debugger [baseline] (6.268 ms) : 0, 6268
Debugger [candidate] (9.706 ms) : 0, 9706
Remote Config [baseline] (676.789 µs) : 0, 677
Remote Config [candidate] (674.22 µs) : 0, 674
Telemetry [baseline] (13.767 ms) : 0, 13767
Telemetry [candidate] (8.798 ms) : 0, 8798
crashtracking [baseline] (1.413 ms) : 0, 1413
ProfilingAgent [baseline] (102.48 ms) : 0, 102480
ProfilingAgent [candidate] (104.444 ms) : 0, 104444
Profiling [baseline] (102.503 ms) : 0, 102503
Profiling [candidate] (104.468 ms) : 0, 104468
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.52.0-SNAPSHOT~e633223c5f, baseline=1.52.0-SNAPSHOT~2fe6aa2d23

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.045 s) : 0, 1044928
Total [baseline] (8.647 s) : 0, 8647311
Agent [candidate] (995.837 ms) : 0, 995837
Total [candidate] (8.583 s) : 0, 8582944
section iast
Agent [baseline] (1.182 s) : 0, 1181912
Total [baseline] (9.306 s) : 0, 9305741
Agent [candidate] (1.134 s) : 0, 1133629
Total [candidate] (9.277 s) : 0, 9276878
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.045 s -
Agent iast 1.182 s 136.983 ms (13.1%)
Total tracing 8.647 s -
Total iast 9.306 s 658.43 ms (7.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 995.837 ms -
Agent iast 1.134 s 137.792 ms (13.8%)
Total tracing 8.583 s -
Total iast 9.277 s 693.934 ms (8.1%)
gantt
    title insecure-bank - break down per module: candidate=1.52.0-SNAPSHOT~e633223c5f, baseline=1.52.0-SNAPSHOT~2fe6aa2d23

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (734.766 ms) : 0, 734766
BytebuddyAgent [candidate] (687.164 ms) : 0, 687164
GlobalTracer [baseline] (241.673 ms) : 0, 241673
GlobalTracer [candidate] (242.676 ms) : 0, 242676
AppSec [baseline] (30.528 ms) : 0, 30528
AppSec [candidate] (30.26 ms) : 0, 30260
Debugger [baseline] (6.02 ms) : 0, 6020
Debugger [candidate] (5.94 ms) : 0, 5940
Remote Config [baseline] (650.236 µs) : 0, 650
Remote Config [candidate] (673.607 µs) : 0, 674
Telemetry [baseline] (8.981 ms) : 0, 8981
Telemetry [candidate] (8.248 ms) : 0, 8248
crashtracking [baseline] (1.433 ms) : 0, 1433
section iast
BytebuddyAgent [baseline] (854.254 ms) : 0, 854254
BytebuddyAgent [candidate] (808.031 ms) : 0, 808031
GlobalTracer [baseline] (232.662 ms) : 0, 232662
GlobalTracer [candidate] (232.719 ms) : 0, 232719
AppSec [baseline] (27.377 ms) : 0, 27377
AppSec [candidate] (29.022 ms) : 0, 29022
Debugger [baseline] (6.652 ms) : 0, 6652
Debugger [candidate] (5.776 ms) : 0, 5776
Remote Config [baseline] (593.488 µs) : 0, 593
Remote Config [candidate] (590.247 µs) : 0, 590
Telemetry [baseline] (7.984 ms) : 0, 7984
Telemetry [candidate] (7.994 ms) : 0, 7994
crashtracking [baseline] (1.45 ms) : 0, 1450
IAST [baseline] (30.084 ms) : 0, 30084
IAST [candidate] (28.825 ms) : 0, 28825
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/maven-smoke-feedback
git_commit_date 1752667115 1752677766
git_commit_sha 2fe6aa2 e633223
release_version 1.52.0-SNAPSHOT~2fe6aa2d23 1.52.0-SNAPSHOT~e633223c5f
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1752680000 1752680000
ci_job_id 1031780470 1031780470
ci_pipeline_id 70731484 70731484
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-6lr2mdey 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-6lr2mdey 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:no_agent:high_load better
[-1.784ms; -1.144ms] or [-4.662%; -2.990%]
unstable
[-3.957op/s; +13.607op/s] or [-3.237%; +11.133%]
36.803ms 127.037op/s 38.267ms 122.213op/s
scenario:load:petclinic:tracing:high_load worse
[+1.032ms; +1.855ms] or [+2.333%; +4.192%]
unstable
[-10.930op/s; +4.305op/s] or [-10.338%; +4.072%]
45.699ms 102.412op/s 44.255ms 105.725op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~e633223c5f, baseline=1.52.0-SNAPSHOT~2fe6aa2d23
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.436 ms) : 4386, 4486
.   : milestone, 4436,
iast (9.526 ms) : 9367, 9685
.   : milestone, 9526,
iast_FULL (14.399 ms) : 14111, 14687
.   : milestone, 14399,
iast_GLOBAL (10.075 ms) : 9900, 10251
.   : milestone, 10075,
profiling (8.862 ms) : 8719, 9006
.   : milestone, 8862,
tracing (7.68 ms) : 7558, 7802
.   : milestone, 7680,
section candidate
no_agent (4.299 ms) : 4247, 4351
.   : milestone, 4299,
iast (9.4 ms) : 9243, 9557
.   : milestone, 9400,
iast_FULL (14.183 ms) : 13897, 14469
.   : milestone, 14183,
iast_GLOBAL (10.293 ms) : 10115, 10471
.   : milestone, 10293,
profiling (8.64 ms) : 8501, 8779
.   : milestone, 8640,
tracing (7.58 ms) : 7475, 7685
.   : milestone, 7580,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.436 ms [4.386 ms, 4.486 ms] -
iast 9.526 ms [9.367 ms, 9.685 ms] 5.09 ms (114.7%)
iast_FULL 14.399 ms [14.111 ms, 14.687 ms] 9.963 ms (224.6%)
iast_GLOBAL 10.075 ms [9.9 ms, 10.251 ms] 5.639 ms (127.1%)
profiling 8.862 ms [8.719 ms, 9.006 ms] 4.426 ms (99.8%)
tracing 7.68 ms [7.558 ms, 7.802 ms] 3.244 ms (73.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.299 ms [4.247 ms, 4.351 ms] -
iast 9.4 ms [9.243 ms, 9.557 ms] 5.101 ms (118.6%)
iast_FULL 14.183 ms [13.897 ms, 14.469 ms] 9.884 ms (229.9%)
iast_GLOBAL 10.293 ms [10.115 ms, 10.471 ms] 5.994 ms (139.4%)
profiling 8.64 ms [8.501 ms, 8.779 ms] 4.341 ms (101.0%)
tracing 7.58 ms [7.475 ms, 7.685 ms] 3.281 ms (76.3%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~e633223c5f, baseline=1.52.0-SNAPSHOT~2fe6aa2d23
    dateFormat X
    axisFormat %s
section baseline
no_agent (38.267 ms) : 37960, 38574
.   : milestone, 38267,
appsec (46.897 ms) : 46482, 47311
.   : milestone, 46897,
code_origins (45.776 ms) : 45380, 46172
.   : milestone, 45776,
iast (44.951 ms) : 44553, 45349
.   : milestone, 44951,
profiling (49.255 ms) : 48706, 49803
.   : milestone, 49255,
tracing (44.255 ms) : 43862, 44648
.   : milestone, 44255,
section candidate
no_agent (36.803 ms) : 36516, 37090
.   : milestone, 36803,
appsec (47.321 ms) : 46914, 47728
.   : milestone, 47321,
code_origins (44.867 ms) : 44489, 45245
.   : milestone, 44867,
iast (43.697 ms) : 43313, 44081
.   : milestone, 43697,
profiling (48.455 ms) : 47989, 48921
.   : milestone, 48455,
tracing (45.699 ms) : 45327, 46070
.   : milestone, 45699,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 38.267 ms [37.96 ms, 38.574 ms] -
appsec 46.897 ms [46.482 ms, 47.311 ms] 8.63 ms (22.6%)
code_origins 45.776 ms [45.38 ms, 46.172 ms] 7.509 ms (19.6%)
iast 44.951 ms [44.553 ms, 45.349 ms] 6.684 ms (17.5%)
profiling 49.255 ms [48.706 ms, 49.803 ms] 10.988 ms (28.7%)
tracing 44.255 ms [43.862 ms, 44.648 ms] 5.988 ms (15.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.803 ms [36.516 ms, 37.09 ms] -
appsec 47.321 ms [46.914 ms, 47.728 ms] 10.518 ms (28.6%)
code_origins 44.867 ms [44.489 ms, 45.245 ms] 8.064 ms (21.9%)
iast 43.697 ms [43.313 ms, 44.081 ms] 6.894 ms (18.7%)
profiling 48.455 ms [47.989 ms, 48.921 ms] 11.652 ms (31.7%)
tracing 45.699 ms [45.327 ms, 46.07 ms] 8.895 ms (24.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/maven-smoke-feedback
git_commit_date 1752667115 1752677766
git_commit_sha 2fe6aa2 e633223
release_version 1.52.0-SNAPSHOT~2fe6aa2d23 1.52.0-SNAPSHOT~e633223c5f
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1752680498 1752680498
ci_job_id 1031780471 1031780471
ci_pipeline_id 70731484 70731484
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-un7ec5tm 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-un7ec5tm 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.332ms; -1.000ms] or [-37.251%; -27.989%]
2.408ms 3.575ms
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~e633223c5f, baseline=1.52.0-SNAPSHOT~2fe6aa2d23
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.473 ms) : 1462, 1485
.   : milestone, 1473,
appsec (3.575 ms) : 3363, 3786
.   : milestone, 3575,
iast (2.197 ms) : 2134, 2260
.   : milestone, 2197,
iast_GLOBAL (2.225 ms) : 2163, 2288
.   : milestone, 2225,
profiling (2.038 ms) : 1988, 2087
.   : milestone, 2038,
tracing (2.006 ms) : 1957, 2054
.   : milestone, 2006,
section candidate
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (2.408 ms) : 2359, 2458
.   : milestone, 2408,
iast (2.193 ms) : 2131, 2255
.   : milestone, 2193,
iast_GLOBAL (2.227 ms) : 2165, 2289
.   : milestone, 2227,
profiling (2.036 ms) : 1985, 2086
.   : milestone, 2036,
tracing (2.003 ms) : 1955, 2051
.   : milestone, 2003,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.462 ms, 1.485 ms] -
appsec 3.575 ms [3.363 ms, 3.786 ms] 2.101 ms (142.6%)
iast 2.197 ms [2.134 ms, 2.26 ms] 723.586 µs (49.1%)
iast_GLOBAL 2.225 ms [2.163 ms, 2.288 ms] 752.105 µs (51.0%)
profiling 2.038 ms [1.988 ms, 2.087 ms] 564.311 µs (38.3%)
tracing 2.006 ms [1.957 ms, 2.054 ms] 532.348 µs (36.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.484 ms] -
appsec 2.408 ms [2.359 ms, 2.458 ms] 936.16 µs (63.6%)
iast 2.193 ms [2.131 ms, 2.255 ms] 720.62 µs (48.9%)
iast_GLOBAL 2.227 ms [2.165 ms, 2.289 ms] 754.621 µs (51.3%)
profiling 2.036 ms [1.985 ms, 2.086 ms] 563.33 µs (38.3%)
tracing 2.003 ms [1.955 ms, 2.051 ms] 530.796 µs (36.1%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~e633223c5f, baseline=1.52.0-SNAPSHOT~2fe6aa2d23
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.054 s) : 15054000, 15054000
.   : milestone, 15054000,
appsec (14.945 s) : 14945000, 14945000
.   : milestone, 14945000,
iast (18.19 s) : 18190000, 18190000
.   : milestone, 18190000,
iast_GLOBAL (18.172 s) : 18172000, 18172000
.   : milestone, 18172000,
profiling (15.473 s) : 15473000, 15473000
.   : milestone, 15473000,
tracing (14.999 s) : 14999000, 14999000
.   : milestone, 14999000,
section candidate
no_agent (15.57 s) : 15570000, 15570000
.   : milestone, 15570000,
appsec (14.888 s) : 14888000, 14888000
.   : milestone, 14888000,
iast (18.358 s) : 18358000, 18358000
.   : milestone, 18358000,
iast_GLOBAL (17.956 s) : 17956000, 17956000
.   : milestone, 17956000,
profiling (15.415 s) : 15415000, 15415000
.   : milestone, 15415000,
tracing (14.626 s) : 14626000, 14626000
.   : milestone, 14626000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.054 s [15.054 s, 15.054 s] -
appsec 14.945 s [14.945 s, 14.945 s] -109.0 ms (-0.7%)
iast 18.19 s [18.19 s, 18.19 s] 3.136 s (20.8%)
iast_GLOBAL 18.172 s [18.172 s, 18.172 s] 3.118 s (20.7%)
profiling 15.473 s [15.473 s, 15.473 s] 419.0 ms (2.8%)
tracing 14.999 s [14.999 s, 14.999 s] -55.0 ms (-0.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.57 s [15.57 s, 15.57 s] -
appsec 14.888 s [14.888 s, 14.888 s] -682.0 ms (-4.4%)
iast 18.358 s [18.358 s, 18.358 s] 2.788 s (17.9%)
iast_GLOBAL 17.956 s [17.956 s, 17.956 s] 2.386 s (15.3%)
profiling 15.415 s [15.415 s, 15.415 s] -155.0 ms (-1.0%)
tracing 14.626 s [14.626 s, 14.626 s] -944.0 ms (-6.1%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp: ci visibility Continuous Integration Visibility tag: do not merge Do not merge changes tag: no release notes Changes to exclude from release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant