Skip to content

Adding Config Inversion Telemetry component #9244

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

mhlidd
Copy link
Contributor

@mhlidd mhlidd commented Jul 24, 2025

What Does This Do

As part of Config Inversion, we want to emit Telemetry metrics for all environment variables set that are DD related but not documented in the supported-configurations.json file. This PR introduces the Telemetry metrics component for Config Inversion. Given that the ConfigHelper and supported-configurations.json file do not exist yet, testing is done with a lightweight "Mock" helper that has a list of "supported configurations", and emits a telemetry metric if an environment variable is passed in that is not "supported".

Motivation

Config Inversion RFC

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@pr-commenter
Copy link

pr-commenter bot commented Jul 24, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/config_inversion_telemetry
git_commit_date 1753480309 1753495238
git_commit_sha ae34f27 0231151
release_version 1.51.1-SNAPSHOT~ae34f27d9d 1.51.1-SNAPSHOT~02311518d7
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1753497164 1753497164
ci_job_id 1049179855 1049179855
ci_pipeline_id 71800489 71800489
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-mcdqk4i2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-mcdqk4i2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 49 metrics, 10 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.51.1-SNAPSHOT~02311518d7, baseline=1.51.1-SNAPSHOT~ae34f27d9d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.042 s) : 0, 1041793
Total [baseline] (8.573 s) : 0, 8573458
Agent [candidate] (1.043 s) : 0, 1042848
Total [candidate] (8.546 s) : 0, 8546296
section iast
Agent [baseline] (1.169 s) : 0, 1169107
Total [baseline] (9.332 s) : 0, 9332206
Agent [candidate] (1.173 s) : 0, 1173389
Total [candidate] (9.226 s) : 0, 9225607
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.042 s -
Agent iast 1.169 s 127.314 ms (12.2%)
Total tracing 8.573 s -
Total iast 9.332 s 758.748 ms (8.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.043 s -
Agent iast 1.173 s 130.541 ms (12.5%)
Total tracing 8.546 s -
Total iast 9.226 s 679.31 ms (7.9%)
gantt
    title insecure-bank - break down per module: candidate=1.51.1-SNAPSHOT~02311518d7, baseline=1.51.1-SNAPSHOT~ae34f27d9d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.425 ms) : 0, 1425
crashtracking [candidate] (1.414 ms) : 0, 1414
BytebuddyAgent [baseline] (729.467 ms) : 0, 729467
BytebuddyAgent [candidate] (729.484 ms) : 0, 729484
GlobalTracer [baseline] (241.099 ms) : 0, 241099
GlobalTracer [candidate] (241.297 ms) : 0, 241297
AppSec [baseline] (30.362 ms) : 0, 30362
AppSec [candidate] (30.419 ms) : 0, 30419
Debugger [baseline] (6.06 ms) : 0, 6060
Debugger [candidate] (6.036 ms) : 0, 6036
Remote Config [baseline] (653.435 µs) : 0, 653
Remote Config [candidate] (650.809 µs) : 0, 651
Telemetry [baseline] (11.846 ms) : 0, 11846
Telemetry [candidate] (12.689 ms) : 0, 12689
section iast
crashtracking [baseline] (1.415 ms) : 0, 1415
crashtracking [candidate] (1.418 ms) : 0, 1418
BytebuddyAgent [baseline] (844.366 ms) : 0, 844366
BytebuddyAgent [candidate] (846.932 ms) : 0, 846932
GlobalTracer [baseline] (230.485 ms) : 0, 230485
GlobalTracer [candidate] (231.58 ms) : 0, 231580
IAST [baseline] (28.086 ms) : 0, 28086
IAST [candidate] (29.959 ms) : 0, 29959
AppSec [baseline] (29.563 ms) : 0, 29563
AppSec [candidate] (27.068 ms) : 0, 27068
Debugger [baseline] (5.804 ms) : 0, 5804
Debugger [candidate] (6.689 ms) : 0, 6689
Remote Config [baseline] (586.647 µs) : 0, 587
Remote Config [candidate] (602.107 µs) : 0, 602
Telemetry [baseline] (8.026 ms) : 0, 8026
Telemetry [candidate] (8.224 ms) : 0, 8224
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.51.1-SNAPSHOT~02311518d7, baseline=1.51.1-SNAPSHOT~ae34f27d9d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.047 s) : 0, 1047465
Total [baseline] (10.67 s) : 0, 10670078
Agent [candidate] (1.041 s) : 0, 1040552
Total [candidate] (10.633 s) : 0, 10632944
section appsec
Agent [baseline] (1.214 s) : 0, 1214188
Total [baseline] (10.724 s) : 0, 10724374
Agent [candidate] (1.217 s) : 0, 1216544
Total [candidate] (10.725 s) : 0, 10725057
section iast
Agent [baseline] (1.167 s) : 0, 1166918
Total [baseline] (10.884 s) : 0, 10884374
Agent [candidate] (1.172 s) : 0, 1172126
Total [candidate] (10.865 s) : 0, 10865028
section profiling
Agent [baseline] (1.189 s) : 0, 1189103
Total [baseline] (10.807 s) : 0, 10807404
Agent [candidate] (1.191 s) : 0, 1191484
Total [candidate] (10.831 s) : 0, 10830788
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.047 s -
Agent appsec 1.214 s 166.723 ms (15.9%)
Agent iast 1.167 s 119.453 ms (11.4%)
Agent profiling 1.189 s 141.638 ms (13.5%)
Total tracing 10.67 s -
Total appsec 10.724 s 54.295 ms (0.5%)
Total iast 10.884 s 214.296 ms (2.0%)
Total profiling 10.807 s 137.326 ms (1.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.041 s -
Agent appsec 1.217 s 175.993 ms (16.9%)
Agent iast 1.172 s 131.575 ms (12.6%)
Agent profiling 1.191 s 150.932 ms (14.5%)
Total tracing 10.633 s -
Total appsec 10.725 s 92.112 ms (0.9%)
Total iast 10.865 s 232.084 ms (2.2%)
Total profiling 10.831 s 197.844 ms (1.9%)
gantt
    title petclinic - break down per module: candidate=1.51.1-SNAPSHOT~02311518d7, baseline=1.51.1-SNAPSHOT~ae34f27d9d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.433 ms) : 0, 1433
crashtracking [candidate] (1.431 ms) : 0, 1431
BytebuddyAgent [baseline] (732.855 ms) : 0, 732855
BytebuddyAgent [candidate] (728.197 ms) : 0, 728197
GlobalTracer [baseline] (242.031 ms) : 0, 242031
GlobalTracer [candidate] (240.877 ms) : 0, 240877
AppSec [baseline] (30.657 ms) : 0, 30657
AppSec [candidate] (30.372 ms) : 0, 30372
Debugger [baseline] (6.088 ms) : 0, 6088
Debugger [candidate] (6.049 ms) : 0, 6049
Remote Config [baseline] (661.539 µs) : 0, 662
Remote Config [candidate] (644.039 µs) : 0, 644
Telemetry [baseline] (12.676 ms) : 0, 12676
Telemetry [candidate] (12.014 ms) : 0, 12014
section appsec
crashtracking [baseline] (1.415 ms) : 0, 1415
crashtracking [candidate] (1.434 ms) : 0, 1434
BytebuddyAgent [baseline] (748.958 ms) : 0, 748958
BytebuddyAgent [candidate] (750.439 ms) : 0, 750439
GlobalTracer [baseline] (233.78 ms) : 0, 233780
GlobalTracer [candidate] (234.378 ms) : 0, 234378
IAST [baseline] (23.413 ms) : 0, 23413
IAST [candidate] (23.558 ms) : 0, 23558
AppSec [baseline] (168.006 ms) : 0, 168006
AppSec [candidate] (167.78 ms) : 0, 167780
Debugger [baseline] (8.615 ms) : 0, 8615
Debugger [candidate] (8.725 ms) : 0, 8725
Remote Config [baseline] (600.532 µs) : 0, 601
Remote Config [candidate] (621.188 µs) : 0, 621
Telemetry [baseline] (8.214 ms) : 0, 8214
Telemetry [candidate] (8.333 ms) : 0, 8333
section iast
crashtracking [baseline] (1.417 ms) : 0, 1417
crashtracking [candidate] (1.424 ms) : 0, 1424
BytebuddyAgent [baseline] (842.194 ms) : 0, 842194
BytebuddyAgent [candidate] (846.256 ms) : 0, 846256
GlobalTracer [baseline] (231.044 ms) : 0, 231044
GlobalTracer [candidate] (230.836 ms) : 0, 230836
IAST [baseline] (28.963 ms) : 0, 28963
IAST [candidate] (27.476 ms) : 0, 27476
AppSec [baseline] (27.984 ms) : 0, 27984
AppSec [candidate] (29.685 ms) : 0, 29685
Debugger [baseline] (5.744 ms) : 0, 5744
Debugger [candidate] (6.648 ms) : 0, 6648
Remote Config [baseline] (595.633 µs) : 0, 596
Remote Config [candidate] (595.497 µs) : 0, 595
Telemetry [baseline] (8.123 ms) : 0, 8123
Telemetry [candidate] (8.266 ms) : 0, 8266
section profiling
crashtracking [baseline] (1.399 ms) : 0, 1399
crashtracking [candidate] (1.4 ms) : 0, 1400
BytebuddyAgent [baseline] (758.812 ms) : 0, 758812
BytebuddyAgent [candidate] (761.234 ms) : 0, 761234
GlobalTracer [baseline] (219.696 ms) : 0, 219696
GlobalTracer [candidate] (219.569 ms) : 0, 219569
AppSec [baseline] (30.205 ms) : 0, 30205
AppSec [candidate] (30.064 ms) : 0, 30064
Debugger [baseline] (6.266 ms) : 0, 6266
Debugger [candidate] (6.248 ms) : 0, 6248
Remote Config [baseline] (687.233 µs) : 0, 687
Remote Config [candidate] (675.067 µs) : 0, 675
Telemetry [baseline] (15.958 ms) : 0, 15958
Telemetry [candidate] (15.96 ms) : 0, 15960
ProfilingAgent [baseline] (107.142 ms) : 0, 107142
ProfilingAgent [candidate] (107.142 ms) : 0, 107142
Profiling [baseline] (107.759 ms) : 0, 107759
Profiling [candidate] (107.787 ms) : 0, 107787
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/config_inversion_telemetry
git_commit_date 1753480309 1753495238
git_commit_sha ae34f27 0231151
release_version 1.51.1-SNAPSHOT~ae34f27d9d 1.51.1-SNAPSHOT~02311518d7
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1753496843 1753496843
ci_job_id 1049179856 1049179856
ci_pipeline_id 71800489 71800489
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-opytxzb1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-opytxzb1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 5 performance improvements and 0 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:tracing:high_load better
[-504.983µs; -272.052µs] or [-6.368%; -3.431%]
unstable
[-42.783op/s; +101.845op/s] or [-7.323%; +17.432%]
7.542ms 613.781op/s 7.930ms 584.250op/s
scenario:load:insecure-bank:profiling:high_load better
[-732.576µs; -424.831µs] or [-7.766%; -4.503%]
unstable
[-33.708op/s; +96.708op/s] or [-6.847%; +19.645%]
8.855ms 523.781op/s 9.434ms 492.281op/s
scenario:load:petclinic:tracing:high_load better
[-2.111ms; -1.286ms] or [-4.581%; -2.790%]
unstable
[-3.353op/s; +11.153op/s] or [-3.303%; +10.986%]
44.384ms 105.412op/s 46.083ms 101.513op/s
scenario:load:petclinic:appsec:high_load better
[-3.116ms; -2.229ms] or [-6.464%; -4.624%]
unstable
[-1.473op/s; +12.798op/s] or [-1.518%; +13.184%]
45.529ms 102.737op/s 48.201ms 97.075op/s
scenario:load:petclinic:profiling:high_load better
[-2.784ms; -1.799ms] or [-5.646%; -3.648%]
unstable
[-2.794op/s; +11.819op/s] or [-2.942%; +12.443%]
47.025ms 99.500op/s 49.316ms 94.987op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.51.1-SNAPSHOT~02311518d7, baseline=1.51.1-SNAPSHOT~ae34f27d9d
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.306 ms) : 4258, 4354
.   : milestone, 4306,
iast (9.32 ms) : 9169, 9470
.   : milestone, 9320,
iast_FULL (13.879 ms) : 13602, 14157
.   : milestone, 13879,
iast_GLOBAL (10.35 ms) : 10169, 10530
.   : milestone, 10350,
profiling (9.434 ms) : 9284, 9584
.   : milestone, 9434,
tracing (7.93 ms) : 7817, 8043
.   : milestone, 7930,
section candidate
no_agent (4.286 ms) : 4239, 4333
.   : milestone, 4286,
iast (9.453 ms) : 9296, 9610
.   : milestone, 9453,
iast_FULL (13.85 ms) : 13577, 14123
.   : milestone, 13850,
iast_GLOBAL (10.222 ms) : 10036, 10408
.   : milestone, 10222,
profiling (8.855 ms) : 8719, 8990
.   : milestone, 8855,
tracing (7.542 ms) : 7438, 7645
.   : milestone, 7542,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.306 ms [4.258 ms, 4.354 ms] -
iast 9.32 ms [9.169 ms, 9.47 ms] 5.014 ms (116.4%)
iast_FULL 13.879 ms [13.602 ms, 14.157 ms] 9.573 ms (222.3%)
iast_GLOBAL 10.35 ms [10.169 ms, 10.53 ms] 6.044 ms (140.3%)
profiling 9.434 ms [9.284 ms, 9.584 ms] 5.127 ms (119.1%)
tracing 7.93 ms [7.817 ms, 8.043 ms] 3.624 ms (84.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.286 ms [4.239 ms, 4.333 ms] -
iast 9.453 ms [9.296 ms, 9.61 ms] 5.167 ms (120.5%)
iast_FULL 13.85 ms [13.577 ms, 14.123 ms] 9.564 ms (223.1%)
iast_GLOBAL 10.222 ms [10.036 ms, 10.408 ms] 5.936 ms (138.5%)
profiling 8.855 ms [8.719 ms, 8.99 ms] 4.569 ms (106.6%)
tracing 7.542 ms [7.438 ms, 7.645 ms] 3.255 ms (75.9%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.51.1-SNAPSHOT~02311518d7, baseline=1.51.1-SNAPSHOT~ae34f27d9d
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.753 ms) : 36451, 37056
.   : milestone, 36753,
appsec (48.201 ms) : 47779, 48624
.   : milestone, 48201,
code_origins (45.807 ms) : 45419, 46195
.   : milestone, 45807,
iast (44.433 ms) : 44058, 44809
.   : milestone, 44433,
profiling (49.316 ms) : 48851, 49781
.   : milestone, 49316,
tracing (46.083 ms) : 45698, 46467
.   : milestone, 46083,
section candidate
no_agent (36.873 ms) : 36580, 37166
.   : milestone, 36873,
appsec (45.529 ms) : 45127, 45931
.   : milestone, 45529,
code_origins (45.003 ms) : 44615, 45391
.   : milestone, 45003,
iast (44.895 ms) : 44501, 45289
.   : milestone, 44895,
profiling (47.025 ms) : 46574, 47475
.   : milestone, 47025,
tracing (44.384 ms) : 44002, 44767
.   : milestone, 44384,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.753 ms [36.451 ms, 37.056 ms] -
appsec 48.201 ms [47.779 ms, 48.624 ms] 11.448 ms (31.1%)
code_origins 45.807 ms [45.419 ms, 46.195 ms] 9.054 ms (24.6%)
iast 44.433 ms [44.058 ms, 44.809 ms] 7.68 ms (20.9%)
profiling 49.316 ms [48.851 ms, 49.781 ms] 12.563 ms (34.2%)
tracing 46.083 ms [45.698 ms, 46.467 ms] 9.33 ms (25.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.873 ms [36.58 ms, 37.166 ms] -
appsec 45.529 ms [45.127 ms, 45.931 ms] 8.656 ms (23.5%)
code_origins 45.003 ms [44.615 ms, 45.391 ms] 8.13 ms (22.0%)
iast 44.895 ms [44.501 ms, 45.289 ms] 8.022 ms (21.8%)
profiling 47.025 ms [46.574 ms, 47.475 ms] 10.151 ms (27.5%)
tracing 44.384 ms [44.002 ms, 44.767 ms] 7.511 ms (20.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mhlidd/config_inversion_telemetry
git_commit_date 1753480309 1753495238
git_commit_sha ae34f27 0231151
release_version 1.51.1-SNAPSHOT~ae34f27d9d 1.51.1-SNAPSHOT~02311518d7
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1753497337 1753497337
ci_job_id 1049179857 1049179857
ci_pipeline_id 71800489 71800489
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-x0e4c138 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-x0e4c138 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.51.1-SNAPSHOT~02311518d7, baseline=1.51.1-SNAPSHOT~ae34f27d9d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1460, 1483
.   : milestone, 1472,
appsec (3.645 ms) : 3429, 3862
.   : milestone, 3645,
iast (2.186 ms) : 2123, 2248
.   : milestone, 2186,
iast_GLOBAL (2.235 ms) : 2172, 2298
.   : milestone, 2235,
profiling (2.038 ms) : 1988, 2089
.   : milestone, 2038,
tracing (2.015 ms) : 1966, 2064
.   : milestone, 2015,
section candidate
no_agent (1.468 ms) : 1456, 1479
.   : milestone, 1468,
appsec (3.617 ms) : 3402, 3832
.   : milestone, 3617,
iast (2.19 ms) : 2127, 2252
.   : milestone, 2190,
iast_GLOBAL (2.231 ms) : 2168, 2294
.   : milestone, 2231,
profiling (2.041 ms) : 1989, 2092
.   : milestone, 2041,
tracing (2.014 ms) : 1965, 2063
.   : milestone, 2014,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.46 ms, 1.483 ms] -
appsec 3.645 ms [3.429 ms, 3.862 ms] 2.173 ms (147.7%)
iast 2.186 ms [2.123 ms, 2.248 ms] 714.19 µs (48.5%)
iast_GLOBAL 2.235 ms [2.172 ms, 2.298 ms] 762.95 µs (51.8%)
profiling 2.038 ms [1.988 ms, 2.089 ms] 566.703 µs (38.5%)
tracing 2.015 ms [1.966 ms, 2.064 ms] 543.336 µs (36.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.456 ms, 1.479 ms] -
appsec 3.617 ms [3.402 ms, 3.832 ms] 2.15 ms (146.5%)
iast 2.19 ms [2.127 ms, 2.252 ms] 722.005 µs (49.2%)
iast_GLOBAL 2.231 ms [2.168 ms, 2.294 ms] 763.485 µs (52.0%)
profiling 2.041 ms [1.989 ms, 2.092 ms] 573.025 µs (39.0%)
tracing 2.014 ms [1.965 ms, 2.063 ms] 546.598 µs (37.2%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.51.1-SNAPSHOT~02311518d7, baseline=1.51.1-SNAPSHOT~ae34f27d9d
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.495 s) : 15495000, 15495000
.   : milestone, 15495000,
appsec (14.833 s) : 14833000, 14833000
.   : milestone, 14833000,
iast (18.573 s) : 18573000, 18573000
.   : milestone, 18573000,
iast_GLOBAL (18.146 s) : 18146000, 18146000
.   : milestone, 18146000,
profiling (15.289 s) : 15289000, 15289000
.   : milestone, 15289000,
tracing (15.02 s) : 15020000, 15020000
.   : milestone, 15020000,
section candidate
no_agent (14.773 s) : 14773000, 14773000
.   : milestone, 14773000,
appsec (15.019 s) : 15019000, 15019000
.   : milestone, 15019000,
iast (18.452 s) : 18452000, 18452000
.   : milestone, 18452000,
iast_GLOBAL (17.872 s) : 17872000, 17872000
.   : milestone, 17872000,
profiling (15.228 s) : 15228000, 15228000
.   : milestone, 15228000,
tracing (15.273 s) : 15273000, 15273000
.   : milestone, 15273000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.495 s [15.495 s, 15.495 s] -
appsec 14.833 s [14.833 s, 14.833 s] -662.0 ms (-4.3%)
iast 18.573 s [18.573 s, 18.573 s] 3.078 s (19.9%)
iast_GLOBAL 18.146 s [18.146 s, 18.146 s] 2.651 s (17.1%)
profiling 15.289 s [15.289 s, 15.289 s] -206.0 ms (-1.3%)
tracing 15.02 s [15.02 s, 15.02 s] -475.0 ms (-3.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.773 s [14.773 s, 14.773 s] -
appsec 15.019 s [15.019 s, 15.019 s] 246.0 ms (1.7%)
iast 18.452 s [18.452 s, 18.452 s] 3.679 s (24.9%)
iast_GLOBAL 17.872 s [17.872 s, 17.872 s] 3.099 s (21.0%)
profiling 15.228 s [15.228 s, 15.228 s] 455.0 ms (3.1%)
tracing 15.273 s [15.273 s, 15.273 s] 500.0 ms (3.4%)

@mhlidd mhlidd marked this pull request as ready for review July 26, 2025 02:57
@mhlidd mhlidd requested review from a team as code owners July 26, 2025 02:57
@mhlidd mhlidd requested review from dougqh and removed request for a team July 26, 2025 02:57
Copy link
Contributor

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@mhlidd mhlidd requested a review from mcculls July 26, 2025 02:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant