Skip to content

Enable Code Origin with Dynamic instrumentation #8940

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Enable Code Origin with Dynamic instrumentation #8940

wants to merge 1 commit into from

Conversation

jpbempel
Copy link
Member

@jpbempel jpbempel commented Jun 6, 2025 •
edited by jira bot
Loading

What Does This Do

When Di is enabled we are automatically starting the Code Origin for Spans product

Motivation

Additional Notes

Contributor Checklist

Jira ticket: DEBUG-3946

@jpbempel
Enable Code Origin with Dynamic instrumentation
98d78e8 
When Di is enabled we are automatically starting the Code  Origin
for Spans product
@jpbempel jpbempel requested a review from a team as a code owner June 6, 2025 09:29
@jpbempel jpbempel requested review from evanchooly and removed request for a team June 6, 2025 09:29
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jun 6, 2025 •
edited
Loading

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@jpbempel jpbempel added comp: debugger Dynamic Instrumentation type: enhancement labels Jun 6, 2025
@pr-commenter
Copy link

pr-commenter bot commented Jun 6, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1749202648 1749203016
end_time 2025-06-06T09:38:48 2025-06-06T09:44:56
git_branch master jpbempel/enable-CO-with-DI
git_commit_sha 7787af7 98d78e8
start_time 2025-06-06T09:37:29 2025-06-06T09:43:37
See matching parameters
Baseline Candidate
ci_job_id 971467847 971467847
ci_pipeline_id 67156541 67156541
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1749202094 1749202094

Summary

Found 0 performance improvements and 5 performance regressions! Performance is the same for 4 metrics, 6 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:loop worse
[+264.008µs; +418.207µs] or [+2.649%; +4.195%]		 worse
[+288.019µs; +453.262µs] or [+2.850%; +4.485%]		 worse
[+264.708µs; +445.963µs] or [+2.592%; +4.366%]		 worse
[+272.211µs; +657.974µs] or [+2.600%; +6.285%]		 worse
[-4.543op/s; -1.899op/s] or [-4.657%; -1.947%]
See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-28.860µs; +57.089µs] or [-10.538%; +20.845%]		 unstable
[-35.880µs; +65.957µs] or [-11.422%; +20.996%]		 unstable
[-45.246µs; +84.211µs] or [-13.772%; +25.632%]		 unstable
[-333.756µs; +771.848µs] or [-34.340%; +79.415%]		 same
scenario:basic same same same unstable
[-114.019µs; +91.174µs] or [-14.177%; +11.336%]		 unstable
[-171.436op/s; +171.436op/s] or [-7.029%; +7.029%]
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (314.139 µs) : 285, 343
.   : milestone, 314,
basic (314.138 µs) : 305, 324
.   : milestone, 314,
loop (10.106 ms) : 10085, 10126
.   : milestone, 10106,
section candidate
noprobe (329.177 µs) : 267, 391
.   : milestone, 329,
basic (312.173 µs) : 297, 328
.   : milestone, 312,
loop (10.476 ms) : 10370, 10583
.   : milestone, 10476,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 314.139 µs [285.388 µs, 342.89 µs]
basic 314.138 µs [304.765 µs, 323.51 µs]
loop 10.106 ms [10.085 ms, 10.126 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 329.177 µs [266.924 µs, 391.431 µs]
basic 312.173 µs [296.813 µs, 327.532 µs]
loop 10.476 ms [10.37 ms, 10.583 ms]

@pr-commenter
Copy link

pr-commenter bot commented Jun 6, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/enable-CO-with-DI
git_commit_date 1749044153 1749202094
git_commit_sha 7787af7 98d78e8
release_version 1.50.0-SNAPSHOT~7787af738f 1.50.0-SNAPSHOT~98d78e8ae3
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1749204467 1749204467
ci_job_id 971467829 971467829
ci_pipeline_id 67156541 67156541
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-z87jatgw-project-304-concurrent-0-l4ue78cz 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-z87jatgw-project-304-concurrent-0-l4ue78cz 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 58 metrics, 12 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:petclinic:iast:Remote Config worse
[+11.922µs; +57.413µs] or [+2.048%; +9.861%]		 616.900µs 582.232µs
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~98d78e8ae3, baseline=1.50.0-SNAPSHOT~7787af738f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.03 s) : 0, 1030153
Total [baseline] (8.561 s) : 0, 8561127
Agent [candidate] (1.035 s) : 0, 1034606
Total [candidate] (8.587 s) : 0, 8586610
section iast
Agent [baseline] (1.153 s) : 0, 1152507
Total [baseline] (9.185 s) : 0, 9185061
Agent [candidate] (1.158 s) : 0, 1158403
Total [candidate] (9.199 s) : 0, 9198633
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.151 s) : 0, 1150818
Total [baseline] (9.135 s) : 0, 9134907
Agent [candidate] (1.158 s) : 0, 1157901
Total [candidate] (9.173 s) : 0, 9173492
section iast_TELEMETRY_OFF
Agent [baseline] (1.146 s) : 0, 1145840
Total [baseline] (9.232 s) : 0, 9232259
Agent [candidate] (1.147 s) : 0, 1146829
Total [candidate] (9.213 s) : 0, 9212929
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.03 s -
Agent iast 1.153 s 122.353 ms (11.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.151 s 120.664 ms (11.7%)
Agent iast_TELEMETRY_OFF 1.146 s 115.687 ms (11.2%)
Total tracing 8.561 s -
Total iast 9.185 s 623.934 ms (7.3%)
Total iast_HARDCODED_SECRET_DISABLED 9.135 s 573.78 ms (6.7%)
Total iast_TELEMETRY_OFF 9.232 s 671.132 ms (7.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.035 s -
Agent iast 1.158 s 123.796 ms (12.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.158 s 123.294 ms (11.9%)
Agent iast_TELEMETRY_OFF 1.147 s 112.223 ms (10.8%)
Total tracing 8.587 s -
Total iast 9.199 s 612.023 ms (7.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.173 s 586.882 ms (6.8%)
Total iast_TELEMETRY_OFF 9.213 s 626.32 ms (7.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~98d78e8ae3, baseline=1.50.0-SNAPSHOT~7787af738f

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (687.622 ms) : 0, 687622
BytebuddyAgent [candidate] (689.978 ms) : 0, 689978
GlobalTracer [baseline] (241.781 ms) : 0, 241781
GlobalTracer [candidate] (243.337 ms) : 0, 243337
AppSec [baseline] (57.164 ms) : 0, 57164
AppSec [candidate] (57.5 ms) : 0, 57500
Debugger [baseline] (6.245 ms) : 0, 6245
Debugger [candidate] (6.277 ms) : 0, 6277
Remote Config [baseline] (760.162 µs) : 0, 760
Remote Config [candidate] (767.81 µs) : 0, 768
Telemetry [baseline] (12.898 ms) : 0, 12898
Telemetry [candidate] (12.978 ms) : 0, 12978
section iast
BytebuddyAgent [baseline] (803.806 ms) : 0, 803806
BytebuddyAgent [candidate] (808.735 ms) : 0, 808735
GlobalTracer [baseline] (231.061 ms) : 0, 231061
GlobalTracer [candidate] (232.34 ms) : 0, 232340
IAST [baseline] (26.166 ms) : 0, 26166
IAST [candidate] (26.061 ms) : 0, 26061
AppSec [baseline] (53.394 ms) : 0, 53394
AppSec [candidate] (53.243 ms) : 0, 53243
Debugger [baseline] (5.983 ms) : 0, 5983
Debugger [candidate] (5.917 ms) : 0, 5917
Remote Config [baseline] (610.768 µs) : 0, 611
Remote Config [candidate] (592.393 µs) : 0, 592
Telemetry [baseline] (7.895 ms) : 0, 7895
Telemetry [candidate] (7.905 ms) : 0, 7905
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (802.42 ms) : 0, 802420
BytebuddyAgent [candidate] (807.881 ms) : 0, 807881
GlobalTracer [baseline] (230.929 ms) : 0, 230929
GlobalTracer [candidate] (231.514 ms) : 0, 231514
IAST [baseline] (27.521 ms) : 0, 27521
IAST [candidate] (27.94 ms) : 0, 27940
AppSec [baseline] (51.899 ms) : 0, 51899
AppSec [candidate] (52.302 ms) : 0, 52302
Debugger [baseline] (5.989 ms) : 0, 5989
Debugger [candidate] (5.987 ms) : 0, 5987
Remote Config [baseline] (595.793 µs) : 0, 596
Remote Config [candidate] (609.175 µs) : 0, 609
Telemetry [baseline] (7.974 ms) : 0, 7974
Telemetry [candidate] (8.016 ms) : 0, 8016
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (798.401 ms) : 0, 798401
BytebuddyAgent [candidate] (798.313 ms) : 0, 798313
GlobalTracer [baseline] (230.744 ms) : 0, 230744
GlobalTracer [candidate] (230.669 ms) : 0, 230669
IAST [baseline] (30.335 ms) : 0, 30335
IAST [candidate] (27.833 ms) : 0, 27833
AppSec [baseline] (48.387 ms) : 0, 48387
AppSec [candidate] (51.762 ms) : 0, 51762
Debugger [baseline] (5.973 ms) : 0, 5973
Debugger [candidate] (6.116 ms) : 0, 6116
Remote Config [baseline] (592.044 µs) : 0, 592
Remote Config [candidate] (616.236 µs) : 0, 616
Telemetry [baseline] (7.909 ms) : 0, 7909
Telemetry [candidate] (7.995 ms) : 0, 7995
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~98d78e8ae3, baseline=1.50.0-SNAPSHOT~7787af738f

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.033 s) : 0, 1032779
Total [baseline] (11.138 s) : 0, 11137635
Agent [candidate] (1.025 s) : 0, 1024525
Total [candidate] (11.159 s) : 0, 11158908
section appsec
Agent [baseline] (1.17 s) : 0, 1169767
Total [baseline] (11.307 s) : 0, 11307302
Agent [candidate] (1.162 s) : 0, 1162264
Total [candidate] (11.233 s) : 0, 11232708
section iast
Agent [baseline] (1.15 s) : 0, 1149642
Total [baseline] (11.323 s) : 0, 11323193
Agent [candidate] (1.152 s) : 0, 1152314
Total [candidate] (11.344 s) : 0, 11343805
section profiling
Agent [baseline] (1.27 s) : 0, 1269839
Total [baseline] (11.45 s) : 0, 11449783
Agent [candidate] (1.27 s) : 0, 1270326
Total [candidate] (11.469 s) : 0, 11469232
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.033 s -
Agent appsec 1.17 s 136.989 ms (13.3%)
Agent iast 1.15 s 116.863 ms (11.3%)
Agent profiling 1.27 s 237.06 ms (23.0%)
Total tracing 11.138 s -
Total appsec 11.307 s 169.667 ms (1.5%)
Total iast 11.323 s 185.557 ms (1.7%)
Total profiling 11.45 s 312.148 ms (2.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.025 s -
Agent appsec 1.162 s 137.739 ms (13.4%)
Agent iast 1.152 s 127.789 ms (12.5%)
Agent profiling 1.27 s 245.801 ms (24.0%)
Total tracing 11.159 s -
Total appsec 11.233 s 73.8 ms (0.7%)
Total iast 11.344 s 184.897 ms (1.7%)
Total profiling 11.469 s 310.324 ms (2.8%) 
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~98d78e8ae3, baseline=1.50.0-SNAPSHOT~7787af738f

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (688.36 ms) : 0, 688360
BytebuddyAgent [candidate] (683.58 ms) : 0, 683580
GlobalTracer [baseline] (242.108 ms) : 0, 242108
GlobalTracer [candidate] (240.718 ms) : 0, 240718
AppSec [baseline] (56.778 ms) : 0, 56778
AppSec [candidate] (58.386 ms) : 0, 58386
Debugger [baseline] (6.246 ms) : 0, 6246
Debugger [candidate] (6.159 ms) : 0, 6159
Remote Config [baseline] (744.438 µs) : 0, 744
Remote Config [candidate] (727.258 µs) : 0, 727
Telemetry [baseline] (14.675 ms) : 0, 14675
Telemetry [candidate] (11.358 ms) : 0, 11358
section appsec
BytebuddyAgent [baseline] (704.835 ms) : 0, 704835
BytebuddyAgent [candidate] (699.904 ms) : 0, 699904
GlobalTracer [baseline] (239.345 ms) : 0, 239345
GlobalTracer [candidate] (237.637 ms) : 0, 237637
AppSec [baseline] (176.901 ms) : 0, 176901
AppSec [candidate] (176.243 ms) : 0, 176243
Debugger [baseline] (5.981 ms) : 0, 5981
Debugger [candidate] (5.992 ms) : 0, 5992
Remote Config [baseline] (638.041 µs) : 0, 638
Remote Config [candidate] (623.795 µs) : 0, 624
Telemetry [baseline] (7.372 ms) : 0, 7372
Telemetry [candidate] (7.329 ms) : 0, 7329
IAST [baseline] (21.837 ms) : 0, 21837
IAST [candidate] (21.858 ms) : 0, 21858
section iast
BytebuddyAgent [baseline] (801.88 ms) : 0, 801880
BytebuddyAgent [candidate] (803.515 ms) : 0, 803515
GlobalTracer [baseline] (230.595 ms) : 0, 230595
GlobalTracer [candidate] (231.087 ms) : 0, 231087
AppSec [baseline] (50.068 ms) : 0, 50068
AppSec [candidate] (50.304 ms) : 0, 50304
Debugger [baseline] (5.892 ms) : 0, 5892
Debugger [candidate] (5.999 ms) : 0, 5999
Remote Config [baseline] (582.232 µs) : 0, 582
Remote Config [candidate] (616.9 µs) : 0, 617
Telemetry [baseline] (7.989 ms) : 0, 7989
Telemetry [candidate] (8.036 ms) : 0, 8036
IAST [baseline] (29.055 ms) : 0, 29055
IAST [candidate] (28.421 ms) : 0, 28421
section profiling
ProfilingAgent [baseline] (103.489 ms) : 0, 103489
ProfilingAgent [candidate] (104.635 ms) : 0, 104635
BytebuddyAgent [baseline] (677.902 ms) : 0, 677902
BytebuddyAgent [candidate] (677.307 ms) : 0, 677307
GlobalTracer [baseline] (360.713 ms) : 0, 360713
GlobalTracer [candidate] (360.571 ms) : 0, 360571
AppSec [baseline] (61.777 ms) : 0, 61777
AppSec [candidate] (61.755 ms) : 0, 61755
Debugger [baseline] (6.031 ms) : 0, 6031
Debugger [candidate] (6.103 ms) : 0, 6103
Remote Config [baseline] (652.865 µs) : 0, 653
Remote Config [candidate] (644.92 µs) : 0, 645
Telemetry [baseline] (8.16 ms) : 0, 8160
Telemetry [candidate] (8.153 ms) : 0, 8153
Profiling [baseline] (103.513 ms) : 0, 103513
Profiling [candidate] (104.66 ms) : 0, 104660
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-06-06T09:50:17 2025-06-06T09:55:34
git_branch master jpbempel/enable-CO-with-DI
git_commit_date 1749044153 1749202094
git_commit_sha 7787af7 98d78e8
release_version 1.50.0-SNAPSHOT~7787af738f 1.50.0-SNAPSHOT~98d78e8ae3
start_time 2025-06-06T09:48:18 2025-06-06T09:54:47
See matching parameters
Baseline Candidate
application petclinic petclinic
ci_job_date 1749203734 1749203734
ci_job_id 971467832 971467832
ci_pipeline_id 67156541 67156541
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-63wmvl1-project-304-concurrent-3-3lej0abh 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-63wmvl1-project-304-concurrent-3-3lej0abh 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
thresholds_or_results results results
variant appsec appsec

Summary

Found 0 performance improvements and 5 performance regressions! Performance is the same for 0 metrics, 9 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:appsec unstable
[+85.684ms; +89.388ms] or [+1167.456%; +1217.926%]		 worse
[-633.744op/s; -597.214op/s] or [-95.062%; -89.582%]		 94.875ms 51.188op/s 7.339ms 666.667op/s
scenario:load:petclinic:appsec_no_iast unstable
[+88.891ms; +93.634ms] or [+789.339%; +831.457%]		 worse
[-413.905op/s; -370.762op/s] or [-94.176%; -84.360%]		 102.524ms 47.167op/s 11.261ms 439.500op/s
scenario:load:petclinic:no_agent unstable
[+63.769ms; +66.012ms] or [+770.119%; +797.209%]		 worse
[-542.087op/s; -517.168op/s] or [-90.800%; -86.626%]		 73.171ms 67.388op/s 8.280ms 597.015op/s
scenario:load:petclinic:profiling unstable
[+76.372ms; +79.311ms] or [+943.545%; +979.863%]		 worse
[-563.846op/s; -533.975op/s] or [-93.035%; -88.106%]		 85.936ms 57.150op/s 8.094ms 606.061op/s
scenario:load:petclinic:tracing unstable
[+67.842ms; +70.291ms] or [+829.748%; +859.700%]		 worse
[-551.915op/s; -523.870op/s] or [-91.756%; -87.093%]		 77.243ms 63.611op/s 8.176ms 601.504op/s

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/enable-CO-with-DI
git_commit_date 1749044153 1749202094
git_commit_sha 7787af7 98d78e8
release_version 1.50.0-SNAPSHOT~7787af738f 1.50.0-SNAPSHOT~98d78e8ae3
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1749204101 1749204101
ci_job_id 971467834 971467834
ci_pipeline_id 67156541 67156541
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-z87jatgw-project-304-concurrent-1-d5snb33r 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-z87jatgw-project-304-concurrent-1-d5snb33r 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~98d78e8ae3, baseline=1.50.0-SNAPSHOT~7787af738f
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.203 s) : 15203000, 15203000
.   : milestone, 15203000,
appsec (14.953 s) : 14953000, 14953000
.   : milestone, 14953000,
iast (18.176 s) : 18176000, 18176000
.   : milestone, 18176000,
iast_GLOBAL (18.125 s) : 18125000, 18125000
.   : milestone, 18125000,
profiling (15.124 s) : 15124000, 15124000
.   : milestone, 15124000,
tracing (14.778 s) : 14778000, 14778000
.   : milestone, 14778000,
section candidate
no_agent (15.224 s) : 15224000, 15224000
.   : milestone, 15224000,
appsec (14.776 s) : 14776000, 14776000
.   : milestone, 14776000,
iast (18.238 s) : 18238000, 18238000
.   : milestone, 18238000,
iast_GLOBAL (17.985 s) : 17985000, 17985000
.   : milestone, 17985000,
profiling (15.312 s) : 15312000, 15312000
.   : milestone, 15312000,
tracing (15.081 s) : 15081000, 15081000
.   : milestone, 15081000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.203 s [15.203 s, 15.203 s] -
appsec 14.953 s [14.953 s, 14.953 s] -250.0 ms (-1.6%)
iast 18.176 s [18.176 s, 18.176 s] 2.973 s (19.6%)
iast_GLOBAL 18.125 s [18.125 s, 18.125 s] 2.922 s (19.2%)
profiling 15.124 s [15.124 s, 15.124 s] -79.0 ms (-0.5%)
tracing 14.778 s [14.778 s, 14.778 s] -425.0 ms (-2.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.224 s [15.224 s, 15.224 s] -
appsec 14.776 s [14.776 s, 14.776 s] -448.0 ms (-2.9%)
iast 18.238 s [18.238 s, 18.238 s] 3.014 s (19.8%)
iast_GLOBAL 17.985 s [17.985 s, 17.985 s] 2.761 s (18.1%)
profiling 15.312 s [15.312 s, 15.312 s] 88.0 ms (0.6%)
tracing 15.081 s [15.081 s, 15.081 s] -143.0 ms (-0.9%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~98d78e8ae3, baseline=1.50.0-SNAPSHOT~7787af738f
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1460, 1483
.   : milestone, 1472,
appsec (2.394 ms) : 2345, 2442
.   : milestone, 2394,
iast (2.174 ms) : 2112, 2235
.   : milestone, 2174,
iast_GLOBAL (2.218 ms) : 2156, 2279
.   : milestone, 2218,
profiling (2.047 ms) : 1997, 2097
.   : milestone, 2047,
tracing (1.99 ms) : 1943, 2037
.   : milestone, 1990,
section candidate
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (2.391 ms) : 2342, 2439
.   : milestone, 2391,
iast (2.169 ms) : 2108, 2230
.   : milestone, 2169,
iast_GLOBAL (2.21 ms) : 2148, 2271
.   : milestone, 2210,
profiling (2.034 ms) : 1984, 2083
.   : milestone, 2034,
tracing (1.988 ms) : 1941, 2035
.   : milestone, 1988,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.46 ms, 1.483 ms] -
appsec 2.394 ms [2.345 ms, 2.442 ms] 921.895 µs (62.6%)
iast 2.174 ms [2.112 ms, 2.235 ms] 702.005 µs (47.7%)
iast_GLOBAL 2.218 ms [2.156 ms, 2.279 ms] 746.009 µs (50.7%)
profiling 2.047 ms [1.997 ms, 2.097 ms] 575.635 µs (39.1%)
tracing 1.99 ms [1.943 ms, 2.037 ms] 518.754 µs (35.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.461 ms, 1.484 ms] -
appsec 2.391 ms [2.342 ms, 2.439 ms] 917.633 µs (62.3%)
iast 2.169 ms [2.108 ms, 2.23 ms] 696.152 µs (47.3%)
iast_GLOBAL 2.21 ms [2.148 ms, 2.271 ms] 736.714 µs (50.0%)
profiling 2.034 ms [1.984 ms, 2.083 ms] 560.751 µs (38.1%)
tracing 1.988 ms [1.941 ms, 2.035 ms] 514.99 µs (35.0%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@evanchooly evanchooly evanchooly approved these changes

Assignees
No one assigned
Labels
comp: debugger Dynamic Instrumentation type: enhancement
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@jpbempel @evanchooly