-
Notifications
You must be signed in to change notification settings - Fork 309
Reduces Maven smoke test timeout for better feedback on failures #9142
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Draft
daniel-mohedano
wants to merge
2
commits into
master
Choose a base branch
from
daniel.mohedano/maven-smoke-feedback
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
+9
−5
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
BenchmarksStartupParameters
See matching parameters
SummaryFound 10 performance improvements and 3 performance regressions! Performance is the same for 26 metrics, 14 unstable metrics.
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.52.0-SNAPSHOT~e633223c5f, baseline=1.52.0-SNAPSHOT~2fe6aa2d23
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.04 s) : 0, 1039549
Total [baseline] (10.716 s) : 0, 10716303
Agent [candidate] (995.846 ms) : 0, 995846
Total [candidate] (10.617 s) : 0, 10617106
section appsec
Agent [baseline] (1.218 s) : 0, 1217821
Total [baseline] (10.737 s) : 0, 10736924
Agent [candidate] (1.184 s) : 0, 1183994
Total [candidate] (10.843 s) : 0, 10842954
section iast
Agent [baseline] (1.178 s) : 0, 1178040
Total [baseline] (10.975 s) : 0, 10974730
Agent [candidate] (1.131 s) : 0, 1130600
Total [candidate] (10.807 s) : 0, 10807442
section profiling
Agent [baseline] (1.183 s) : 0, 1183425
Total [baseline] (10.821 s) : 0, 10821429
Agent [candidate] (1.245 s) : 0, 1245018
Total [candidate] (10.948 s) : 0, 10947855
gantt
title petclinic - break down per module: candidate=1.52.0-SNAPSHOT~e633223c5f, baseline=1.52.0-SNAPSHOT~2fe6aa2d23
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (728.741 ms) : 0, 728741
BytebuddyAgent [candidate] (687.501 ms) : 0, 687501
GlobalTracer [baseline] (242.157 ms) : 0, 242157
GlobalTracer [candidate] (242.3 ms) : 0, 242300
AppSec [baseline] (30.589 ms) : 0, 30589
AppSec [candidate] (30.298 ms) : 0, 30298
Debugger [baseline] (6.058 ms) : 0, 6058
Debugger [candidate] (5.972 ms) : 0, 5972
Remote Config [baseline] (645.515 µs) : 0, 646
Remote Config [candidate] (679.755 µs) : 0, 680
Telemetry [baseline] (9.002 ms) : 0, 9002
Telemetry [candidate] (8.184 ms) : 0, 8184
crashtracking [baseline] (1.436 ms) : 0, 1436
section appsec
BytebuddyAgent [baseline] (751.532 ms) : 0, 751532
BytebuddyAgent [candidate] (716.756 ms) : 0, 716756
GlobalTracer [baseline] (234.6 ms) : 0, 234600
GlobalTracer [candidate] (236.745 ms) : 0, 236745
IAST [baseline] (23.579 ms) : 0, 23579
IAST [candidate] (23.527 ms) : 0, 23527
AppSec [baseline] (167.224 ms) : 0, 167224
AppSec [candidate] (171.644 ms) : 0, 171644
Debugger [baseline] (8.71 ms) : 0, 8710
Debugger [candidate] (5.691 ms) : 0, 5691
Remote Config [baseline] (604.603 µs) : 0, 605
Remote Config [candidate] (601.141 µs) : 0, 601
Telemetry [baseline] (8.825 ms) : 0, 8825
Telemetry [candidate] (8.092 ms) : 0, 8092
crashtracking [baseline] (1.431 ms) : 0, 1431
section iast
BytebuddyAgent [baseline] (850.162 ms) : 0, 850162
BytebuddyAgent [candidate] (805.821 ms) : 0, 805821
GlobalTracer [baseline] (232.801 ms) : 0, 232801
GlobalTracer [candidate] (232.191 ms) : 0, 232191
IAST [baseline] (28.482 ms) : 0, 28482
IAST [candidate] (27.104 ms) : 0, 27104
AppSec [baseline] (28.118 ms) : 0, 28118
AppSec [candidate] (29.784 ms) : 0, 29784
Debugger [baseline] (7.387 ms) : 0, 7387
Debugger [candidate] (6.519 ms) : 0, 6519
Remote Config [baseline] (599.503 µs) : 0, 600
Remote Config [candidate] (579.019 µs) : 0, 579
Telemetry [baseline] (7.994 ms) : 0, 7994
Telemetry [candidate] (7.864 ms) : 0, 7864
crashtracking [baseline] (1.445 ms) : 0, 1445
section profiling
BytebuddyAgent [baseline] (759.766 ms) : 0, 759766
BytebuddyAgent [candidate] (678.155 ms) : 0, 678155
GlobalTracer [baseline] (220.363 ms) : 0, 220363
GlobalTracer [candidate] (361.553 ms) : 0, 361553
AppSec [baseline] (30.319 ms) : 0, 30319
AppSec [candidate] (32.359 ms) : 0, 32359
Debugger [baseline] (6.268 ms) : 0, 6268
Debugger [candidate] (9.706 ms) : 0, 9706
Remote Config [baseline] (676.789 µs) : 0, 677
Remote Config [candidate] (674.22 µs) : 0, 674
Telemetry [baseline] (13.767 ms) : 0, 13767
Telemetry [candidate] (8.798 ms) : 0, 8798
crashtracking [baseline] (1.413 ms) : 0, 1413
ProfilingAgent [baseline] (102.48 ms) : 0, 102480
ProfilingAgent [candidate] (104.444 ms) : 0, 104444
Profiling [baseline] (102.503 ms) : 0, 102503
Profiling [candidate] (104.468 ms) : 0, 104468
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.52.0-SNAPSHOT~e633223c5f, baseline=1.52.0-SNAPSHOT~2fe6aa2d23
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.045 s) : 0, 1044928
Total [baseline] (8.647 s) : 0, 8647311
Agent [candidate] (995.837 ms) : 0, 995837
Total [candidate] (8.583 s) : 0, 8582944
section iast
Agent [baseline] (1.182 s) : 0, 1181912
Total [baseline] (9.306 s) : 0, 9305741
Agent [candidate] (1.134 s) : 0, 1133629
Total [candidate] (9.277 s) : 0, 9276878
gantt
title insecure-bank - break down per module: candidate=1.52.0-SNAPSHOT~e633223c5f, baseline=1.52.0-SNAPSHOT~2fe6aa2d23
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (734.766 ms) : 0, 734766
BytebuddyAgent [candidate] (687.164 ms) : 0, 687164
GlobalTracer [baseline] (241.673 ms) : 0, 241673
GlobalTracer [candidate] (242.676 ms) : 0, 242676
AppSec [baseline] (30.528 ms) : 0, 30528
AppSec [candidate] (30.26 ms) : 0, 30260
Debugger [baseline] (6.02 ms) : 0, 6020
Debugger [candidate] (5.94 ms) : 0, 5940
Remote Config [baseline] (650.236 µs) : 0, 650
Remote Config [candidate] (673.607 µs) : 0, 674
Telemetry [baseline] (8.981 ms) : 0, 8981
Telemetry [candidate] (8.248 ms) : 0, 8248
crashtracking [baseline] (1.433 ms) : 0, 1433
section iast
BytebuddyAgent [baseline] (854.254 ms) : 0, 854254
BytebuddyAgent [candidate] (808.031 ms) : 0, 808031
GlobalTracer [baseline] (232.662 ms) : 0, 232662
GlobalTracer [candidate] (232.719 ms) : 0, 232719
AppSec [baseline] (27.377 ms) : 0, 27377
AppSec [candidate] (29.022 ms) : 0, 29022
Debugger [baseline] (6.652 ms) : 0, 6652
Debugger [candidate] (5.776 ms) : 0, 5776
Remote Config [baseline] (593.488 µs) : 0, 593
Remote Config [candidate] (590.247 µs) : 0, 590
Telemetry [baseline] (7.984 ms) : 0, 7984
Telemetry [candidate] (7.994 ms) : 0, 7994
crashtracking [baseline] (1.45 ms) : 0, 1450
IAST [baseline] (30.084 ms) : 0, 30084
IAST [candidate] (28.825 ms) : 0, 28825
LoadParameters
See matching parameters
SummaryFound 1 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~e633223c5f, baseline=1.52.0-SNAPSHOT~2fe6aa2d23
dateFormat X
axisFormat %s
section baseline
no_agent (4.436 ms) : 4386, 4486
. : milestone, 4436,
iast (9.526 ms) : 9367, 9685
. : milestone, 9526,
iast_FULL (14.399 ms) : 14111, 14687
. : milestone, 14399,
iast_GLOBAL (10.075 ms) : 9900, 10251
. : milestone, 10075,
profiling (8.862 ms) : 8719, 9006
. : milestone, 8862,
tracing (7.68 ms) : 7558, 7802
. : milestone, 7680,
section candidate
no_agent (4.299 ms) : 4247, 4351
. : milestone, 4299,
iast (9.4 ms) : 9243, 9557
. : milestone, 9400,
iast_FULL (14.183 ms) : 13897, 14469
. : milestone, 14183,
iast_GLOBAL (10.293 ms) : 10115, 10471
. : milestone, 10293,
profiling (8.64 ms) : 8501, 8779
. : milestone, 8640,
tracing (7.58 ms) : 7475, 7685
. : milestone, 7580,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~e633223c5f, baseline=1.52.0-SNAPSHOT~2fe6aa2d23
dateFormat X
axisFormat %s
section baseline
no_agent (38.267 ms) : 37960, 38574
. : milestone, 38267,
appsec (46.897 ms) : 46482, 47311
. : milestone, 46897,
code_origins (45.776 ms) : 45380, 46172
. : milestone, 45776,
iast (44.951 ms) : 44553, 45349
. : milestone, 44951,
profiling (49.255 ms) : 48706, 49803
. : milestone, 49255,
tracing (44.255 ms) : 43862, 44648
. : milestone, 44255,
section candidate
no_agent (36.803 ms) : 36516, 37090
. : milestone, 36803,
appsec (47.321 ms) : 46914, 47728
. : milestone, 47321,
code_origins (44.867 ms) : 44489, 45245
. : milestone, 44867,
iast (43.697 ms) : 43313, 44081
. : milestone, 43697,
profiling (48.455 ms) : 47989, 48921
. : milestone, 48455,
tracing (45.699 ms) : 45327, 46070
. : milestone, 45699,
DacapoParameters
See matching parameters
SummaryFound 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~e633223c5f, baseline=1.52.0-SNAPSHOT~2fe6aa2d23
dateFormat X
axisFormat %s
section baseline
no_agent (1.473 ms) : 1462, 1485
. : milestone, 1473,
appsec (3.575 ms) : 3363, 3786
. : milestone, 3575,
iast (2.197 ms) : 2134, 2260
. : milestone, 2197,
iast_GLOBAL (2.225 ms) : 2163, 2288
. : milestone, 2225,
profiling (2.038 ms) : 1988, 2087
. : milestone, 2038,
tracing (2.006 ms) : 1957, 2054
. : milestone, 2006,
section candidate
no_agent (1.472 ms) : 1461, 1484
. : milestone, 1472,
appsec (2.408 ms) : 2359, 2458
. : milestone, 2408,
iast (2.193 ms) : 2131, 2255
. : milestone, 2193,
iast_GLOBAL (2.227 ms) : 2165, 2289
. : milestone, 2227,
profiling (2.036 ms) : 1985, 2086
. : milestone, 2036,
tracing (2.003 ms) : 1955, 2051
. : milestone, 2003,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~e633223c5f, baseline=1.52.0-SNAPSHOT~2fe6aa2d23
dateFormat X
axisFormat %s
section baseline
no_agent (15.054 s) : 15054000, 15054000
. : milestone, 15054000,
appsec (14.945 s) : 14945000, 14945000
. : milestone, 14945000,
iast (18.19 s) : 18190000, 18190000
. : milestone, 18190000,
iast_GLOBAL (18.172 s) : 18172000, 18172000
. : milestone, 18172000,
profiling (15.473 s) : 15473000, 15473000
. : milestone, 15473000,
tracing (14.999 s) : 14999000, 14999000
. : milestone, 14999000,
section candidate
no_agent (15.57 s) : 15570000, 15570000
. : milestone, 15570000,
appsec (14.888 s) : 14888000, 14888000
. : milestone, 14888000,
iast (18.358 s) : 18358000, 18358000
. : milestone, 18358000,
iast_GLOBAL (17.956 s) : 17956000, 17956000
. : milestone, 17956000,
profiling (15.415 s) : 15415000, 15415000
. : milestone, 15415000,
tracing (14.626 s) : 14626000, 14626000
. : milestone, 14626000,
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Labels
comp: ci visibility
Continuous Integration Visibility
tag: do not merge
Do not merge changes
tag: no release notes
Changes to exclude from release notes
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
Motivation
Additional Notes
Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any usefull labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]