Draft
Conversation
BenchmarksStartupParameters
See matching parameters
SummaryFound 2 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 11 unstable metrics.
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~509213b6b5, baseline=1.61.0-SNAPSHOT~5580c61ac4
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.057 s) : 0, 1057178
Total [baseline] (11.107 s) : 0, 11106751
Agent [candidate] (1.066 s) : 0, 1066085
Total [candidate] (11.15 s) : 0, 11150464
section appsec
Agent [baseline] (1.243 s) : 0, 1243451
Total [baseline] (11.123 s) : 0, 11122638
Agent [candidate] (1.253 s) : 0, 1252730
Total [candidate] (11.328 s) : 0, 11327947
section iast
Agent [baseline] (1.227 s) : 0, 1227004
Total [baseline] (11.331 s) : 0, 11330964
Agent [candidate] (1.229 s) : 0, 1229134
Total [candidate] (11.361 s) : 0, 11361405
section profiling
Agent [baseline] (1.183 s) : 0, 1183153
Total [baseline] (11.06 s) : 0, 11060058
Agent [candidate] (1.191 s) : 0, 1190864
Total [candidate] (11.022 s) : 0, 11022364
gantt
title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~509213b6b5, baseline=1.61.0-SNAPSHOT~5580c61ac4
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (629.041 ms) : 0, 629041
BytebuddyAgent [candidate] (633.333 ms) : 0, 633333
AgentMeter [baseline] (29.33 ms) : 0, 29330
AgentMeter [candidate] (29.398 ms) : 0, 29398
GlobalTracer [baseline] (256.719 ms) : 0, 256719
GlobalTracer [candidate] (258.246 ms) : 0, 258246
AppSec [baseline] (31.7 ms) : 0, 31700
AppSec [candidate] (31.886 ms) : 0, 31886
Debugger [baseline] (60.259 ms) : 0, 60259
Debugger [candidate] (61.405 ms) : 0, 61405
Remote Config [baseline] (590.802 µs) : 0, 591
Remote Config [candidate] (594.405 µs) : 0, 594
Telemetry [baseline] (8.73 ms) : 0, 8730
Telemetry [candidate] (8.856 ms) : 0, 8856
Flare Poller [baseline] (3.612 ms) : 0, 3612
Flare Poller [candidate] (5.034 ms) : 0, 5034
section appsec
crashtracking [baseline] (1.203 ms) : 0, 1203
crashtracking [candidate] (1.2 ms) : 0, 1200
BytebuddyAgent [baseline] (656.503 ms) : 0, 656503
BytebuddyAgent [candidate] (661.329 ms) : 0, 661329
AgentMeter [baseline] (12.117 ms) : 0, 12117
AgentMeter [candidate] (12.224 ms) : 0, 12224
GlobalTracer [baseline] (257.475 ms) : 0, 257475
GlobalTracer [candidate] (259.061 ms) : 0, 259061
IAST [baseline] (24.122 ms) : 0, 24122
IAST [candidate] (24.374 ms) : 0, 24374
AppSec [baseline] (177.528 ms) : 0, 177528
AppSec [candidate] (178.393 ms) : 0, 178393
Debugger [baseline] (65.878 ms) : 0, 65878
Debugger [candidate] (66.856 ms) : 0, 66856
Remote Config [baseline] (638.759 µs) : 0, 639
Remote Config [candidate] (654.56 µs) : 0, 655
Telemetry [baseline] (8.236 ms) : 0, 8236
Telemetry [candidate] (8.519 ms) : 0, 8519
Flare Poller [baseline] (3.507 ms) : 0, 3507
Flare Poller [candidate] (3.677 ms) : 0, 3677
section iast
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (795.589 ms) : 0, 795589
BytebuddyAgent [candidate] (796.706 ms) : 0, 796706
AgentMeter [baseline] (11.437 ms) : 0, 11437
AgentMeter [candidate] (11.391 ms) : 0, 11391
GlobalTracer [baseline] (247.351 ms) : 0, 247351
GlobalTracer [candidate] (247.756 ms) : 0, 247756
IAST [baseline] (25.334 ms) : 0, 25334
IAST [candidate] (25.359 ms) : 0, 25359
AppSec [baseline] (26.454 ms) : 0, 26454
AppSec [candidate] (26.519 ms) : 0, 26519
Debugger [baseline] (69.079 ms) : 0, 69079
Debugger [candidate] (64.981 ms) : 0, 64981
Remote Config [baseline] (536.925 µs) : 0, 537
Remote Config [candidate] (512.68 µs) : 0, 513
Telemetry [baseline] (10.283 ms) : 0, 10283
Telemetry [candidate] (13.843 ms) : 0, 13843
Flare Poller [baseline] (3.651 ms) : 0, 3651
Flare Poller [candidate] (4.741 ms) : 0, 4741
section profiling
crashtracking [baseline] (1.181 ms) : 0, 1181
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (683.32 ms) : 0, 683320
BytebuddyAgent [candidate] (687.714 ms) : 0, 687714
AgentMeter [baseline] (9.076 ms) : 0, 9076
AgentMeter [candidate] (9.111 ms) : 0, 9111
GlobalTracer [baseline] (215.547 ms) : 0, 215547
GlobalTracer [candidate] (216.834 ms) : 0, 216834
AppSec [baseline] (32.162 ms) : 0, 32162
AppSec [candidate] (32.339 ms) : 0, 32339
Debugger [baseline] (65.519 ms) : 0, 65519
Debugger [candidate] (66.032 ms) : 0, 66032
Remote Config [baseline] (557.117 µs) : 0, 557
Remote Config [candidate] (573.568 µs) : 0, 574
Telemetry [baseline] (7.7 ms) : 0, 7700
Telemetry [candidate] (7.833 ms) : 0, 7833
Flare Poller [baseline] (3.482 ms) : 0, 3482
Flare Poller [candidate] (3.584 ms) : 0, 3584
ProfilingAgent [baseline] (93.551 ms) : 0, 93551
ProfilingAgent [candidate] (94.257 ms) : 0, 94257
Profiling [baseline] (94.109 ms) : 0, 94109
Profiling [candidate] (94.816 ms) : 0, 94816
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~509213b6b5, baseline=1.61.0-SNAPSHOT~5580c61ac4
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.078 s) : 0, 1078258
Total [baseline] (8.936 s) : 0, 8935822
Agent [candidate] (1.057 s) : 0, 1056785
Total [candidate] (8.816 s) : 0, 8816484
section iast
Agent [baseline] (1.229 s) : 0, 1228940
Total [baseline] (9.574 s) : 0, 9574140
Agent [candidate] (1.225 s) : 0, 1225134
Total [candidate] (9.534 s) : 0, 9534013
gantt
title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~509213b6b5, baseline=1.61.0-SNAPSHOT~5580c61ac4
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.238 ms) : 0, 1238
crashtracking [candidate] (1.194 ms) : 0, 1194
BytebuddyAgent [baseline] (641.938 ms) : 0, 641938
BytebuddyAgent [candidate] (629.314 ms) : 0, 629314
AgentMeter [baseline] (30.075 ms) : 0, 30075
AgentMeter [candidate] (29.275 ms) : 0, 29275
GlobalTracer [baseline] (261.22 ms) : 0, 261220
GlobalTracer [candidate] (256.952 ms) : 0, 256952
AppSec [baseline] (32.393 ms) : 0, 32393
AppSec [candidate] (31.749 ms) : 0, 31749
Debugger [baseline] (60.785 ms) : 0, 60785
Debugger [candidate] (60.188 ms) : 0, 60188
Remote Config [baseline] (602.257 µs) : 0, 602
Remote Config [candidate] (588.414 µs) : 0, 588
Telemetry [baseline] (9.083 ms) : 0, 9083
Telemetry [candidate] (7.986 ms) : 0, 7986
Flare Poller [baseline] (4.346 ms) : 0, 4346
Flare Poller [candidate] (3.532 ms) : 0, 3532
section iast
crashtracking [baseline] (1.193 ms) : 0, 1193
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (796.798 ms) : 0, 796798
BytebuddyAgent [candidate] (794.849 ms) : 0, 794849
AgentMeter [baseline] (11.449 ms) : 0, 11449
AgentMeter [candidate] (11.346 ms) : 0, 11346
GlobalTracer [baseline] (247.529 ms) : 0, 247529
GlobalTracer [candidate] (247.014 ms) : 0, 247014
IAST [baseline] (25.482 ms) : 0, 25482
IAST [candidate] (25.307 ms) : 0, 25307
AppSec [baseline] (26.572 ms) : 0, 26572
AppSec [candidate] (26.346 ms) : 0, 26346
Debugger [baseline] (69.139 ms) : 0, 69139
Debugger [candidate] (63.211 ms) : 0, 63211
Remote Config [baseline] (533.173 µs) : 0, 533
Remote Config [candidate] (530.566 µs) : 0, 531
Telemetry [baseline] (10.269 ms) : 0, 10269
Telemetry [candidate] (14.39 ms) : 0, 14390
Flare Poller [baseline] (3.673 ms) : 0, 3673
Flare Poller [candidate] (4.866 ms) : 0, 4866
LoadParameters
See matching parameters
SummaryFound 1 performance improvements and 0 performance regressions! Performance is the same for 20 metrics, 15 unstable metrics.
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~509213b6b5, baseline=1.61.0-SNAPSHOT~5580c61ac4
dateFormat X
axisFormat %s
section baseline
no_agent (1.177 ms) : 1166, 1189
. : milestone, 1177,
iast (3.156 ms) : 3120, 3191
. : milestone, 3156,
iast_FULL (5.81 ms) : 5752, 5867
. : milestone, 5810,
iast_GLOBAL (3.681 ms) : 3621, 3742
. : milestone, 3681,
profiling (2.104 ms) : 2086, 2122
. : milestone, 2104,
tracing (1.818 ms) : 1803, 1834
. : milestone, 1818,
section candidate
no_agent (1.177 ms) : 1165, 1188
. : milestone, 1177,
iast (3.285 ms) : 3235, 3335
. : milestone, 3285,
iast_FULL (5.976 ms) : 5915, 6036
. : milestone, 5976,
iast_GLOBAL (3.611 ms) : 3551, 3671
. : milestone, 3611,
profiling (2.221 ms) : 2200, 2242
. : milestone, 2221,
tracing (1.786 ms) : 1770, 1802
. : milestone, 1786,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~509213b6b5, baseline=1.61.0-SNAPSHOT~5580c61ac4
dateFormat X
axisFormat %s
section baseline
no_agent (18.268 ms) : 18085, 18452
. : milestone, 18268,
appsec (18.513 ms) : 18326, 18699
. : milestone, 18513,
code_origins (17.801 ms) : 17626, 17976
. : milestone, 17801,
iast (18.289 ms) : 18105, 18473
. : milestone, 18289,
profiling (18.514 ms) : 18328, 18700
. : milestone, 18514,
tracing (18.847 ms) : 18656, 19039
. : milestone, 18847,
section candidate
no_agent (18.793 ms) : 18602, 18984
. : milestone, 18793,
appsec (18.741 ms) : 18550, 18931
. : milestone, 18741,
code_origins (17.834 ms) : 17657, 18011
. : milestone, 17834,
iast (17.882 ms) : 17699, 18066
. : milestone, 17882,
profiling (18.983 ms) : 18792, 19174
. : milestone, 18983,
tracing (17.788 ms) : 17610, 17965
. : milestone, 17788,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~509213b6b5, baseline=1.61.0-SNAPSHOT~5580c61ac4
dateFormat X
axisFormat %s
section baseline
no_agent (1.473 ms) : 1462, 1485
. : milestone, 1473,
appsec (3.792 ms) : 3572, 4013
. : milestone, 3792,
iast (2.252 ms) : 2183, 2321
. : milestone, 2252,
iast_GLOBAL (2.287 ms) : 2217, 2356
. : milestone, 2287,
profiling (2.075 ms) : 2020, 2130
. : milestone, 2075,
tracing (2.072 ms) : 2018, 2126
. : milestone, 2072,
section candidate
no_agent (1.467 ms) : 1456, 1478
. : milestone, 1467,
appsec (3.781 ms) : 3559, 4003
. : milestone, 3781,
iast (2.251 ms) : 2182, 2320
. : milestone, 2251,
iast_GLOBAL (2.3 ms) : 2230, 2369
. : milestone, 2300,
profiling (2.51 ms) : 2342, 2678
. : milestone, 2510,
tracing (2.073 ms) : 2020, 2127
. : milestone, 2073,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~509213b6b5, baseline=1.61.0-SNAPSHOT~5580c61ac4
dateFormat X
axisFormat %s
section baseline
no_agent (14.761 s) : 14761000, 14761000
. : milestone, 14761000,
appsec (14.791 s) : 14791000, 14791000
. : milestone, 14791000,
iast (18.246 s) : 18246000, 18246000
. : milestone, 18246000,
iast_GLOBAL (18.091 s) : 18091000, 18091000
. : milestone, 18091000,
profiling (15.514 s) : 15514000, 15514000
. : milestone, 15514000,
tracing (15.017 s) : 15017000, 15017000
. : milestone, 15017000,
section candidate
no_agent (15.002 s) : 15002000, 15002000
. : milestone, 15002000,
appsec (14.587 s) : 14587000, 14587000
. : milestone, 14587000,
iast (18.421 s) : 18421000, 18421000
. : milestone, 18421000,
iast_GLOBAL (18.071 s) : 18071000, 18071000
. : milestone, 18071000,
profiling (15.525 s) : 15525000, 15525000
. : milestone, 15525000,
tracing (15.218 s) : 15218000, 15218000
. : milestone, 15218000,
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What Does This Do
Java implementation for protocol v1.
Motivation
Additional Notes
DO NOT MERGE, WIP.