Draft
Conversation
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 66 metrics, 5 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~7d86270c40, baseline=1.61.0-SNAPSHOT~1e2a36d2f8
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1059234
Total [baseline] (8.845 s) : 0, 8844697
Agent [candidate] (1.058 s) : 0, 1057980
Total [candidate] (8.82 s) : 0, 8820475
section iast
Agent [baseline] (1.224 s) : 0, 1224085
Total [baseline] (9.572 s) : 0, 9571702
Agent [candidate] (1.224 s) : 0, 1224178
Total [candidate] (9.535 s) : 0, 9535492
gantt
title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~7d86270c40, baseline=1.61.0-SNAPSHOT~1e2a36d2f8
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.189 ms) : 0, 1189
BytebuddyAgent [baseline] (628.358 ms) : 0, 628358
BytebuddyAgent [candidate] (628.264 ms) : 0, 628264
AgentMeter [baseline] (29.061 ms) : 0, 29061
AgentMeter [candidate] (29.046 ms) : 0, 29046
GlobalTracer [baseline] (257.389 ms) : 0, 257389
GlobalTracer [candidate] (257.451 ms) : 0, 257451
AppSec [baseline] (31.548 ms) : 0, 31548
AppSec [candidate] (31.594 ms) : 0, 31594
Debugger [baseline] (58.716 ms) : 0, 58716
Debugger [candidate] (58.609 ms) : 0, 58609
Remote Config [baseline] (624.308 µs) : 0, 624
Remote Config [candidate] (614.855 µs) : 0, 615
Telemetry [baseline] (8.776 ms) : 0, 8776
Telemetry [candidate] (8.636 ms) : 0, 8636
Flare Poller [baseline] (7.423 ms) : 0, 7423
Flare Poller [candidate] (6.518 ms) : 0, 6518
section iast
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (793.977 ms) : 0, 793977
BytebuddyAgent [candidate] (794.598 ms) : 0, 794598
AgentMeter [baseline] (11.267 ms) : 0, 11267
AgentMeter [candidate] (11.283 ms) : 0, 11283
GlobalTracer [baseline] (246.645 ms) : 0, 246645
GlobalTracer [candidate] (247.382 ms) : 0, 247382
IAST [baseline] (25.064 ms) : 0, 25064
IAST [candidate] (25.12 ms) : 0, 25120
AppSec [baseline] (26.218 ms) : 0, 26218
AppSec [candidate] (26.237 ms) : 0, 26237
Debugger [baseline] (63.398 ms) : 0, 63398
Debugger [candidate] (62.191 ms) : 0, 62191
Remote Config [baseline] (520.005 µs) : 0, 520
Remote Config [candidate] (511.871 µs) : 0, 512
Telemetry [baseline] (14.851 ms) : 0, 14851
Telemetry [candidate] (14.728 ms) : 0, 14728
Flare Poller [baseline] (4.881 ms) : 0, 4881
Flare Poller [candidate] (4.895 ms) : 0, 4895
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~7d86270c40, baseline=1.61.0-SNAPSHOT~1e2a36d2f8
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.072 s) : 0, 1072500
Total [baseline] (11.255 s) : 0, 11254966
Agent [candidate] (1.061 s) : 0, 1061315
Total [candidate] (11.039 s) : 0, 11038969
section appsec
Agent [baseline] (1.263 s) : 0, 1263120
Total [baseline] (11.197 s) : 0, 11197160
Agent [candidate] (1.248 s) : 0, 1248155
Total [candidate] (11.279 s) : 0, 11279350
section iast
Agent [baseline] (1.226 s) : 0, 1225915
Total [baseline] (11.352 s) : 0, 11351860
Agent [candidate] (1.229 s) : 0, 1228553
Total [candidate] (11.414 s) : 0, 11414472
section profiling
Agent [baseline] (1.185 s) : 0, 1185041
Total [baseline] (11.159 s) : 0, 11158923
Agent [candidate] (1.184 s) : 0, 1184053
Total [candidate] (11.087 s) : 0, 11086818
gantt
title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~7d86270c40, baseline=1.61.0-SNAPSHOT~1e2a36d2f8
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.21 ms) : 0, 1210
crashtracking [candidate] (1.18 ms) : 0, 1180
BytebuddyAgent [baseline] (635.113 ms) : 0, 635113
BytebuddyAgent [candidate] (628.916 ms) : 0, 628916
AgentMeter [baseline] (29.366 ms) : 0, 29366
AgentMeter [candidate] (29.162 ms) : 0, 29162
GlobalTracer [baseline] (259.514 ms) : 0, 259514
GlobalTracer [candidate] (257.89 ms) : 0, 257890
AppSec [baseline] (31.86 ms) : 0, 31860
AppSec [candidate] (31.48 ms) : 0, 31480
Debugger [baseline] (60.096 ms) : 0, 60096
Debugger [candidate] (59.387 ms) : 0, 59387
Remote Config [baseline] (629.43 µs) : 0, 629
Remote Config [candidate] (618.367 µs) : 0, 618
Telemetry [baseline] (8.79 ms) : 0, 8790
Telemetry [candidate] (8.694 ms) : 0, 8694
Flare Poller [baseline] (9.658 ms) : 0, 9658
Flare Poller [candidate] (7.912 ms) : 0, 7912
section appsec
crashtracking [baseline] (1.231 ms) : 0, 1231
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (667.984 ms) : 0, 667984
BytebuddyAgent [candidate] (658.524 ms) : 0, 658524
AgentMeter [baseline] (12.189 ms) : 0, 12189
AgentMeter [candidate] (12.137 ms) : 0, 12137
GlobalTracer [baseline] (261.241 ms) : 0, 261241
GlobalTracer [candidate] (258.354 ms) : 0, 258354
IAST [baseline] (24.411 ms) : 0, 24411
IAST [candidate] (24.011 ms) : 0, 24011
AppSec [baseline] (179.556 ms) : 0, 179556
AppSec [candidate] (178.059 ms) : 0, 178059
Debugger [baseline] (66.528 ms) : 0, 66528
Debugger [candidate] (66.15 ms) : 0, 66150
Remote Config [baseline] (575.185 µs) : 0, 575
Remote Config [candidate] (591.547 µs) : 0, 592
Telemetry [baseline] (9.024 ms) : 0, 9024
Telemetry [candidate] (9.095 ms) : 0, 9095
Flare Poller [baseline] (3.661 ms) : 0, 3661
Flare Poller [candidate] (3.705 ms) : 0, 3705
section iast
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.189 ms) : 0, 1189
BytebuddyAgent [baseline] (795.014 ms) : 0, 795014
BytebuddyAgent [candidate] (796.966 ms) : 0, 796966
AgentMeter [baseline] (11.316 ms) : 0, 11316
AgentMeter [candidate] (11.306 ms) : 0, 11306
GlobalTracer [baseline] (247.285 ms) : 0, 247285
GlobalTracer [candidate] (247.636 ms) : 0, 247636
IAST [baseline] (25.064 ms) : 0, 25064
IAST [candidate] (25.149 ms) : 0, 25149
AppSec [baseline] (26.42 ms) : 0, 26420
AppSec [candidate] (26.343 ms) : 0, 26343
Debugger [baseline] (63.308 ms) : 0, 63308
Debugger [candidate] (64.977 ms) : 0, 64977
Remote Config [baseline] (512.994 µs) : 0, 513
Remote Config [candidate] (523.962 µs) : 0, 524
Telemetry [baseline] (14.872 ms) : 0, 14872
Telemetry [candidate] (13.842 ms) : 0, 13842
Flare Poller [baseline] (4.872 ms) : 0, 4872
Flare Poller [candidate] (4.589 ms) : 0, 4589
section profiling
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.174 ms) : 0, 1174
BytebuddyAgent [baseline] (684.231 ms) : 0, 684231
BytebuddyAgent [candidate] (683.911 ms) : 0, 683911
AgentMeter [baseline] (8.702 ms) : 0, 8702
AgentMeter [candidate] (8.655 ms) : 0, 8655
GlobalTracer [baseline] (216.033 ms) : 0, 216033
GlobalTracer [candidate] (215.717 ms) : 0, 215717
AppSec [baseline] (31.99 ms) : 0, 31990
AppSec [candidate] (32.224 ms) : 0, 32224
Debugger [baseline] (64.342 ms) : 0, 64342
Debugger [candidate] (64.541 ms) : 0, 64541
Remote Config [baseline] (596.392 µs) : 0, 596
Remote Config [candidate] (589.048 µs) : 0, 589
Telemetry [baseline] (9.753 ms) : 0, 9753
Telemetry [candidate] (8.967 ms) : 0, 8967
Flare Poller [baseline] (3.54 ms) : 0, 3540
Flare Poller [candidate] (3.517 ms) : 0, 3517
ProfilingAgent [baseline] (93.729 ms) : 0, 93729
ProfilingAgent [candidate] (93.795 ms) : 0, 93795
Profiling [baseline] (94.3 ms) : 0, 94300
Profiling [candidate] (94.346 ms) : 0, 94346
LoadParameters
See matching parameters
SummaryFound 1 performance improvements and 0 performance regressions! Performance is the same for 16 metrics, 19 unstable metrics.
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~7d86270c40, baseline=1.61.0-SNAPSHOT~1e2a36d2f8
dateFormat X
axisFormat %s
section baseline
no_agent (1.187 ms) : 1176, 1199
. : milestone, 1187,
iast (3.257 ms) : 3212, 3301
. : milestone, 3257,
iast_FULL (6.005 ms) : 5945, 6066
. : milestone, 6005,
iast_GLOBAL (3.6 ms) : 3536, 3663
. : milestone, 3600,
profiling (2.235 ms) : 2215, 2256
. : milestone, 2235,
tracing (1.748 ms) : 1733, 1762
. : milestone, 1748,
section candidate
no_agent (1.184 ms) : 1172, 1196
. : milestone, 1184,
iast (3.208 ms) : 3164, 3252
. : milestone, 3208,
iast_FULL (5.972 ms) : 5911, 6033
. : milestone, 5972,
iast_GLOBAL (3.492 ms) : 3435, 3549
. : milestone, 3492,
profiling (2.089 ms) : 2070, 2107
. : milestone, 2089,
tracing (1.821 ms) : 1806, 1836
. : milestone, 1821,
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~7d86270c40, baseline=1.61.0-SNAPSHOT~1e2a36d2f8
dateFormat X
axisFormat %s
section baseline
no_agent (18.133 ms) : 17946, 18321
. : milestone, 18133,
appsec (18.538 ms) : 18354, 18722
. : milestone, 18538,
code_origins (17.562 ms) : 17386, 17739
. : milestone, 17562,
iast (18.275 ms) : 18092, 18459
. : milestone, 18275,
profiling (19.91 ms) : 19707, 20113
. : milestone, 19910,
tracing (17.787 ms) : 17610, 17964
. : milestone, 17787,
section candidate
no_agent (18.241 ms) : 18051, 18431
. : milestone, 18241,
appsec (18.67 ms) : 18480, 18860
. : milestone, 18670,
code_origins (17.661 ms) : 17485, 17838
. : milestone, 17661,
iast (18.102 ms) : 17917, 18287
. : milestone, 18102,
profiling (18.549 ms) : 18365, 18732
. : milestone, 18549,
tracing (17.615 ms) : 17439, 17790
. : milestone, 17615,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~7d86270c40, baseline=1.61.0-SNAPSHOT~1e2a36d2f8
dateFormat X
axisFormat %s
section baseline
no_agent (15.497 s) : 15497000, 15497000
. : milestone, 15497000,
appsec (15.162 s) : 15162000, 15162000
. : milestone, 15162000,
iast (18.499 s) : 18499000, 18499000
. : milestone, 18499000,
iast_GLOBAL (17.919 s) : 17919000, 17919000
. : milestone, 17919000,
profiling (15.003 s) : 15003000, 15003000
. : milestone, 15003000,
tracing (15.136 s) : 15136000, 15136000
. : milestone, 15136000,
section candidate
no_agent (15.701 s) : 15701000, 15701000
. : milestone, 15701000,
appsec (14.272 s) : 14272000, 14272000
. : milestone, 14272000,
iast (18.247 s) : 18247000, 18247000
. : milestone, 18247000,
iast_GLOBAL (17.667 s) : 17667000, 17667000
. : milestone, 17667000,
profiling (15.088 s) : 15088000, 15088000
. : milestone, 15088000,
tracing (15.25 s) : 15250000, 15250000
. : milestone, 15250000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~7d86270c40, baseline=1.61.0-SNAPSHOT~1e2a36d2f8
dateFormat X
axisFormat %s
section baseline
no_agent (1.471 ms) : 1460, 1483
. : milestone, 1471,
appsec (2.521 ms) : 2466, 2576
. : milestone, 2521,
iast (2.252 ms) : 2184, 2321
. : milestone, 2252,
iast_GLOBAL (2.295 ms) : 2226, 2365
. : milestone, 2295,
profiling (2.142 ms) : 2083, 2202
. : milestone, 2142,
tracing (2.065 ms) : 2011, 2119
. : milestone, 2065,
section candidate
no_agent (1.48 ms) : 1469, 1492
. : milestone, 1480,
appsec (3.814 ms) : 3593, 4036
. : milestone, 3814,
iast (2.259 ms) : 2190, 2329
. : milestone, 2259,
iast_GLOBAL (2.297 ms) : 2227, 2366
. : milestone, 2297,
profiling (2.104 ms) : 2047, 2161
. : milestone, 2104,
tracing (2.052 ms) : 1998, 2105
. : milestone, 2052,
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What Does This Do
Java implementation for protocol v1.
Motivation
Additional Notes
DO NOT MERGE, WIP.