Skip to content

Fix version parsing in smoke test latest version resolution#10817

Open
daniel-mohedano wants to merge 4 commits intomasterfrom
daniel.mohedano/latest-smoke-test-fix
Open

Fix version parsing in smoke test latest version resolution#10817
daniel-mohedano wants to merge 4 commits intomasterfrom
daniel.mohedano/latest-smoke-test-fix

Conversation

@daniel-mohedano
Copy link
Contributor

@daniel-mohedano daniel-mohedano commented Mar 12, 2026

What Does This Do

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@daniel-mohedano daniel-mohedano added the tag: do not merge Do not merge changes label Mar 12, 2026
@daniel-mohedano daniel-mohedano added type: bug Bug report and fix tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling and removed tag: do not merge Do not merge changes labels Mar 12, 2026
@daniel-mohedano daniel-mohedano changed the title fix: version parsing Fix version parsing in smoke test latest version resolution Mar 12, 2026
@daniel-mohedano daniel-mohedano marked this pull request as ready for review March 12, 2026 11:36
@daniel-mohedano daniel-mohedano requested a review from a team as a code owner March 12, 2026 11:36
@pr-commenter
Copy link

pr-commenter bot commented Mar 12, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/latest-smoke-test-fix
git_commit_date 1773312120 1773315264
git_commit_sha 93c3816 da34d27
release_version 1.61.0-SNAPSHOT~93c3816062 1.61.0-SNAPSHOT~da34d27f0e
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773317157 1773317157
ci_job_id 1499932440 1499932440
ci_pipeline_id 102104895 102104895
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-gztuqeof 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-gztuqeof 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~da34d27f0e, baseline=1.61.0-SNAPSHOT~93c3816062

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.062 s) : 0, 1062321
Total [baseline] (8.819 s) : 0, 8819017
Agent [candidate] (1.055 s) : 0, 1054606
Total [candidate] (8.787 s) : 0, 8787045
section iast
Agent [baseline] (1.242 s) : 0, 1241694
Total [baseline] (9.596 s) : 0, 9596349
Agent [candidate] (1.224 s) : 0, 1224154
Total [candidate] (9.54 s) : 0, 9539780
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.062 s -
Agent iast 1.242 s 179.373 ms (16.9%)
Total tracing 8.819 s -
Total iast 9.596 s 777.333 ms (8.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent iast 1.224 s 169.548 ms (16.1%)
Total tracing 8.787 s -
Total iast 9.54 s 752.735 ms (8.6%)
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~da34d27f0e, baseline=1.61.0-SNAPSHOT~93c3816062

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.212 ms) : 0, 1212
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (632.356 ms) : 0, 632356
BytebuddyAgent [candidate] (627.038 ms) : 0, 627038
AgentMeter [baseline] (29.234 ms) : 0, 29234
AgentMeter [candidate] (28.97 ms) : 0, 28970
GlobalTracer [baseline] (258.229 ms) : 0, 258229
GlobalTracer [candidate] (256.367 ms) : 0, 256367
AppSec [baseline] (31.73 ms) : 0, 31730
AppSec [candidate] (31.539 ms) : 0, 31539
Debugger [baseline] (58.962 ms) : 0, 58962
Debugger [candidate] (58.537 ms) : 0, 58537
Remote Config [baseline] (588.324 µs) : 0, 588
Remote Config [candidate] (588.355 µs) : 0, 588
Telemetry [baseline] (8.779 ms) : 0, 8779
Telemetry [candidate] (8.696 ms) : 0, 8696
Flare Poller [baseline] (5.08 ms) : 0, 5080
Flare Poller [candidate] (5.714 ms) : 0, 5714
section iast
crashtracking [baseline] (1.214 ms) : 0, 1214
crashtracking [candidate] (1.177 ms) : 0, 1177
BytebuddyAgent [baseline] (806.778 ms) : 0, 806778
BytebuddyAgent [candidate] (794.627 ms) : 0, 794627
AgentMeter [baseline] (11.822 ms) : 0, 11822
AgentMeter [candidate] (11.319 ms) : 0, 11319
GlobalTracer [baseline] (249.734 ms) : 0, 249734
GlobalTracer [candidate] (247.213 ms) : 0, 247213
IAST [baseline] (25.507 ms) : 0, 25507
IAST [candidate] (25.093 ms) : 0, 25093
AppSec [baseline] (26.763 ms) : 0, 26763
AppSec [candidate] (26.282 ms) : 0, 26282
Debugger [baseline] (63.278 ms) : 0, 63278
Debugger [candidate] (62.404 ms) : 0, 62404
Remote Config [baseline] (533.609 µs) : 0, 534
Remote Config [candidate] (525.953 µs) : 0, 526
Telemetry [baseline] (15.305 ms) : 0, 15305
Telemetry [candidate] (14.701 ms) : 0, 14701
Flare Poller [baseline] (4.317 ms) : 0, 4317
Flare Poller [candidate] (4.815 ms) : 0, 4815
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~da34d27f0e, baseline=1.61.0-SNAPSHOT~93c3816062

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1058621
Total [baseline] (10.993 s) : 0, 10993484
Agent [candidate] (1.058 s) : 0, 1057631
Total [candidate] (11.045 s) : 0, 11045255
section appsec
Agent [baseline] (1.246 s) : 0, 1245629
Total [baseline] (11.119 s) : 0, 11118801
Agent [candidate] (1.245 s) : 0, 1245056
Total [candidate] (11.145 s) : 0, 11145466
section iast
Agent [baseline] (1.228 s) : 0, 1227644
Total [baseline] (11.332 s) : 0, 11332052
Agent [candidate] (1.231 s) : 0, 1230945
Total [candidate] (11.335 s) : 0, 11335196
section profiling
Agent [baseline] (1.185 s) : 0, 1185269
Total [baseline] (11.092 s) : 0, 11091586
Agent [candidate] (1.187 s) : 0, 1186541
Total [candidate] (10.998 s) : 0, 10998010
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent appsec 1.246 s 187.008 ms (17.7%)
Agent iast 1.228 s 169.023 ms (16.0%)
Agent profiling 1.185 s 126.648 ms (12.0%)
Total tracing 10.993 s -
Total appsec 11.119 s 125.317 ms (1.1%)
Total iast 11.332 s 338.568 ms (3.1%)
Total profiling 11.092 s 98.101 ms (0.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent appsec 1.245 s 187.424 ms (17.7%)
Agent iast 1.231 s 173.314 ms (16.4%)
Agent profiling 1.187 s 128.91 ms (12.2%)
Total tracing 11.045 s -
Total appsec 11.145 s 100.211 ms (0.9%)
Total iast 11.335 s 289.941 ms (2.6%)
Total profiling 10.998 s -47.245 ms (-0.4%)
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~da34d27f0e, baseline=1.61.0-SNAPSHOT~93c3816062

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (628.566 ms) : 0, 628566
BytebuddyAgent [candidate] (626.433 ms) : 0, 626433
AgentMeter [baseline] (29.103 ms) : 0, 29103
AgentMeter [candidate] (29.074 ms) : 0, 29074
GlobalTracer [baseline] (256.853 ms) : 0, 256853
GlobalTracer [candidate] (256.369 ms) : 0, 256369
AppSec [baseline] (31.668 ms) : 0, 31668
AppSec [candidate] (31.53 ms) : 0, 31530
Debugger [baseline] (59.453 ms) : 0, 59453
Debugger [candidate] (59.356 ms) : 0, 59356
Remote Config [baseline] (588.972 µs) : 0, 589
Remote Config [candidate] (584.826 µs) : 0, 585
Telemetry [baseline] (8.671 ms) : 0, 8671
Telemetry [candidate] (8.633 ms) : 0, 8633
Flare Poller [baseline] (6.427 ms) : 0, 6427
Flare Poller [candidate] (8.644 ms) : 0, 8644
section appsec
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (659.373 ms) : 0, 659373
BytebuddyAgent [candidate] (657.335 ms) : 0, 657335
AgentMeter [baseline] (12.027 ms) : 0, 12027
AgentMeter [candidate] (11.986 ms) : 0, 11986
GlobalTracer [baseline] (257.501 ms) : 0, 257501
GlobalTracer [candidate] (258.471 ms) : 0, 258471
IAST [baseline] (23.862 ms) : 0, 23862
IAST [candidate] (23.937 ms) : 0, 23937
AppSec [baseline] (176.903 ms) : 0, 176903
AppSec [candidate] (177.129 ms) : 0, 177129
Debugger [baseline] (65.535 ms) : 0, 65535
Debugger [candidate] (65.61 ms) : 0, 65610
Remote Config [baseline] (575.171 µs) : 0, 575
Remote Config [candidate] (571.48 µs) : 0, 571
Telemetry [baseline] (8.836 ms) : 0, 8836
Telemetry [candidate] (9.062 ms) : 0, 9062
Flare Poller [baseline] (3.561 ms) : 0, 3561
Flare Poller [candidate] (3.59 ms) : 0, 3590
section iast
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (797.243 ms) : 0, 797243
BytebuddyAgent [candidate] (798.212 ms) : 0, 798212
AgentMeter [baseline] (11.269 ms) : 0, 11269
AgentMeter [candidate] (11.41 ms) : 0, 11410
GlobalTracer [baseline] (246.643 ms) : 0, 246643
GlobalTracer [candidate] (248.677 ms) : 0, 248677
IAST [baseline] (25.1 ms) : 0, 25100
IAST [candidate] (25.365 ms) : 0, 25365
AppSec [baseline] (26.311 ms) : 0, 26311
AppSec [candidate] (26.674 ms) : 0, 26674
Debugger [baseline] (65.467 ms) : 0, 65467
Debugger [candidate] (63.16 ms) : 0, 63160
Remote Config [baseline] (550.166 µs) : 0, 550
Remote Config [candidate] (527.786 µs) : 0, 528
Telemetry [baseline] (13.831 ms) : 0, 13831
Telemetry [candidate] (14.999 ms) : 0, 14999
Flare Poller [baseline] (3.84 ms) : 0, 3840
Flare Poller [candidate] (4.739 ms) : 0, 4739
section profiling
crashtracking [baseline] (1.168 ms) : 0, 1168
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (684.467 ms) : 0, 684467
BytebuddyAgent [candidate] (685.629 ms) : 0, 685629
AgentMeter [baseline] (8.645 ms) : 0, 8645
AgentMeter [candidate] (8.614 ms) : 0, 8614
GlobalTracer [baseline] (216.078 ms) : 0, 216078
GlobalTracer [candidate] (216.279 ms) : 0, 216279
AppSec [baseline] (31.93 ms) : 0, 31930
AppSec [candidate] (32.107 ms) : 0, 32107
Debugger [baseline] (63.271 ms) : 0, 63271
Debugger [candidate] (63.923 ms) : 0, 63923
Remote Config [baseline] (589.632 µs) : 0, 590
Remote Config [candidate] (595.152 µs) : 0, 595
Telemetry [baseline] (10.581 ms) : 0, 10581
Telemetry [candidate] (9.863 ms) : 0, 9863
Flare Poller [baseline] (3.497 ms) : 0, 3497
Flare Poller [candidate] (3.474 ms) : 0, 3474
ProfilingAgent [baseline] (94.147 ms) : 0, 94147
ProfilingAgent [candidate] (93.849 ms) : 0, 93849
Profiling [baseline] (94.718 ms) : 0, 94718
Profiling [candidate] (94.418 ms) : 0, 94418
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/latest-smoke-test-fix
git_commit_date 1773312120 1773315264
git_commit_sha 93c3816 da34d27
release_version 1.61.0-SNAPSHOT~93c3816062 1.61.0-SNAPSHOT~da34d27f0e
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773317639 1773317639
ci_job_id 1499932441 1499932441
ci_pipeline_id 102104895 102104895
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-4-ic28dl9d 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-4-ic28dl9d 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 18 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load better
[-320.671µs; -109.599µs] or [-6.149%; -2.102%]
unsure
[-813.921µs; -106.602µs] or [-6.587%; -0.863%]
unstable
[-57.344op/s; +111.344op/s] or [-7.248%; +14.074%]
5.000ms 11.896ms 818.156op/s 5.215ms 12.356ms 791.156op/s
scenario:load:petclinic:no_agent:high_load worse
[+0.645ms; +2.186ms] or [+3.674%; +12.444%]
unstable
[+0.351ms; +3.316ms] or [+1.192%; +11.263%]
unstable
[-48.560op/s; +12.248op/s] or [-18.747%; +4.728%]
18.978ms 31.271ms 240.875op/s 17.563ms 29.438ms 259.031op/s
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~da34d27f0e, baseline=1.61.0-SNAPSHOT~93c3816062
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.171 ms) : 1159, 1182
.   : milestone, 1171,
iast (3.239 ms) : 3196, 3282
.   : milestone, 3239,
iast_FULL (5.845 ms) : 5787, 5904
.   : milestone, 5845,
iast_GLOBAL (3.615 ms) : 3551, 3678
.   : milestone, 3615,
profiling (2.29 ms) : 2268, 2311
.   : milestone, 2290,
tracing (1.761 ms) : 1748, 1775
.   : milestone, 1761,
section candidate
no_agent (1.194 ms) : 1182, 1205
.   : milestone, 1194,
iast (3.21 ms) : 3165, 3255
.   : milestone, 3210,
iast_FULL (5.649 ms) : 5593, 5704
.   : milestone, 5649,
iast_GLOBAL (3.581 ms) : 3517, 3644
.   : milestone, 3581,
profiling (2.095 ms) : 2076, 2114
.   : milestone, 2095,
tracing (1.786 ms) : 1771, 1800
.   : milestone, 1786,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.171 ms [1.159 ms, 1.182 ms] -
iast 3.239 ms [3.196 ms, 3.282 ms] 2.069 ms (176.7%)
iast_FULL 5.845 ms [5.787 ms, 5.904 ms] 4.675 ms (399.4%)
iast_GLOBAL 3.615 ms [3.551 ms, 3.678 ms] 2.444 ms (208.8%)
profiling 2.29 ms [2.268 ms, 2.311 ms] 1.119 ms (95.6%)
tracing 1.761 ms [1.748 ms, 1.775 ms] 590.787 µs (50.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.194 ms [1.182 ms, 1.205 ms] -
iast 3.21 ms [3.165 ms, 3.255 ms] 2.016 ms (168.9%)
iast_FULL 5.649 ms [5.593 ms, 5.704 ms] 4.455 ms (373.2%)
iast_GLOBAL 3.581 ms [3.517 ms, 3.644 ms] 2.387 ms (200.0%)
profiling 2.095 ms [2.076 ms, 2.114 ms] 901.177 µs (75.5%)
tracing 1.786 ms [1.771 ms, 1.8 ms] 591.934 µs (49.6%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~da34d27f0e, baseline=1.61.0-SNAPSHOT~93c3816062
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.016 ms) : 17831, 18200
.   : milestone, 18016,
appsec (19.423 ms) : 19223, 19623
.   : milestone, 19423,
code_origins (18.254 ms) : 18076, 18432
.   : milestone, 18254,
iast (17.91 ms) : 17731, 18089
.   : milestone, 17910,
profiling (18.656 ms) : 18466, 18847
.   : milestone, 18656,
tracing (18.068 ms) : 17884, 18252
.   : milestone, 18068,
section candidate
no_agent (19.376 ms) : 19178, 19574
.   : milestone, 19376,
appsec (19.685 ms) : 19486, 19884
.   : milestone, 19685,
code_origins (17.738 ms) : 17559, 17917
.   : milestone, 17738,
iast (18.57 ms) : 18380, 18760
.   : milestone, 18570,
profiling (18.51 ms) : 18329, 18692
.   : milestone, 18510,
tracing (17.73 ms) : 17552, 17907
.   : milestone, 17730,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.016 ms [17.831 ms, 18.2 ms] -
appsec 19.423 ms [19.223 ms, 19.623 ms] 1.407 ms (7.8%)
code_origins 18.254 ms [18.076 ms, 18.432 ms] 238.426 µs (1.3%)
iast 17.91 ms [17.731 ms, 18.089 ms] -105.467 µs (-0.6%)
profiling 18.656 ms [18.466 ms, 18.847 ms] 640.492 µs (3.6%)
tracing 18.068 ms [17.884 ms, 18.252 ms] 52.217 µs (0.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.376 ms [19.178 ms, 19.574 ms] -
appsec 19.685 ms [19.486 ms, 19.884 ms] 308.951 µs (1.6%)
code_origins 17.738 ms [17.559 ms, 17.917 ms] -1.638 ms (-8.5%)
iast 18.57 ms [18.38 ms, 18.76 ms] -805.84 µs (-4.2%)
profiling 18.51 ms [18.329 ms, 18.692 ms] -865.329 µs (-4.5%)
tracing 17.73 ms [17.552 ms, 17.907 ms] -1.646 ms (-8.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/latest-smoke-test-fix
git_commit_date 1773312120 1773315264
git_commit_sha 93c3816 da34d27
release_version 1.61.0-SNAPSHOT~93c3816062 1.61.0-SNAPSHOT~da34d27f0e
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1773317397 1773317397
ci_job_id 1499932442 1499932442
ci_pipeline_id 102104895 102104895
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-5-sx1ucu5d 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-5-sx1ucu5d 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~da34d27f0e, baseline=1.61.0-SNAPSHOT~93c3816062
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.64 s) : 15640000, 15640000
.   : milestone, 15640000,
appsec (14.987 s) : 14987000, 14987000
.   : milestone, 14987000,
iast (17.901 s) : 17901000, 17901000
.   : milestone, 17901000,
iast_GLOBAL (17.545 s) : 17545000, 17545000
.   : milestone, 17545000,
profiling (14.826 s) : 14826000, 14826000
.   : milestone, 14826000,
tracing (15.04 s) : 15040000, 15040000
.   : milestone, 15040000,
section candidate
no_agent (15.31 s) : 15310000, 15310000
.   : milestone, 15310000,
appsec (15.191 s) : 15191000, 15191000
.   : milestone, 15191000,
iast (18.188 s) : 18188000, 18188000
.   : milestone, 18188000,
iast_GLOBAL (17.623 s) : 17623000, 17623000
.   : milestone, 17623000,
profiling (15.401 s) : 15401000, 15401000
.   : milestone, 15401000,
tracing (15.051 s) : 15051000, 15051000
.   : milestone, 15051000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.64 s [15.64 s, 15.64 s] -
appsec 14.987 s [14.987 s, 14.987 s] -653.0 ms (-4.2%)
iast 17.901 s [17.901 s, 17.901 s] 2.261 s (14.5%)
iast_GLOBAL 17.545 s [17.545 s, 17.545 s] 1.905 s (12.2%)
profiling 14.826 s [14.826 s, 14.826 s] -814.0 ms (-5.2%)
tracing 15.04 s [15.04 s, 15.04 s] -600.0 ms (-3.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.31 s [15.31 s, 15.31 s] -
appsec 15.191 s [15.191 s, 15.191 s] -119.0 ms (-0.8%)
iast 18.188 s [18.188 s, 18.188 s] 2.878 s (18.8%)
iast_GLOBAL 17.623 s [17.623 s, 17.623 s] 2.313 s (15.1%)
profiling 15.401 s [15.401 s, 15.401 s] 91.0 ms (0.6%)
tracing 15.051 s [15.051 s, 15.051 s] -259.0 ms (-1.7%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~da34d27f0e, baseline=1.61.0-SNAPSHOT~93c3816062
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (3.797 ms) : 3573, 4020
.   : milestone, 3797,
iast (2.263 ms) : 2193, 2333
.   : milestone, 2263,
iast_GLOBAL (2.303 ms) : 2233, 2374
.   : milestone, 2303,
profiling (2.085 ms) : 2030, 2140
.   : milestone, 2085,
tracing (2.074 ms) : 2020, 2128
.   : milestone, 2074,
section candidate
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (3.783 ms) : 3563, 4003
.   : milestone, 3783,
iast (2.257 ms) : 2188, 2326
.   : milestone, 2257,
iast_GLOBAL (2.304 ms) : 2234, 2374
.   : milestone, 2304,
profiling (2.107 ms) : 2050, 2163
.   : milestone, 2107,
tracing (2.069 ms) : 2015, 2123
.   : milestone, 2069,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.472 ms [1.461 ms, 1.484 ms] -
appsec 3.797 ms [3.573 ms, 4.02 ms] 2.325 ms (157.9%)
iast 2.263 ms [2.193 ms, 2.333 ms] 791.262 µs (53.8%)
iast_GLOBAL 2.303 ms [2.233 ms, 2.374 ms] 831.34 µs (56.5%)
profiling 2.085 ms [2.03 ms, 2.14 ms] 612.491 µs (41.6%)
tracing 2.074 ms [2.02 ms, 2.128 ms] 602.04 µs (40.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.483 ms] -
appsec 3.783 ms [3.563 ms, 4.003 ms] 2.312 ms (157.1%)
iast 2.257 ms [2.188 ms, 2.326 ms] 785.994 µs (53.4%)
iast_GLOBAL 2.304 ms [2.234 ms, 2.374 ms] 832.774 µs (56.6%)
profiling 2.107 ms [2.05 ms, 2.163 ms] 635.485 µs (43.2%)
tracing 2.069 ms [2.015 ms, 2.123 ms] 597.614 µs (40.6%)

Copy link
Contributor

@sarahchen6 sarahchen6 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: bug Bug report and fix

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants