Skip to content

Refactor shallow git tests to use synthetic repo#10825

Open
daniel-mohedano wants to merge 1 commit intomasterfrom
daniel.mohedano/refactor-git-shallow-tests
Open

Refactor shallow git tests to use synthetic repo#10825
daniel-mohedano wants to merge 1 commit intomasterfrom
daniel.mohedano/refactor-git-shallow-tests

Conversation

@daniel-mohedano
Copy link
Contributor

What Does This Do

Motivation

This will avoid failures when Github or the network have any issues which could arise when unshallowing and fetching the remote repository's information.

Additional Notes

test-environment-trigger: skip

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@daniel-mohedano daniel-mohedano added type: enhancement Enhancements and improvements tag: no release notes Changes to exclude from release notes comp: ci visibility Continuous Integration Visibility labels Mar 12, 2026
@daniel-mohedano daniel-mohedano marked this pull request as ready for review March 12, 2026 16:42
@daniel-mohedano daniel-mohedano requested a review from a team as a code owner March 12, 2026 16:42
@pr-commenter
Copy link

pr-commenter bot commented Mar 12, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/refactor-git-shallow-tests
git_commit_date 1773312120 1773333406
git_commit_sha 93c3816 956874e
release_version 1.61.0-SNAPSHOT~93c3816062 1.61.0-SNAPSHOT~956874ecee
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773335061 1773335061
ci_job_id 1501319449 1501319449
ci_pipeline_id 102185407 102185407
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-5k66co3n 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-5k66co3n 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~956874ecee, baseline=1.61.0-SNAPSHOT~93c3816062

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1057820
Total [baseline] (11.038 s) : 0, 11038050
Agent [candidate] (1.059 s) : 0, 1059128
Total [candidate] (11.086 s) : 0, 11085811
section appsec
Agent [baseline] (1.242 s) : 0, 1242495
Total [baseline] (11.104 s) : 0, 11104171
Agent [candidate] (1.247 s) : 0, 1247035
Total [candidate] (11.277 s) : 0, 11277273
section iast
Agent [baseline] (1.238 s) : 0, 1237998
Total [baseline] (11.388 s) : 0, 11387727
Agent [candidate] (1.228 s) : 0, 1227891
Total [candidate] (11.386 s) : 0, 11386481
section profiling
Agent [baseline] (1.18 s) : 0, 1179982
Total [baseline] (10.971 s) : 0, 10971292
Agent [candidate] (1.181 s) : 0, 1181192
Total [candidate] (11.049 s) : 0, 11049036
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent appsec 1.242 s 184.675 ms (17.5%)
Agent iast 1.238 s 180.178 ms (17.0%)
Agent profiling 1.18 s 122.162 ms (11.5%)
Total tracing 11.038 s -
Total appsec 11.104 s 66.121 ms (0.6%)
Total iast 11.388 s 349.677 ms (3.2%)
Total profiling 10.971 s -66.758 ms (-0.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.059 s -
Agent appsec 1.247 s 187.907 ms (17.7%)
Agent iast 1.228 s 168.763 ms (15.9%)
Agent profiling 1.181 s 122.064 ms (11.5%)
Total tracing 11.086 s -
Total appsec 11.277 s 191.462 ms (1.7%)
Total iast 11.386 s 300.67 ms (2.7%)
Total profiling 11.049 s -36.775 ms (-0.3%)
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~956874ecee, baseline=1.61.0-SNAPSHOT~93c3816062

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (628.037 ms) : 0, 628037
BytebuddyAgent [candidate] (627.908 ms) : 0, 627908
AgentMeter [baseline] (29.162 ms) : 0, 29162
AgentMeter [candidate] (29.219 ms) : 0, 29219
GlobalTracer [baseline] (257.368 ms) : 0, 257368
GlobalTracer [candidate] (257.288 ms) : 0, 257288
AppSec [baseline] (31.608 ms) : 0, 31608
AppSec [candidate] (31.546 ms) : 0, 31546
Debugger [baseline] (59.481 ms) : 0, 59481
Debugger [candidate] (59.546 ms) : 0, 59546
Remote Config [baseline] (594.474 µs) : 0, 594
Remote Config [candidate] (610.406 µs) : 0, 610
Telemetry [baseline] (8.67 ms) : 0, 8670
Telemetry [candidate] (8.644 ms) : 0, 8644
Flare Poller [baseline] (5.721 ms) : 0, 5721
Flare Poller [candidate] (7.199 ms) : 0, 7199
section appsec
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.189 ms) : 0, 1189
BytebuddyAgent [baseline] (656.285 ms) : 0, 656285
BytebuddyAgent [candidate] (658.085 ms) : 0, 658085
AgentMeter [baseline] (11.968 ms) : 0, 11968
AgentMeter [candidate] (12.076 ms) : 0, 12076
GlobalTracer [baseline] (257.362 ms) : 0, 257362
GlobalTracer [candidate] (258.835 ms) : 0, 258835
AppSec [baseline] (176.971 ms) : 0, 176971
AppSec [candidate] (177.635 ms) : 0, 177635
Debugger [baseline] (65.607 ms) : 0, 65607
Debugger [candidate] (65.712 ms) : 0, 65712
Remote Config [baseline] (568.862 µs) : 0, 569
Remote Config [candidate] (572.704 µs) : 0, 573
Telemetry [baseline] (8.979 ms) : 0, 8979
Telemetry [candidate] (9.095 ms) : 0, 9095
Flare Poller [baseline] (3.575 ms) : 0, 3575
Flare Poller [candidate] (3.596 ms) : 0, 3596
IAST [baseline] (23.841 ms) : 0, 23841
IAST [candidate] (24.059 ms) : 0, 24059
section iast
crashtracking [baseline] (1.201 ms) : 0, 1201
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (803.618 ms) : 0, 803618
BytebuddyAgent [candidate] (796.769 ms) : 0, 796769
AgentMeter [baseline] (11.611 ms) : 0, 11611
AgentMeter [candidate] (11.343 ms) : 0, 11343
GlobalTracer [baseline] (248.9 ms) : 0, 248900
GlobalTracer [candidate] (247.558 ms) : 0, 247558
AppSec [baseline] (27.441 ms) : 0, 27441
AppSec [candidate] (26.355 ms) : 0, 26355
Debugger [baseline] (63.986 ms) : 0, 63986
Debugger [candidate] (64.16 ms) : 0, 64160
Remote Config [baseline] (526.487 µs) : 0, 526
Remote Config [candidate] (525.711 µs) : 0, 526
Telemetry [baseline] (14.986 ms) : 0, 14986
Telemetry [candidate] (14.586 ms) : 0, 14586
Flare Poller [baseline] (4.185 ms) : 0, 4185
Flare Poller [candidate] (4.436 ms) : 0, 4436
IAST [baseline] (25.327 ms) : 0, 25327
IAST [candidate] (25.098 ms) : 0, 25098
section profiling
crashtracking [baseline] (1.176 ms) : 0, 1176
crashtracking [candidate] (1.165 ms) : 0, 1165
BytebuddyAgent [baseline] (681.709 ms) : 0, 681709
BytebuddyAgent [candidate] (682.124 ms) : 0, 682124
AgentMeter [baseline] (8.604 ms) : 0, 8604
AgentMeter [candidate] (8.688 ms) : 0, 8688
GlobalTracer [baseline] (214.996 ms) : 0, 214996
GlobalTracer [candidate] (215.399 ms) : 0, 215399
AppSec [baseline] (31.901 ms) : 0, 31901
AppSec [candidate] (31.907 ms) : 0, 31907
Debugger [baseline] (63.786 ms) : 0, 63786
Debugger [candidate] (65.363 ms) : 0, 65363
Remote Config [baseline] (588.911 µs) : 0, 589
Remote Config [candidate] (590.85 µs) : 0, 591
Telemetry [baseline] (9.688 ms) : 0, 9688
Telemetry [candidate] (8.19 ms) : 0, 8190
Flare Poller [baseline] (3.467 ms) : 0, 3467
Flare Poller [candidate] (3.44 ms) : 0, 3440
ProfilingAgent [baseline] (93.454 ms) : 0, 93454
ProfilingAgent [candidate] (93.64 ms) : 0, 93640
Profiling [baseline] (94.02 ms) : 0, 94020
Profiling [candidate] (94.212 ms) : 0, 94212
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~956874ecee, baseline=1.61.0-SNAPSHOT~93c3816062

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.061 s) : 0, 1060689
Total [baseline] (8.815 s) : 0, 8815058
Agent [candidate] (1.07 s) : 0, 1070270
Total [candidate] (8.872 s) : 0, 8872123
section iast
Agent [baseline] (1.225 s) : 0, 1224730
Total [baseline] (9.541 s) : 0, 9540519
Agent [candidate] (1.228 s) : 0, 1227784
Total [candidate] (9.532 s) : 0, 9531657
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.061 s -
Agent iast 1.225 s 164.041 ms (15.5%)
Total tracing 8.815 s -
Total iast 9.541 s 725.46 ms (8.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.07 s -
Agent iast 1.228 s 157.514 ms (14.7%)
Total tracing 8.872 s -
Total iast 9.532 s 659.534 ms (7.4%)
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~956874ecee, baseline=1.61.0-SNAPSHOT~93c3816062

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.219 ms) : 0, 1219
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (632.123 ms) : 0, 632123
BytebuddyAgent [candidate] (635.695 ms) : 0, 635695
AgentMeter [baseline] (29.055 ms) : 0, 29055
AgentMeter [candidate] (29.444 ms) : 0, 29444
GlobalTracer [baseline] (256.439 ms) : 0, 256439
GlobalTracer [candidate] (259.018 ms) : 0, 259018
AppSec [baseline] (31.578 ms) : 0, 31578
AppSec [candidate] (31.988 ms) : 0, 31988
Debugger [baseline] (58.621 ms) : 0, 58621
Debugger [candidate] (59.392 ms) : 0, 59392
Remote Config [baseline] (586.529 µs) : 0, 587
Remote Config [candidate] (599.24 µs) : 0, 599
Telemetry [baseline] (8.635 ms) : 0, 8635
Telemetry [candidate] (8.778 ms) : 0, 8778
Flare Poller [baseline] (6.358 ms) : 0, 6358
Flare Poller [candidate] (7.934 ms) : 0, 7934
section iast
crashtracking [baseline] (1.207 ms) : 0, 1207
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (795.675 ms) : 0, 795675
BytebuddyAgent [candidate] (796.822 ms) : 0, 796822
AgentMeter [baseline] (11.314 ms) : 0, 11314
AgentMeter [candidate] (11.303 ms) : 0, 11303
GlobalTracer [baseline] (246.656 ms) : 0, 246656
GlobalTracer [candidate] (247.537 ms) : 0, 247537
AppSec [baseline] (26.317 ms) : 0, 26317
AppSec [candidate] (26.362 ms) : 0, 26362
Debugger [baseline] (62.439 ms) : 0, 62439
Debugger [candidate] (63.129 ms) : 0, 63129
Remote Config [baseline] (548.635 µs) : 0, 549
Remote Config [candidate] (518.03 µs) : 0, 518
Telemetry [baseline] (14.973 ms) : 0, 14973
Telemetry [candidate] (15.186 ms) : 0, 15186
Flare Poller [baseline] (4.559 ms) : 0, 4559
Flare Poller [candidate] (4.555 ms) : 0, 4555
IAST [baseline] (25.083 ms) : 0, 25083
IAST [candidate] (25.117 ms) : 0, 25117
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/refactor-git-shallow-tests
git_commit_date 1773312120 1773333406
git_commit_sha 93c3816 956874e
release_version 1.61.0-SNAPSHOT~93c3816062 1.61.0-SNAPSHOT~956874ecee
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773335542 1773335542
ci_job_id 1501319451 1501319451
ci_pipeline_id 102185407 102185407
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-zecfbbmo 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-zecfbbmo 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 15 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:petclinic:appsec:high_load worse
[+554.791µs; +1322.945µs] or [+3.042%; +7.253%]
worse
[+0.651ms; +2.169ms] or [+2.193%; +7.306%]
unstable
[-36.022op/s; +12.397op/s] or [-14.309%; +4.924%]
19.179ms 31.096ms 239.938op/s 18.241ms 29.686ms 251.750op/s
scenario:load:petclinic:profiling:high_load better
[-2.337ms; -1.790ms] or [-11.270%; -8.630%]
better
[-3.061ms; -1.738ms] or [-9.276%; -5.267%]
unstable
[-0.832op/s; +44.707op/s] or [-0.374%; +20.116%]
18.677ms 30.603ms 244.188op/s 20.740ms 33.003ms 222.250op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~956874ecee, baseline=1.61.0-SNAPSHOT~93c3816062
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.087 ms) : 18892, 19282
.   : milestone, 19087,
appsec (18.538 ms) : 18350, 18726
.   : milestone, 18538,
code_origins (17.723 ms) : 17545, 17900
.   : milestone, 17723,
iast (18.089 ms) : 17908, 18269
.   : milestone, 18089,
profiling (21.009 ms) : 20795, 21222
.   : milestone, 21009,
tracing (17.525 ms) : 17352, 17699
.   : milestone, 17525,
section candidate
no_agent (18.056 ms) : 17870, 18241
.   : milestone, 18056,
appsec (19.452 ms) : 19251, 19652
.   : milestone, 19452,
code_origins (17.959 ms) : 17780, 18138
.   : milestone, 17959,
iast (17.98 ms) : 17801, 18160
.   : milestone, 17980,
profiling (19.112 ms) : 18921, 19303
.   : milestone, 19112,
tracing (17.662 ms) : 17486, 17838
.   : milestone, 17662,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.087 ms [18.892 ms, 19.282 ms] -
appsec 18.538 ms [18.35 ms, 18.726 ms] -549.058 µs (-2.9%)
code_origins 17.723 ms [17.545 ms, 17.9 ms] -1.365 ms (-7.1%)
iast 18.089 ms [17.908 ms, 18.269 ms] -998.514 µs (-5.2%)
profiling 21.009 ms [20.795 ms, 21.222 ms] 1.921 ms (10.1%)
tracing 17.525 ms [17.352 ms, 17.699 ms] -1.562 ms (-8.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.056 ms [17.87 ms, 18.241 ms] -
appsec 19.452 ms [19.251 ms, 19.652 ms] 1.396 ms (7.7%)
code_origins 17.959 ms [17.78 ms, 18.138 ms] -97.066 µs (-0.5%)
iast 17.98 ms [17.801 ms, 18.16 ms] -75.629 µs (-0.4%)
profiling 19.112 ms [18.921 ms, 19.303 ms] 1.056 ms (5.9%)
tracing 17.662 ms [17.486 ms, 17.838 ms] -393.839 µs (-2.2%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~956874ecee, baseline=1.61.0-SNAPSHOT~93c3816062
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.166 ms) : 1155, 1177
.   : milestone, 1166,
iast (3.233 ms) : 3187, 3280
.   : milestone, 3233,
iast_FULL (5.775 ms) : 5718, 5833
.   : milestone, 5775,
iast_GLOBAL (3.608 ms) : 3552, 3665
.   : milestone, 3608,
profiling (1.955 ms) : 1937, 1974
.   : milestone, 1955,
tracing (1.78 ms) : 1765, 1796
.   : milestone, 1780,
section candidate
no_agent (1.191 ms) : 1179, 1202
.   : milestone, 1191,
iast (3.162 ms) : 3119, 3204
.   : milestone, 3162,
iast_FULL (5.719 ms) : 5662, 5775
.   : milestone, 5719,
iast_GLOBAL (3.601 ms) : 3547, 3655
.   : milestone, 3601,
profiling (2.307 ms) : 2285, 2330
.   : milestone, 2307,
tracing (1.786 ms) : 1772, 1801
.   : milestone, 1786,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.166 ms [1.155 ms, 1.177 ms] -
iast 3.233 ms [3.187 ms, 3.28 ms] 2.068 ms (177.3%)
iast_FULL 5.775 ms [5.718 ms, 5.833 ms] 4.609 ms (395.3%)
iast_GLOBAL 3.608 ms [3.552 ms, 3.665 ms] 2.442 ms (209.5%)
profiling 1.955 ms [1.937 ms, 1.974 ms] 789.395 µs (67.7%)
tracing 1.78 ms [1.765 ms, 1.796 ms] 614.331 µs (52.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.191 ms [1.179 ms, 1.202 ms] -
iast 3.162 ms [3.119 ms, 3.204 ms] 1.971 ms (165.5%)
iast_FULL 5.719 ms [5.662 ms, 5.775 ms] 4.528 ms (380.3%)
iast_GLOBAL 3.601 ms [3.547 ms, 3.655 ms] 2.41 ms (202.4%)
profiling 2.307 ms [2.285 ms, 2.33 ms] 1.117 ms (93.8%)
tracing 1.786 ms [1.772 ms, 1.801 ms] 595.557 µs (50.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master daniel.mohedano/refactor-git-shallow-tests
git_commit_date 1773312120 1773333406
git_commit_sha 93c3816 956874e
release_version 1.61.0-SNAPSHOT~93c3816062 1.61.0-SNAPSHOT~956874ecee
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1773335357 1773335357
ci_job_id 1501319454 1501319454
ci_pipeline_id 102185407 102185407
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-7hzx1ktq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-7hzx1ktq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~956874ecee, baseline=1.61.0-SNAPSHOT~93c3816062
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.477 ms) : 1466, 1489
.   : milestone, 1477,
appsec (3.833 ms) : 3612, 4055
.   : milestone, 3833,
iast (2.258 ms) : 2189, 2326
.   : milestone, 2258,
iast_GLOBAL (2.296 ms) : 2227, 2365
.   : milestone, 2296,
profiling (2.495 ms) : 2277, 2713
.   : milestone, 2495,
tracing (2.071 ms) : 2017, 2124
.   : milestone, 2071,
section candidate
no_agent (1.478 ms) : 1466, 1489
.   : milestone, 1478,
appsec (3.82 ms) : 3599, 4041
.   : milestone, 3820,
iast (2.257 ms) : 2188, 2326
.   : milestone, 2257,
iast_GLOBAL (2.298 ms) : 2228, 2367
.   : milestone, 2298,
profiling (2.088 ms) : 2034, 2143
.   : milestone, 2088,
tracing (2.057 ms) : 2004, 2110
.   : milestone, 2057,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.466 ms, 1.489 ms] -
appsec 3.833 ms [3.612 ms, 4.055 ms] 2.356 ms (159.5%)
iast 2.258 ms [2.189 ms, 2.326 ms] 780.176 µs (52.8%)
iast_GLOBAL 2.296 ms [2.227 ms, 2.365 ms] 818.854 µs (55.4%)
profiling 2.495 ms [2.277 ms, 2.713 ms] 1.018 ms (68.9%)
tracing 2.071 ms [2.017 ms, 2.124 ms] 593.268 µs (40.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.478 ms [1.466 ms, 1.489 ms] -
appsec 3.82 ms [3.599 ms, 4.041 ms] 2.342 ms (158.5%)
iast 2.257 ms [2.188 ms, 2.326 ms] 779.137 µs (52.7%)
iast_GLOBAL 2.298 ms [2.228 ms, 2.367 ms] 819.835 µs (55.5%)
profiling 2.088 ms [2.034 ms, 2.143 ms] 610.421 µs (41.3%)
tracing 2.057 ms [2.004 ms, 2.11 ms] 579.569 µs (39.2%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~956874ecee, baseline=1.61.0-SNAPSHOT~93c3816062
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.15 s) : 15150000, 15150000
.   : milestone, 15150000,
appsec (15.046 s) : 15046000, 15046000
.   : milestone, 15046000,
iast (18.211 s) : 18211000, 18211000
.   : milestone, 18211000,
iast_GLOBAL (17.718 s) : 17718000, 17718000
.   : milestone, 17718000,
profiling (14.831 s) : 14831000, 14831000
.   : milestone, 14831000,
tracing (15.277 s) : 15277000, 15277000
.   : milestone, 15277000,
section candidate
no_agent (15.648 s) : 15648000, 15648000
.   : milestone, 15648000,
appsec (14.876 s) : 14876000, 14876000
.   : milestone, 14876000,
iast (17.937 s) : 17937000, 17937000
.   : milestone, 17937000,
iast_GLOBAL (17.721 s) : 17721000, 17721000
.   : milestone, 17721000,
profiling (15.082 s) : 15082000, 15082000
.   : milestone, 15082000,
tracing (15.283 s) : 15283000, 15283000
.   : milestone, 15283000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.15 s [15.15 s, 15.15 s] -
appsec 15.046 s [15.046 s, 15.046 s] -104.0 ms (-0.7%)
iast 18.211 s [18.211 s, 18.211 s] 3.061 s (20.2%)
iast_GLOBAL 17.718 s [17.718 s, 17.718 s] 2.568 s (17.0%)
profiling 14.831 s [14.831 s, 14.831 s] -319.0 ms (-2.1%)
tracing 15.277 s [15.277 s, 15.277 s] 127.0 ms (0.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.648 s [15.648 s, 15.648 s] -
appsec 14.876 s [14.876 s, 14.876 s] -772.0 ms (-4.9%)
iast 17.937 s [17.937 s, 17.937 s] 2.289 s (14.6%)
iast_GLOBAL 17.721 s [17.721 s, 17.721 s] 2.073 s (13.2%)
profiling 15.082 s [15.082 s, 15.082 s] -566.0 ms (-3.6%)
tracing 15.283 s [15.283 s, 15.283 s] -365.0 ms (-2.3%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: ci visibility Continuous Integration Visibility tag: no release notes Changes to exclude from release notes type: enhancement Enhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants