Skip to content

feat(ai-guard): return SDS findings into SDK Response#10821

Open
obordeau wants to merge 2 commits intomasterfrom
oceane.bordeau/sds-attach-sdk-response
Open

feat(ai-guard): return SDS findings into SDK Response#10821
obordeau wants to merge 2 commits intomasterfrom
oceane.bordeau/sds-attach-sdk-response

Conversation

@obordeau
Copy link
Contributor

@obordeau obordeau commented Mar 12, 2026

What Does This Do

Takes the SDS tags receives from the AI Guard evaluation API and exposes them in the span tags.

Motivation

Additional Notes

APPSEC-61588 - SDS scans returned in SDK response by AI Guard [system-tests]
System Test for this feature is passing locally

 ./run.sh AI_GUARD
=================================================================================================== test context ====================================================================================================
Scenario: AI_GUARD
Logs folder: ./logs_ai_guard
Starting containers...
Agent: 7.76.1
Backend: datad0g.com
Library: java@1.60.0-SNAPSHOT+5448f3c473
Weblog variant: spring-boot
Weblog system: Linux weblog 6.12.65-linuxkit #1 SMP Thu Jan 15 14:58:53 UTC 2026 aarch64 aarch64 aarch64 GNU/Linux

================================================================================================ test session starts ================================================================================================
collected 2267 items / 2256 deselected / 11 selected                                                                                                                                                                
---------------------------------------------------------------------------------------------------- tests setup ----------------------------------------------------------------------------------------------------

tests/ai_guard/test_ai_guard_sdk.py .........

----------------------------------------------------------------------------------------- Wait for library interface (25s) ------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------- Wait for agent interface (5s) -------------------------------------------------------------------------------------------
------------------------------------------------------------------------------------------ Wait for backend interface (0s) ------------------------------------------------------------------------------------------

tests/ai_guard/test_ai_guard_sdk.py ....X..XX                                                                                                                                                                 [ 81%]
tests/schemas/test_schemas.py ..                                                                                                                                                                              [100%]

-------------------------------------------------- generated xml file: /Users/oceane.bordeau/go/src/github.com/DataDog/system-tests/logs_ai_guard/reportJunit.xml ---------------------------------------------------
============================================================================================== short test summary info ==============================================================================================
XPASS tests/ai_guard/test_ai_guard_sdk.py::Test_RootSpanUserKeep::test_root_span_user_keep missing_feature
XPASS tests/ai_guard/test_ai_guard_sdk.py::Test_SensitiveDataScanning::test_sensitive_data missing_feature (declared version for java is v1.61.0-SNAPSHOT)
XPASS tests/ai_guard/test_ai_guard_sdk.py::Test_SDS_Findings_In_SDK_Response::test_sds_in_response missing_feature

Contributor Checklist

Jira ticket: [APPSEC-61589]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@pr-commenter
Copy link

pr-commenter bot commented Mar 12, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master oceane.bordeau/sds-attach-sdk-response
git_commit_date 1773312120 1773332178
git_commit_sha 93c3816 eec48ac
release_version 1.61.0-SNAPSHOT~93c3816062 1.61.0-SNAPSHOT~eec48acd50
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773334030 1773334030
ci_job_id 1501201479 1501201479
ci_pipeline_id 102179687 102179687
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-lj1fgttp 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-lj1fgttp 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~eec48acd50, baseline=1.61.0-SNAPSHOT~93c3816062

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.057 s) : 0, 1057428
Total [baseline] (11.038 s) : 0, 11037800
Agent [candidate] (1.06 s) : 0, 1060477
Total [candidate] (11.019 s) : 0, 11018988
section appsec
Agent [baseline] (1.271 s) : 0, 1270517
Total [baseline] (11.223 s) : 0, 11223158
Agent [candidate] (1.245 s) : 0, 1245329
Total [candidate] (11.19 s) : 0, 11189758
section iast
Agent [baseline] (1.228 s) : 0, 1227609
Total [baseline] (11.383 s) : 0, 11382801
Agent [candidate] (1.234 s) : 0, 1233646
Total [candidate] (11.265 s) : 0, 11264633
section profiling
Agent [baseline] (1.198 s) : 0, 1197696
Total [baseline] (11.093 s) : 0, 11092551
Agent [candidate] (1.181 s) : 0, 1180751
Total [candidate] (11.061 s) : 0, 11060940
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.057 s -
Agent appsec 1.271 s 213.089 ms (20.2%)
Agent iast 1.228 s 170.181 ms (16.1%)
Agent profiling 1.198 s 140.268 ms (13.3%)
Total tracing 11.038 s -
Total appsec 11.223 s 185.358 ms (1.7%)
Total iast 11.383 s 345.002 ms (3.1%)
Total profiling 11.093 s 54.751 ms (0.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.06 s -
Agent appsec 1.245 s 184.852 ms (17.4%)
Agent iast 1.234 s 173.169 ms (16.3%)
Agent profiling 1.181 s 120.274 ms (11.3%)
Total tracing 11.019 s -
Total appsec 11.19 s 170.769 ms (1.5%)
Total iast 11.265 s 245.645 ms (2.2%)
Total profiling 11.061 s 41.952 ms (0.4%)
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~eec48acd50, baseline=1.61.0-SNAPSHOT~93c3816062

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.201 ms) : 0, 1201
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (627.556 ms) : 0, 627556
BytebuddyAgent [candidate] (627.422 ms) : 0, 627422
AgentMeter [baseline] (29.119 ms) : 0, 29119
AgentMeter [candidate] (29.092 ms) : 0, 29092
GlobalTracer [baseline] (256.966 ms) : 0, 256966
GlobalTracer [candidate] (256.732 ms) : 0, 256732
AppSec [baseline] (31.537 ms) : 0, 31537
AppSec [candidate] (31.512 ms) : 0, 31512
Debugger [baseline] (59.43 ms) : 0, 59430
Debugger [candidate] (59.387 ms) : 0, 59387
Remote Config [baseline] (588.75 µs) : 0, 589
Remote Config [candidate] (592.177 µs) : 0, 592
Telemetry [baseline] (8.616 ms) : 0, 8616
Telemetry [candidate] (8.644 ms) : 0, 8644
Flare Poller [baseline] (6.46 ms) : 0, 6460
Flare Poller [candidate] (9.985 ms) : 0, 9985
section appsec
crashtracking [baseline] (1.218 ms) : 0, 1218
crashtracking [candidate] (1.196 ms) : 0, 1196
BytebuddyAgent [baseline] (673.138 ms) : 0, 673138
BytebuddyAgent [candidate] (657.967 ms) : 0, 657967
AgentMeter [baseline] (12.214 ms) : 0, 12214
AgentMeter [candidate] (12.016 ms) : 0, 12016
GlobalTracer [baseline] (262.677 ms) : 0, 262677
GlobalTracer [candidate] (257.989 ms) : 0, 257989
IAST [baseline] (24.51 ms) : 0, 24510
IAST [candidate] (23.949 ms) : 0, 23949
AppSec [baseline] (179.602 ms) : 0, 179602
AppSec [candidate] (177.192 ms) : 0, 177192
Debugger [baseline] (66.941 ms) : 0, 66941
Debugger [candidate] (65.636 ms) : 0, 65636
Remote Config [baseline] (583.909 µs) : 0, 584
Remote Config [candidate] (563.805 µs) : 0, 564
Telemetry [baseline] (9.18 ms) : 0, 9180
Telemetry [candidate] (9.033 ms) : 0, 9033
Flare Poller [baseline] (3.725 ms) : 0, 3725
Flare Poller [candidate] (3.561 ms) : 0, 3561
section iast
crashtracking [baseline] (1.207 ms) : 0, 1207
crashtracking [candidate] (1.222 ms) : 0, 1222
BytebuddyAgent [baseline] (795.693 ms) : 0, 795693
BytebuddyAgent [candidate] (801.332 ms) : 0, 801332
AgentMeter [baseline] (11.343 ms) : 0, 11343
AgentMeter [candidate] (11.607 ms) : 0, 11607
GlobalTracer [baseline] (248.001 ms) : 0, 248001
GlobalTracer [candidate] (248.541 ms) : 0, 248541
IAST [baseline] (25.135 ms) : 0, 25135
IAST [candidate] (25.238 ms) : 0, 25238
AppSec [baseline] (26.461 ms) : 0, 26461
AppSec [candidate] (26.527 ms) : 0, 26527
Debugger [baseline] (63.657 ms) : 0, 63657
Debugger [candidate] (63.715 ms) : 0, 63715
Remote Config [baseline] (531.275 µs) : 0, 531
Remote Config [candidate] (527.807 µs) : 0, 528
Telemetry [baseline] (15.103 ms) : 0, 15103
Telemetry [candidate] (14.344 ms) : 0, 14344
Flare Poller [baseline] (4.361 ms) : 0, 4361
Flare Poller [candidate] (4.486 ms) : 0, 4486
section profiling
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.164 ms) : 0, 1164
BytebuddyAgent [baseline] (691.689 ms) : 0, 691689
BytebuddyAgent [candidate] (682.627 ms) : 0, 682627
AgentMeter [baseline] (8.724 ms) : 0, 8724
AgentMeter [candidate] (8.595 ms) : 0, 8595
GlobalTracer [baseline] (218.414 ms) : 0, 218414
GlobalTracer [candidate] (215.077 ms) : 0, 215077
AppSec [baseline] (32.504 ms) : 0, 32504
AppSec [candidate] (31.911 ms) : 0, 31911
Debugger [baseline] (65.092 ms) : 0, 65092
Debugger [candidate] (62.419 ms) : 0, 62419
Remote Config [baseline] (612.896 µs) : 0, 613
Remote Config [candidate] (592.599 µs) : 0, 593
Telemetry [baseline] (9.212 ms) : 0, 9212
Telemetry [candidate] (8.997 ms) : 0, 8997
Flare Poller [baseline] (3.587 ms) : 0, 3587
Flare Poller [candidate] (5.107 ms) : 0, 5107
ProfilingAgent [baseline] (95.214 ms) : 0, 95214
ProfilingAgent [candidate] (93.623 ms) : 0, 93623
Profiling [baseline] (95.789 ms) : 0, 95789
Profiling [candidate] (94.188 ms) : 0, 94188
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~eec48acd50, baseline=1.61.0-SNAPSHOT~93c3816062

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.056 s) : 0, 1055514
Total [baseline] (8.785 s) : 0, 8784568
Agent [candidate] (1.058 s) : 0, 1058437
Total [candidate] (8.798 s) : 0, 8798387
section iast
Agent [baseline] (1.228 s) : 0, 1228190
Total [baseline] (9.539 s) : 0, 9538555
Agent [candidate] (1.228 s) : 0, 1228063
Total [candidate] (9.551 s) : 0, 9550891
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent iast 1.228 s 172.676 ms (16.4%)
Total tracing 8.785 s -
Total iast 9.539 s 753.987 ms (8.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.058 s -
Agent iast 1.228 s 169.625 ms (16.0%)
Total tracing 8.798 s -
Total iast 9.551 s 752.504 ms (8.6%)
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~eec48acd50, baseline=1.61.0-SNAPSHOT~93c3816062

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (628.771 ms) : 0, 628771
BytebuddyAgent [candidate] (627.51 ms) : 0, 627510
AgentMeter [baseline] (29.073 ms) : 0, 29073
AgentMeter [candidate] (29.055 ms) : 0, 29055
GlobalTracer [baseline] (256.993 ms) : 0, 256993
GlobalTracer [candidate] (256.626 ms) : 0, 256626
AppSec [baseline] (31.618 ms) : 0, 31618
AppSec [candidate] (31.531 ms) : 0, 31531
Debugger [baseline] (58.946 ms) : 0, 58946
Debugger [candidate] (58.664 ms) : 0, 58664
Remote Config [baseline] (603.378 µs) : 0, 603
Remote Config [candidate] (583.182 µs) : 0, 583
Telemetry [baseline] (8.699 ms) : 0, 8699
Telemetry [candidate] (8.678 ms) : 0, 8678
Flare Poller [baseline] (3.506 ms) : 0, 3506
Flare Poller [candidate] (8.575 ms) : 0, 8575
section iast
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (797.6 ms) : 0, 797600
BytebuddyAgent [candidate] (798.43 ms) : 0, 798430
AgentMeter [baseline] (11.353 ms) : 0, 11353
AgentMeter [candidate] (11.314 ms) : 0, 11314
GlobalTracer [baseline] (248.011 ms) : 0, 248011
GlobalTracer [candidate] (246.978 ms) : 0, 246978
IAST [baseline] (25.051 ms) : 0, 25051
IAST [candidate] (25.088 ms) : 0, 25088
AppSec [baseline] (26.275 ms) : 0, 26275
AppSec [candidate] (26.363 ms) : 0, 26363
Debugger [baseline] (62.629 ms) : 0, 62629
Debugger [candidate] (62.393 ms) : 0, 62393
Remote Config [baseline] (532.907 µs) : 0, 533
Remote Config [candidate] (521.289 µs) : 0, 521
Telemetry [baseline] (15.211 ms) : 0, 15211
Telemetry [candidate] (15.391 ms) : 0, 15391
Flare Poller [baseline] (4.215 ms) : 0, 4215
Flare Poller [candidate] (4.327 ms) : 0, 4327
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master oceane.bordeau/sds-attach-sdk-response
git_commit_date 1773312120 1773332178
git_commit_sha 93c3816 eec48ac
release_version 1.61.0-SNAPSHOT~93c3816062 1.61.0-SNAPSHOT~eec48acd50
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773334557 1773334557
ci_job_id 1501201483 1501201483
ci_pipeline_id 102179687 102179687
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-0012j0rv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-0012j0rv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 1 performance regressions! Performance is the same for 16 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load better
[-141.757µs; -55.919µs] or [-5.617%; -2.216%]
same
[-328.390µs; +24.898µs] or [-4.462%; +0.338%]
unstable
[-94.155op/s; +186.780op/s] or [-6.668%; +13.228%]
2.425ms 7.208ms 1458.281op/s 2.524ms 7.359ms 1411.969op/s
scenario:load:petclinic:iast:high_load worse
[+0.645ms; +1.569ms] or [+3.700%; +8.998%]
unsure
[+0.456ms; +1.850ms] or [+1.594%; +6.472%]
unstable
[-37.665op/s; +12.102op/s] or [-14.405%; +4.629%]
18.545ms 29.742ms 248.688op/s 17.438ms 28.589ms 261.469op/s
scenario:load:petclinic:no_agent:high_load better
[-1.767ms; -0.406ms] or [-9.534%; -2.189%]
unsure
[-3.110ms; -0.447ms] or [-10.137%; -1.458%]
unstable
[-10.505op/s; +41.817op/s] or [-4.286%; +17.062%]
17.445ms 28.901ms 260.750op/s 18.531ms 30.679ms 245.094op/s
scenario:load:petclinic:tracing:high_load better
[-1.584ms; -1.136ms] or [-8.505%; -6.099%]
better
[-1.949ms; -0.765ms] or [-6.493%; -2.550%]
unstable
[-8.051op/s; +40.301op/s] or [-3.257%; +16.306%]
17.261ms 28.665ms 263.281op/s 18.621ms 30.022ms 247.156op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~eec48acd50, baseline=1.61.0-SNAPSHOT~93c3816062
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.046 ms) : 18855, 19237
.   : milestone, 19046,
appsec (18.752 ms) : 18566, 18937
.   : milestone, 18752,
code_origins (17.504 ms) : 17331, 17678
.   : milestone, 17504,
iast (17.853 ms) : 17677, 18030
.   : milestone, 17853,
profiling (18.367 ms) : 18184, 18550
.   : milestone, 18367,
tracing (18.881 ms) : 18694, 19068
.   : milestone, 18881,
section candidate
no_agent (17.901 ms) : 17721, 18081
.   : milestone, 17901,
appsec (18.554 ms) : 18366, 18741
.   : milestone, 18554,
code_origins (17.645 ms) : 17469, 17821
.   : milestone, 17645,
iast (18.768 ms) : 18579, 18956
.   : milestone, 18768,
profiling (18.476 ms) : 18290, 18663
.   : milestone, 18476,
tracing (17.721 ms) : 17546, 17896
.   : milestone, 17721,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.046 ms [18.855 ms, 19.237 ms] -
appsec 18.752 ms [18.566 ms, 18.937 ms] -293.903 µs (-1.5%)
code_origins 17.504 ms [17.331 ms, 17.678 ms] -1.542 ms (-8.1%)
iast 17.853 ms [17.677 ms, 18.03 ms] -1.193 ms (-6.3%)
profiling 18.367 ms [18.184 ms, 18.55 ms] -678.894 µs (-3.6%)
tracing 18.881 ms [18.694 ms, 19.068 ms] -164.912 µs (-0.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.901 ms [17.721 ms, 18.081 ms] -
appsec 18.554 ms [18.366 ms, 18.741 ms] 652.492 µs (3.6%)
code_origins 17.645 ms [17.469 ms, 17.821 ms] -256.323 µs (-1.4%)
iast 18.768 ms [18.579 ms, 18.956 ms] 866.709 µs (4.8%)
profiling 18.476 ms [18.29 ms, 18.663 ms] 575.367 µs (3.2%)
tracing 17.721 ms [17.546 ms, 17.896 ms] -180.148 µs (-1.0%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~eec48acd50, baseline=1.61.0-SNAPSHOT~93c3816062
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.185 ms) : 1173, 1196
.   : milestone, 1185,
iast (3.24 ms) : 3196, 3284
.   : milestone, 3240,
iast_FULL (5.831 ms) : 5773, 5890
.   : milestone, 5831,
iast_GLOBAL (3.507 ms) : 3454, 3560
.   : milestone, 3507,
profiling (2.08 ms) : 2061, 2099
.   : milestone, 2080,
tracing (1.825 ms) : 1808, 1842
.   : milestone, 1825,
section candidate
no_agent (1.201 ms) : 1189, 1213
.   : milestone, 1201,
iast (3.137 ms) : 3095, 3178
.   : milestone, 3137,
iast_FULL (5.6 ms) : 5546, 5655
.   : milestone, 5600,
iast_GLOBAL (3.533 ms) : 3471, 3594
.   : milestone, 3533,
profiling (2.165 ms) : 2145, 2185
.   : milestone, 2165,
tracing (1.758 ms) : 1744, 1771
.   : milestone, 1758,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.185 ms [1.173 ms, 1.196 ms] -
iast 3.24 ms [3.196 ms, 3.284 ms] 2.055 ms (173.5%)
iast_FULL 5.831 ms [5.773 ms, 5.89 ms] 4.647 ms (392.2%)
iast_GLOBAL 3.507 ms [3.454 ms, 3.56 ms] 2.322 ms (196.0%)
profiling 2.08 ms [2.061 ms, 2.099 ms] 895.061 µs (75.6%)
tracing 1.825 ms [1.808 ms, 1.842 ms] 640.312 µs (54.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.201 ms [1.189 ms, 1.213 ms] -
iast 3.137 ms [3.095 ms, 3.178 ms] 1.936 ms (161.2%)
iast_FULL 5.6 ms [5.546 ms, 5.655 ms] 4.399 ms (366.3%)
iast_GLOBAL 3.533 ms [3.471 ms, 3.594 ms] 2.332 ms (194.2%)
profiling 2.165 ms [2.145 ms, 2.185 ms] 964.147 µs (80.3%)
tracing 1.758 ms [1.744 ms, 1.771 ms] 556.697 µs (46.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master oceane.bordeau/sds-attach-sdk-response
git_commit_date 1773312120 1773332178
git_commit_sha 93c3816 eec48ac
release_version 1.61.0-SNAPSHOT~93c3816062 1.61.0-SNAPSHOT~eec48acd50
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1773334165 1773334165
ci_job_id 1501201487 1501201487
ci_pipeline_id 102179687 102179687
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-3-8ywh0is5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-3-8ywh0is5 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 1 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.424ms; -1.083ms] or [-37.862%; -28.796%]
2.507ms 3.760ms
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~eec48acd50, baseline=1.61.0-SNAPSHOT~93c3816062
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.995 s) : 14995000, 14995000
.   : milestone, 14995000,
appsec (14.968 s) : 14968000, 14968000
.   : milestone, 14968000,
iast (17.79 s) : 17790000, 17790000
.   : milestone, 17790000,
iast_GLOBAL (17.686 s) : 17686000, 17686000
.   : milestone, 17686000,
profiling (15.387 s) : 15387000, 15387000
.   : milestone, 15387000,
tracing (15.322 s) : 15322000, 15322000
.   : milestone, 15322000,
section candidate
no_agent (15.5 s) : 15500000, 15500000
.   : milestone, 15500000,
appsec (14.884 s) : 14884000, 14884000
.   : milestone, 14884000,
iast (18.052 s) : 18052000, 18052000
.   : milestone, 18052000,
iast_GLOBAL (17.662 s) : 17662000, 17662000
.   : milestone, 17662000,
profiling (14.932 s) : 14932000, 14932000
.   : milestone, 14932000,
tracing (15.01 s) : 15010000, 15010000
.   : milestone, 15010000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.995 s [14.995 s, 14.995 s] -
appsec 14.968 s [14.968 s, 14.968 s] -27.0 ms (-0.2%)
iast 17.79 s [17.79 s, 17.79 s] 2.795 s (18.6%)
iast_GLOBAL 17.686 s [17.686 s, 17.686 s] 2.691 s (17.9%)
profiling 15.387 s [15.387 s, 15.387 s] 392.0 ms (2.6%)
tracing 15.322 s [15.322 s, 15.322 s] 327.0 ms (2.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.5 s [15.5 s, 15.5 s] -
appsec 14.884 s [14.884 s, 14.884 s] -616.0 ms (-4.0%)
iast 18.052 s [18.052 s, 18.052 s] 2.552 s (16.5%)
iast_GLOBAL 17.662 s [17.662 s, 17.662 s] 2.162 s (13.9%)
profiling 14.932 s [14.932 s, 14.932 s] -568.0 ms (-3.7%)
tracing 15.01 s [15.01 s, 15.01 s] -490.0 ms (-3.2%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~eec48acd50, baseline=1.61.0-SNAPSHOT~93c3816062
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.475 ms) : 1464, 1487
.   : milestone, 1475,
appsec (3.76 ms) : 3543, 3978
.   : milestone, 3760,
iast (2.256 ms) : 2187, 2325
.   : milestone, 2256,
iast_GLOBAL (2.306 ms) : 2236, 2375
.   : milestone, 2306,
profiling (2.506 ms) : 2342, 2671
.   : milestone, 2506,
tracing (2.057 ms) : 2003, 2110
.   : milestone, 2057,
section candidate
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (2.507 ms) : 2453, 2562
.   : milestone, 2507,
iast (2.272 ms) : 2202, 2342
.   : milestone, 2272,
iast_GLOBAL (2.304 ms) : 2235, 2374
.   : milestone, 2304,
profiling (2.515 ms) : 2300, 2731
.   : milestone, 2515,
tracing (2.069 ms) : 2014, 2123
.   : milestone, 2069,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.464 ms, 1.487 ms] -
appsec 3.76 ms [3.543 ms, 3.978 ms] 2.285 ms (154.9%)
iast 2.256 ms [2.187 ms, 2.325 ms] 780.431 µs (52.9%)
iast_GLOBAL 2.306 ms [2.236 ms, 2.375 ms] 830.523 µs (56.3%)
profiling 2.506 ms [2.342 ms, 2.671 ms] 1.031 ms (69.9%)
tracing 2.057 ms [2.003 ms, 2.11 ms] 581.358 µs (39.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 2.507 ms [2.453 ms, 2.562 ms] 1.033 ms (70.1%)
iast 2.272 ms [2.202 ms, 2.342 ms] 797.598 µs (54.1%)
iast_GLOBAL 2.304 ms [2.235 ms, 2.374 ms] 830.175 µs (56.3%)
profiling 2.515 ms [2.3 ms, 2.731 ms] 1.041 ms (70.6%)
tracing 2.069 ms [2.014 ms, 2.123 ms] 594.343 µs (40.3%)

@obordeau obordeau marked this pull request as ready for review March 13, 2026 09:24
@obordeau obordeau requested a review from a team as a code owner March 13, 2026 09:24
@github-actions
Copy link
Contributor

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@obordeau obordeau added type: enhancement Enhancements and improvements comp: asm waf Application Security Management (WAF) tag: experimental Experimental changes labels Mar 13, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: asm waf Application Security Management (WAF) tag: experimental Experimental changes type: enhancement Enhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant