Skip to content

🪞 9979 - Instrumentation test error visibility #10300

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
mcculls wants to merge 5 commits into
base: master
Choose a base branch
from
Open

🪞 9979 - Instrumentation test error visibility #10300

mcculls wants to merge 5 commits into from
+124 −37

Conversation

@mcculls
Copy link
Contributor

@mcculls mcculls commented Jan 7, 2026

This PR mirrors the changes from the original community contribution to enable CI testing with maintainer privileges.

Original PR: #9979
Original Author: @deejgregor
Original Branch: deejgregor/dd-trace-java:feature-instrumentation-test-error-visibility

Closes #9979

This is an automated mirror created to run CI checks. See tooling/mirror-community-pull-request.sh for details.

@deejgregor @mcculls
ExceptionHandlers: Fix code in bytecode comment
b75ddc1
@deejgregor @mcculls
InstrumentationContext: be more explicit about the reasons for failure
b0a2570
@deejgregor @mcculls
Add instrumentation error details on test failures
d5dd82b 
This puts the details front and center in the test summary and is
much easier than hunting back through log messages.

Note: In InstrumentationErrors, errors are only recorded when
enableRecordingAndReset has been called. This is only done from the
InstrumentationSpecification test specification, so we don't need
to worry about the ArrayList growing without bounds in production.
I considered adding a limit to the ArrayList, but opted not to for
simplicity. I also wanted to avoid silently discarding some errors.
@deejgregor @mcculls
Check for blocked instrumentation in tests
332a4f4 
If there is a blocked instrumentation, the test will fail and the
failure message will include the same information that is logged
from MuzzleCheck.
@deejgregor @mcculls
Fail fast on muzzle or instrumentation errors
e9388b2
@mcculls mcculls requested a review from a team as a code owner January 7, 2026 10:36
@mcculls mcculls added the tag: community Community contribution label Jan 7, 2026
@mcculls mcculls requested a review from amarziali January 7, 2026 10:36
@mcculls mcculls added the tag: do not merge Do not merge changes label Jan 7, 2026
@mcculls
Copy link
Contributor Author

mcculls commented Jan 7, 2026

Created this to mainly run CI checks - there are a couple of things to clean up before this can be merged.

@github-actions
Copy link
Contributor

github-actions bot commented Jan 7, 2026

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@mcculls mcculls added type: enhancement Enhancements and improvements comp: tooling Build & Tooling labels Jan 7, 2026
@pr-commenter
Copy link

pr-commenter bot commented Jan 7, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master community-pr-9979
git_commit_date 1767720455 1767782168
git_commit_sha 92c84e2 e9388b2
release_version 1.59.0-SNAPSHOT~92c84e28db 1.59.0-SNAPSHOT~e9388b2bab
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767784024 1767784024
ci_job_id 1332369573 1332369573
ci_pipeline_id 89411565 89411565
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-wqcd17sy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-wqcd17sy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 9 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.59.0-SNAPSHOT~e9388b2bab, baseline=1.59.0-SNAPSHOT~92c84e28db

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.09 s) : 0, 1090211
Total [baseline] (10.981 s) : 0, 10981108
Agent [candidate] (1.084 s) : 0, 1084101
Total [candidate] (10.919 s) : 0, 10918929
section appsec
Agent [baseline] (1.274 s) : 0, 1274420
Total [baseline] (10.949 s) : 0, 10948515
Agent [candidate] (1.267 s) : 0, 1266946
Total [candidate] (11.024 s) : 0, 11023503
section iast
Agent [baseline] (1.236 s) : 0, 1235847
Total [baseline] (11.369 s) : 0, 11369396
Agent [candidate] (1.225 s) : 0, 1225108
Total [candidate] (11.138 s) : 0, 11138364
section profiling
Agent [baseline] (1.205 s) : 0, 1204957
Total [baseline] (10.927 s) : 0, 10926509
Agent [candidate] (1.212 s) : 0, 1211779
Total [candidate] (10.973 s) : 0, 10973250
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.09 s -
Agent appsec 1.274 s 184.209 ms (16.9%)
Agent iast 1.236 s 145.636 ms (13.4%)
Agent profiling 1.205 s 114.746 ms (10.5%)
Total tracing 10.981 s -
Total appsec 10.949 s -32.593 ms (-0.3%)
Total iast 11.369 s 388.288 ms (3.5%)
Total profiling 10.927 s -54.599 ms (-0.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.084 s -
Agent appsec 1.267 s 182.845 ms (16.9%)
Agent iast 1.225 s 141.007 ms (13.0%)
Agent profiling 1.212 s 127.678 ms (11.8%)
Total tracing 10.919 s -
Total appsec 11.024 s 104.573 ms (1.0%)
Total iast 11.138 s 219.434 ms (2.0%)
Total profiling 10.973 s 54.32 ms (0.5%) 
gantt
    title petclinic - break down per module: candidate=1.59.0-SNAPSHOT~e9388b2bab, baseline=1.59.0-SNAPSHOT~92c84e28db

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.182 ms) : 0, 1182
BytebuddyAgent [baseline] (654.333 ms) : 0, 654333
BytebuddyAgent [candidate] (650.65 ms) : 0, 650650
GlobalTracer [baseline] (283.242 ms) : 0, 283242
GlobalTracer [candidate] (282.296 ms) : 0, 282296
AppSec [baseline] (32.675 ms) : 0, 32675
AppSec [candidate] (32.442 ms) : 0, 32442
Debugger [baseline] (69.693 ms) : 0, 69693
Debugger [candidate] (68.526 ms) : 0, 68526
Remote Config [baseline] (638.615 µs) : 0, 639
Remote Config [candidate] (607.856 µs) : 0, 608
Telemetry [baseline] (8.981 ms) : 0, 8981
Telemetry [candidate] (9.011 ms) : 0, 9011
Flare Poller [baseline] (3.718 ms) : 0, 3718
Flare Poller [candidate] (3.725 ms) : 0, 3725
section appsec
crashtracking [baseline] (1.19 ms) : 0, 1190
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (696.827 ms) : 0, 696827
BytebuddyAgent [candidate] (690.893 ms) : 0, 690893
GlobalTracer [baseline] (260.159 ms) : 0, 260159
GlobalTracer [candidate] (258.644 ms) : 0, 258644
IAST [baseline] (24.767 ms) : 0, 24767
IAST [candidate] (24.553 ms) : 0, 24553
AppSec [baseline] (174.457 ms) : 0, 174457
AppSec [candidate] (174.764 ms) : 0, 174764
Debugger [baseline] (67.519 ms) : 0, 67519
Debugger [candidate] (67.361 ms) : 0, 67361
Remote Config [baseline] (756.018 µs) : 0, 756
Remote Config [candidate] (745.278 µs) : 0, 745
Telemetry [baseline] (9.387 ms) : 0, 9387
Telemetry [candidate] (9.491 ms) : 0, 9491
Flare Poller [baseline] (3.75 ms) : 0, 3750
Flare Poller [candidate] (3.809 ms) : 0, 3809
section iast
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.184 ms) : 0, 1184
BytebuddyAgent [baseline] (798.695 ms) : 0, 798695
BytebuddyAgent [candidate] (791.646 ms) : 0, 791646
GlobalTracer [baseline] (259.019 ms) : 0, 259019
GlobalTracer [candidate] (256.294 ms) : 0, 256294
IAST [baseline] (27.316 ms) : 0, 27316
IAST [candidate] (26.969 ms) : 0, 26969
AppSec [baseline] (33.993 ms) : 0, 33993
AppSec [candidate] (32.724 ms) : 0, 32724
Debugger [baseline] (67.098 ms) : 0, 67098
Debugger [candidate] (68.183 ms) : 0, 68183
Remote Config [baseline] (559.864 µs) : 0, 560
Remote Config [candidate] (566.83 µs) : 0, 567
Telemetry [baseline] (8.624 ms) : 0, 8624
Telemetry [candidate] (8.537 ms) : 0, 8537
Flare Poller [baseline] (3.601 ms) : 0, 3601
Flare Poller [candidate] (3.551 ms) : 0, 3551
section profiling
crashtracking [baseline] (1.234 ms) : 0, 1234
crashtracking [candidate] (1.219 ms) : 0, 1219
BytebuddyAgent [baseline] (702.855 ms) : 0, 702855
BytebuddyAgent [candidate] (707.295 ms) : 0, 707295
GlobalTracer [baseline] (220.453 ms) : 0, 220453
GlobalTracer [candidate] (221.448 ms) : 0, 221448
AppSec [baseline] (32.279 ms) : 0, 32279
AppSec [candidate] (32.391 ms) : 0, 32391
Debugger [baseline] (67.965 ms) : 0, 67965
Debugger [candidate] (68.676 ms) : 0, 68676
Remote Config [baseline] (620.288 µs) : 0, 620
Remote Config [candidate] (624.094 µs) : 0, 624
Telemetry [baseline] (8.725 ms) : 0, 8725
Telemetry [candidate] (8.809 ms) : 0, 8809
Flare Poller [baseline] (3.654 ms) : 0, 3654
Flare Poller [candidate] (3.676 ms) : 0, 3676
ProfilingAgent [baseline] (97.287 ms) : 0, 97287
ProfilingAgent [candidate] (97.442 ms) : 0, 97442
Profiling [baseline] (97.86 ms) : 0, 97860
Profiling [candidate] (98.027 ms) : 0, 98027
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.59.0-SNAPSHOT~e9388b2bab, baseline=1.59.0-SNAPSHOT~92c84e28db

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.09 s) : 0, 1090445
Total [baseline] (8.747 s) : 0, 8747300
Agent [candidate] (1.085 s) : 0, 1085237
Total [candidate] (8.797 s) : 0, 8796576
section iast
Agent [baseline] (1.23 s) : 0, 1230263
Total [baseline] (9.363 s) : 0, 9363124
Agent [candidate] (1.223 s) : 0, 1222758
Total [candidate] (9.366 s) : 0, 9365722
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.09 s -
Agent iast 1.23 s 139.819 ms (12.8%)
Total tracing 8.747 s -
Total iast 9.363 s 615.824 ms (7.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent iast 1.223 s 137.52 ms (12.7%)
Total tracing 8.797 s -
Total iast 9.366 s 569.146 ms (6.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.59.0-SNAPSHOT~e9388b2bab, baseline=1.59.0-SNAPSHOT~92c84e28db

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.202 ms) : 0, 1202
crashtracking [candidate] (1.188 ms) : 0, 1188
BytebuddyAgent [baseline] (657.158 ms) : 0, 657158
BytebuddyAgent [candidate] (651.956 ms) : 0, 651956
GlobalTracer [baseline] (282.718 ms) : 0, 282718
GlobalTracer [candidate] (283.191 ms) : 0, 283191
AppSec [baseline] (32.836 ms) : 0, 32836
AppSec [candidate] (32.742 ms) : 0, 32742
Debugger [baseline] (67.284 ms) : 0, 67284
Debugger [candidate] (67.399 ms) : 0, 67399
Remote Config [baseline] (621.48 µs) : 0, 621
Remote Config [candidate] (621.272 µs) : 0, 621
Telemetry [baseline] (8.969 ms) : 0, 8969
Telemetry [candidate] (8.872 ms) : 0, 8872
Flare Poller [baseline] (3.744 ms) : 0, 3744
Flare Poller [candidate] (3.705 ms) : 0, 3705
section iast
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (796.558 ms) : 0, 796558
BytebuddyAgent [candidate] (790.716 ms) : 0, 790716
GlobalTracer [baseline] (257.422 ms) : 0, 257422
GlobalTracer [candidate] (256.002 ms) : 0, 256002
IAST [baseline] (27.331 ms) : 0, 27331
IAST [candidate] (26.993 ms) : 0, 26993
AppSec [baseline] (35.624 ms) : 0, 35624
AppSec [candidate] (33.567 ms) : 0, 33567
Debugger [baseline] (63.871 ms) : 0, 63871
Debugger [candidate] (66.08 ms) : 0, 66080
Remote Config [baseline] (607.965 µs) : 0, 608
Remote Config [candidate] (590.952 µs) : 0, 591
Telemetry [baseline] (8.444 ms) : 0, 8444
Telemetry [candidate] (8.563 ms) : 0, 8563
Flare Poller [baseline] (3.532 ms) : 0, 3532
Flare Poller [candidate] (3.562 ms) : 0, 3562
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master community-pr-9979
git_commit_date 1767720455 1767782168
git_commit_sha 92c84e2 e9388b2
release_version 1.59.0-SNAPSHOT~92c84e28db 1.59.0-SNAPSHOT~e9388b2bab
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1767784487 1767784487
ci_job_id 1332369574 1332369574
ci_pipeline_id 89411565 89411565
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-qdyml10w 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-qdyml10w 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 17 metrics, 15 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load better
[-170.354µs; -55.802µs] or [-6.577%; -2.154%]		 unsure
[-572.559µs; -153.159µs] or [-7.454%; -1.994%]		 unstable
[-98.014op/s; +211.077op/s] or [-7.082%; +15.252%]		 2.477ms 7.319ms 1440.469op/s 2.590ms 7.681ms 1383.938op/s
scenario:load:insecure-bank:iast_FULL:high_load better
[-432.125µs; -171.438µs] or [-8.395%; -3.331%]		 better
[-951.442µs; -367.863µs] or [-7.673%; -2.967%]		 unstable
[-40.166op/s; +127.541op/s] or [-5.071%; +16.104%]		 4.846ms 11.740ms 835.688op/s 5.147ms 12.399ms 792.000op/s
scenario:load:petclinic:iast:high_load worse
[+484.824µs; +1411.792µs] or [+2.798%; +8.148%]		 unsure
[+0.352ms; +1.686ms] or [+1.230%; +5.887%]		 unstable
[-36.267op/s; +15.829op/s] or [-13.834%; +6.038%]		 18.276ms 29.648ms 251.938op/s 17.328ms 28.630ms 262.156op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~e9388b2bab, baseline=1.59.0-SNAPSHOT~92c84e28db
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.192 ms) : 1180, 1204
.   : milestone, 1192,
iast (3.307 ms) : 3272, 3343
.   : milestone, 3307,
iast_FULL (5.839 ms) : 5780, 5898
.   : milestone, 5839,
iast_GLOBAL (3.541 ms) : 3493, 3589
.   : milestone, 3541,
profiling (2.058 ms) : 2039, 2076
.   : milestone, 2058,
tracing (1.834 ms) : 1818, 1850
.   : milestone, 1834,
section candidate
no_agent (1.174 ms) : 1163, 1186
.   : milestone, 1174,
iast (3.176 ms) : 3139, 3212
.   : milestone, 3176,
iast_FULL (5.529 ms) : 5475, 5584
.   : milestone, 5529,
iast_GLOBAL (3.604 ms) : 3550, 3658
.   : milestone, 3604,
profiling (1.958 ms) : 1941, 1974
.   : milestone, 1958,
tracing (1.798 ms) : 1783, 1813
.   : milestone, 1798,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.192 ms [1.18 ms, 1.204 ms] -
iast 3.307 ms [3.272 ms, 3.343 ms] 2.115 ms (177.4%)
iast_FULL 5.839 ms [5.78 ms, 5.898 ms] 4.647 ms (389.8%)
iast_GLOBAL 3.541 ms [3.493 ms, 3.589 ms] 2.349 ms (197.0%)
profiling 2.058 ms [2.039 ms, 2.076 ms] 865.448 µs (72.6%)
tracing 1.834 ms [1.818 ms, 1.85 ms] 641.961 µs (53.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.174 ms [1.163 ms, 1.186 ms] -
iast 3.176 ms [3.139 ms, 3.212 ms] 2.001 ms (170.4%)
iast_FULL 5.529 ms [5.475 ms, 5.584 ms] 4.355 ms (370.8%)
iast_GLOBAL 3.604 ms [3.55 ms, 3.658 ms] 2.43 ms (206.9%)
profiling 1.958 ms [1.941 ms, 1.974 ms] 783.468 µs (66.7%)
tracing 1.798 ms [1.783 ms, 1.813 ms] 623.818 µs (53.1%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.59.0-SNAPSHOT~e9388b2bab, baseline=1.59.0-SNAPSHOT~92c84e28db
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.412 ms) : 18223, 18601
.   : milestone, 18412,
appsec (18.767 ms) : 18576, 18958
.   : milestone, 18767,
code_origins (17.92 ms) : 17737, 18103
.   : milestone, 17920,
iast (17.799 ms) : 17624, 17974
.   : milestone, 17799,
profiling (18.629 ms) : 18443, 18816
.   : milestone, 18629,
tracing (17.472 ms) : 17302, 17642
.   : milestone, 17472,
section candidate
no_agent (18.957 ms) : 18769, 19146
.   : milestone, 18957,
appsec (18.639 ms) : 18451, 18826
.   : milestone, 18639,
code_origins (18.147 ms) : 17966, 18327
.   : milestone, 18147,
iast (18.525 ms) : 18339, 18711
.   : milestone, 18525,
profiling (18.317 ms) : 18133, 18501
.   : milestone, 18317,
tracing (17.609 ms) : 17433, 17785
.   : milestone, 17609,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.412 ms [18.223 ms, 18.601 ms] -
appsec 18.767 ms [18.576 ms, 18.958 ms] 354.478 µs (1.9%)
code_origins 17.92 ms [17.737 ms, 18.103 ms] -492.635 µs (-2.7%)
iast 17.799 ms [17.624 ms, 17.974 ms] -613.328 µs (-3.3%)
profiling 18.629 ms [18.443 ms, 18.816 ms] 217.007 µs (1.2%)
tracing 17.472 ms [17.302 ms, 17.642 ms] -939.96 µs (-5.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.957 ms [18.769 ms, 19.146 ms] -
appsec 18.639 ms [18.451 ms, 18.826 ms] -318.551 µs (-1.7%)
code_origins 18.147 ms [17.966 ms, 18.327 ms] -810.342 µs (-4.3%)
iast 18.525 ms [18.339 ms, 18.711 ms] -432.101 µs (-2.3%)
profiling 18.317 ms [18.133 ms, 18.501 ms] -640.074 µs (-3.4%)
tracing 17.609 ms [17.433 ms, 17.785 ms] -1.348 ms (-7.1%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master community-pr-9979
git_commit_date 1767720455 1767782168
git_commit_sha 92c84e2 e9388b2
release_version 1.59.0-SNAPSHOT~92c84e28db 1.59.0-SNAPSHOT~e9388b2bab
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1767784364 1767784364
ci_job_id 1332369575 1332369575
ci_pipeline_id 89411565 89411565
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-3d3qe773 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-3d3qe773 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~e9388b2bab, baseline=1.59.0-SNAPSHOT~92c84e28db
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.038 s) : 15038000, 15038000
.   : milestone, 15038000,
appsec (14.469 s) : 14469000, 14469000
.   : milestone, 14469000,
iast (18.591 s) : 18591000, 18591000
.   : milestone, 18591000,
iast_GLOBAL (17.955 s) : 17955000, 17955000
.   : milestone, 17955000,
profiling (15.004 s) : 15004000, 15004000
.   : milestone, 15004000,
tracing (14.714 s) : 14714000, 14714000
.   : milestone, 14714000,
section candidate
no_agent (14.972 s) : 14972000, 14972000
.   : milestone, 14972000,
appsec (14.572 s) : 14572000, 14572000
.   : milestone, 14572000,
iast (17.908 s) : 17908000, 17908000
.   : milestone, 17908000,
iast_GLOBAL (17.988 s) : 17988000, 17988000
.   : milestone, 17988000,
profiling (14.694 s) : 14694000, 14694000
.   : milestone, 14694000,
tracing (14.821 s) : 14821000, 14821000
.   : milestone, 14821000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.038 s [15.038 s, 15.038 s] -
appsec 14.469 s [14.469 s, 14.469 s] -569.0 ms (-3.8%)
iast 18.591 s [18.591 s, 18.591 s] 3.553 s (23.6%)
iast_GLOBAL 17.955 s [17.955 s, 17.955 s] 2.917 s (19.4%)
profiling 15.004 s [15.004 s, 15.004 s] -34.0 ms (-0.2%)
tracing 14.714 s [14.714 s, 14.714 s] -324.0 ms (-2.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.972 s [14.972 s, 14.972 s] -
appsec 14.572 s [14.572 s, 14.572 s] -400.0 ms (-2.7%)
iast 17.908 s [17.908 s, 17.908 s] 2.936 s (19.6%)
iast_GLOBAL 17.988 s [17.988 s, 17.988 s] 3.016 s (20.1%)
profiling 14.694 s [14.694 s, 14.694 s] -278.0 ms (-1.9%)
tracing 14.821 s [14.821 s, 14.821 s] -151.0 ms (-1.0%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.59.0-SNAPSHOT~e9388b2bab, baseline=1.59.0-SNAPSHOT~92c84e28db
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.466 ms) : 1454, 1477
.   : milestone, 1466,
appsec (3.719 ms) : 3499, 3939
.   : milestone, 3719,
iast (2.211 ms) : 2145, 2276
.   : milestone, 2211,
iast_GLOBAL (2.258 ms) : 2192, 2323
.   : milestone, 2258,
profiling (2.057 ms) : 2004, 2110
.   : milestone, 2057,
tracing (2.034 ms) : 1982, 2085
.   : milestone, 2034,
section candidate
no_agent (1.467 ms) : 1455, 1478
.   : milestone, 1467,
appsec (3.719 ms) : 3499, 3939
.   : milestone, 3719,
iast (2.202 ms) : 2137, 2267
.   : milestone, 2202,
iast_GLOBAL (2.244 ms) : 2179, 2309
.   : milestone, 2244,
profiling (2.062 ms) : 2009, 2114
.   : milestone, 2062,
tracing (2.039 ms) : 1988, 2091
.   : milestone, 2039,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.466 ms [1.454 ms, 1.477 ms] -
appsec 3.719 ms [3.499 ms, 3.939 ms] 2.253 ms (153.7%)
iast 2.211 ms [2.145 ms, 2.276 ms] 745.087 µs (50.8%)
iast_GLOBAL 2.258 ms [2.192 ms, 2.323 ms] 791.948 µs (54.0%)
profiling 2.057 ms [2.004 ms, 2.11 ms] 591.583 µs (40.4%)
tracing 2.034 ms [1.982 ms, 2.085 ms] 567.922 µs (38.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.467 ms [1.455 ms, 1.478 ms] -
appsec 3.719 ms [3.499 ms, 3.939 ms] 2.253 ms (153.6%)
iast 2.202 ms [2.137 ms, 2.267 ms] 735.359 µs (50.1%)
iast_GLOBAL 2.244 ms [2.179 ms, 2.309 ms] 777.087 µs (53.0%)
profiling 2.062 ms [2.009 ms, 2.114 ms] 595.132 µs (40.6%)
tracing 2.039 ms [1.988 ms, 2.091 ms] 572.949 µs (39.1%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@amarziali amarziali Awaiting requested review from amarziali amarziali is a code owner automatically assigned from DataDog/apm-java

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

comp: tooling Build & Tooling tag: community Community contribution tag: do not merge Do not merge changes type: enhancement Enhancements and improvements

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@mcculls @deejgregor