Skip to content

🍒 9909 - Fix npe on ConflatingMetricsAggregator when the resource is null #9938

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 1 commit into from
Closed

🍒 9909 - Fix npe on ConflatingMetricsAggregator when the resource is null #9938

wants to merge 1 commit into from

Conversation

@amarziali
Copy link
Contributor

@amarziali amarziali commented Nov 12, 2025

Backport #9909 to release/v1.55.x

@amarziali amarziali requested a review from a team as a code owner November 12, 2025 15:29
@amarziali amarziali added type: bug Bug report and fix comp: metrics Metrics tag: telemetry error reported Reported by error telemetry labels Nov 12, 2025
@datadog-datadog-prod-us1
Copy link
Contributor

datadog-datadog-prod-us1 bot commented Nov 12, 2025 •
edited by datadog-official bot
Loading

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.71% (-0.02%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 44c1e5f | Docs | Datadog PR Page | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Nov 12, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/backport-pr-9909
git_commit_date 1762997139 1762961378
git_commit_sha b99070a 44c1e5f
release_version 1.56.0-SNAPSHOT~b99070a00c 1.56.0-SNAPSHOT~44c1e5f367
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763029707 1763029707
ci_job_id 1232090880 1232090880
ci_pipeline_id 82105176 82105176
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-7s2ko4ro 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-7s2ko4ro 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 12 performance improvements and 10 performance regressions! Performance is the same for 31 metrics, 12 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent.start better
[-86.539ms; -54.724ms] or [-6.974%; -4.410%]		 1.170s 1.241s
scenario:startup:insecure-bank:iast:Debugger better
[-59.490ms; -58.489ms] or [-91.411%; -89.872%]		 6.091ms 65.080ms
scenario:startup:insecure-bank:iast:Remote Config worse
[+40.896µs; +67.898µs] or [+7.523%; +12.490%]		 598.012µs 543.615µs
scenario:startup:insecure-bank:iast:Telemetry worse
[+401.972µs; +832.485µs] or [+5.161%; +10.687%]		 8.407ms 7.789ms
scenario:startup:insecure-bank:iast:Flare Poller worse
[+473.322µs; +644.572µs] or [+13.410%; +18.261%]		 4.089ms 3.530ms
scenario:startup:insecure-bank:tracing:Agent.start better
[-93.672ms; -64.560ms] or [-8.431%; -5.810%]		 1.032s 1.111s
scenario:startup:insecure-bank:tracing:Debugger better
[-62.659ms; -61.784ms] or [-91.346%; -90.070%]		 6.374ms 68.596ms
scenario:startup:insecure-bank:tracing:Remote Config worse
[+33.721µs; +67.291µs] or [+5.293%; +10.563%]		 687.541µs 637.034µs
scenario:startup:petclinic:appsec:Agent.start better
[-103.043ms; -57.925ms] or [-7.993%; -4.493%]		 1.209s 1.289s
scenario:startup:petclinic:appsec:Debugger better
[-56.518ms; -54.937ms] or [-91.679%; -89.115%]		 5.920ms 61.647ms
scenario:startup:petclinic:iast:Agent.start better
[-111.084ms; -80.627ms] or [-8.846%; -6.421%]		 1.160s 1.256s
scenario:startup:petclinic:iast:Debugger better
[-61.724ms; -59.757ms] or [-92.425%; -89.478%]		 6.043ms 66.783ms
scenario:startup:petclinic:iast:Remote Config worse
[+12.733µs; +51.940µs] or [+2.288%; +9.335%]		 588.762µs 556.426µs
scenario:startup:petclinic:iast:Telemetry worse
[+230.746µs; +608.888µs] or [+2.930%; +7.732%]		 8.294ms 7.875ms
scenario:startup:petclinic:iast:Flare Poller worse
[+388.825µs; +610.673µs] or [+10.811%; +16.979%]		 4.096ms 3.597ms
scenario:startup:petclinic:profiling:Agent.start better
[-90.057ms; -34.352ms] or [-7.201%; -2.747%]		 1.188s 1.251s
scenario:startup:petclinic:profiling:ProfilingAgent worse
[+11.761ms; +15.486ms] or [+12.121%; +15.960%]		 110.652ms 97.029ms
scenario:startup:petclinic:profiling:Debugger better
[-61.343ms; -55.837ms] or [-88.573%; -80.623%]		 10.667ms 69.257ms
scenario:startup:petclinic:profiling:Profiling worse
[+11.783ms; +15.546ms] or [+12.069%; +15.923%]		 111.299ms 97.634ms
scenario:startup:petclinic:tracing:Agent.start better
[-78.148ms; -52.110ms] or [-7.081%; -4.722%]		 1.039s 1.104s
scenario:startup:petclinic:tracing:Debugger better
[-63.077ms; -62.143ms] or [-91.263%; -89.911%]		 6.506ms 69.116ms
scenario:startup:petclinic:tracing:Remote Config worse
[+26.551µs; +77.914µs] or [+4.172%; +12.242%]		 688.664µs 636.432µs
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~44c1e5f367, baseline=1.56.0-SNAPSHOT~b99070a00c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.104 s) : 0, 1103665
Total [baseline] (10.679 s) : 0, 10678752
Agent [candidate] (1.039 s) : 0, 1038535
Total [candidate] (10.878 s) : 0, 10877985
section appsec
Agent [baseline] (1.289 s) : 0, 1289201
Total [baseline] (11.239 s) : 0, 11239224
Agent [candidate] (1.209 s) : 0, 1208717
Total [candidate] (10.949 s) : 0, 10949285
section iast
Agent [baseline] (1.256 s) : 0, 1255693
Total [baseline] (11.231 s) : 0, 11230882
Agent [candidate] (1.16 s) : 0, 1159838
Total [candidate] (11.167 s) : 0, 11166845
section profiling
Agent [baseline] (1.251 s) : 0, 1250659
Total [baseline] (11.146 s) : 0, 11146227
Agent [candidate] (1.188 s) : 0, 1188455
Total [candidate] (10.995 s) : 0, 10994806
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.104 s -
Agent appsec 1.289 s 185.536 ms (16.8%)
Agent iast 1.256 s 152.029 ms (13.8%)
Agent profiling 1.251 s 146.994 ms (13.3%)
Total tracing 10.679 s -
Total appsec 11.239 s 560.472 ms (5.2%)
Total iast 11.231 s 552.13 ms (5.2%)
Total profiling 11.146 s 467.475 ms (4.4%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.039 s -
Agent appsec 1.209 s 170.181 ms (16.4%)
Agent iast 1.16 s 121.302 ms (11.7%)
Agent profiling 1.188 s 149.919 ms (14.4%)
Total tracing 10.878 s -
Total appsec 10.949 s 71.3 ms (0.7%)
Total iast 11.167 s 288.86 ms (2.7%)
Total profiling 10.995 s 116.821 ms (1.1%) 
gantt
    title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~44c1e5f367, baseline=1.56.0-SNAPSHOT~b99070a00c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.459 ms) : 0, 1459
crashtracking [candidate] (1.466 ms) : 0, 1466
BytebuddyAgent [baseline] (705.214 ms) : 0, 705214
BytebuddyAgent [candidate] (708.55 ms) : 0, 708550
GlobalTracer [baseline] (248.235 ms) : 0, 248235
GlobalTracer [candidate] (247.013 ms) : 0, 247013
AppSec [baseline] (32.287 ms) : 0, 32287
AppSec [candidate] (32.626 ms) : 0, 32626
Debugger [baseline] (69.116 ms) : 0, 69116
Debugger [candidate] (6.506 ms) : 0, 6506
Remote Config [baseline] (636.432 µs) : 0, 636
Remote Config [candidate] (688.664 µs) : 0, 689
Telemetry [baseline] (8.247 ms) : 0, 8247
Telemetry [candidate] (13.85 ms) : 0, 13850
Flare Poller [baseline] (3.793 ms) : 0, 3793
Flare Poller [candidate] (6.507 ms) : 0, 6507
section appsec
crashtracking [baseline] (1.474 ms) : 0, 1474
crashtracking [candidate] (1.487 ms) : 0, 1487
BytebuddyAgent [baseline] (735.201 ms) : 0, 735201
BytebuddyAgent [candidate] (729.861 ms) : 0, 729861
GlobalTracer [baseline] (242.471 ms) : 0, 242471
GlobalTracer [candidate] (237.268 ms) : 0, 237268
IAST [baseline] (25.122 ms) : 0, 25122
IAST [candidate] (25.2 ms) : 0, 25200
AppSec [baseline] (175.191 ms) : 0, 175191
AppSec [candidate] (174.76 ms) : 0, 174760
Debugger [baseline] (61.647 ms) : 0, 61647
Debugger [candidate] (5.92 ms) : 0, 5920
Remote Config [baseline] (665.185 µs) : 0, 665
Remote Config [candidate] (637.698 µs) : 0, 638
Telemetry [baseline] (8.46 ms) : 0, 8460
Telemetry [candidate] (8.431 ms) : 0, 8431
Flare Poller [baseline] (3.915 ms) : 0, 3915
Flare Poller [candidate] (3.942 ms) : 0, 3942
section iast
crashtracking [baseline] (1.477 ms) : 0, 1477
crashtracking [candidate] (1.466 ms) : 0, 1466
BytebuddyAgent [baseline] (839.567 ms) : 0, 839567
BytebuddyAgent [candidate] (823.218 ms) : 0, 823218
GlobalTracer [baseline] (238.884 ms) : 0, 238884
GlobalTracer [candidate] (233.708 ms) : 0, 233708
IAST [baseline] (30.329 ms) : 0, 30329
IAST [candidate] (34.134 ms) : 0, 34134
AppSec [baseline] (31.637 ms) : 0, 31637
AppSec [candidate] (27.034 ms) : 0, 27034
Debugger [baseline] (66.783 ms) : 0, 66783
Debugger [candidate] (6.043 ms) : 0, 6043
Remote Config [baseline] (556.426 µs) : 0, 556
Remote Config [candidate] (588.762 µs) : 0, 589
Telemetry [baseline] (7.875 ms) : 0, 7875
Telemetry [candidate] (8.294 ms) : 0, 8294
Flare Poller [baseline] (3.597 ms) : 0, 3597
Flare Poller [candidate] (4.096 ms) : 0, 4096
section profiling
crashtracking [baseline] (1.467 ms) : 0, 1467
crashtracking [candidate] (1.483 ms) : 0, 1483
BytebuddyAgent [baseline] (741.181 ms) : 0, 741181
BytebuddyAgent [candidate] (736.195 ms) : 0, 736195
GlobalTracer [baseline] (225.3 ms) : 0, 225300
GlobalTracer [candidate] (223.204 ms) : 0, 223204
AppSec [baseline] (33.053 ms) : 0, 33053
AppSec [candidate] (34.311 ms) : 0, 34311
Debugger [baseline] (69.257 ms) : 0, 69257
Debugger [candidate] (10.667 ms) : 0, 10667
Remote Config [baseline] (665.186 µs) : 0, 665
Remote Config [candidate] (693.49 µs) : 0, 693
Telemetry [baseline] (8.123 ms) : 0, 8123
Telemetry [candidate] (10.63 ms) : 0, 10630
Flare Poller [baseline] (3.869 ms) : 0, 3869
Flare Poller [candidate] (4.251 ms) : 0, 4251
ProfilingAgent [baseline] (97.029 ms) : 0, 97029
ProfilingAgent [candidate] (110.652 ms) : 0, 110652
Profiling [baseline] (97.634 ms) : 0, 97634
Profiling [candidate] (111.299 ms) : 0, 111299
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~44c1e5f367, baseline=1.56.0-SNAPSHOT~b99070a00c

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.111 s) : 0, 1111108
Total [baseline] (8.846 s) : 0, 8846401
Agent [candidate] (1.032 s) : 0, 1031991
Total [candidate] (8.666 s) : 0, 8665640
section iast
Agent [baseline] (1.241 s) : 0, 1240859
Total [baseline] (9.577 s) : 0, 9577164
Agent [candidate] (1.17 s) : 0, 1170228
Total [candidate] (9.353 s) : 0, 9352756
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.111 s -
Agent iast 1.241 s 129.752 ms (11.7%)
Total tracing 8.846 s -
Total iast 9.577 s 730.764 ms (8.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.032 s -
Agent iast 1.17 s 138.236 ms (13.4%)
Total tracing 8.666 s -
Total iast 9.353 s 687.116 ms (7.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~44c1e5f367, baseline=1.56.0-SNAPSHOT~b99070a00c

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.465 ms) : 0, 1465
crashtracking [candidate] (1.468 ms) : 0, 1468
BytebuddyAgent [baseline] (711.3 ms) : 0, 711300
BytebuddyAgent [candidate] (703.929 ms) : 0, 703929
GlobalTracer [baseline] (249.801 ms) : 0, 249801
GlobalTracer [candidate] (245.298 ms) : 0, 245298
AppSec [baseline] (32.588 ms) : 0, 32588
AppSec [candidate] (32.202 ms) : 0, 32202
Debugger [baseline] (68.596 ms) : 0, 68596
Debugger [candidate] (6.374 ms) : 0, 6374
Remote Config [baseline] (637.034 µs) : 0, 637
Remote Config [candidate] (687.541 µs) : 0, 688
Telemetry [baseline] (8.136 ms) : 0, 8136
Telemetry [candidate] (15.933 ms) : 0, 15933
Flare Poller [baseline] (3.702 ms) : 0, 3702
Flare Poller [candidate] (4.939 ms) : 0, 4939
section iast
crashtracking [baseline] (1.455 ms) : 0, 1455
crashtracking [candidate] (1.486 ms) : 0, 1486
BytebuddyAgent [baseline] (828.68 ms) : 0, 828680
BytebuddyAgent [candidate] (831.752 ms) : 0, 831752
GlobalTracer [baseline] (237.581 ms) : 0, 237581
GlobalTracer [candidate] (234.934 ms) : 0, 234934
IAST [baseline] (29.211 ms) : 0, 29211
IAST [candidate] (32.603 ms) : 0, 32603
AppSec [baseline] (32.271 ms) : 0, 32271
AppSec [candidate] (28.889 ms) : 0, 28889
Debugger [baseline] (65.08 ms) : 0, 65080
Debugger [candidate] (6.091 ms) : 0, 6091
Remote Config [baseline] (543.615 µs) : 0, 544
Remote Config [candidate] (598.012 µs) : 0, 598
Telemetry [baseline] (7.789 ms) : 0, 7789
Telemetry [candidate] (8.407 ms) : 0, 8407
Flare Poller [baseline] (3.53 ms) : 0, 3530
Flare Poller [candidate] (4.089 ms) : 0, 4089
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/backport-pr-9909
git_commit_date 1762997139 1762961378
git_commit_sha b99070a 44c1e5f
release_version 1.56.0-SNAPSHOT~b99070a00c 1.56.0-SNAPSHOT~44c1e5f367
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1763030188 1763030188
ci_job_id 1232090848 1232090848
ci_pipeline_id 82105176 82105176
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-82spcue6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-82spcue6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 3 performance regressions! Performance is the same for 13 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load better
[-156.508µs; -45.261µs] or [-9.273%; -2.682%]		 unstable
[-995.077µs; -58.121µs] or [-20.242%; -1.182%]		 unstable
[-81.217op/s; +446.842op/s] or [-3.774%; +20.766%]		 1.587ms 4.389ms 2334.656op/s 1.688ms 4.916ms 2151.844op/s
scenario:load:petclinic:iast:high_load better
[-1.750ms; -0.820ms] or [-9.453%; -4.430%]		 unsure
[-1.978ms; -0.544ms] or [-6.704%; -1.844%]		 unstable
[-13.267op/s; +44.017op/s] or [-5.328%; +17.677%]		 17.232ms 28.247ms 264.375op/s 18.517ms 29.508ms 249.000op/s
scenario:load:petclinic:appsec:high_load worse
[+2.020ms; +2.576ms] or [+11.093%; +14.152%]		 worse
[+1.809ms; +2.903ms] or [+6.019%; +9.658%]		 unstable
[-51.382op/s; +1.132op/s] or [-20.479%; +0.451%]		 20.504ms 32.418ms 225.781op/s 18.206ms 30.061ms 250.906op/s
scenario:load:petclinic:tracing:high_load worse
[+521.024µs; +1398.823µs] or [+2.999%; +8.052%]		 same
[-45.110µs; +1503.506µs] or [-0.159%; +5.284%]		 unstable
[-40.670op/s; +16.982op/s] or [-15.447%; +6.450%]		 18.332ms 29.184ms 251.438op/s 17.372ms 28.455ms 263.281op/s
scenario:load:petclinic:profiling:high_load better
[-2.586ms; -2.129ms] or [-12.623%; -10.396%]		 better
[-3.747ms; -2.635ms] or [-11.624%; -8.175%]		 unstable
[+0.947op/s; +53.053op/s] or [+0.419%; +23.465%]		 18.126ms 29.044ms 253.094op/s 20.484ms 32.235ms 226.094op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~44c1e5f367, baseline=1.56.0-SNAPSHOT~b99070a00c
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.18 ms) : 1169, 1190
.   : milestone, 1180,
iast (3.173 ms) : 3133, 3213
.   : milestone, 3173,
iast_FULL (5.709 ms) : 5652, 5765
.   : milestone, 5709,
iast_GLOBAL (3.681 ms) : 3619, 3743
.   : milestone, 3681,
profiling (2.101 ms) : 2081, 2122
.   : milestone, 2101,
tracing (1.802 ms) : 1788, 1816
.   : milestone, 1802,
section candidate
no_agent (1.231 ms) : 1218, 1243
.   : milestone, 1231,
iast (3.126 ms) : 3086, 3166
.   : milestone, 3126,
iast_FULL (5.85 ms) : 5792, 5908
.   : milestone, 5850,
iast_GLOBAL (3.598 ms) : 3546, 3651
.   : milestone, 3598,
profiling (1.93 ms) : 1914, 1946
.   : milestone, 1930,
tracing (1.792 ms) : 1778, 1805
.   : milestone, 1792,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.18 ms [1.169 ms, 1.19 ms] -
iast 3.173 ms [3.133 ms, 3.213 ms] 1.994 ms (169.0%)
iast_FULL 5.709 ms [5.652 ms, 5.765 ms] 4.529 ms (384.0%)
iast_GLOBAL 3.681 ms [3.619 ms, 3.743 ms] 2.502 ms (212.1%)
profiling 2.101 ms [2.081 ms, 2.122 ms] 921.529 µs (78.1%)
tracing 1.802 ms [1.788 ms, 1.816 ms] 622.867 µs (52.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.231 ms [1.218 ms, 1.243 ms] -
iast 3.126 ms [3.086 ms, 3.166 ms] 1.895 ms (154.0%)
iast_FULL 5.85 ms [5.792 ms, 5.908 ms] 4.619 ms (375.3%)
iast_GLOBAL 3.598 ms [3.546 ms, 3.651 ms] 2.367 ms (192.3%)
profiling 1.93 ms [1.914 ms, 1.946 ms] 699.3 µs (56.8%)
tracing 1.792 ms [1.778 ms, 1.805 ms] 560.692 µs (45.6%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~44c1e5f367, baseline=1.56.0-SNAPSHOT~b99070a00c
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.399 ms) : 17227, 17572
.   : milestone, 17399,
appsec (18.599 ms) : 18409, 18789
.   : milestone, 18599,
code_origins (18.976 ms) : 18786, 19167
.   : milestone, 18976,
iast (18.741 ms) : 18556, 18926
.   : milestone, 18741,
profiling (20.648 ms) : 20443, 20853
.   : milestone, 20648,
tracing (17.721 ms) : 17544, 17898
.   : milestone, 17721,
section candidate
no_agent (17.597 ms) : 17420, 17773
.   : milestone, 17597,
appsec (20.683 ms) : 20472, 20894
.   : milestone, 20683,
code_origins (19.242 ms) : 19051, 19434
.   : milestone, 19242,
iast (17.648 ms) : 17474, 17821
.   : milestone, 17648,
profiling (18.439 ms) : 18258, 18620
.   : milestone, 18439,
tracing (18.558 ms) : 18375, 18741
.   : milestone, 18558,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.399 ms [17.227 ms, 17.572 ms] -
appsec 18.599 ms [18.409 ms, 18.789 ms] 1.2 ms (6.9%)
code_origins 18.976 ms [18.786 ms, 19.167 ms] 1.577 ms (9.1%)
iast 18.741 ms [18.556 ms, 18.926 ms] 1.341 ms (7.7%)
profiling 20.648 ms [20.443 ms, 20.853 ms] 3.249 ms (18.7%)
tracing 17.721 ms [17.544 ms, 17.898 ms] 321.748 µs (1.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.597 ms [17.42 ms, 17.773 ms] -
appsec 20.683 ms [20.472 ms, 20.894 ms] 3.086 ms (17.5%)
code_origins 19.242 ms [19.051 ms, 19.434 ms] 1.646 ms (9.4%)
iast 17.648 ms [17.474 ms, 17.821 ms] 51.064 µs (0.3%)
profiling 18.439 ms [18.258 ms, 18.62 ms] 842.485 µs (4.8%)
tracing 18.558 ms [18.375 ms, 18.741 ms] 961.361 µs (5.5%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/backport-pr-9909
git_commit_date 1762958042 1762961378
git_commit_sha 5dde230 44c1e5f
release_version 1.56.0-SNAPSHOT~5dde230896 1.56.0-SNAPSHOT~44c1e5f367
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1762963618 1762963618
ci_job_id 1230218459 1230218459
ci_pipeline_id 82105176 82105176
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-nso7u644 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-nso7u644 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~44c1e5f367, baseline=1.56.0-SNAPSHOT~5dde230896
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.482 ms) : 1471, 1494
.   : milestone, 1482,
appsec (3.708 ms) : 3490, 3925
.   : milestone, 3708,
iast (2.221 ms) : 2157, 2285
.   : milestone, 2221,
iast_GLOBAL (2.266 ms) : 2202, 2330
.   : milestone, 2266,
profiling (2.086 ms) : 2032, 2139
.   : milestone, 2086,
tracing (2.028 ms) : 1978, 2077
.   : milestone, 2028,
section candidate
no_agent (1.489 ms) : 1478, 1501
.   : milestone, 1489,
appsec (3.657 ms) : 3444, 3870
.   : milestone, 3657,
iast (2.225 ms) : 2161, 2288
.   : milestone, 2225,
iast_GLOBAL (2.254 ms) : 2190, 2318
.   : milestone, 2254,
profiling (2.06 ms) : 2009, 2112
.   : milestone, 2060,
tracing (2.035 ms) : 1986, 2085
.   : milestone, 2035,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.471 ms, 1.494 ms] -
appsec 3.708 ms [3.49 ms, 3.925 ms] 2.225 ms (150.1%)
iast 2.221 ms [2.157 ms, 2.285 ms] 738.818 µs (49.8%)
iast_GLOBAL 2.266 ms [2.202 ms, 2.33 ms] 783.743 µs (52.9%)
profiling 2.086 ms [2.032 ms, 2.139 ms] 603.228 µs (40.7%)
tracing 2.028 ms [1.978 ms, 2.077 ms] 545.437 µs (36.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.489 ms [1.478 ms, 1.501 ms] -
appsec 3.657 ms [3.444 ms, 3.87 ms] 2.168 ms (145.5%)
iast 2.225 ms [2.161 ms, 2.288 ms] 735.017 µs (49.3%)
iast_GLOBAL 2.254 ms [2.19 ms, 2.318 ms] 764.436 µs (51.3%)
profiling 2.06 ms [2.009 ms, 2.112 ms] 570.824 µs (38.3%)
tracing 2.035 ms [1.986 ms, 2.085 ms] 545.672 µs (36.6%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~44c1e5f367, baseline=1.56.0-SNAPSHOT~5dde230896
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.609 s) : 15609000, 15609000
.   : milestone, 15609000,
appsec (14.645 s) : 14645000, 14645000
.   : milestone, 14645000,
iast (18.555 s) : 18555000, 18555000
.   : milestone, 18555000,
iast_GLOBAL (17.714 s) : 17714000, 17714000
.   : milestone, 17714000,
profiling (15.823 s) : 15823000, 15823000
.   : milestone, 15823000,
tracing (14.757 s) : 14757000, 14757000
.   : milestone, 14757000,
section candidate
no_agent (15.256 s) : 15256000, 15256000
.   : milestone, 15256000,
appsec (14.891 s) : 14891000, 14891000
.   : milestone, 14891000,
iast (18.386 s) : 18386000, 18386000
.   : milestone, 18386000,
iast_GLOBAL (18.102 s) : 18102000, 18102000
.   : milestone, 18102000,
profiling (15.356 s) : 15356000, 15356000
.   : milestone, 15356000,
tracing (15.466 s) : 15466000, 15466000
.   : milestone, 15466000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.609 s [15.609 s, 15.609 s] -
appsec 14.645 s [14.645 s, 14.645 s] -964.0 ms (-6.2%)
iast 18.555 s [18.555 s, 18.555 s] 2.946 s (18.9%)
iast_GLOBAL 17.714 s [17.714 s, 17.714 s] 2.105 s (13.5%)
profiling 15.823 s [15.823 s, 15.823 s] 214.0 ms (1.4%)
tracing 14.757 s [14.757 s, 14.757 s] -852.0 ms (-5.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.256 s [15.256 s, 15.256 s] -
appsec 14.891 s [14.891 s, 14.891 s] -365.0 ms (-2.4%)
iast 18.386 s [18.386 s, 18.386 s] 3.13 s (20.5%)
iast_GLOBAL 18.102 s [18.102 s, 18.102 s] 2.846 s (18.7%)
profiling 15.356 s [15.356 s, 15.356 s] 100.0 ms (0.7%)
tracing 15.466 s [15.466 s, 15.466 s] 210.0 ms (1.4%)

@amarziali amarziali enabled auto-merge (squash) November 12, 2025 16:29
PerfectSlayer
PerfectSlayer approved these changes Nov 12, 2025
View reviewed changes
Copy link
Contributor

@PerfectSlayer PerfectSlayer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Back-porting the approval

@amarziali amarziali closed this Nov 20, 2025
auto-merge was automatically disabled November 20, 2025 07:39

Pull request was closed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

Assignees

No one assigned

Labels

comp: metrics Metrics tag: telemetry error reported Reported by error telemetry type: bug Bug report and fix

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@amarziali @PerfectSlayer