Skip to content

Optimize Lambda proxy class matching on filtering#10905

Open
jpbempel wants to merge 1 commit intomasterfrom
jpbempel/optim-lambda-check
Open

Optimize Lambda proxy class matching on filtering#10905
jpbempel wants to merge 1 commit intomasterfrom
jpbempel/optim-lambda-check

Conversation

@jpbempel
Copy link
Member

@jpbempel jpbempel commented Mar 19, 2026

What Does This Do

When trying to match classes to exclude third-party ones we are excluding also lambda proxy classes that are shown with JVM option -XX:+ShowHiddenFrames
RegEx are used to identify them correctly but this is expensive. we are using a fast path by searching for 'Lambda' first before applying RegEx matching.

Motivation

Additional Notes

MicroBenchmark shows the difference between the 2 aproaches in case of classname not matching lambda proxies (((% of the time)

Benchmark                                     Mode  Cnt    Score   Error  Units
ClassNameFilteringBenchmark.containsAndRegex  avgt    5   21.678 ± 2.200  ns/op
ClassNameFilteringBenchmark.regexOnly         avgt    5  116.430 ± 5.861  ns/op

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@jpbempel
Optimize Lambda proxy class matching on filtering
3debd02 
When trying to match classes to exclude third-party ones we are
excluding also lambda proxy classes that are shown with JVM option
-XX:+ShowHiddenFrames
RegEx are used to identify them correctly but this is expensive.
we are using a fast path by searching for 'Lambda' first before
applying RegEx matching.
@jpbempel jpbempel requested a review from a team as a code owner March 19, 2026 14:05
@jpbempel jpbempel requested review from ojung and removed request for a team March 19, 2026 14:05
@github-actions
Copy link
Contributor

github-actions bot commented Mar 19, 2026 •
edited
Loading

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@jpbempel jpbempel added comp: debugger Dynamic Instrumentation type: enhancement Enhancements and improvements labels Mar 19, 2026
@pr-commenter
Copy link

pr-commenter bot commented Mar 19, 2026

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1773929655 1773930001
end_time 2026-03-19T14:15:35 2026-03-19T14:21:22
git_branch master jpbempel/optim-lambda-check
git_commit_sha 018d1ea 3debd02
start_time 2026-03-19T14:14:16 2026-03-19T14:20:02
See matching parameters
Baseline Candidate
ci_job_id 1521553828 1521553828
ci_pipeline_id 103497370 103497370
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1773928783 1773928783

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 8 metrics, 7 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-39.647µs; +36.758µs] or [-13.999%; +12.979%]		 unstable
[-59.558µs; +51.710µs] or [-18.156%; +15.764%]		 unstable
[-67.876µs; +63.540µs] or [-19.852%; +18.584%]		 unstable
[-300.622µs; +134.486µs] or [-29.311%; +13.113%]		 unstable
[-159.643op/s; +97.914op/s] or [-6.386%; +3.917%]
scenario:basic same same same unstable
[-96.386µs; +81.012µs] or [-13.438%; +11.294%]		 unstable
[-226.323op/s; +226.323op/s] or [-8.600%; +8.600%]
scenario:loop unsure
[-13.469µs; -7.637µs] or [-0.152%; -0.086%]		 unsure
[-13.297µs; -4.066µs] or [-0.148%; -0.045%]		 unsure
[-10.548µs; -0.878µs] or [-0.117%; -0.010%]		 same same
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (328.03 µs) : 267, 389
.   : milestone, 328,
basic (277.047 µs) : 271, 284
.   : milestone, 277,
loop (8.961 ms) : 8957, 8966
.   : milestone, 8961,
section candidate
noprobe (324.107 µs) : 280, 368
.   : milestone, 324,
basic (279.276 µs) : 272, 287
.   : milestone, 279,
loop (8.953 ms) : 8949, 8957
.   : milestone, 8953,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 328.03 µs [267.331 µs, 388.73 µs]
basic 277.047 µs [270.523 µs, 283.571 µs]
loop 8.961 ms [8.957 ms, 8.966 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 324.107 µs [280.2 µs, 368.014 µs]
basic 279.276 µs [271.912 µs, 286.64 µs]
loop 8.953 ms [8.949 ms, 8.957 ms]

@pr-commenter
Copy link

pr-commenter bot commented Mar 19, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/optim-lambda-check
git_commit_date 1773923179 1773928783
git_commit_sha 018d1ea 3debd02
release_version 1.61.0-SNAPSHOT~018d1ea157 1.61.0-SNAPSHOT~3debd0241d
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773930692 1773930692
ci_job_id 1521553819 1521553819
ci_pipeline_id 103497370 103497370
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-6fodaito 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-6fodaito 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~3debd0241d, baseline=1.61.0-SNAPSHOT~018d1ea157

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1055357
Total [baseline] (8.837 s) : 0, 8836753
Agent [candidate] (1.066 s) : 0, 1065699
Total [candidate] (8.838 s) : 0, 8837633
section iast
Agent [baseline] (1.227 s) : 0, 1227101
Total [baseline] (9.551 s) : 0, 9551265
Agent [candidate] (1.242 s) : 0, 1242481
Total [candidate] (9.622 s) : 0, 9622142
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent iast 1.227 s 171.744 ms (16.3%)
Total tracing 8.837 s -
Total iast 9.551 s 714.513 ms (8.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent iast 1.242 s 176.782 ms (16.6%)
Total tracing 8.838 s -
Total iast 9.622 s 784.508 ms (8.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~3debd0241d, baseline=1.61.0-SNAPSHOT~018d1ea157

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.218 ms) : 0, 1218
BytebuddyAgent [baseline] (628.042 ms) : 0, 628042
BytebuddyAgent [candidate] (634.388 ms) : 0, 634388
AgentMeter [baseline] (28.974 ms) : 0, 28974
AgentMeter [candidate] (29.191 ms) : 0, 29191
GlobalTracer [baseline] (256.642 ms) : 0, 256642
GlobalTracer [candidate] (258.054 ms) : 0, 258054
AppSec [baseline] (31.633 ms) : 0, 31633
AppSec [candidate] (31.802 ms) : 0, 31802
Debugger [baseline] (59.294 ms) : 0, 59294
Debugger [candidate] (59.855 ms) : 0, 59855
Remote Config [baseline] (587.844 µs) : 0, 588
Remote Config [candidate] (583.539 µs) : 0, 584
Telemetry [baseline] (8.708 ms) : 0, 8708
Telemetry [candidate] (9.173 ms) : 0, 9173
Flare Poller [baseline] (4.289 ms) : 0, 4289
Flare Poller [candidate] (5.152 ms) : 0, 5152
section iast
crashtracking [baseline] (1.179 ms) : 0, 1179
crashtracking [candidate] (1.198 ms) : 0, 1198
BytebuddyAgent [baseline] (796.187 ms) : 0, 796187
BytebuddyAgent [candidate] (806.084 ms) : 0, 806084
AgentMeter [baseline] (11.339 ms) : 0, 11339
AgentMeter [candidate] (11.652 ms) : 0, 11652
GlobalTracer [baseline] (247.346 ms) : 0, 247346
GlobalTracer [candidate] (250.61 ms) : 0, 250610
IAST [baseline] (25.32 ms) : 0, 25320
IAST [candidate] (25.689 ms) : 0, 25689
AppSec [baseline] (26.472 ms) : 0, 26472
AppSec [candidate] (27.957 ms) : 0, 27957
Debugger [baseline] (70.079 ms) : 0, 70079
Debugger [candidate] (66.891 ms) : 0, 66891
Remote Config [baseline] (533.455 µs) : 0, 533
Remote Config [candidate] (533.516 µs) : 0, 534
Telemetry [baseline] (9.224 ms) : 0, 9224
Telemetry [candidate] (11.378 ms) : 0, 11378
Flare Poller [baseline] (3.377 ms) : 0, 3377
Flare Poller [candidate] (4.057 ms) : 0, 4057
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~3debd0241d, baseline=1.61.0-SNAPSHOT~018d1ea157

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.056 s) : 0, 1055951
Total [baseline] (10.265 s) : 0, 10264891
Agent [candidate] (1.068 s) : 0, 1068369
Total [candidate] (11.23 s) : 0, 11229864
section appsec
Agent [baseline] (1.252 s) : 0, 1251785
Total [baseline] (11.216 s) : 0, 11215553
Agent [candidate] (1.267 s) : 0, 1266536
Total [candidate] (11.351 s) : 0, 11350793
section iast
Agent [baseline] (1.252 s) : 0, 1252030
Total [baseline] (11.337 s) : 0, 11337210
Agent [candidate] (1.24 s) : 0, 1240019
Total [candidate] (11.382 s) : 0, 11381905
section profiling
Agent [baseline] (1.189 s) : 0, 1189015
Total [baseline] (11.078 s) : 0, 11077954
Agent [candidate] (1.189 s) : 0, 1188918
Total [candidate] (10.99 s) : 0, 10989822
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.056 s -
Agent appsec 1.252 s 195.834 ms (18.5%)
Agent iast 1.252 s 196.079 ms (18.6%)
Agent profiling 1.189 s 133.064 ms (12.6%)
Total tracing 10.265 s -
Total appsec 11.216 s 950.662 ms (9.3%)
Total iast 11.337 s 1.072 s (10.4%)
Total profiling 11.078 s 813.063 ms (7.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent appsec 1.267 s 198.167 ms (18.5%)
Agent iast 1.24 s 171.65 ms (16.1%)
Agent profiling 1.189 s 120.548 ms (11.3%)
Total tracing 11.23 s -
Total appsec 11.351 s 120.929 ms (1.1%)
Total iast 11.382 s 152.04 ms (1.4%)
Total profiling 10.99 s -240.042 ms (-2.1%) 
gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~3debd0241d, baseline=1.61.0-SNAPSHOT~018d1ea157

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.18 ms) : 0, 1180
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (627.01 ms) : 0, 627010
BytebuddyAgent [candidate] (634.601 ms) : 0, 634601
AgentMeter [baseline] (29.038 ms) : 0, 29038
AgentMeter [candidate] (29.405 ms) : 0, 29405
GlobalTracer [baseline] (256.166 ms) : 0, 256166
GlobalTracer [candidate] (260.658 ms) : 0, 260658
AppSec [baseline] (31.529 ms) : 0, 31529
AppSec [candidate] (32.315 ms) : 0, 32315
Debugger [baseline] (60.215 ms) : 0, 60215
Debugger [candidate] (61.45 ms) : 0, 61450
Remote Config [baseline] (588.001 µs) : 0, 588
Remote Config [candidate] (606.829 µs) : 0, 607
Telemetry [baseline] (7.968 ms) : 0, 7968
Telemetry [candidate] (8.134 ms) : 0, 8134
Flare Poller [baseline] (6.401 ms) : 0, 6401
Flare Poller [candidate] (3.62 ms) : 0, 3620
section appsec
crashtracking [baseline] (1.205 ms) : 0, 1205
crashtracking [candidate] (1.205 ms) : 0, 1205
BytebuddyAgent [baseline] (661.955 ms) : 0, 661955
BytebuddyAgent [candidate] (669.784 ms) : 0, 669784
AgentMeter [baseline] (12.031 ms) : 0, 12031
AgentMeter [candidate] (12.187 ms) : 0, 12187
GlobalTracer [baseline] (258.977 ms) : 0, 258977
GlobalTracer [candidate] (262.21 ms) : 0, 262210
AppSec [baseline] (178.17 ms) : 0, 178170
AppSec [candidate] (179.764 ms) : 0, 179764
Debugger [baseline] (65.981 ms) : 0, 65981
Debugger [candidate] (66.95 ms) : 0, 66950
Remote Config [baseline] (633.583 µs) : 0, 634
Remote Config [candidate] (642.229 µs) : 0, 642
Telemetry [baseline] (8.362 ms) : 0, 8362
Telemetry [candidate] (8.566 ms) : 0, 8566
Flare Poller [baseline] (3.628 ms) : 0, 3628
Flare Poller [candidate] (3.749 ms) : 0, 3749
IAST [baseline] (24.305 ms) : 0, 24305
IAST [candidate] (24.731 ms) : 0, 24731
section iast
crashtracking [baseline] (1.228 ms) : 0, 1228
crashtracking [candidate] (1.205 ms) : 0, 1205
BytebuddyAgent [baseline] (812.507 ms) : 0, 812507
BytebuddyAgent [candidate] (805.559 ms) : 0, 805559
AgentMeter [baseline] (11.574 ms) : 0, 11574
AgentMeter [candidate] (11.479 ms) : 0, 11479
GlobalTracer [baseline] (251.359 ms) : 0, 251359
GlobalTracer [candidate] (249.086 ms) : 0, 249086
AppSec [baseline] (27.222 ms) : 0, 27222
AppSec [candidate] (26.629 ms) : 0, 26629
Debugger [baseline] (72.262 ms) : 0, 72262
Debugger [candidate] (70.971 ms) : 0, 70971
Remote Config [baseline] (552.268 µs) : 0, 552
Remote Config [candidate] (534.558 µs) : 0, 535
Telemetry [baseline] (9.263 ms) : 0, 9263
Telemetry [candidate] (9.441 ms) : 0, 9441
Flare Poller [baseline] (3.445 ms) : 0, 3445
Flare Poller [candidate] (3.355 ms) : 0, 3355
IAST [baseline] (25.887 ms) : 0, 25887
IAST [candidate] (25.384 ms) : 0, 25384
section profiling
ProfilingAgent [baseline] (94.389 ms) : 0, 94389
ProfilingAgent [candidate] (94.56 ms) : 0, 94560
crashtracking [baseline] (1.161 ms) : 0, 1161
crashtracking [candidate] (1.166 ms) : 0, 1166
BytebuddyAgent [baseline] (686.521 ms) : 0, 686521
BytebuddyAgent [candidate] (685.965 ms) : 0, 685965
AgentMeter [baseline] (8.624 ms) : 0, 8624
AgentMeter [candidate] (8.614 ms) : 0, 8614
GlobalTracer [baseline] (216.97 ms) : 0, 216970
GlobalTracer [candidate] (217.001 ms) : 0, 217001
AppSec [baseline] (32.37 ms) : 0, 32370
AppSec [candidate] (32.41 ms) : 0, 32410
Debugger [baseline] (66.086 ms) : 0, 66086
Debugger [candidate] (65.41 ms) : 0, 65410
Remote Config [baseline] (559.983 µs) : 0, 560
Remote Config [candidate] (574.673 µs) : 0, 575
Telemetry [baseline] (7.778 ms) : 0, 7778
Telemetry [candidate] (8.544 ms) : 0, 8544
Flare Poller [baseline] (3.474 ms) : 0, 3474
Flare Poller [candidate] (3.554 ms) : 0, 3554
Profiling [baseline] (94.953 ms) : 0, 94953
Profiling [candidate] (95.122 ms) : 0, 95122
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/optim-lambda-check
git_commit_date 1773923179 1773928783
git_commit_sha 018d1ea 3debd02
release_version 1.61.0-SNAPSHOT~018d1ea157 1.61.0-SNAPSHOT~3debd0241d
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1773931278 1773931278
ci_job_id 1521553820 1521553820
ci_pipeline_id 103497370 103497370
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-i1e3nqpq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-i1e3nqpq 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 3 performance regressions! Performance is the same for 16 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+90.403µs; +200.933µs] or [+3.357%; +7.461%]		 worse
[+209.183µs; +613.840µs] or [+2.723%; +7.990%]		 unstable
[-205.660op/s; +65.222op/s] or [-15.477%; +4.908%]		 2.839ms 8.094ms 1258.594op/s 2.693ms 7.683ms 1328.812op/s
scenario:load:petclinic:profiling:high_load worse
[+0.573ms; +1.615ms] or [+3.114%; +8.778%]		 same
[-416.854µs; +1816.943µs] or [-1.357%; +5.913%]		 unstable
[-37.699op/s; +16.011op/s] or [-15.245%; +6.475%]		 19.491ms 31.428ms 236.438op/s 18.397ms 30.728ms 247.281op/s
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~3debd0241d, baseline=1.61.0-SNAPSHOT~018d1ea157
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.203 ms) : 1191, 1215
.   : milestone, 1203,
iast (3.154 ms) : 3113, 3195
.   : milestone, 3154,
iast_FULL (5.822 ms) : 5763, 5880
.   : milestone, 5822,
iast_GLOBAL (3.448 ms) : 3398, 3498
.   : milestone, 3448,
profiling (2.015 ms) : 1998, 2033
.   : milestone, 2015,
tracing (1.826 ms) : 1810, 1841
.   : milestone, 1826,
section candidate
no_agent (1.196 ms) : 1184, 1207
.   : milestone, 1196,
iast (3.148 ms) : 3106, 3191
.   : milestone, 3148,
iast_FULL (5.923 ms) : 5862, 5983
.   : milestone, 5923,
iast_GLOBAL (3.645 ms) : 3584, 3706
.   : milestone, 3645,
profiling (2.052 ms) : 2033, 2070
.   : milestone, 2052,
tracing (1.817 ms) : 1801, 1833
.   : milestone, 1817,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.203 ms [1.191 ms, 1.215 ms] -
iast 3.154 ms [3.113 ms, 3.195 ms] 1.951 ms (162.1%)
iast_FULL 5.822 ms [5.763 ms, 5.88 ms] 4.619 ms (383.9%)
iast_GLOBAL 3.448 ms [3.398 ms, 3.498 ms] 2.245 ms (186.6%)
profiling 2.015 ms [1.998 ms, 2.033 ms] 811.975 µs (67.5%)
tracing 1.826 ms [1.81 ms, 1.841 ms] 622.508 µs (51.7%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.196 ms [1.184 ms, 1.207 ms] -
iast 3.148 ms [3.106 ms, 3.191 ms] 1.953 ms (163.3%)
iast_FULL 5.923 ms [5.862 ms, 5.983 ms] 4.727 ms (395.4%)
iast_GLOBAL 3.645 ms [3.584 ms, 3.706 ms] 2.449 ms (204.9%)
profiling 2.052 ms [2.033 ms, 2.07 ms] 855.94 µs (71.6%)
tracing 1.817 ms [1.801 ms, 1.833 ms] 621.52 µs (52.0%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~3debd0241d, baseline=1.61.0-SNAPSHOT~018d1ea157
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.188 ms) : 18000, 18375
.   : milestone, 18188,
appsec (19.004 ms) : 18810, 19199
.   : milestone, 19004,
code_origins (17.725 ms) : 17547, 17903
.   : milestone, 17725,
iast (18.022 ms) : 17843, 18201
.   : milestone, 18022,
profiling (18.876 ms) : 18681, 19071
.   : milestone, 18876,
tracing (17.726 ms) : 17552, 17900
.   : milestone, 17726,
section candidate
no_agent (18.098 ms) : 17906, 18289
.   : milestone, 18098,
appsec (18.636 ms) : 18445, 18827
.   : milestone, 18636,
code_origins (17.771 ms) : 17592, 17950
.   : milestone, 17771,
iast (17.855 ms) : 17676, 18034
.   : milestone, 17855,
profiling (19.746 ms) : 19543, 19949
.   : milestone, 19746,
tracing (18.059 ms) : 17879, 18239
.   : milestone, 18059,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.188 ms [18.0 ms, 18.375 ms] -
appsec 19.004 ms [18.81 ms, 19.199 ms] 816.756 µs (4.5%)
code_origins 17.725 ms [17.547 ms, 17.903 ms] -462.372 µs (-2.5%)
iast 18.022 ms [17.843 ms, 18.201 ms] -165.437 µs (-0.9%)
profiling 18.876 ms [18.681 ms, 19.071 ms] 688.307 µs (3.8%)
tracing 17.726 ms [17.552 ms, 17.9 ms] -461.324 µs (-2.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.098 ms [17.906 ms, 18.289 ms] -
appsec 18.636 ms [18.445 ms, 18.827 ms] 538.59 µs (3.0%)
code_origins 17.771 ms [17.592 ms, 17.95 ms] -326.423 µs (-1.8%)
iast 17.855 ms [17.676 ms, 18.034 ms] -242.705 µs (-1.3%)
profiling 19.746 ms [19.543 ms, 19.949 ms] 1.648 ms (9.1%)
tracing 18.059 ms [17.879 ms, 18.239 ms] -38.807 µs (-0.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/optim-lambda-check
git_commit_date 1773923179 1773928783
git_commit_sha 018d1ea 3debd02
release_version 1.61.0-SNAPSHOT~018d1ea157 1.61.0-SNAPSHOT~3debd0241d
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1773931006 1773931006
ci_job_id 1521553821 1521553821
ci_pipeline_id 103497370 103497370
cpu_model Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-z04x21g9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-z04x21g9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:dacapo:tomcat:appsec better
[-1.560ms; -1.152ms] or [-36.974%; -27.302%]		 2.863ms 4.219ms
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~3debd0241d, baseline=1.61.0-SNAPSHOT~018d1ea157
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.579 s) : 14579000, 14579000
.   : milestone, 14579000,
appsec (14.141 s) : 14141000, 14141000
.   : milestone, 14141000,
iast (17.196 s) : 17196000, 17196000
.   : milestone, 17196000,
iast_GLOBAL (17.125 s) : 17125000, 17125000
.   : milestone, 17125000,
profiling (14.84 s) : 14840000, 14840000
.   : milestone, 14840000,
tracing (14.443 s) : 14443000, 14443000
.   : milestone, 14443000,
section candidate
no_agent (14.505 s) : 14505000, 14505000
.   : milestone, 14505000,
appsec (14.225 s) : 14225000, 14225000
.   : milestone, 14225000,
iast (17.577 s) : 17577000, 17577000
.   : milestone, 17577000,
iast_GLOBAL (17.211 s) : 17211000, 17211000
.   : milestone, 17211000,
profiling (14.39 s) : 14390000, 14390000
.   : milestone, 14390000,
tracing (14.755 s) : 14755000, 14755000
.   : milestone, 14755000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.579 s [14.579 s, 14.579 s] -
appsec 14.141 s [14.141 s, 14.141 s] -438.0 ms (-3.0%)
iast 17.196 s [17.196 s, 17.196 s] 2.617 s (18.0%)
iast_GLOBAL 17.125 s [17.125 s, 17.125 s] 2.546 s (17.5%)
profiling 14.84 s [14.84 s, 14.84 s] 261.0 ms (1.8%)
tracing 14.443 s [14.443 s, 14.443 s] -136.0 ms (-0.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.505 s [14.505 s, 14.505 s] -
appsec 14.225 s [14.225 s, 14.225 s] -280.0 ms (-1.9%)
iast 17.577 s [17.577 s, 17.577 s] 3.072 s (21.2%)
iast_GLOBAL 17.211 s [17.211 s, 17.211 s] 2.706 s (18.7%)
profiling 14.39 s [14.39 s, 14.39 s] -115.0 ms (-0.8%)
tracing 14.755 s [14.755 s, 14.755 s] 250.0 ms (1.7%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~3debd0241d, baseline=1.61.0-SNAPSHOT~018d1ea157
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.484 ms) : 1473, 1496
.   : milestone, 1484,
appsec (4.219 ms) : 3966, 4472
.   : milestone, 4219,
iast (2.666 ms) : 2556, 2777
.   : milestone, 2666,
iast_GLOBAL (2.708 ms) : 2598, 2819
.   : milestone, 2708,
profiling (2.476 ms) : 2383, 2570
.   : milestone, 2476,
tracing (2.411 ms) : 2323, 2500
.   : milestone, 2411,
section candidate
no_agent (1.485 ms) : 1473, 1497
.   : milestone, 1485,
appsec (2.863 ms) : 2774, 2953
.   : milestone, 2863,
iast (2.668 ms) : 2558, 2778
.   : milestone, 2668,
iast_GLOBAL (2.71 ms) : 2600, 2821
.   : milestone, 2710,
profiling (2.439 ms) : 2349, 2530
.   : milestone, 2439,
tracing (2.413 ms) : 2324, 2501
.   : milestone, 2413,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.484 ms [1.473 ms, 1.496 ms] -
appsec 4.219 ms [3.966 ms, 4.472 ms] 2.735 ms (184.2%)
iast 2.666 ms [2.556 ms, 2.777 ms] 1.182 ms (79.6%)
iast_GLOBAL 2.708 ms [2.598 ms, 2.819 ms] 1.224 ms (82.5%)
profiling 2.476 ms [2.383 ms, 2.57 ms] 991.944 µs (66.8%)
tracing 2.411 ms [2.323 ms, 2.5 ms] 926.977 µs (62.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.485 ms [1.473 ms, 1.497 ms] -
appsec 2.863 ms [2.774 ms, 2.953 ms] 1.378 ms (92.8%)
iast 2.668 ms [2.558 ms, 2.778 ms] 1.183 ms (79.7%)
iast_GLOBAL 2.71 ms [2.6 ms, 2.821 ms] 1.225 ms (82.5%)
profiling 2.439 ms [2.349 ms, 2.53 ms] 954.282 µs (64.3%)
tracing 2.413 ms [2.324 ms, 2.501 ms] 927.856 µs (62.5%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@ojung ojung Awaiting requested review from ojung ojung is a code owner automatically assigned from DataDog/debugger-java

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

comp: debugger Dynamic Instrumentation type: enhancement Enhancements and improvements

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@jpbempel