List iteration benchmark by dougqh · Pull Request #10888 · DataDog/dd-trace-java

dougqh · 2026-03-18T14:00:21Z

What Does This Do

Benchmark examining different ways to iterate over Lists: Collections.emptyList, Collections.singletonList, and ArrayList of different sizes

Covers multiple iteration options...

c-style for ( int i = 0; i < list.size(); ++i ) ...
iterator
enhanced for ( x : list ) (sugar for iterator)
List.forEach
List.stream
List.parallelStream

Each benchmark has a variation with and without the loop body fully inlined

Motivation

Illustrate overhead and make recommendations about the preferred way to iterate over lists in dd-java-agent.

Additional Notes

Recommends are...

prefer enhanced for -- except in the uncommon situation where escape analysis fails -- in that case, forEach or c-style are the best altenatives
avoid streams - always incur extra allocation - generally unnecessary for the task at hand

Contributor Checklist

Format the title according to the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any other useful labels
Avoid using close, fix, or any linking keywords when referencing an issue
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, migration, or deletion
Update public documentation with any new configuration flags or behaviors

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

pr-commenter · 2026-03-18T14:47:03Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	dougqh/list-iteration-benchmark
git_commit_date	1773841815	1773876833
git_commit_sha	`f4fa29a`	`d002783`
release_version	1.61.0-SNAPSHOT~f4fa29a892	1.61.0-SNAPSHOT~d002783f13

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1773878613	1773878613
ci_job_id	1520012688	1520012688
ci_pipeline_id	103410619	103410619
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-pbqswi2u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-pbqswi2u 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~d002783f13, baseline=1.61.0-SNAPSHOT~f4fa29a892

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1054868
Total [baseline] (8.868 s) : 0, 8868099
Agent [candidate] (1.066 s) : 0, 1066480
Total [candidate] (8.918 s) : 0, 8918167
section iast
Agent [baseline] (1.236 s) : 0, 1236129
Total [baseline] (9.567 s) : 0, 9566726
Agent [candidate] (1.229 s) : 0, 1229034
Total [candidate] (9.566 s) : 0, 9565875

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.055 s	-
Agent	iast	1.236 s	181.261 ms (17.2%)
Total	tracing	8.868 s	-
Total	iast	9.567 s	698.627 ms (7.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.066 s	-
Agent	iast	1.229 s	162.554 ms (15.2%)
Total	tracing	8.918 s	-
Total	iast	9.566 s	647.708 ms (7.3%)

gantt
    title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~d002783f13, baseline=1.61.0-SNAPSHOT~f4fa29a892

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.215 ms) : 0, 1215
BytebuddyAgent [baseline] (627.108 ms) : 0, 627108
BytebuddyAgent [candidate] (635.538 ms) : 0, 635538
AgentMeter [baseline] (29.121 ms) : 0, 29121
AgentMeter [candidate] (29.546 ms) : 0, 29546
GlobalTracer [baseline] (256.493 ms) : 0, 256493
GlobalTracer [candidate] (259.639 ms) : 0, 259639
AppSec [baseline] (31.488 ms) : 0, 31488
AppSec [candidate] (31.881 ms) : 0, 31881
Debugger [baseline] (59.146 ms) : 0, 59146
Debugger [candidate] (60.143 ms) : 0, 60143
Remote Config [baseline] (577.849 µs) : 0, 578
Remote Config [candidate] (586.636 µs) : 0, 587
Telemetry [baseline] (7.946 ms) : 0, 7946
Telemetry [candidate] (8.103 ms) : 0, 8103
Flare Poller [baseline] (5.774 ms) : 0, 5774
Flare Poller [candidate] (3.539 ms) : 0, 3539
section iast
crashtracking [baseline] (1.203 ms) : 0, 1203
crashtracking [candidate] (1.199 ms) : 0, 1199
BytebuddyAgent [baseline] (803.572 ms) : 0, 803572
BytebuddyAgent [candidate] (796.947 ms) : 0, 796947
AgentMeter [baseline] (11.432 ms) : 0, 11432
AgentMeter [candidate] (11.342 ms) : 0, 11342
GlobalTracer [baseline] (248.684 ms) : 0, 248684
GlobalTracer [candidate] (247.836 ms) : 0, 247836
IAST [baseline] (25.536 ms) : 0, 25536
IAST [candidate] (25.35 ms) : 0, 25350
AppSec [baseline] (26.717 ms) : 0, 26717
AppSec [candidate] (26.549 ms) : 0, 26549
Debugger [baseline] (69.624 ms) : 0, 69624
Debugger [candidate] (69.042 ms) : 0, 69042
Remote Config [baseline] (525.403 µs) : 0, 525
Remote Config [candidate] (548.849 µs) : 0, 549
Telemetry [baseline] (9.131 ms) : 0, 9131
Telemetry [candidate] (10.308 ms) : 0, 10308
Flare Poller [baseline] (3.323 ms) : 0, 3323
Flare Poller [candidate] (3.71 ms) : 0, 3710

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~d002783f13, baseline=1.61.0-SNAPSHOT~f4fa29a892

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.059 s) : 0, 1058930
Total [baseline] (11.127 s) : 0, 11126903
Agent [candidate] (1.061 s) : 0, 1060894
Total [candidate] (11.142 s) : 0, 11141528
section appsec
Agent [baseline] (1.247 s) : 0, 1247236
Total [baseline] (11.183 s) : 0, 11183096
Agent [candidate] (1.264 s) : 0, 1264210
Total [candidate] (11.304 s) : 0, 11303715
section iast
Agent [baseline] (1.234 s) : 0, 1233658
Total [baseline] (11.46 s) : 0, 11460196
Agent [candidate] (1.244 s) : 0, 1244282
Total [candidate] (11.437 s) : 0, 11436824
section profiling
Agent [baseline] (1.185 s) : 0, 1184839
Total [baseline] (11.119 s) : 0, 11119135
Agent [candidate] (1.191 s) : 0, 1191013
Total [candidate] (11.071 s) : 0, 11070668

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.059 s	-
Agent	appsec	1.247 s	188.306 ms (17.8%)
Agent	iast	1.234 s	174.728 ms (16.5%)
Agent	profiling	1.185 s	125.91 ms (11.9%)
Total	tracing	11.127 s	-
Total	appsec	11.183 s	56.193 ms (0.5%)
Total	iast	11.46 s	333.293 ms (3.0%)
Total	profiling	11.119 s	-7.768 ms (-0.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.061 s	-
Agent	appsec	1.264 s	203.315 ms (19.2%)
Agent	iast	1.244 s	183.387 ms (17.3%)
Agent	profiling	1.191 s	130.119 ms (12.3%)
Total	tracing	11.142 s	-
Total	appsec	11.304 s	162.187 ms (1.5%)
Total	iast	11.437 s	295.296 ms (2.7%)
Total	profiling	11.071 s	-70.859 ms (-0.6%)

gantt
    title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~d002783f13, baseline=1.61.0-SNAPSHOT~f4fa29a892

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.191 ms) : 0, 1191
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (629.235 ms) : 0, 629235
BytebuddyAgent [candidate] (629.044 ms) : 0, 629044
AgentMeter [baseline] (29.221 ms) : 0, 29221
AgentMeter [candidate] (29.173 ms) : 0, 29173
GlobalTracer [baseline] (258.01 ms) : 0, 258010
GlobalTracer [candidate] (257.585 ms) : 0, 257585
AppSec [baseline] (31.804 ms) : 0, 31804
AppSec [candidate] (31.657 ms) : 0, 31657
Debugger [baseline] (60.422 ms) : 0, 60422
Debugger [candidate] (60.289 ms) : 0, 60289
Remote Config [baseline] (587.374 µs) : 0, 587
Remote Config [candidate] (593.491 µs) : 0, 593
Telemetry [baseline] (7.995 ms) : 0, 7995
Telemetry [candidate] (8.012 ms) : 0, 8012
Flare Poller [baseline] (4.314 ms) : 0, 4314
Flare Poller [candidate] (7.285 ms) : 0, 7285
section appsec
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.229 ms) : 0, 1229
BytebuddyAgent [baseline] (658.667 ms) : 0, 658667
BytebuddyAgent [candidate] (668.221 ms) : 0, 668221
AgentMeter [baseline] (11.957 ms) : 0, 11957
AgentMeter [candidate] (12.166 ms) : 0, 12166
GlobalTracer [baseline] (258.224 ms) : 0, 258224
GlobalTracer [candidate] (261.77 ms) : 0, 261770
IAST [baseline] (24.17 ms) : 0, 24170
IAST [candidate] (24.607 ms) : 0, 24607
AppSec [baseline] (177.778 ms) : 0, 177778
AppSec [candidate] (179.476 ms) : 0, 179476
Debugger [baseline] (66.271 ms) : 0, 66271
Debugger [candidate] (67.191 ms) : 0, 67191
Remote Config [baseline] (658.434 µs) : 0, 658
Remote Config [candidate] (641.762 µs) : 0, 642
Telemetry [baseline] (8.431 ms) : 0, 8431
Telemetry [candidate] (8.52 ms) : 0, 8520
Flare Poller [baseline] (3.596 ms) : 0, 3596
Flare Poller [candidate] (3.719 ms) : 0, 3719
section iast
crashtracking [baseline] (1.213 ms) : 0, 1213
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (800.364 ms) : 0, 800364
BytebuddyAgent [candidate] (806.602 ms) : 0, 806602
AgentMeter [baseline] (11.32 ms) : 0, 11320
AgentMeter [candidate] (11.539 ms) : 0, 11539
GlobalTracer [baseline] (247.915 ms) : 0, 247915
GlobalTracer [candidate] (250.705 ms) : 0, 250705
IAST [baseline] (25.345 ms) : 0, 25345
IAST [candidate] (25.827 ms) : 0, 25827
AppSec [baseline] (26.513 ms) : 0, 26513
AppSec [candidate] (27.109 ms) : 0, 27109
Debugger [baseline] (71.481 ms) : 0, 71481
Debugger [candidate] (71.571 ms) : 0, 71571
Remote Config [baseline] (543.022 µs) : 0, 543
Remote Config [candidate] (546.399 µs) : 0, 546
Telemetry [baseline] (9.255 ms) : 0, 9255
Telemetry [candidate] (9.377 ms) : 0, 9377
Flare Poller [baseline] (3.394 ms) : 0, 3394
Flare Poller [candidate] (3.482 ms) : 0, 3482
section profiling
crashtracking [baseline] (1.17 ms) : 0, 1170
crashtracking [candidate] (1.19 ms) : 0, 1190
BytebuddyAgent [baseline] (684.736 ms) : 0, 684736
BytebuddyAgent [candidate] (688.922 ms) : 0, 688922
AgentMeter [baseline] (8.606 ms) : 0, 8606
AgentMeter [candidate] (8.658 ms) : 0, 8658
GlobalTracer [baseline] (215.3 ms) : 0, 215300
GlobalTracer [candidate] (216.852 ms) : 0, 216852
AppSec [baseline] (32.333 ms) : 0, 32333
AppSec [candidate] (32.531 ms) : 0, 32531
Debugger [baseline] (65.25 ms) : 0, 65250
Debugger [candidate] (66.244 ms) : 0, 66244
Remote Config [baseline] (564.343 µs) : 0, 564
Remote Config [candidate] (556.051 µs) : 0, 556
Telemetry [baseline] (7.734 ms) : 0, 7734
Telemetry [candidate] (7.712 ms) : 0, 7712
Flare Poller [baseline] (4.25 ms) : 0, 4250
Flare Poller [candidate] (3.477 ms) : 0, 3477
ProfilingAgent [baseline] (93.973 ms) : 0, 93973
ProfilingAgent [candidate] (94.052 ms) : 0, 94052
Profiling [baseline] (94.536 ms) : 0, 94536
Profiling [candidate] (94.601 ms) : 0, 94601

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	dougqh/list-iteration-benchmark
git_commit_date	1773841815	1773876833
git_commit_sha	`f4fa29a`	`d002783`
release_version	1.61.0-SNAPSHOT~f4fa29a892	1.61.0-SNAPSHOT~d002783f13

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1773879070	1773879070
ci_job_id	1520012689	1520012689
ci_pipeline_id	103410619	103410619
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-k8sh0rvf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-k8sh0rvf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 7 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 16 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load	better [-381.833µs; -270.912µs] or [-13.012%; -9.232%]	better [-774.144µs; -363.467µs] or [-9.405%; -4.416%]	unstable [-19.760op/s; +247.573op/s] or [-1.593%; +19.959%]	2.608ms	7.662ms	1354.312op/s	2.934ms	8.231ms	1240.406op/s
scenario:load:petclinic:tracing:high_load	better [-1.465ms; -0.570ms] or [-8.012%; -3.117%]	better [-2.140ms; -0.689ms] or [-7.101%; -2.285%]	unstable [-13.457op/s; +39.520op/s] or [-5.375%; +15.784%]	17.266ms	28.726ms	263.406op/s	18.283ms	30.140ms	250.375op/s
scenario:load:petclinic:code_origins:high_load	better [-1.614ms; -0.817ms] or [-8.709%; -4.410%]	unsure [-2.024ms; -0.532ms] or [-6.773%; -1.779%]	unstable [-12.167op/s; +40.792op/s] or [-4.897%; +16.417%]	17.311ms	28.600ms	262.781op/s	18.527ms	29.878ms	248.469op/s
scenario:load:petclinic:iast:high_load	better [-1.697ms; -0.783ms] or [-9.128%; -4.210%]	better [-2.708ms; -1.207ms] or [-8.990%; -4.005%]	unstable [-11.082op/s; +42.395op/s] or [-4.462%; +17.071%]	17.351ms	28.168ms	264.000op/s	18.591ms	30.125ms	248.344op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~d002783f13, baseline=1.61.0-SNAPSHOT~f4fa29a892
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.186 ms) : 1175, 1197
.   : milestone, 1186,
iast (3.22 ms) : 3178, 3263
.   : milestone, 3220,
iast_FULL (5.918 ms) : 5859, 5977
.   : milestone, 5918,
iast_GLOBAL (3.7 ms) : 3642, 3758
.   : milestone, 3700,
profiling (2.134 ms) : 2110, 2157
.   : milestone, 2134,
tracing (1.807 ms) : 1793, 1821
.   : milestone, 1807,
section candidate
no_agent (1.178 ms) : 1167, 1190
.   : milestone, 1178,
iast (3.172 ms) : 3124, 3220
.   : milestone, 3172,
iast_FULL (6.001 ms) : 5940, 6062
.   : milestone, 6001,
iast_GLOBAL (3.382 ms) : 3331, 3433
.   : milestone, 3382,
profiling (2.116 ms) : 2093, 2139
.   : milestone, 2116,
tracing (1.776 ms) : 1761, 1790
.   : milestone, 1776,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.186 ms [1.175 ms, 1.197 ms]	-
iast	3.22 ms [3.178 ms, 3.263 ms]	2.034 ms (171.6%)
iast_FULL	5.918 ms [5.859 ms, 5.977 ms]	4.732 ms (399.1%)
iast_GLOBAL	3.7 ms [3.642 ms, 3.758 ms]	2.514 ms (212.0%)
profiling	2.134 ms [2.11 ms, 2.157 ms]	948.004 µs (79.9%)
tracing	1.807 ms [1.793 ms, 1.821 ms]	621.12 µs (52.4%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.178 ms [1.167 ms, 1.19 ms]	-
iast	3.172 ms [3.124 ms, 3.22 ms]	1.993 ms (169.2%)
iast_FULL	6.001 ms [5.94 ms, 6.062 ms]	4.822 ms (409.2%)
iast_GLOBAL	3.382 ms [3.331 ms, 3.433 ms]	2.203 ms (187.0%)
profiling	2.116 ms [2.093 ms, 2.139 ms]	937.474 µs (79.5%)
tracing	1.776 ms [1.761 ms, 1.79 ms]	597.069 µs (50.7%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~d002783f13, baseline=1.61.0-SNAPSHOT~f4fa29a892
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.923 ms) : 17741, 18105
.   : milestone, 17923,
appsec (18.781 ms) : 18592, 18970
.   : milestone, 18781,
code_origins (18.777 ms) : 18588, 18966
.   : milestone, 18777,
iast (18.795 ms) : 18605, 18985
.   : milestone, 18795,
profiling (18.721 ms) : 18532, 18910
.   : milestone, 18721,
tracing (18.637 ms) : 18447, 18828
.   : milestone, 18637,
section candidate
no_agent (17.128 ms) : 16958, 17299
.   : milestone, 17128,
appsec (18.697 ms) : 18509, 18886
.   : milestone, 18697,
code_origins (17.755 ms) : 17578, 17933
.   : milestone, 17755,
iast (17.675 ms) : 17502, 17848
.   : milestone, 17675,
profiling (18.828 ms) : 18638, 19017
.   : milestone, 18828,
tracing (17.712 ms) : 17535, 17890
.   : milestone, 17712,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.923 ms [17.741 ms, 18.105 ms]	-
appsec	18.781 ms [18.592 ms, 18.97 ms]	857.939 µs (4.8%)
code_origins	18.777 ms [18.588 ms, 18.966 ms]	853.993 µs (4.8%)
iast	18.795 ms [18.605 ms, 18.985 ms]	872.431 µs (4.9%)
profiling	18.721 ms [18.532 ms, 18.91 ms]	798.306 µs (4.5%)
tracing	18.637 ms [18.447 ms, 18.828 ms]	714.534 µs (4.0%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.128 ms [16.958 ms, 17.299 ms]	-
appsec	18.697 ms [18.509 ms, 18.886 ms]	1.569 ms (9.2%)
code_origins	17.755 ms [17.578 ms, 17.933 ms]	626.799 µs (3.7%)
iast	17.675 ms [17.502 ms, 17.848 ms]	546.639 µs (3.2%)
profiling	18.828 ms [18.638 ms, 19.017 ms]	1.699 ms (9.9%)
tracing	17.712 ms [17.535 ms, 17.89 ms]	583.679 µs (3.4%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	dougqh/list-iteration-benchmark
git_commit_date	1773841815	1773876833
git_commit_sha	`f4fa29a`	`d002783`
release_version	1.61.0-SNAPSHOT~f4fa29a892	1.61.0-SNAPSHOT~d002783f13

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1773878824	1773878824
ci_job_id	1520012690	1520012690
ci_pipeline_id	103410619	103410619
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-7nb1briu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-7nb1briu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~d002783f13, baseline=1.61.0-SNAPSHOT~f4fa29a892
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (3.789 ms) : 3568, 4009
.   : milestone, 3789,
iast (2.254 ms) : 2185, 2322
.   : milestone, 2254,
iast_GLOBAL (2.3 ms) : 2230, 2369
.   : milestone, 2300,
profiling (2.102 ms) : 2046, 2158
.   : milestone, 2102,
tracing (2.066 ms) : 2013, 2120
.   : milestone, 2066,
section candidate
no_agent (1.467 ms) : 1456, 1479
.   : milestone, 1467,
appsec (3.799 ms) : 3578, 4021
.   : milestone, 3799,
iast (2.251 ms) : 2182, 2320
.   : milestone, 2251,
iast_GLOBAL (2.3 ms) : 2231, 2369
.   : milestone, 2300,
profiling (2.087 ms) : 2031, 2142
.   : milestone, 2087,
tracing (2.067 ms) : 2014, 2120
.   : milestone, 2067,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.474 ms [1.462 ms, 1.485 ms]	-
appsec	3.789 ms [3.568 ms, 4.009 ms]	2.315 ms (157.1%)
iast	2.254 ms [2.185 ms, 2.322 ms]	780.292 µs (53.0%)
iast_GLOBAL	2.3 ms [2.23 ms, 2.369 ms]	826.225 µs (56.1%)
profiling	2.102 ms [2.046 ms, 2.158 ms]	628.339 µs (42.6%)
tracing	2.066 ms [2.013 ms, 2.12 ms]	592.933 µs (40.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.467 ms [1.456 ms, 1.479 ms]	-
appsec	3.799 ms [3.578 ms, 4.021 ms]	2.332 ms (158.9%)
iast	2.251 ms [2.182 ms, 2.32 ms]	783.392 µs (53.4%)
iast_GLOBAL	2.3 ms [2.231 ms, 2.369 ms]	832.72 µs (56.7%)
profiling	2.087 ms [2.031 ms, 2.142 ms]	619.364 µs (42.2%)
tracing	2.067 ms [2.014 ms, 2.12 ms]	599.561 µs (40.9%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~d002783f13, baseline=1.61.0-SNAPSHOT~f4fa29a892
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.504 s) : 15504000, 15504000
.   : milestone, 15504000,
appsec (15.047 s) : 15047000, 15047000
.   : milestone, 15047000,
iast (18.469 s) : 18469000, 18469000
.   : milestone, 18469000,
iast_GLOBAL (18.298 s) : 18298000, 18298000
.   : milestone, 18298000,
profiling (15.599 s) : 15599000, 15599000
.   : milestone, 15599000,
tracing (14.93 s) : 14930000, 14930000
.   : milestone, 14930000,
section candidate
no_agent (15.274 s) : 15274000, 15274000
.   : milestone, 15274000,
appsec (14.873 s) : 14873000, 14873000
.   : milestone, 14873000,
iast (18.503 s) : 18503000, 18503000
.   : milestone, 18503000,
iast_GLOBAL (17.852 s) : 17852000, 17852000
.   : milestone, 17852000,
profiling (14.8 s) : 14800000, 14800000
.   : milestone, 14800000,
tracing (14.859 s) : 14859000, 14859000
.   : milestone, 14859000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.504 s [15.504 s, 15.504 s]	-
appsec	15.047 s [15.047 s, 15.047 s]	-457.0 ms (-2.9%)
iast	18.469 s [18.469 s, 18.469 s]	2.965 s (19.1%)
iast_GLOBAL	18.298 s [18.298 s, 18.298 s]	2.794 s (18.0%)
profiling	15.599 s [15.599 s, 15.599 s]	95.0 ms (0.6%)
tracing	14.93 s [14.93 s, 14.93 s]	-574.0 ms (-3.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.274 s [15.274 s, 15.274 s]	-
appsec	14.873 s [14.873 s, 14.873 s]	-401.0 ms (-2.6%)
iast	18.503 s [18.503 s, 18.503 s]	3.229 s (21.1%)
iast_GLOBAL	17.852 s [17.852 s, 17.852 s]	2.578 s (16.9%)
profiling	14.8 s [14.8 s, 14.8 s]	-474.0 ms (-3.1%)
tracing	14.859 s [14.859 s, 14.859 s]	-415.0 ms (-2.7%)

…tion earlier

Adding missing end ul to doc Moving iterator benchmarks next to enhancedFor

List iteration benchmark

d2a2295

dougqh requested a review from a team as a code owner March 18, 2026 14:00

dougqh requested a review from ygree March 18, 2026 14:00

dougqh added comp: core Tracer core type: documentation tag: performance Performance related changes labels Mar 18, 2026

Merge branch 'master' into dougqh/list-iteration-benchmark

372dff0

dougqh added 2 commits March 18, 2026 13:14

Fixing silly oversight - commented out benchmarks to run one in isola…

54883cd

…tion earlier

A bit of clean-up

d002783

Adding missing end ul to doc Moving iterator benchmarks next to enhancedFor

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

List iteration benchmark#10888

List iteration benchmark#10888
dougqh wants to merge 4 commits intomasterfrom
dougqh/list-iteration-benchmark

dougqh commented Mar 18, 2026

Uh oh!

pr-commenter bot commented Mar 18, 2026 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

dougqh commented Mar 18, 2026

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Mar 18, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

pr-commenter bot commented Mar 18, 2026 •

edited

Loading