ci: add x86 spot metal CI runner to bench, remove Bencher by jkaczman · Pull Request #1915 · pgdogdev/pgdog

jkaczman · 2026-10-28T21:33:44Z

Runs the metal bench on an x86 spot instance in parallel with Graviton (arm64).

Also:

codecov · 2026-10-28T21:35:25Z

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

github-actions · 2026-10-28T22:06:53Z

Metal bench (arm64) passed. All 148 measures within bounds.

suite	throughput	cpu/txn	user cycles/txn	user instr/txn	kernel cycles/txn	ctx/txn
pooler		26.48 (+0.4% ± 0.7%)	26,546 (+0.2% ± 0.8%)	35,187 (-0.0% ± 0.02%)	38,123 (+0.6% ± 1.2%)
lb		27.2 (-0.2% ± 1.3%)	27,742 (-0.2% ± 1.1%)	36,066 (+0.0% ± 0.04%)	38,604 (-0.3% ± 1.9%)
sharding-w2		49.99 (+1.4%)	64,374 (+1.1%)	72,258 (+0.0%)	59,650 (+1.7%)	1.39 (-0.1%)
sharding-w8	160,124 (-0.7%)	45.59 (+0.5%)	65,245 (-0.2%)	56,090 (+0.0%)	52,260 (+1.2%)	0.1505 (+1.3%)

Counters per txn

suite	frontend stall	l1i refill	backend stall
pooler	12,282 (+0.5% ± 1.8%)	3,068 (+0.2% ± 0.4%)	2,851 (+0.1% ± 1.1%)
lb	12,910 (-0.5% ± 2.3%)	3,146 (+0.1% ± 0.7%)	3,101 (-0.0% ± 2.3%)
sharding-w2	36,229 (+2.7%)	5,192 (+0.7%)	6,505 (-3.6%)
sharding-w8	36,590 (-0.1%)	4,992 (+1.2%)	9,101 (-2.5%)

Microbench: all 135 measures within bounds.

lb flamegraph vs 17cc5b6

Open interactive for hover, zoom and search.

microbench flamegraph vs 17cc5b6

Open interactive for hover, zoom and search.

pooler flamegraph vs 17cc5b6

Open interactive for hover, zoom and search.

sharding-w2 flamegraph vs 17cc5b6

Open interactive for hover, zoom and search.

sharding-w8 flamegraph vs 17cc5b6

Open interactive for hover, zoom and search.

Logs

Compared 5002d1f with 17cc5b6 on c7g.metal (on-demand).

github-actions · 2026-10-28T22:07:29Z

Metal bench (x86) passed. All 148 measures within bounds.

suite	throughput	cpu/txn	user cycles/txn	user instr/txn	kernel cycles/txn	ctx/txn
pooler		26.27 (-0.0% ± 0.3%)	20,486 (+0.0% ± 0.09%)	36,798 (+0.0% ± 0.03%)	33,823 (-0.1% ± 0.6%)
lb		26.65 (+0.0% ± 0.3%)	21,089 (+0.1% ± 0.1%)	37,738 (+0.0% ± 0.03%)	33,916 (+0.1% ± 0.5%)
sharding-w2		41.13 (-0.1%)	44,771 (-0.6%)	75,817 (+0.0%)	40,395 (+0.4%)	1.514 (+0.1%)
sharding-w8	169,738 (-0.9%)	38.61 (-0.5%)	48,952 (-0.5%)	59,033 (+0.0%)	42,106 (-0.7%)	0.1881 (+1.1%)

Counters per txn

suite	frontend stall	l1i refill	backend stall
pooler	3,458 (+0.2% ± 0.3%)	1,167 (-0.0% ± 0.4%)	42,585 (-0.0% ± 0.3%)
lb	3,547 (+0.1% ± 0.4%)	1,191 (-0.0% ± 0.5%)	44,241 (+0.1% ± 0.5%)
sharding-w2	6,415 (-0.1%)	1,701 (-0.2%)	118,452 (-1.1%)
sharding-w8	3,538 (+0.6%)	1,023 (+1.0%)	184,308 (-0.9%)