Skip to content

core: aggregate builder request auths for gloas builders - #4783

Merged
KaloyanTanev merged 15 commits into
gloasfrom
kalo/gloas-builder-preferences
Oct 19, 2026
Merged

KaloyanTanev merged 15 commits into
gloasfrom
kalo/gloas-builder-preferences

Conversation

@KaloyanTanev

Copy link
Copy Markdown
Collaborator

Adds the gloas builder preferences duty (#4724). Partial SignedBuilderRequestAuths from validator clients, received ahead of time via POST /eth/v1/validator/builder_preferences or inline in the v4 block production body, are threshold-aggregated per builder, attached to the proposal's BuilderConfig and submitted to the beacon node. Bumps go-eth2-client to v0.30.1-obol.1-gloas and generalises AggSigDB.Await to take AwaitOpts.

Stacked on #4771. The Eth-Builder-Url round-trip on publish is left for a follow-up.

category: feature
ticket: #4324

@KaloyanTanev KaloyanTanev self-assigned this Oct 18, 2026
@github-actions github-actions Bot added the branch-invalid PR raised against invalid branch. Not a main or release branch. label Oct 18, 2026
@KaloyanTanev
KaloyanTanev requested a balanced review from Copilot October 18, 2026 13:50

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

An organization owner can choose the repository organization as the billing source for reviews requested by members with a paid Copilot license. Learn about Copilot code review billing. Review the Copilot code review billing settings.

@codecov

codecov Bot commented Oct 18, 2026 •

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 84.40748% with 75 lines in your changes missing coverage. Please review.
⚠️ Please upload report for BASE (gloas@282a123). Learn more about missing BASE report.

Files with missing lines Patch % Lines
app/eth2wrap/eth2wrap_gen.go 0.00% 16 Missing ⚠️
core/validatorapi/validatorapi.go 90.26% 11 Missing ⚠️
app/app.go 0.00% 10 Missing ⚠️
core/signeddata.go 72.00% 7 Missing ⚠️
core/bcast/bcast.go 92.10% 6 Missing ⚠️
core/tracker/tracker.go 88.88% 5 Missing ⚠️
core/types.go 25.00% 3 Missing ⚠️
core/aggsigdb/memory.go 92.00% 2 Missing ⚠️
core/fetcher/fetcher.go 95.12% 2 Missing ⚠️
core/tracing.go 0.00% 2 Missing ⚠️
... and 8 more
Additional details and impacted files
@@           Coverage Diff            @@
##             gloas    #4783   +/-   ##
========================================
  Coverage         ?   67.46%           
========================================
  Files            ?      253           
  Lines            ?    33434           
  Branches         ?        0           
========================================
  Hits             ?    22556           
  Misses           ?    10877           
  Partials         ?        1           

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

Base automatically changed from kalo/gloas-proposal-split to gloas October 18, 2026 21:48
@KaloyanTanev
KaloyanTanev force-pushed the kalo/gloas-builder-preferences branch from e248db1 to 7ff561c Compare October 18, 2026 21:54
@KaloyanTanev
KaloyanTanev force-pushed the kalo/gloas-builder-preferences branch from 1b5689b to 152589f Compare October 19, 2026 08:55
@sonarqubecloud

Copy link
Copy Markdown

@OisinKyne OisinKyne left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed:

  • False "inconsistent partial signed data" reports: builder preferences are now skipped in reportParSigs.
  • Inline auth errors: an error forwarding the optional inline auths now logs a warning instead of failing the whole proposal.
  • Shared hostnames: every configured builder on the same host now gets its preferences submitted.
  • Metric label: the VC-supplied host is capped at 253 bytes and made valid UTF-8. This also fixes a possible crash I'd missed, since the Prometheus client panics on invalid UTF-8 labels.

Still open, none blocking an rc:

  1. The 500ms wait per proposal when a builder has no aggregate (fetcher.go:687) is unchanged. It's safe for rc1 because --builder-urls has no default and CDVN doesn't set it, so it only affects operators who opt in. It should still get the "skip if there's no partial" fix plus a metric for builders dropped from proposals before this goes default-on.
  2. Metric cardinality: the label is now capped in length, but a misbehaving VC can still create a new series per distinct host it signs. Collapsing unknown hosts to "unknown" (as the tracker does) is the real fix.
  3. Ordering: inline auths are still forwarded after randao, so they can arrive after the 500ms wait has started.
  4. Spec check: the DOMAIN_BUILDER_REQUEST_AUTH value still needs checking against the pinned builder-specs commit. Worth a quick look before rc1, because the testnet is the first place a wrong value would show up.
  5. Lower priority:
    • The mismatch counter counts per submission rather than per proposal.
    • The core_bcast_delay_seconds delay metric is off for this duty.
    • The tracker can't see when one builder failed while another succeeded.

@KaloyanTanev
KaloyanTanev merged commit 6e59dc0 into gloas Oct 19, 2026
9 checks passed
@KaloyanTanev
KaloyanTanev deleted the kalo/gloas-builder-preferences branch October 19, 2026 13:44
KaloyanTanev added a commit to ObolNetwork/charon-distributed-validator-node that referenced this pull request Oct 19, 2026
Bumps charon to `6e59dc0`, the latest `gloas` branch commit, which
includes serving execution payload envelopes (ObolNetwork/charon#4765),
agreeing on self-built blocks without payload (ObolNetwork/charon#4771)
and aggregated builder request auths (ObolNetwork/charon#4783).

Also bumps the clients to their Hoodi Glamsterdam ready releases:
Lighthouse `v8.3.0`, Teku `26.10.1`, Lodestar `v1.50.0`, Prysm `v7.3.0`,
Nimbus `v26.10.1`, Grandine `3.0.0-rc.1`, Nethermind `2.2.0` and
Commit-Boost `v0.12.0-rc1`. Grandine and Commit-Boost are release
candidates, but they are the versions listed for the Hoodi fork.
Supersedes #492 and #493.

The `obolnetwork/charon:6e59dc0` image is still building, so this should
merge once it is published.
@KaloyanTanev KaloyanTanev mentioned this pull request Oct 20, 2026
58 of 77 tasks
KaloyanTanev added a commit that referenced this pull request Oct 20, 2026
* *: configurable time offset for different duties in a slot (#4617)

* Configurable time offset for different duties in a slot

* Add more error wrapping

* Add PayloadAttestation duty (#4618)

* *: migrate from fastssz to dynssz (#4652)

* Migrate from fastssz to dynssz

* Address Copilot review: update stale comment, return hashers to pool

* Traverse SignedExitMessage in ExitBlob hashing, add SSZ golden tests

* core: add payload attestation types for gloas (#4653)

* core/dutydb: support payload attestation duty (#4656)

* core/validatorapi: add payload attestation endpoints (#4657)

* core: wire payload attestation into duty timing plumbing

* core/validatorapi: add payload attestation endpoints

* core/validatorapi: adopt payload attestation interfaces (#4658)

* core/validatorapi: use go-eth2-client payload attestation interfaces

* core/validatorapi: reject non-gloas payload attestation data

* core/scheduler: resolve payload timeliness committee duties (#4659)

* core/scheduler: resolve payload timeliness committee duties

* core/scheduler: address Copilot review on ptc resolution

* core/scheduler: make ptc duty tests hang-proof

* app/eth2wrap: add fork readiness metrics (#4660)

* app/eth2wrap: add fork readiness metrics

* app/eth2wrap: address Copilot review on fork readiness

* app: use masked beacon node address in fork readiness labels

* app/eth2wrap: match masked addresses in ClientForAddress

* app/eth2wrap: match clients by configured address

* core: version payload attestation data (#4663)

* core: version payload attestation data

* add constructor and version mapping tests

* core/validatorapi: serve ptc duties (#4669)

* core: version and broadcast payload attestation message (#4668)

* core: version payload attestation message

* broadcast payload attestation messages

* core/fetcher: fetch payload attestation data (#4667)

* testutil: vmock payload attestation and simnet e2e (#4670)

* testutil: validatormock payload attestation and simnet e2e

* distinct nil errors and payload attest unit tests

* e2e duty timing migration test

* fix durationcheck lint

* match production offset rounding, fix unparam lint

* trim test comments

* core: accept gloas versioned attestations (#4671)

* core: accept gloas versioned attestations

* dutydb payload status index regression test

* gloas router tests, tidy error paths

* core/validatorapi: optional committee index param (#4672)

* core/validatorapi: optional committee index param

* own test function for attestation data route

* align committee index comments with spec wording

* core/app: fork-aware slot fraction timings (#4676)

* fork-aware proposer duty deadline

* fork-aware sse block lateness thresholds

* quarter-slot sse head delay buckets

* dedupe block lateness predicate

* core: add gloas proposer preferences duty (#4693)

* go.mod: bump go-eth2-client fork to v0.29.0-obol.3-gloas

* core: add proposer preferences duty type and signing domain

* core: add SignedProposerPreferences signed data type

* core/validatorapi: accept proposer preferences submissions

* core/parsigdb: split partial signature storage by duty family

* core/aggsigdb: split aggregate storage by duty family

* core/bcast: no-op proposer preferences until client support

* cmd: forbid feerecipient fetch from the gloas fork (#4707)

* core/validatorapi: serve v2 proposer duties dependent root (#4708)

* app/eth2wrap: add proposer duties v2 provider

* core/validatorapi: serve v2 proposer duties dependent root

* *: keep license header on generated files

* app/eth2wrap: note duties cache in v2 swap todo

* app: generate proposer config file for validator clients (#4700)

* app: generate proposer config file for validator clients

* app: emit sparse canonical proposer config schema

* app: generate builder config for validator clients (#4704)

* app: add builder config flags to proposer config file

* app: add builder config metrics

* app/peerinfo: warn on peer builder config mismatch

* core/tracker: track proposer preferences duty (#4709)

* core/scheduler: widen ptc duties test failsafe to deflake (#4721)

* *: adopt go-eth2-client v0.29.0-obol.4-gloas (#4715)

* *: bump go-eth2-client to v0.29.0-obol.4-gloas

* app/eth2wrap: adopt client v2 proposer duties and preferences submitter

* core/validatorapi: use eth2client v2 duties and preferences interfaces

* core/bcast: submit proposer preferences to beacon node

* app/eth2wrap: cache v2 proposer duties

* core/bcast: anchor proposer preferences delay to earliest submission

* app/eth2wrap: remove comment slop on v2 proposer duties cache

* core/bcast: omit blinded log field for gloas proposals

* testutil: vmock proposer preferences and simnet e2e (#4716)

* testutil/beaconmock: deterministic v2 proposer duties option

* testutil/validatormock: proposer preferences duty and simnet e2e

* app: skip proposer config file for in-memory test lock

* testutil/beaconmock: dedupe deterministic proposer duties options

* core: gloas epbs proposal data types (#4717)

* testutil: random gloas epbs proposal helpers

* core: gloas epbs proposal unsigned and signed data

* core: discriminate gloas proposals without blinded semantics

* core: gate epbs proposal semantics on gloas onwards

* core: version switch in epbs proposal constructor

* core: uniform proposal unmarshal flow across versions

* core: guard nil epbs proposal in MarshalJSON

* core/fetcher: fetch gloas epbs proposals (#4718)

* core/validatorapi: serve and accept gloas epbs proposals (#4719)

* core: widen dutydb proposals to the core type

* core/validatorapi: serve and accept gloas epbs proposals

* core/validatorapi: epbs proposals carry no blinded flag

* core/validatorapi: gate proposal endpoints on gloas onwards

* core: split dutydb proposal getters into pre-gloas and epbs

* core/dutydb: remove duplicate godoc comment

* core/validatorapi: always serve stateless epbs proposals

* core/validatorapi: warn on stateful gloas block production request

* core/validatorapi: version-structure epbs proposal matching

* core: version-structure proposal root

* core: guard nil epbs proposal in root

* testutil: vmock gloas epbs proposals and simnet e2e (#4720)

* core: gloas execution payload envelope publishing (#4725)

* core: add gloas execution payload envelope signed data type

* app/eth2wrap: add execution payload envelope submitter and provider

* core/validatorapi: accept execution payload envelope submissions

* core/bcast: broadcast execution payload envelopes

* core/tracker: track execution payload envelope duty and inclusion

* testutil: validatormock and simnet e2e for execution payload envelopes

* *: add licence headers to generated files

* *: add tests for execution payload envelope publishing

* core: anchor envelope bcast delay to payload deadline

* core/validatorapi: add value headers to v4 propose block (#4731)

* core: agree on no block for payload attestation duty (#4732)

* core: agree on no block for payload attestation duty

* core/dutydb: reject second decision for ptc slot, restore cancelled queries test

* core/validatorapi: serve ssz for gloas endpoints (#4733)

* core/validatorapi: serve ssz propose block v4 responses

* core/validatorapi: ssz for payload attestation endpoints

* core/scheduler: stop validator registrations at gloas fork (#4727)

* core/scheduler: stop validator registrations at gloas fork

* core/scheduler: gate registrations at call sites, drop skip-log

* core/scheduler: gate registrations on fork schedule, add no-registrations test

* core: flag no payload in payload attestation data (#4735)

* core: flag no payload in payload attestation data

* core: address review nits on no payload flag

* app/forkschedule: apply fork schedule at runtime (#4736)

* app/forkschedule: track freshest fork schedule across beacon nodes

* *: apply fork schedule at runtime in fetcher and scheduler

* app: fork readiness and fork metrics from the runtime schedule

* app/forkschedule: read primaries without fallbacks, clamp pre-genesis epoch

* app/forkschedule: test beacon node restarts with a sooner fork

* testutil/beaconmock: check error before closing up probe response

* core/scheduler: wait for checks in reorg test to deflake it

* *: address review on runtime fork schedule

* *: fix runtime fork schedule follow-ups (#4738)

* core/fetcher: call the fork schedule function

* app/forkschedule: set fork metrics for every scheduled fork

* app/eth2wrap: treat no payload attestation data as an answer (#4739)

* app/eth2wrap: add gloas fork ready client versions (#4740)

* app/eth2wrap: add gloas fork ready client versions

* app/eth2wrap: respect pre-release precedence in fork readiness

* app/eth2wrap: match client names case-insensitively and filter VC user agents

* core/validatorapi: serve execution payload envelopes (#4765)

* core/consensus: model round timers and extensions (#4767)

* core/consensus/timer: model round timers and extensions

* core/consensus: run leader down test in a synctest bubble

* core/consensus/timer: make extension arm extras cumulative

* core/consensus/timer: revert cumulative extension arm extras

* core: start gloas attester consensus at slot start (#4769)

* core/scheduler: wait for attestation fallback via delayFunc

* app/featureset: remove fetch_att_on_block_with_delay

* app/featureset: promote fetch_att_on_block to stable

* core/consensus/timer: add eager_ahead_split timer for gloas attesters

* core/fetcher: fetch gloas attestation data upon head events

* core/scheduler: trigger gloas attester duties at slot start

* core: mark pre-gloas early attestation fetch for removal

* testutil/integration: add gloas attester simnet case

* core: agree on gloas self-built blocks without payload (#4771)

* core: add payload contents root to self-built gloas proposals

* core/dutydb: store and await agreed execution payload contents

* core/fetcher: agree on self-built gloas blocks without payload

* core/validatorapi: serve agreed gloas blocks without payload

* core/payloadex: exchange payload contents of agreed self-built blocks

* core: wire the payload contents exchange into the workflow

* core: await agreed proposals in one versioned form

* core/payloadex: hold one push and one request per peer

* core: retain agreed proposals until the end of the slot

* core/validatorapi: serve stateless requests the shared contents

* core/payloadex: bound requests and bind pull answers to their duty

* core: commit to envelope and blobs roots separately

* core/payloadex: key candidates by slot and roots

* core/payloadex: observe contents delay, envelope size and blob count

* app: warn on proposer config builder mismatch (#4784)

* app: update builder settings of proposer config on start

* app: warn on proposer config builder mismatch

* app: compare proposer config builder settings explicitly

* app: warn on proposer config builder mismatch (#4784)

* app: update builder settings of proposer config on start

* app: warn on proposer config builder mismatch

* app: compare proposer config builder settings explicitly

* core: aggregate builder request auths for gloas builders (#4783)

* eth2util: add builder request auth domain and default auth data

* app/eth2wrap: bump go-eth2-client to v0.30.1-obol.1-gloas

* core: add builder preferences duty and signed builder request auth

* core: await aggregates by AwaitOpts, store builder request auths per builder

* core/fetcher: attach aggregated builder request auths to proposals

* core/bcast: submit builder preferences to the beacon node

* core/validatorapi: aggregate builder request auths from validator clients

* testutil: builder preferences in validatormock and simnet

* docs: builder preferences duty

* core/tracker: count builder request auths by peer and builder

* core/validatorapi: count builder preferences mismatching the builders

* core/tracker: don't report builder request auths as inconsistent

* core/validatorapi: don't fail proposal on inline auth errors

* core/bcast: submit builder preferences for all builders of a host

* core/validatorapi: sanitise builder host metric label

* core: agree and forward gloas proposal builder url (#4786)

* core: agree on gloas proposal builder url

* cmd: reject builder urls longer than the maximum

* core/fetcher: log and label gloas proposal builder source

* core/bcast: forward and count gloas proposal builder url

* core/bcast: forward the agreed builder url as decided (#4787)

* core/bcast: forward the agreed builder url as decided

* *: bump go-eth2-client to v0.30.1-obol.2-gloas
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

branch-invalid PR raised against invalid branch. Not a main or release branch.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants