Repository navigation
core: aggregate builder request auths for gloas builders - #4783
Conversation
There was a problem hiding this comment.
Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.
An organization owner can choose the repository organization as the billing source for reviews requested by members with a paid Copilot license. Learn about Copilot code review billing. Review the Copilot code review billing settings.
Codecov Report❌ Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## gloas #4783 +/- ##
========================================
Coverage ? 67.46%
========================================
Files ? 253
Lines ? 33434
Branches ? 0
========================================
Hits ? 22556
Misses ? 10877
Partials ? 1 ☔ View full report in Codecov by Harness. 🚀 New features to boost your workflow:
|
e248db1 to
7ff561c
Compare
1b5689b to
152589f
Compare
|
OisinKyne
left a comment
There was a problem hiding this comment.
Fixed:
- False "inconsistent partial signed data" reports: builder preferences are now skipped in reportParSigs.
- Inline auth errors: an error forwarding the optional inline auths now logs a warning instead of failing the whole proposal.
- Shared hostnames: every configured builder on the same host now gets its preferences submitted.
- Metric label: the VC-supplied host is capped at 253 bytes and made valid UTF-8. This also fixes a possible crash I'd missed, since the Prometheus client panics on invalid UTF-8 labels.
Still open, none blocking an rc:
- The 500ms wait per proposal when a builder has no aggregate (fetcher.go:687) is unchanged. It's safe for rc1 because --builder-urls has no default and CDVN doesn't set it, so it only affects operators who opt in. It should still get the "skip if there's no partial" fix plus a metric for builders dropped from proposals before this goes default-on.
- Metric cardinality: the label is now capped in length, but a misbehaving VC can still create a new series per distinct host it signs. Collapsing unknown hosts to "unknown" (as the tracker does) is the real fix.
- Ordering: inline auths are still forwarded after randao, so they can arrive after the 500ms wait has started.
- Spec check: the DOMAIN_BUILDER_REQUEST_AUTH value still needs checking against the pinned builder-specs commit. Worth a quick look before rc1, because the testnet is the first place a wrong value would show up.
- Lower priority:
- The mismatch counter counts per submission rather than per proposal.
- The core_bcast_delay_seconds delay metric is off for this duty.
- The tracker can't see when one builder failed while another succeeded.
Bumps charon to `6e59dc0`, the latest `gloas` branch commit, which includes serving execution payload envelopes (ObolNetwork/charon#4765), agreeing on self-built blocks without payload (ObolNetwork/charon#4771) and aggregated builder request auths (ObolNetwork/charon#4783). Also bumps the clients to their Hoodi Glamsterdam ready releases: Lighthouse `v8.3.0`, Teku `26.10.1`, Lodestar `v1.50.0`, Prysm `v7.3.0`, Nimbus `v26.10.1`, Grandine `3.0.0-rc.1`, Nethermind `2.2.0` and Commit-Boost `v0.12.0-rc1`. Grandine and Commit-Boost are release candidates, but they are the versions listed for the Hoodi fork. Supersedes #492 and #493. The `obolnetwork/charon:6e59dc0` image is still building, so this should merge once it is published.
* *: configurable time offset for different duties in a slot (#4617) * Configurable time offset for different duties in a slot * Add more error wrapping * Add PayloadAttestation duty (#4618) * *: migrate from fastssz to dynssz (#4652) * Migrate from fastssz to dynssz * Address Copilot review: update stale comment, return hashers to pool * Traverse SignedExitMessage in ExitBlob hashing, add SSZ golden tests * core: add payload attestation types for gloas (#4653) * core/dutydb: support payload attestation duty (#4656) * core/validatorapi: add payload attestation endpoints (#4657) * core: wire payload attestation into duty timing plumbing * core/validatorapi: add payload attestation endpoints * core/validatorapi: adopt payload attestation interfaces (#4658) * core/validatorapi: use go-eth2-client payload attestation interfaces * core/validatorapi: reject non-gloas payload attestation data * core/scheduler: resolve payload timeliness committee duties (#4659) * core/scheduler: resolve payload timeliness committee duties * core/scheduler: address Copilot review on ptc resolution * core/scheduler: make ptc duty tests hang-proof * app/eth2wrap: add fork readiness metrics (#4660) * app/eth2wrap: add fork readiness metrics * app/eth2wrap: address Copilot review on fork readiness * app: use masked beacon node address in fork readiness labels * app/eth2wrap: match masked addresses in ClientForAddress * app/eth2wrap: match clients by configured address * core: version payload attestation data (#4663) * core: version payload attestation data * add constructor and version mapping tests * core/validatorapi: serve ptc duties (#4669) * core: version and broadcast payload attestation message (#4668) * core: version payload attestation message * broadcast payload attestation messages * core/fetcher: fetch payload attestation data (#4667) * testutil: vmock payload attestation and simnet e2e (#4670) * testutil: validatormock payload attestation and simnet e2e * distinct nil errors and payload attest unit tests * e2e duty timing migration test * fix durationcheck lint * match production offset rounding, fix unparam lint * trim test comments * core: accept gloas versioned attestations (#4671) * core: accept gloas versioned attestations * dutydb payload status index regression test * gloas router tests, tidy error paths * core/validatorapi: optional committee index param (#4672) * core/validatorapi: optional committee index param * own test function for attestation data route * align committee index comments with spec wording * core/app: fork-aware slot fraction timings (#4676) * fork-aware proposer duty deadline * fork-aware sse block lateness thresholds * quarter-slot sse head delay buckets * dedupe block lateness predicate * core: add gloas proposer preferences duty (#4693) * go.mod: bump go-eth2-client fork to v0.29.0-obol.3-gloas * core: add proposer preferences duty type and signing domain * core: add SignedProposerPreferences signed data type * core/validatorapi: accept proposer preferences submissions * core/parsigdb: split partial signature storage by duty family * core/aggsigdb: split aggregate storage by duty family * core/bcast: no-op proposer preferences until client support * cmd: forbid feerecipient fetch from the gloas fork (#4707) * core/validatorapi: serve v2 proposer duties dependent root (#4708) * app/eth2wrap: add proposer duties v2 provider * core/validatorapi: serve v2 proposer duties dependent root * *: keep license header on generated files * app/eth2wrap: note duties cache in v2 swap todo * app: generate proposer config file for validator clients (#4700) * app: generate proposer config file for validator clients * app: emit sparse canonical proposer config schema * app: generate builder config for validator clients (#4704) * app: add builder config flags to proposer config file * app: add builder config metrics * app/peerinfo: warn on peer builder config mismatch * core/tracker: track proposer preferences duty (#4709) * core/scheduler: widen ptc duties test failsafe to deflake (#4721) * *: adopt go-eth2-client v0.29.0-obol.4-gloas (#4715) * *: bump go-eth2-client to v0.29.0-obol.4-gloas * app/eth2wrap: adopt client v2 proposer duties and preferences submitter * core/validatorapi: use eth2client v2 duties and preferences interfaces * core/bcast: submit proposer preferences to beacon node * app/eth2wrap: cache v2 proposer duties * core/bcast: anchor proposer preferences delay to earliest submission * app/eth2wrap: remove comment slop on v2 proposer duties cache * core/bcast: omit blinded log field for gloas proposals * testutil: vmock proposer preferences and simnet e2e (#4716) * testutil/beaconmock: deterministic v2 proposer duties option * testutil/validatormock: proposer preferences duty and simnet e2e * app: skip proposer config file for in-memory test lock * testutil/beaconmock: dedupe deterministic proposer duties options * core: gloas epbs proposal data types (#4717) * testutil: random gloas epbs proposal helpers * core: gloas epbs proposal unsigned and signed data * core: discriminate gloas proposals without blinded semantics * core: gate epbs proposal semantics on gloas onwards * core: version switch in epbs proposal constructor * core: uniform proposal unmarshal flow across versions * core: guard nil epbs proposal in MarshalJSON * core/fetcher: fetch gloas epbs proposals (#4718) * core/validatorapi: serve and accept gloas epbs proposals (#4719) * core: widen dutydb proposals to the core type * core/validatorapi: serve and accept gloas epbs proposals * core/validatorapi: epbs proposals carry no blinded flag * core/validatorapi: gate proposal endpoints on gloas onwards * core: split dutydb proposal getters into pre-gloas and epbs * core/dutydb: remove duplicate godoc comment * core/validatorapi: always serve stateless epbs proposals * core/validatorapi: warn on stateful gloas block production request * core/validatorapi: version-structure epbs proposal matching * core: version-structure proposal root * core: guard nil epbs proposal in root * testutil: vmock gloas epbs proposals and simnet e2e (#4720) * core: gloas execution payload envelope publishing (#4725) * core: add gloas execution payload envelope signed data type * app/eth2wrap: add execution payload envelope submitter and provider * core/validatorapi: accept execution payload envelope submissions * core/bcast: broadcast execution payload envelopes * core/tracker: track execution payload envelope duty and inclusion * testutil: validatormock and simnet e2e for execution payload envelopes * *: add licence headers to generated files * *: add tests for execution payload envelope publishing * core: anchor envelope bcast delay to payload deadline * core/validatorapi: add value headers to v4 propose block (#4731) * core: agree on no block for payload attestation duty (#4732) * core: agree on no block for payload attestation duty * core/dutydb: reject second decision for ptc slot, restore cancelled queries test * core/validatorapi: serve ssz for gloas endpoints (#4733) * core/validatorapi: serve ssz propose block v4 responses * core/validatorapi: ssz for payload attestation endpoints * core/scheduler: stop validator registrations at gloas fork (#4727) * core/scheduler: stop validator registrations at gloas fork * core/scheduler: gate registrations at call sites, drop skip-log * core/scheduler: gate registrations on fork schedule, add no-registrations test * core: flag no payload in payload attestation data (#4735) * core: flag no payload in payload attestation data * core: address review nits on no payload flag * app/forkschedule: apply fork schedule at runtime (#4736) * app/forkschedule: track freshest fork schedule across beacon nodes * *: apply fork schedule at runtime in fetcher and scheduler * app: fork readiness and fork metrics from the runtime schedule * app/forkschedule: read primaries without fallbacks, clamp pre-genesis epoch * app/forkschedule: test beacon node restarts with a sooner fork * testutil/beaconmock: check error before closing up probe response * core/scheduler: wait for checks in reorg test to deflake it * *: address review on runtime fork schedule * *: fix runtime fork schedule follow-ups (#4738) * core/fetcher: call the fork schedule function * app/forkschedule: set fork metrics for every scheduled fork * app/eth2wrap: treat no payload attestation data as an answer (#4739) * app/eth2wrap: add gloas fork ready client versions (#4740) * app/eth2wrap: add gloas fork ready client versions * app/eth2wrap: respect pre-release precedence in fork readiness * app/eth2wrap: match client names case-insensitively and filter VC user agents * core/validatorapi: serve execution payload envelopes (#4765) * core/consensus: model round timers and extensions (#4767) * core/consensus/timer: model round timers and extensions * core/consensus: run leader down test in a synctest bubble * core/consensus/timer: make extension arm extras cumulative * core/consensus/timer: revert cumulative extension arm extras * core: start gloas attester consensus at slot start (#4769) * core/scheduler: wait for attestation fallback via delayFunc * app/featureset: remove fetch_att_on_block_with_delay * app/featureset: promote fetch_att_on_block to stable * core/consensus/timer: add eager_ahead_split timer for gloas attesters * core/fetcher: fetch gloas attestation data upon head events * core/scheduler: trigger gloas attester duties at slot start * core: mark pre-gloas early attestation fetch for removal * testutil/integration: add gloas attester simnet case * core: agree on gloas self-built blocks without payload (#4771) * core: add payload contents root to self-built gloas proposals * core/dutydb: store and await agreed execution payload contents * core/fetcher: agree on self-built gloas blocks without payload * core/validatorapi: serve agreed gloas blocks without payload * core/payloadex: exchange payload contents of agreed self-built blocks * core: wire the payload contents exchange into the workflow * core: await agreed proposals in one versioned form * core/payloadex: hold one push and one request per peer * core: retain agreed proposals until the end of the slot * core/validatorapi: serve stateless requests the shared contents * core/payloadex: bound requests and bind pull answers to their duty * core: commit to envelope and blobs roots separately * core/payloadex: key candidates by slot and roots * core/payloadex: observe contents delay, envelope size and blob count * app: warn on proposer config builder mismatch (#4784) * app: update builder settings of proposer config on start * app: warn on proposer config builder mismatch * app: compare proposer config builder settings explicitly * app: warn on proposer config builder mismatch (#4784) * app: update builder settings of proposer config on start * app: warn on proposer config builder mismatch * app: compare proposer config builder settings explicitly * core: aggregate builder request auths for gloas builders (#4783) * eth2util: add builder request auth domain and default auth data * app/eth2wrap: bump go-eth2-client to v0.30.1-obol.1-gloas * core: add builder preferences duty and signed builder request auth * core: await aggregates by AwaitOpts, store builder request auths per builder * core/fetcher: attach aggregated builder request auths to proposals * core/bcast: submit builder preferences to the beacon node * core/validatorapi: aggregate builder request auths from validator clients * testutil: builder preferences in validatormock and simnet * docs: builder preferences duty * core/tracker: count builder request auths by peer and builder * core/validatorapi: count builder preferences mismatching the builders * core/tracker: don't report builder request auths as inconsistent * core/validatorapi: don't fail proposal on inline auth errors * core/bcast: submit builder preferences for all builders of a host * core/validatorapi: sanitise builder host metric label * core: agree and forward gloas proposal builder url (#4786) * core: agree on gloas proposal builder url * cmd: reject builder urls longer than the maximum * core/fetcher: log and label gloas proposal builder source * core/bcast: forward and count gloas proposal builder url * core/bcast: forward the agreed builder url as decided (#4787) * core/bcast: forward the agreed builder url as decided * *: bump go-eth2-client to v0.30.1-obol.2-gloas



Adds the gloas builder preferences duty (#4724). Partial
SignedBuilderRequestAuths from validator clients, received ahead of time viaPOST /eth/v1/validator/builder_preferencesor inline in the v4 block production body, are threshold-aggregated per builder, attached to the proposal'sBuilderConfigand submitted to the beacon node. Bumps go-eth2-client tov0.30.1-obol.1-gloasand generalisesAggSigDB.Awaitto takeAwaitOpts.Stacked on #4771. The
Eth-Builder-Urlround-trip on publish is left for a follow-up.category: feature
ticket: #4324