Skip to content

perf(rollout): reduce and trace writer flushes#30668

Draft
apanasenko-oai wants to merge 1 commit into
mainfrom
apanasenko/ttft-rollout-writer
Draft

perf(rollout): reduce and trace writer flushes#30668
apanasenko-oai wants to merge 1 commit into
mainfrom
apanasenko/ttft-rollout-writer

Conversation

@apanasenko-oai

Copy link
Copy Markdown
Collaborator

Summary

Reduce redundant rollout writer flushes and make persistence latency attributable.

  • Skip clean-writer filesystem flushes.
  • Remove the redundant batch-level flush from the thread-store append path.
  • Add queue, writer, recovery, serialization, and filesystem timing spans.
  • Preserve retry and flush-materialization behavior.

This is the rollout-writer slice split out of #30632.

Validation

  • just test -p codex-rollout passed 80 tests.
  • just test -p codex-thread-store passed 89 tests.
  • just fmt passed, with an unrelated justfile rewrite discarded.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant