feat: add zstd message compression codec for SNS and SQS#442

Merged

kibertoad merged 24 commits into

kibertoad:mainfrom

May 22, 2026

Commits on May 18, 2026

feat: add zstd message compression codec for SNS and SQS

Irfan Hodzic
authored and
Irfan Hodzic
committed
refactor: move zstd implementation out of core, harden codec guardrails, fix test races

authored and
Irfan Hodzic
committed

Commits on May 19, 2026

ci: rebuild @mongodb-js/zstd native binary after --ignore-scripts install

authored and
Irfan Hodzic
committed
feat(sqs): add codec benchmarks for publish and consume throughput

authored and
Irfan Hodzic
committed
feat(sqs/core): replace @mongodb-js/zstd with Node.js built-in zlib and add codec documentation

authored and
Irfan Hodzic
committed
feat: extract codec into standalone @message-queue-toolkit/codec package

authored and
Irfan Hodzic
committed
fix(codec): tighten Node.js version requirement to >=22.15.0

authored and
Irfan Hodzic
committed
Merge branch 'main' into main
irfanh94
authored
refactor: compress-once in publish, split offload into focused helpers

authored and
Irfan Hodzic
committed
test: verify wire format of compressed messages in integration tests

authored and
Irfan Hodzic
committed

Commits on May 21, 2026

feat: add skipCompressionBelow option with default of 512 bytes

authored and
Irfan Hodzic
committed
perf: stream codec+offload path to avoid 3× buffer materialisation

authored and
Irfan Hodzic
committed
fix(codec): rename envelope fields, fix wire-size threshold, skip intermediate object

authored and
Irfan Hodzic
committed
feat(codec): extensible codec system with consumer registry and custom handler support

authored and
Irfan Hodzic
committed
fix(codec): validate __mqtData is well-formed base64 before decoding in decompressMessageBody

authored and
Irfan Hodzic
committed
fix(codec): address code-review comments on codec implementation

authored and
Irfan Hodzic
committed
perf(core): replace blocking fs sync calls with async equivalents

authored and
Irfan Hodzic
committed
feat(codec): validate custom codec names at registration time

authored and
Irfan Hodzic
committed

Commits on May 22, 2026

fix(codec): address second round of code-review comments

authored and
Irfan Hodzic
committed
refactor: hoist prepareOutgoingPayload to AbstractQueueService and add codec/offload improvements

authored and
Irfan Hodzic
committed
fix(codec): address PR review — merge codec into core, fix offload threshold bug

kibertoad
and
claude
committed
Extra refinement
kibertoad
committed
fix(codec): address review — retriable missing-codec, drop redundant helpers, docs

kibertoad
and
claude
committed
fix(codec): treat unregistered-codec messages as invalid, not retriable

kibertoad
and
claude
committed