feat: implement spill callback for cross-task memory eviction [experimental]#3869

Draft

andygrove wants to merge 12 commits intoapache:mainfrom

andygrove:memory-profiling-tools

Commits on Apr 1, 2026

feat: add memory profiling script and analysis for off-heap usage
andygrove
committed
docs: move memory analysis into contributor guide
andygrove
committed
docs: add benchmark results and fix memory-profile.sh time parsing
andygrove
committed
docs: add shuffle isolation results and PR 3845 notes
andygrove
committed
feat: add SpillState for cross-thread spill coordination
andygrove
committed
feat: wire SpillState into CometUnifiedMemoryPool
andygrove
committed
feat: add JNI requestSpill function with SpillState in ExecutionContext
andygrove
committed
feat: implement spill() callback in CometTaskMemoryManager
andygrove
committed
feat: wire native plan handle to CometTaskMemoryManager for spill routing
andygrove
committed
docs: update memory analysis with spill callback results
andygrove
committed
chore: apply cargo fmt and prettier formatting
andygrove
committed
docs: remove standalone memory-management doc, add spill coordination to development guide
andygrove
committed