Core: Add batch load endpoints for tables and views#15669
Closed
stevenzwu wants to merge 1 commit intoapache:mainfrom
Closed
Core: Add batch load endpoints for tables and views#15669stevenzwu wants to merge 1 commit intoapache:mainfrom
stevenzwu wants to merge 1 commit intoapache:mainfrom
Conversation
stevenzwu
force-pushed
the
rest-batch-load
branch
2 times, most recently
from
3f2d3c9 to
2f34901
Compare
Add batch load REST endpoints, serializers, and RESTSessionCatalog wiring. SessionCatalog and ViewSessionCatalog gain default batchLoadTable(s) / batchLoadView(s) methods returning CloseableIterable. Made-with: Cursor Model: GPT-5.2
stevenzwu
force-pushed
the
rest-batch-load
branch
from
20e0edc to
09e48d9
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Implement the Java side of the batch load REST endpoints (POST /v1/{prefix}/tables/batch-load and views/batch-load).
This includes request/response models, custom JSON parsers, serializer registration, routing, server-side handlers in CatalogHandlers, RESTCatalogAdapter routing, and client-side methods in RESTSessionCatalog returning CloseableIterable with automatic retry of unprocessed tables.
The OpenAPI spec changes are tracked in a separate PR (#15528).
Made-with: Cursor
Model: claude-4.6-opus-high-thinking
I carefully reviewed the changes and refined the implementation with a few iterations
RESTSessionCatalog#batchLoadTablesreturn type from a list to an iterable so that results can be consumed in a streaming fashion in case of server pagination and client retries. This avoid holding a large amount of items in memory for large responses.StringtoSnapshotModeenum, providing type safety.