[Feature Request]: Improve pagination performance for searches using Atlas search under the hood

[kbuma]

Problem

Pagination across large result sets backed by Mongo collections significantly degrades when moving through the dataset. This is because all the results prior to the skip target have to be iterated over as part of the operation.

Proposed Solution

Atlas search provides an alternate, cursor-based pagination scheme for searches using text indexes as described in https://www.mongodb.com/docs/atlas/atlas-search/paginate-results/

Please implement underlying pagination to utilize this approach when using Atlas search and fall back to the original approach otherwise.

Alternatives

No response