-
Notifications
You must be signed in to change notification settings - Fork 30
INTPYTHON-793: Push conditions into lookup when possible. #440
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
INTPYTHON-793: Push conditions into lookup when possible. #440
Conversation
184d5e6 to
73bfed5
Compare
| combinator_pipeline.append({"$unset": "_id"}) | ||
| return combinator_pipeline | ||
|
|
||
| def _get_pushable_conditions(self): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Comments please
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Added
| def _normalize_query(obj): | ||
| if isinstance(obj, dict): | ||
| normalized = {} | ||
| for k, v in obj.items(): | ||
| if k in MongoTestCaseMixin.COMMUTATIVE_OPERATORS and isinstance(v, list): | ||
| # Only sort for commutative operators | ||
| normalized[k] = sorted( | ||
| (MongoTestCaseMixin._normalize_query(i) for i in v), key=lambda x: str(x) | ||
| ) | ||
| else: | ||
| normalized[k] = MongoTestCaseMixin._normalize_query(v) | ||
| return normalized | ||
|
|
||
| if isinstance(obj, list): | ||
| # Lists not under commutative ops keep their order | ||
| return [MongoTestCaseMixin._normalize_query(i) for i in obj] | ||
|
|
||
| return obj |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Needs a docstring. It looks like there's some sorting happening, perhaps because the generated query isn't deterministic?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The query is deterministic, but if I remove this, I had to change many tests because some commutative operators like OR and AND. Since both queries mean the same, the test should accept them as equal under commutative operations.
9f056bf to
694368e
Compare
694368e to
3e20747
Compare
Summary
This PR introduces support for extracting “pushable” conditions from a Django
WhereNode. Pushable conditions are simple field predicates that can be applied earlier in the MongoDB pipeline.Changes in this PR
_get_pushable_conditions()to collect pushable predicates per alias.Test Plan
Focus Areas for Reviewer
Checklist for Reviewer @timgraham @Jibola @aclark4life