Own SQL benchmark suite#8719
Conversation
Merging this PR will degrade performance by 14.72%
|
| Mode | Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|---|
| ❌ | WallTime | cuda/bitpacked_u8/unpack/3bw[100M] |
300 µs | 351.8 µs | -14.72% |
Tip
Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.
Comparing myrrc/sql-bench (2c9252a) with develop (6b27c45)
Footnotes
-
9 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩
|
As this is fast we should probably run this on every commit @AdamGS WDYT? |
Testing SQL queries' correctness is done in vortex-sqllogictest, but we also
want to test relative performance of queries not covered in existing benchmarks.
One example is aggregation with filter which should be much more performant
once we use zone maps statistics, but this type of query isn't present is
existing benchmarks.
This PR introduces a new query-per-file dataset and support for running it in CI