Skip to content

test: add cost model snapshot regression guard - #269

Open
tikhandesanket wants to merge 2 commits into
codeforstartups:developmentfrom
tikhandesanket:Benchmark_regression_guard#94
Open

tikhandesanket wants to merge 2 commits into
codeforstartups:developmentfrom
tikhandesanket:Benchmark_regression_guard#94

Conversation

@tikhandesanket

Copy link
Copy Markdown
Collaborator

Description

Add a snapshot-based regression test to ensure benchmark cost-model numbers remain consistent and unexpected changes are detected.

Related issue

Fixes #94

Changes

  • Added Syrupy as a Python 3.10+ development dependency.
  • Added a snapshot test for the benchmark cost model.
  • Added a snapshot containing the expected cost values for the test workload.

Testing

  • Tests pass locally
  • Ruff checks pass
  • Documentation updated, if applicable

Checklist

  • My changes are focused and relevant to this pull request.
  • I have added or updated tests where appropriate.
  • I have reviewed my changes for unrelated modifications.
  • I have updated documentation where necessary.

@tikhandesanket tikhandesanket mentioned this pull request Sep 29, 2026
2 tasks
…e is importable

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Benchmark regression guard

1 participant