Skip to content

tests: Sienna v4 regression baselines drift after the fixture cache was rebuilt #45

Open

Description

@micahpw

The tests workflow fails on main-based PRs in 4 Sienna v4 regression tests (tests/handlers/test_sienna_regression.py: test_v4_get_generators_tech, test_v4_get_gen_and_curtailment_summary, test_v4_get_area_dispatch_summary, test_v4_get_line_loading_summary), with AssertionError: Values are not sufficiently close.

Findings:

Also: the changes job fails on pushes to main (runs on f60ea4c, 52c986d, 5d0513b), so pytest does not run there.

Options: pin the Sienna package versions (Manifest.toml) in docker/sienna, or regenerate the baselines from the new fixture (--force-regen) after checking that the differences are only numeric drift.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions