Skip to content

Add versioned pipeline scenario contracts - #18

Open
auschoi96 wants to merge 1 commit into
databricks-solutions:mainfrom
auschoi96:versioned-pipeline-scenarios
Open

Add versioned pipeline scenario contracts#18
auschoi96 wants to merge 1 commit into
databricks-solutions:mainfrom
auschoi96:versioned-pipeline-scenarios

Conversation

@auschoi96

Copy link
Copy Markdown

Summary

  • add four versioned, runner-neutral pipeline scenario contracts
  • validate the contracts with strict Pydantic models and a committed JSON Schema
  • load the existing pipeline scenarios through the shared contracts while preserving prompts, capabilities, stages, and timeouts
  • make the demo-generator skill self-locate when project path aliases are unavailable
  • keep all scenario assets outside the deployed generator app and shipped skill

Verification

  • uv run pytest tests/evaluation -q
  • uv run sb-eval cases validate
  • uv run python -m evaluation.schema_generator --check
  • uv lock --check
  • git diff --check origin/main...HEAD

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant