Skip to content

Exit 1 when the run failed and write reports below the artifact dir - #115

Merged
JE-Chen merged 5 commits into
devfrom
feat/testpioneer-run-support
Oct 11, 2026
Merged

JE-Chen merged 5 commits into
devfrom
feat/testpioneer-run-support

Conversation

@JE-Chen

@JE-Chen JE-Chen commented Oct 8, 2026 •

Copy link
Copy Markdown
Member

The CLI now returns exit status 1 after completing a run with failed actions or files, and prints error: N action(s) or file(s) failed. Actions after a failure and the requested reports still run. With TEST_PIONEER_ARTIFACT_DIR set, relative JSON, XML, HTML, JUnit, Allure and interactive HTML reports are written below that directory; generate_all_reports lists their actual paths in its manifest.

Failure detection covers sequential, ledger, dependency, thread, process and async execution. Process workers detect failed actions even with recording disabled. Per-thread counters keep ledger and dependency results independent of other concurrent files. Directory execution counts unreadable files and continues the remaining files. Absolute paths, paths outside the artifact directory and unusable artifact paths retain the supplied path.

Validation on Windows / Python 3.14:

  • Full unit suite: 4,868 passed, 5 skipped, 63 subtests passed.
  • Integration suite: 43 passed, 19 skipped; optional dependencies and browser availability account for skips.
  • Grid e2e suite: 6 skipped because no Selenium Grid was available.
  • Real TestPioneer workflow: parallel passing/failing WebRunner processes returned 0/1, produced JSON/XML/HTML/JUnit reports and manifests under the artifact directories, imported the cases, and executed the following workflow step.
  • git diff --check passed.

CLI and artifact behavior are documented in the three READMEs, English/Chinese CLI documentation, architecture and update log.

The executor records a failed action and runs the next one, so the CLI
ended with status 0 whatever happened. The dispatch now runs inside a
count of the actions that raised and the files reported as failed, and
the process exits 1 when the count is not zero.

With TEST_PIONEER_ARTIFACT_DIR set, a report asked for under a relative
name is written below that directory. Without it nothing changes.
@codacy-production

codacy-production Bot commented Oct 8, 2026 •

Copy link
Copy Markdown

Up to standards ✅

🟢 Issues 0 issues

Results:
0 new issues

View in Codacy

🟢 Metrics 81 complexity · 7 duplication

Metric Results
Complexity 81
Duplication 7

View in Codacy

NEW Get contextual insights on your PRs based on Codacy's metrics, along with PR and Jira context, without leaving GitHub. Enable AI reviewer
TIP This summary will be updated as you push new changes.

@JE-Chen
JE-Chen marked this pull request as ready for review October 11, 2026 07:23
@JE-Chen
JE-Chen merged commit 6f4a417 into dev Oct 11, 2026
5 checks passed
@sonarqubecloud

Copy link
Copy Markdown

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant