Skip to content

ci(cnv-validation-checkup): set ACCEPT_WINDOWS_EULA=true and add TEST_FOCUS for disconnected - #82706

Open
rlobillo wants to merge 2 commits into
openshift:mainfrom
rlobillo:CNV-94166
Open

ci(cnv-validation-checkup): set ACCEPT_WINDOWS_EULA=true and add TEST_FOCUS for disconnected#82706
rlobillo wants to merge 2 commits into
openshift:mainfrom
rlobillo:CNV-94166

Conversation

@rlobillo

@rlobillo rlobillo commented Jul 31, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Set ACCEPT_WINDOWS_EULA back to "true" in e2e-azure now that ocp-virt-validation-checkup#87 and #88 are merged.
  • Add TEST_FOCUS to run-validation-checkup-disconnected with one fast test per suite to reduce job duration.

More details

TEST_FOCUS selects the fastest passing test from each suite based on results from this run:

Suite Test Duration
compute test_id:1650 ~25s
network should report PodIP as its own on interface status ~38s
ssp test_id:4777 ~0.004s
storage should use existing ControllerRevisions for an existing VM restore ~18s
tier2 test_machine_config_pool_health ~0.11s

For ginkgo suites (compute/network/storage/ssp), TEST_FOCUS translates to --ginkgo.focus=(A)|(B)|... combined with the existing per-suite label filter (sig-compute&&conformance, etc.), so cross-suite matching is not an issue. For tier2 (pytest), it translates to -k "A or B or ..." where only test_machine_config_pool_health matches a real pytest function name.

What this PR does / why we need it

  • Restores Windows testing now that the checkup image properly handles ACCEPT_WINDOWS_EULA.
  • Reduces disconnected job duration by running one representative test per suite instead of the full conformance suite.

Resolves: CNV-94166

Summary by CodeRabbit

  • The OpenShift Virtualization validation checkup periodic Azure job now sets ACCEPT_WINDOWS_EULA to "true".
  • The disconnected validation checkup job now focuses on test_id:1650, test_id:4777, and test_machine_config_pool_health.
  • The focused tests cover compute, SSP, and tier2 validation without invalid space-containing pytest -k expressions.

…_FOCUS for disconnected

- Set ACCEPT_WINDOWS_EULA back to "true" in e2e-azure now that
  ocp-virt-validation-checkup#87 and openshift#88 are merged.
- Add TEST_FOCUS to run-validation-checkup-disconnected with one fast
  test per suite to reduce job duration:
  - compute: test_id:1650 (~25s)
  - network: should report PodIP as its own on interface status (~38s)
  - ssp: test_id:4777 (~0.004s)
  - storage: should use existing ControllerRevisions for an existing VM restore (~18s)
  - tier2: test_machine_config_pool_health (~0.11s)

Resolves: CNV-94166

Co-Authored-By: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
@openshift-ci
openshift-ci Bot requested review from nunnatsa and orenc1 July 31, 2026 06:51
@openshift-ci

openshift-ci Bot commented Jul 31, 2026

Copy link
Copy Markdown
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: rlobillo

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci Bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Jul 31, 2026
@rlobillo

Copy link
Copy Markdown
Contributor Author

/pj-rehearse periodic-ci-openshift-cnv-ocp-virt-validation-checkup-main-periodics-e2e-azure

@openshift-merge-bot

Copy link
Copy Markdown
Contributor

@rlobillo: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@coderabbitai

coderabbitai Bot commented Jul 31, 2026

Copy link
Copy Markdown
Contributor

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Repository YAML (base), Central YAML (inherited)

Review profile: CHILL

Plan: Pro Plus

Run ID: 9e8cd8ab-0744-44af-ac86-a098e1a6c589

📥 Commits

Reviewing files that changed from the base of the PR and between 9ebb618 and 3cf068b.

📒 Files selected for processing (1)
  • ci-operator/config/openshift-cnv/ocp-virt-validation-checkup/openshift-cnv-ocp-virt-validation-checkup-main__periodics.yaml
🚧 Files skipped from review as they are similar to previous changes (1)
  • ci-operator/config/openshift-cnv/ocp-virt-validation-checkup/openshift-cnv-ocp-virt-validation-checkup-main__periodics.yaml

Walkthrough

The validation checkup configuration accepts the Windows EULA by default for Azure runs. The disconnected checkup adds focused tests for PodIP interface status, ControllerRevision reuse during VM restore, and MachineConfigPool health.

Changes

Validation checkup configuration

Layer / File(s) Summary
Update validation checkup settings
ci-operator/config/openshift-cnv/ocp-virt-validation-checkup/openshift-cnv-ocp-virt-validation-checkup-main__periodics.yaml
The Azure validation checkup changes ACCEPT_WINDOWS_EULA from "false" to "true". The disconnected validation checkup adds three focused tests.

Estimated code review effort: 1 (Trivial) | ~3 minutes

Suggested reviewers: nunnatsa, orenc1

🚥 Pre-merge checks | ✅ 15
✅ Passed checks (15 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check ✅ Passed The title clearly summarizes both main changes: enabling ACCEPT_WINDOWS_EULA and adding TEST_FOCUS for disconnected validation.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.
Stable And Deterministic Test Names ✅ Passed The PR changes only CI YAML. It adds stable identifiers (test_id:1650, test_id:4777, test_machine_config_pool_health) and changes an environment default; no Ginkgo test titles change.
Test Structure And Quality ✅ Passed PASS: The PR changes only CI YAML defaults; it adds no Ginkgo It blocks or cluster test setup, waits, or assertions to review.
Microshift Test Compatibility ✅ Passed The pull request changes only CI YAML; it adds no Ginkgo tests or test bodies that reference MicroShift-incompatible APIs or features.
Single Node Openshift (Sno) Test Compatibility ✅ Passed The PR changes only CI YAML: ACCEPT_WINDOWS_EULA and TEST_FOCUS. It adds no Ginkgo test declarations or test bodies, so SNO compatibility checks do not apply.
Topology-Aware Scheduling Compatibility ✅ Passed PASS: The PR changes only CI periodic YAML environment defaults; it adds no deployment, operator, controller, replica, affinity, node selector, taint, or PDB scheduling constraints.
Ote Binary Stdout Contract ✅ Passed The PR changes only one periodics YAML file; it modifies TEST_FOCUS configuration and contains no OTE binary or process-level stdout/logging code.
Ipv6 And Disconnected Network Test Compatibility ✅ Passed The PR changes only one periodic YAML file; it adds no Ginkgo test declarations or test source, so this compatibility check is not applicable.
No-Weak-Crypto ✅ Passed The PR changes only CI YAML values for ACCEPT_WINDOWS_EULA and TEST_FOCUS; no weak algorithms, custom crypto, or secret comparisons appear in the PR diff.
Container-Privileges ✅ Passed The only changed YAML lines set ACCEPT_WINDOWS_EULA and TEST_FOCUS; no privileged, hostPID, hostNetwork, hostIPC, SYS_ADMIN, or privilege-escalation settings are present.
No-Sensitive-Data-In-Logs ✅ Passed The patch only removes two TEST_FOCUS entries. It adds no logging; the existing pull-secret command redirects decoded data to a file.
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In
`@ci-operator/config/openshift-cnv/ocp-virt-validation-checkup/openshift-cnv-ocp-virt-validation-checkup-main__periodics.yaml`:
- Around line 129-131: Update TEST_FOCUS in all periodic definitions so every
intended test is preserved as a separate focus entry, including
test_machine_config_pool_health and the complete test_id:4777 case; do not rely
on a multiline or runner-incompatible value that truncates after “should”.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Repository YAML (base), Central YAML (inherited)

Review profile: CHILL

Plan: Pro Plus

Run ID: 3b1cac19-6cc7-4a06-97e3-a81e4ef18a2b

📥 Commits

Reviewing files that changed from the base of the PR and between 656daef and 9ebb618.

📒 Files selected for processing (1)
  • ci-operator/config/openshift-cnv/ocp-virt-validation-checkup/openshift-cnv-ocp-virt-validation-checkup-main__periodics.yaml

Comment on lines +129 to +131
- default: test_id:1650|should report PodIP as its own on interface status|test_id:4777|should
use existing ControllerRevisions for an existing VM restore|test_machine_config_pool_health
name: TEST_FOCUS

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🗄️ Data Integrity & Integration | 🟠 Major | ⚡ Quick win

🧩 Analysis chain

🏁 Script executed:

#!/bin/bash
set -euo pipefail

rg -n -C 8 '\bTEST_FOCUS\b|test_id:1650|test_id:4777|test_machine_config_pool_health' .

Repository: openshift/release

Length of output: 3369


🏁 Script executed:

#!/bin/bash
set -euo pipefail

# Inspect the referenced CI job and any sibling env usages.
sed -n '1,190p' ci-operator/config/openshift-cnv/ocp-virt-validation-checkup/openshift-cnv-ocp-virt-validation-checkup-main__periodics.yaml

printf '\n--- TEST_FOCUS references in repository ---\n'
rg -n --hidden --glob '!_tmp/**' --glob '!.git/**' '\bTEST_FOCUS\b|TEST_SKIPS\b|TEST_SUITES\b|OCP_VIRT_VALIDATION' . | head -200

printf '\n--- YAML env value after fold/continuation expansion probe ---\n'
python3 - <<'PY'
from pathlib import Path
import re

path = Path('ci-operator/config/openshift-cnv/ocp-virt-validation-checkup/openshift-cnv-ocp-virt-validation-checkup-main__periodics.yaml')
text = path.read_text()
m = re.search(r'name:\s*TEST_FOCUS\s+[\S\s]*?default:\s*([^\n][\s\S]*?)(?:\n\s*name:|\n\s*resources:|$)', text)
print('raw match')
print(m.group(1) if m else 'NO MATCH')

# Very lightweight YAML folding model for the exact | block shown in the context:
# YAML treats non-indented continuation lines as separate scalar values unless the scalar is inside a mapping value
# that has explicit folded/continued indentation. Instead, identify the indented default content lines.
default_pat = re.compile(r'^      - default:(.*)$', re.M)
envs = []
cur = None
for line in text.splitlines():
    if default_pat.match(line):
        cur = {'name': None, 'default': [default_pat.match(line).group(1)], 'raw_default': line}
        envs.append(cur)
    elif cur is not None and line.startswith('        name:'):
        cur['name'] = line.split(':', 1)[1].strip()
    elif cur is not None and line.startswith('        resources:'):
        cur = None
print('parsed envs with name', [(e.get('name'), e.get('raw_default'), e.get('default')) for e in envs if e.get('name')])
default_env = next((e for e in envs if e.get('name') == 'TEST_FOCUS'), {})
default_lines = default_env.get('default')
print('joined by space:')
print(' '.join(default_lines or []))
print('joined by newline:')
print('\n'.join(default_lines or []))
PY

Repository: openshift/release

Length of output: 48261


Fix the TEST_FOCUS value across all periodic definitions.

TEST_FOCUS is passed unchanged to the remote checkup image, so the value only keeps the first half of test_id:4777|should use existing ControllerRevisions.... Add test_machine_config_pool_health as a separate focused test or move it into a runner-aware focused-test variable.

🤖 Prompt for AI Agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

In
`@ci-operator/config/openshift-cnv/ocp-virt-validation-checkup/openshift-cnv-ocp-virt-validation-checkup-main__periodics.yaml`
around lines 129 - 131, Update TEST_FOCUS in all periodic definitions so every
intended test is preserved as a separate focus entry, including
test_machine_config_pool_health and the complete test_id:4777 case; do not rely
on a multiline or runner-incompatible value that truncates after “should”.

…connected TEST_FOCUS

pytest's -k expression parser rejects multi-word entries with spaces
(e.g. 'should report PodIP as its own on interface status'). These
ginkgo-style test names work for --ginkgo.focus but break pytest -k,
causing tier2 to fail with:
  ERROR: Wrong expression passed to '-k': ... at column 25: expected
  right parenthesis; got identifier

Remove the two space-containing entries from the disconnected TEST_FOCUS,
keeping only valid pytest/ginkgo identifiers:
  test_id:1650 (compute), test_id:4777 (ssp), test_machine_config_pool_health (tier2)

Co-Authored-By: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
@rlobillo

Copy link
Copy Markdown
Contributor Author

/pj-rehearse periodic-ci-openshift-cnv-ocp-virt-validation-checkup-main-periodics-e2e-azure

@openshift-merge-bot

Copy link
Copy Markdown
Contributor

@rlobillo: now processing your pj-rehearse request. Please allow up to 10 minutes for jobs to trigger or cancel.

@openshift-merge-bot

Copy link
Copy Markdown
Contributor

[REHEARSALNOTIFIER]
@rlobillo: the pj-rehearse plugin accommodates running rehearsal tests for the changes in this PR. Expand 'Interacting with pj-rehearse' for usage details. The following rehearsable tests have been affected by this change:

Test name Repo Type Reason
periodic-ci-openshift-cnv-ocp-virt-validation-checkup-main-periodics-e2e-azure N/A periodic Ci-operator config changed
Interacting with pj-rehearse

Comment: /pj-rehearse to run up to 5 rehearsals
Comment: /pj-rehearse skip to opt-out of rehearsals
Comment: /pj-rehearse {test-name}, with each test separated by a space, to run one or more specific rehearsals
Comment: /pj-rehearse more to run up to 10 rehearsals
Comment: /pj-rehearse max to run up to 25 rehearsals
Comment: /pj-rehearse auto-ack to run up to 5 rehearsals, and add the rehearsals-ack label on success
Comment: /pj-rehearse list to get an up-to-date list of affected jobs
Comment: /pj-rehearse abort to abort all active rehearsals
Comment: /pj-rehearse network-access-allowed to allow rehearsals of tests that have the restrict_network_access field set to false. This must be executed by an openshift org member who is not the PR author

Once you are satisfied with the results of the rehearsals, comment: /pj-rehearse ack to unblock merge. When the rehearsals-ack label is present on your PR, merge will no longer be blocked by rehearsals.
If you would like the rehearsals-ack label removed, comment: /pj-rehearse reject to re-block merging.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by an approver from all required OWNERS files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant