Skip to content

Run a shadow review on every pull request - #550

Closed
bompus wants to merge 3 commits into
mainfrom
reviewer-shadow-rollout
Closed

bompus wants to merge 3 commits into
mainfrom
reviewer-shadow-rollout

Conversation

@bompus

@bompus bompus commented Oct 25, 2026 •

Copy link
Copy Markdown
Owner

Adds a workflow that runs an AI reviewer as a job named shadow review on every non-draft pull request, as a trial alongside the existing review bots.

What it does: the job gives the diff to a reviewer model from a different family than the author and posts one review. The reviewer code runs from a checkout on the runner, never from this repository's pull request.

Shadow mode: the review step cannot fail the job, so nothing is blocked and merges are unaffected. The existing bots keep running; whether to turn any of them off is decided after 20 reviews or a week.

Fork safety: the job only runs for same-repository pull requests, and this repository requires maintainer approval before any fork pull request runs a workflow.

Close this pull request and stop the runner to remove it.

@greptile-apps greptile-apps Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

bompus has reached the 50-credit limit for trial accounts. To continue receiving code reviews, upgrade your plan.

@coderabbitai

coderabbitai Bot commented Oct 25, 2026 •

Copy link
Copy Markdown

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

Run configuration
  • Source mode: Auto
  • Repository: Unavailable
  • Branch: Unavailable
  • File: No configuration file from this repository applied
  • Commit: Unavailable
  • Layers: Organization UI
  • Review profile: CHILL
  • Plan: Advanced
  • Run ID: eadddc2c-97b0-44ec-832b-c0149acfe581

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@bompus bompus changed the title Run the private reviewer on every pull request in shadow mode Run a shadow review on every pull request Oct 25, 2026
@bompus bompus closed this Oct 25, 2026
@bompus
bompus deleted the reviewer-shadow-rollout branch October 25, 2026 06:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant