Skip to content

Fix/several bot failures#251

Closed
colesussmeier wants to merge 2 commits intomainfrom
fix/several-bot-failures
Closed

Fix/several bot failures#251
colesussmeier wants to merge 2 commits intomainfrom
fix/several-bot-failures

Conversation

@colesussmeier
Copy link
Copy Markdown

3 bots were failing after changes made in #245 / #246. Two of the bots were Grok 4.1 since it is actually called 4.1 fast in the xAI / OpenRouter API. The last one was the uniform bot which doesn't actually make any model calls, so it doesn't have a name that corresponds to a token in the METACULUS_TOKENS json list.

@colesussmeier colesussmeier requested a review from CodexVeritas May 7, 2026 19:59
bot_name: "METAC_UNIFORM_PROBABILITY_BOT_TOKEN"
cache_key: asknews-cache-${{ github.run_id }}
secrets:
INPUT_METACULUS_TOKENS: ${{ secrets.METACULUS_TOKENS }}
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In #245, I shifted things so that all of the metaculus api tokens are stored in the METACULUS_TOKENS secret. It might not be working properly, so that might be a blocker, but I think it should be sorted by #246 maybe?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Another note: METACULUS_TOKEN secret I think is an actual staff user metaculus token, not the token for the uniform probability bot (I deleted it from the secrets since we hit the limit of secrets in this repo and I needed space for METACULUS_TOKENS).

@lsabor
Copy link
Copy Markdown
Contributor

lsabor commented May 7, 2026

The last one was the uniform bot which doesn't actually make any model calls, so it doesn't have a name that corresponds to a token in the METACULUS_TOKENS json list.

The Metaculus Tokens list are api token for metaculus rather than any LLM, so it's required in submitting forecasts/comments rather than answering forecasting questions. It is in there under key "metac-uniform-probability-bot".

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants