Repository navigation
Conversation
On-prem webhooks no longer runs AI tasks. The new ai-queue-worker service consumes the ai-bmq queue; without it, AI explanations and chat stop. - aiQueueWorker.* values, on by default, 1 replica. The deployment is a copy of webhooks: same Mongo, Redis, object storage and URL env, same pm2 probes, image currents/on-prem/ai-queue-worker. - LLM settings go in aiQueueWorker.env or global.env. - Docs: quickstart section, ECR repository in the IAM policy, regenerated configuration reference. The image exists only in the Currents release that contains currents-dev/currents#4874. Release this chart with that tag. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_011baD3izoabUn31Y3WeQHMp
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_011baD3izoabUn31Y3WeQHMp
|
| Topic | Details | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| AI Worker Deployment | Deploy the standalone ai-queue-worker service to process on-premises ai-bmq tasks with configurable replicas, image, environment, probes, resources, storage, and scheduling. Keep AI processing separate from webhooks while preserving shared service connectivity.Modified files (4)
Latest Contributors(2)
| |||||||||
| On-Prem Operations | Document the worker’s LLM configuration and operational requirements, including ECR pull permissions, migration from webhooks settings, and disabling the worker when AI is unused.Modified files (2)
Latest Contributors(2)
|
Merger 🟡 Pending
CI is not passing.
| aiQueueWorker: | ||
| # -- Run the AI queue worker. It runs the AI tasks (explanations, chat) from the | ||
| # `ai-bmq` queue; with it off, those tasks stay queued. | ||
| enabled: true |
There was a problem hiding this comment.
Disable by default for first release, it's broken unless the admins provide it with LLM connection details, and we are missing any documentation on why they should bother to do that, what features they receive, and in which ways we use their ai providers. Estimates of token usage, and how to set token usage limits for it.
Owner: @agoldis
Linear: ENG-2181
Adds the
ai-queue-workerdeployment. On-premwebhooksno longer runs AI tasks after the Currents release that contains currents-dev/currents#4874, so without this deployment AI explanations and chat stop.This must ship with, not before, the Currents release that contains currents-dev/currents#4874. The image
currents/on-prem/ai-queue-workerdoes not exist before then. Until it does, theai-queue-workerpod cannot pull its image, and thect installcheck on this PR cannot pass for the same reason.Changes
aiQueueWorkervalues:enabled(defaulttrue),replicas(default1), imagecurrents/on-prem/ai-queue-worker(same registry and tag as the other images),env, probes, resources and scheduling likewebhooks.templates/ai-queue-worker/deployment.yamlis a copy of thewebhooksdeployment. It gets the same MongoDB, Redis, object storage and URL env and secret refs from the shared helpers. It does not override the image command. It uses the same pm2 probes (the process is also nameddist).webhooksanddirectorare unchanged. The chart sets no AI env on either.docs/configuration.md.release: x.y.z), as in release: 1.0.1 [ENG-1851] #69. New values with no breaking change make the next release a minor one.Upgrade notes for on-prem customers
currents/on-prem/ai-queue-workerrepository (seedocs/eks/iam.md). Mirror the image if you mirror the others.LLM_PROVIDER_URL,LLM_API_KEY, ...) set inwebhooks.envhave no effect on the worker. Move them toaiQueueWorker.env, or put them inglobal.env.AI_QUEUE_WORKER_ENABLED=trueonwebhooks, replace it withSLACK_AI_CALLBACK_WORKER_ENABLED=true. KeepAI_QUEUE_WORKER_ENABLED=trueondirectorif you have it.aiQueueWorker.enabled: falseif you run no AI.Checked
helm lintwithcharts/currents/ci/lint-values.yaml: passes.helm templatewith the CI values andsamples/local/chart-config.yaml: renders the new deployment. WithaiQueueWorker.enabled=falsenothing renders for it;replicasandenvoverrides apply.helm templatewith no values and withsamples/eks/eks-config.yamlfails oncurrents.rootUser.password.secretName is required, as onmain../scripts/build-docs.sh(helm-docs):docs/configuration.mdregenerated and committed.ct lint,ct install(needs a kind cluster and ECR pull access).🤖 Generated with Claude Code
https://claude.ai/code/session_011baD3izoabUn31Y3WeQHMp
Open in [code]smith · Need help on this PR? Tag
@codesmith-botwith what you need.