Skip to content

feat: add CloudGPU as an OpenAI-compatible provider alias - #4747

Open
mrhy7176 wants to merge 1 commit into
docker:mainfrom
mrhy7176:add-cloudgpu-provider
Open

mrhy7176 wants to merge 1 commit into
docker:mainfrom
mrhy7176:add-cloudgpu-provider

Conversation

@mrhy7176

Copy link
Copy Markdown

Summary

  • add CloudGPU as a built-in OpenAI-compatible provider alias (cloudgpu, base URL https://cloudgpu.app/v1), in the same shape as the Runcrate and Atlas Cloud aliases
  • discover CLOUDGPU_API_KEY for automatic model selection and credential forwarding, with deepseek-v4.1-flash as the default model
  • merge consecutive system messages, like the other model-host aliases
  • document inline and named-model configuration, add an example recipe, and list the provider in navigation, the alias table and the schema description

CloudGPU rents cloud GPUs and serves DeepSeek, Kimi, GLM, MiniMax and other models through an OpenAI-compatible API (docs, public model list at https://cloudgpu.app/v1/models). It is not in models.dev, so it gets the same exemptions as runcrate, atlascloud and api-route in TestProviderIDsMatchEmbeddedCatalog and modelsDevAbsentProviders, and the docs page says no catalog metadata is imported.

Testing

  • go test ./pkg/model/provider/... ./pkg/config/...: pass (new rows in TestCatalogAliases, the auto-config tables, the system-message merge tests and openAIAliasProviders)
  • CLOUDGPU_API_KEY=... go test ./pkg/model/provider/ -run 'TestOpenAIAliasProvider_LiveAPI/cloudgpu' -v: PASS, live response "pong"
  • gofmt -l pkg/: clean

This PR was prepared with AI assistance (an AI agent wrote the change and ran the tests and the live call above).

Disclosure: I work on CloudGPU.

Signed-off-by: mrhy7176 <129925370+mrhy7176@users.noreply.github.com>
@mrhy7176
mrhy7176 requested a review from a team as a code owner October 27, 2026 17:07
@aheritier aheritier added area/config For configuration parsing, YAML, environment variables area/docs Documentation changes area/providers/openai For features/issues/fixes related to the usage of OpenAI models kind/feat PR adds a new feature (maps to feat:). Use on PRs only. status/needs-signed-commits Some commits in the PR are signed with a valid SSH/GPG key labels Oct 27, 2026
@aheritier

Copy link
Copy Markdown
Collaborator

👋 Some commits in this PR are not signed and verified by GitHub. Please sign your commits with a GPG or SSH key registered in your GitHub account, then force-push.

Commits that are not verified: `7fe35a8`

See GitHub's guide on signing commits (https://docs.github.com/en/authentication/managing-commit-signature-verification/signing-commits) for setup instructions. I've added `status/needs-signed-commits`; it will be removed automatically once every commit in this PR carries a valid GitHub-verified signature.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/config For configuration parsing, YAML, environment variables area/docs Documentation changes area/providers/openai For features/issues/fixes related to the usage of OpenAI models kind/feat PR adds a new feature (maps to feat:). Use on PRs only. status/needs-signed-commits Some commits in the PR are signed with a valid SSH/GPG key

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants