Skip to content

feat(gallery): add Dirk Qwen3.8 variants - #11807

Open
localai-org-maint-bot wants to merge 1 commit into
masterfrom
cron/model-gallery-20260831-run3
Open

feat(gallery): add Dirk Qwen3.8 variants#11807
localai-org-maint-bot wants to merge 1 commit into
masterfrom
cron/model-gallery-20260831-run3

Conversation

@localai-org-maint-bot

Copy link
Copy Markdown
Collaborator

Description

Add Dirk Qwen3.8 27B to the model gallery for llama.cpp. The entry provides Q4_K_XL and Q8_K_XL variants, the shared F16 vision projector, and MTP speculative decoding.

The SHA256 values were verified twice against Hugging Face x-linked-etag headers.

Notes for Reviewers

  • go test ./core/gallery -ginkgo.focus="gallery/index.yaml variant invariants" passes.
  • git diff --check passes.
  • The complete go test ./core/gallery run passes 384 specs. Three unrelated network-dependent specs fail because this runner receives HTTP 403 responses from GitHub/Gist.

Signed commits

  • Yes, I signed my commits. AI agents cannot add DCO sign-offs under repository policy.
  • Documentation updated (docs/content/) for user-facing changes, or not applicable

Add Q4_K_XL and Q8_K_XL llama.cpp builds with the shared vision projector. Enable the preserved MTP head for speculative decoding.

Assisted-by: Codex:gpt-5
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant