Skip to content

feat(llama.cpp): add turboquant support#9198

Closed
mudler wants to merge 3 commits intomasterfrom
feat/turboquant
Closed

feat(llama.cpp): add turboquant support#9198
mudler wants to merge 3 commits intomasterfrom
feat/turboquant

Conversation

@mudler
Copy link
Copy Markdown
Owner

@mudler mudler commented Apr 1, 2026

This PR adds patchset from the great work of @TheTom in https://github.com/TheTom/llama-cpp-turboquant and creates a pipeline that updates the patches against upstream automatically.

It also creates necessary scaffolding for doing this with other patches sources.

@mudler mudler force-pushed the feat/turboquant branch 2 times, most recently from bbde992 to 04b779b Compare April 1, 2026 17:54
This PR adds patchset from the great work of @TheTom in
https://github.com/TheTom/llama-cpp-turboquant and creates a pipeline
that updates the patches against upstream automatically.

It also creates necessary scaffolding for doing this with other patches
sources.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@mudler mudler force-pushed the feat/turboquant branch from 04b779b to e502e51 Compare April 1, 2026 17:57
mudler added 2 commits April 1, 2026 19:42
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@mudler
Copy link
Copy Markdown
Owner Author

mudler commented Apr 3, 2026

closing in favor of #9217

@mudler mudler closed this Apr 3, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant