Run LLMs on everyday hardware: memory-smart MoE scheduling, KV paging, and the `ge` CLI for local GGUF inference. Pairs with Green Compress.
rust inference moe model-serving mixture-of-experts source-available green-engine kv-cache cpu-inference llm long-context llama-cpp gpu-inference ggml local-llm gguf offline-ai transformer-inference expert-scheduling ge-cli
-
Updated
Jul 13, 2026 - Rust