Popular repositories Loading

1. mini-deepinfer mini-deepinfer Public

   Learn DeepInfer through a small, runnable inference engine. Follow the code on CPU, then run real Qwen3.5 models on Ascend 910C.

   Python 25

2. llm-inference-notes llm-inference-notes Public

   LLM inference engineering: SGLang internals, Ascend deployment, distributed inference, and performance analysis.

   Python 1

3. AkiYangDev AkiYangDev Public

   Aki Yang | Backend engineering, SGLang, Ascend NPU, and LLM inference.

4. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python