Pinned Loading

1. huggingface/transformers huggingface/transformers Public

   🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

   Python 166k 34.6k

2. ggml-org/llama.cpp ggml-org/llama.cpp Public

   LLM inference in C/C++

   C++ 129k 23.4k

3. DeepSpeed DeepSpeed Public

   Forked from deepspeedai/DeepSpeed

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python

4. Megatron-LM Megatron-LM Public

   Forked from NVIDIA/Megatron-LM

   Ongoing research training transformer models at scale

   Python

5. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

6. DeepSeek-V3 DeepSeek-V3 Public

   Forked from deepseek-ai/DeepSeek-V3

   DeepSeek-V3 is a high-performance open-weight Mixture-of-Experts (MoE) language model developed by the Chinese AI research company DeepSeek and released in December 2024.

   Python