Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 96k 24.3k

2. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 38.3k 10.1k

3. modelscope/ms-swift modelscope/ms-swift Public

   Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 600+ LLMs (Qwen3.8, DeepSeek-V4, GLM-5.1, InternLM3, Llama4, ...) and 300+ MLLMs (Qwen3-VL, Qwen3-Omni, InternVL3.5, Ovis2.5, GLM5.3, Gemma4, Llava, P…

   Python 16k 1.8k

4. fla-org/flash-linear-attention fla-org/flash-linear-attention Public

   🚀 Efficient implementations for emerging model architectures

   Python 6k 797

5. FlashML-org/FreeToken FlashML-org/FreeToken Public

   FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.

   Python 15.1k 1.5k

6. unslothai/unsloth unslothai/unsloth Public

   Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4.1, MiniMax-H3, Gemma 4, FLUX and more.

   Python 78.9k 7.3k