Pinned Loading

1. flexflow/FlexFlow flexflow/FlexFlow Public

   FlexFlow Serve: Low-Latency, High-Performance LLM Serving

   C++ 1.7k 226

2. quantum-compiler/atlas quantum-compiler/atlas Public

   OpenQASM 10 1

3. S-LoRA/S-LoRA S-LoRA/S-LoRA Public

   S-LoRA: Serving Thousands of Concurrent LoRA Adapters

   Python 1.7k 95

4. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 29.8k 4.5k

5. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 5.9k 486