Vllm Project Vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
FreeOpen source
What you get
Vllm Project Vllm is a free, open-source AI tool published on GitHub by vllm-project.
A high-throughput and memory-efficient inference and serving engine for LLMs
GitHub stars: 95,116
License: Apache-2.0 (free to use)
Language: Python
Topics: amd, blackwell, cuda, deepseek, deepseek-v3, gpt, gpt-oss, inference
Last updated: 2026-10-22
How to get it: open the repository on GitHub, read the README and follow the setup steps. HEEEXY lists it in the Lab because it is popular, actively maintained and openly licensed.
More for llm apps
- Ollama: Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
- TradingAgents: TradingAgents: Multi-Agents LLM Financial Trading Framework
- Transformers: Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.