Directory
Book Reviews
Posts
Tech Explore
Categories
Tags
agent-frontend-ux agentic-browser-automation Blogging Books code-first-agent-frameworks code-sandboxes distributed-runtimes document-parsing-pdf fine-tuning gpu-cloud-platforms graphrag-knowledge-graphs inference-infrastructure llm-programming-gateways llm-security-red-teaming llmops-observability local-runtimes-chat-uis managed-cloud-ai markdown-agents-assistants Meta ml-lifecycle-data-versioning Reviews scraping-crawling speech-voice-agents standards-protocols Tech Explore testing-evaluation vector-databases visual-agent-platforms workflow-orchestration
Table of Contents
Table of Contents
56 words
1 minute
vLLM
vLLM
Category: Inference Infrastructure · GitHub · Docs ⭐ 90,600 · 0.28.0 · Apache-2.0 · snapshot 2026-08-31 Full profile (deep dive, contenders, matrix): [[AI Tools & Platforms Landscape]]
One-liner: The high-throughput LLM serving engine (PagedAttention, continuous batching)
What problem does it solve?
How does it work?
When would I reach for it?
Related tools
- [[Ray]]
- [[Ollama]]
- [[BentoML]]
- [[LM Evaluation Harness]]
My exploration notes
Blog post checklist
- Outline
- Draft → Blog/posts/tech-explore/vllm/
Some information may be outdated
Directory
Book Reviews
Posts
Tech Explore
Categories
Tags
agent-frontend-ux agentic-browser-automation Blogging Books code-first-agent-frameworks code-sandboxes distributed-runtimes document-parsing-pdf fine-tuning gpu-cloud-platforms graphrag-knowledge-graphs inference-infrastructure llm-programming-gateways llm-security-red-teaming llmops-observability local-runtimes-chat-uis managed-cloud-ai markdown-agents-assistants Meta ml-lifecycle-data-versioning Reviews scraping-crawling speech-voice-agents standards-protocols Tech Explore testing-evaluation vector-databases visual-agent-platforms workflow-orchestration
Table of Contents