vllm

About this project

Easy, fast, and cheap LLM serving for everyone Documentation Blog Paper Twitter/X User Forum Developer Slack 🔥 We have built a vLLM website to help you get started with vLLM. Please visit vllm.ai to learn more. For events, please visit vllm.ai/events to join us. About vLLM is a fast and easy-to-use library for LLM inference and serving. Originally developed in the Sky Computing Lab at UC Berkeley, vLLM has grown into one of the most active open-source AI projects built and maintained by a diverse community of many dozens of academic institutions and companies from over 2000 contributors. vLLM is fast with: — State-of-the-art serving throughput — Efficient management of…

GitHub

Reviews

Built by

vllm-project

Imported from GitHub · not yet claimed on GitPalace

View developer pageSign in with GitHub to claim

Maintain vllm-project/vllm? Claiming verifies admin access through your GitHub account and gives you control of this listing.

You might also like

tensorflow

Machine Learning

An Open Source Machine Learning Framework for Everyone

★ New198.9K stars

by tensorflow

prompts.chat

Machine Learning

f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-hos

★ New169.5K stars

by f

transformers

Machine Learning

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and

★ New164.9K stars

by huggingface

ComfyUI

Machine Learning

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.

★ New131.8K stars

by Comfy-Org