vllm-omni

About this project

Easy, fast, and cheap omni-modality model serving for everyone Documentation DeepWiki User Forum Developer Slack WeChat Paper Slides Latest News 🔥 — [2026/08] We released 0.28.0, featuring production-ready MiniMax H3 serving on GPU and NPU, a unified AR/DiT paged KV cache runtime, and enhanced realtime full-duplex serving for the MiniCPM-o series. — [2026/08] VeRL-Omni v0.2.0 is released: faster diffusion RL powered by vLLM-Omni (request-level/step-wise batching with FA3), rebuilt Qwen3-Omni multimodal training (DPO & GSPO), plus LTX-2.3, Qwen-Image-Edit support and more. See the release notes. — [2026/08] We released 0.26.0 - aligned with the vLLM 0.26 release line, featuring…

GitHub

Reviews

Built by

vllm-project

Imported from GitHub · not yet claimed on GitPalace

View developer pageSign in with GitHub to claim

Maintain vllm-project/vllm-omni? Claiming verifies admin access through your GitHub account and gives you control of this listing.

You might also like

tensorflow

Machine Learning

An Open Source Machine Learning Framework for Everyone

★ New198.9K stars

by tensorflow

prompts.chat

Machine Learning

f.k.a. Awesome ChatGPT Prompts. Share, discover, and collect prompts from the community. Free and open source — self-hos

★ New169.5K stars

by f

transformers

Machine Learning

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and

★ New164.9K stars

by huggingface

ComfyUI

Machine Learning

The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.

★ New131.8K stars

by Comfy-Org