aibrix

by vllm-project · Developer Tools

Cost-efficient and pluggable Infrastructure components for GenAI inference

New0 ratings5,066 starsActive
Developer ToolsDeveloper ToolGoPython
↓ Download v0.7.0GitHub⚑ Report
aibrix — image 1

About this project

AIBrix Welcome to AIBrix, an open-source initiative designed to provide essential building blocks to construct scalable GenAI inference infrastructure. AIBrix delivers a cloud-native solution optimized for deploying, managing, and scaling large language model (LLM) inference, tailored specifically to enterprise needs. Documentation Blog White Paper Twitter/X Developer Slack Latest News Releases — [2026-06-16] AIBrix v0.7.0 is released. Check out the release notes and Blog Post for more details. — [2026-03-05] AIBrix v0.6.0 is released. Check out the release notes and Blog Post for more details. — [2025-11-10] AIBrix v0.5.0 is released. Check out the release notes and Blog Post for…

Technologies

TypeScriptPythonJupyter NotebookCudaGo

Project health

Actively maintained
Last updateyesterday
Contributors173
Latest releasev0.7.0
Open issues & PRs376
LicenseApache-2.0
On GitHubsince 2024

GitHub

5,066
stars
683
forks
173
contributors
376
open issues & PRs
Go
language
yesterday
last commit
View on GitHub ↗All releases ↗

Reviews

out of 5 · 0 ratings
★★★★★
0%
★★★★
0%
★★★
0%
★★
0%
0%
Sign in to write a review
No reviews yet
Be the first to review aibrix.

Built by

vllm-project
Imported from GitHub · not yet claimed on GitPalace
View developer pageSign in with GitHub to claim

Maintain vllm-project/aibrix? Claiming verifies admin access through your GitHub account and gives you control of this listing.

You might also like