BitNet

by microsoft · Developer Tools

Official inference framework for 1-bit LLMs

New0 ratings40,227 starsActive
Developer ToolsDeveloper ToolC++Python
GitHub⚑ Report
BitNet — image 1
BitNet — image 2
BitNet — image 3
BitNet — image 4
1 / 4

About this project

bitnet.cpp 📰 News 07/23/2026: 📣 We released VibeASR.cpp — a real-time multilingual ASR inference engine on CPU using BitNet I2S quantization, achieving RTF Code ] [ Models ] [ Report ] 07/20/2026: 📣 We released BitNet-embedding-0.6B and BitNet-embedding-270M on Hugging Face — the first 1-bit embedding models that deliver competitive embedding quality with significantly faster inference on CPUs. — 1.42x to 2.28x speedup over F16 on BitNet-embedding-0.6B prefill (8 threads) — 1.32x to 1.74x speedup over F16 on BitNet-embedding-270M prefill (8 threads) — Supports I2S conversion with optimized kernels on x86 CPUs — Lossless inference with 2 bits per…

Technologies

ShellPythonC++CCMake

Project health

Recently updated
Last updatelast month
Contributors16
Latest release
Open issues & PRs325
LicenseMIT
On GitHubsince 2024

GitHub

40,227
stars
3,723
forks
16
contributors
325
open issues & PRs
C++
language
last month
last commit
View on GitHub ↗

Reviews

out of 5 · 0 ratings
★★★★★
0%
★★★★
0%
★★★
0%
★★
0%
0%
Sign in to write a review
No reviews yet
Be the first to review BitNet.

Built by

microsoft
Imported from GitHub · not yet claimed on GitPalace
View developer pageSign in with GitHub to claim

Maintain microsoft/BitNet? Claiming verifies admin access through your GitHub account and gives you control of this listing.

You might also like