MNN

by alibaba · Machine Learning

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and

New0 ratings16,035 starsActive
Machine LearningAI ApplicationC++C
↓ Download 3.6.1GitHub⚑ Report
MNN — image 1
MNN — image 2
MNN — image 3
MNN — image 4
MNN — image 5
MNN — image 6
1 / 6

About this project

News 🔥 — [2026/07/22] MNN 3.6.1 is released with a new 🚀 Hexagon backend, enabling accelerated model inference on Qualcomm Hexagon DSPs. Learn more. History News — [2026/03/05] Support Qwen3.5 Series. — [2026/02/13] MNN-Sana-Edit-V2 is now available at apps, offering cartoon-style photo editing based on Sana. — [2025/10/16] Support Qwen3-VL Series. — [2025/06/11] New App MNN TaoAvatar released, you can talk with 3DAvatar offline with LLM, ASR, TTS, A2BS and NNR models all run local on your device!! MNN TaoAvatar — [2025/05/12] android app support qwen2.5 omni 3b and 7b MNN Chat App. — [2025/04/30] android app support qwen3 and dark mode MNN Chat App. — [2025/02/18] iOS multimodal LLM…

Technologies

KotlinPythonC++deep-learningCAssemblyarmconvolution

Project health

Actively maintained
Last update4 days ago
Contributors178
Latest release3.6.1
Open issues & PRs49
LicenseApache-2.0
On GitHubsince 2019

GitHub

16,035
stars
2,433
forks
178
contributors
49
open issues & PRs
C++
language
4 days ago
last commit
View on GitHub ↗All releases ↗

Reviews

out of 5 · 0 ratings
★★★★★
0%
★★★★
0%
★★★
0%
★★
0%
0%
Sign in to write a review
No reviews yet
Be the first to review MNN.

Built by

alibaba
Imported from GitHub · not yet claimed on GitPalace
View developer pageSign in with GitHub to claim

Maintain alibaba/MNN? Claiming verifies admin access through your GitHub account and gives you control of this listing.

You might also like