ggml
Tensor library for machine learning
About this project
ggml Tensor library for machine learning Quick start Build from source: For a minimal, fully commented example (matrix multiplication), see examples/simple. Description The main goal of ggml is to be a simple, portable, and efficient tensor library for machine learning with minimal setup. — Plain C/C++ implementation without any dependencies — Cross-platform - x86, ARM, RISC-V, LoongArch, PowerPC, s390x, and WebAssembly — SIMD-optimized kernels for x86, ARM, and RISC-V — Broad backend support - CPU, GPU, NPU, and browser — 2- to 8-bit integer quantization, plus MXFP4 and NVFP4 microscaling formats — Zero memory allocations during runtime Documentation — The GGUF…
Technologies
Project health
GitHub
Reviews
Built by
Maintain ggml-org/ggml? Claiming verifies admin access through your GitHub account and gives you control of this listing.
