ktransformers

About this project

A Flexible Framework for Experiencing Cutting-edge LLM Inference/Fine-tune Optimizations 🎯 Overview 🚀 Inference 🎓 SFT 🔥 Citation 🚀 Roadmap(2026Q2) 🎯 Overview KTransformers is a research project focused on efficient inference and fine-tuning of large language models through CPU-GPU heterogeneous computing. The project now exposes two user-facing capabilities from the kt-kernel source tree: Inference and SFT. 🔥 Updates Aug 26, 2026: Added native support for GLM-5.3-flash, bringing 1M-token context and multimodal input to consumer GPUs. (Tutorial) Aug 25, 2026: Uploaded a new easy-to-use KTransformers × LlamaFactory MoE Fine-Tuning Cookbook, covering hardware checks,…

GitHub

Reviews

Built by

kvcache-ai

Imported from GitHub · not yet claimed on GitPalace

View developer pageSign in with GitHub to claim

Maintain kvcache-ai/ktransformers? Claiming verifies admin access through your GitHub account and gives you control of this listing.

You might also like

build-your-own-x

Developer Tools

Master programming by recreating your favorite technologies from scratch.

★ New545.6K stars

by codecrafters-io

awesome

Developer Tools

😎 Awesome lists about all kinds of interesting topics [NOTE: Pull requests are temporarily disabled until I have a chan

★ New503.7K stars

by sindresorhus

public-apis

Developer Tools

A collective list of free APIs

★ New476.5K stars

by public-apis

free-programming-books

Developer Tools

:books: Freely available programming books

★ New396.1K stars

by EbookFoundation