textgen

About this project

TextGen A desktop app for local LLMs. Open source, no telemetry. Text, vision, tool-calling, web search. UI + API. Get started in 1 minute Download, unzip, double-click textgen. A window opens. https://github.com/oobabooga/textgen/releases Portable builds for Linux, Windows, and macOS with CUDA, Vulkan, ROCm, and CPU-only options. All dependencies included. Compatible with GGUF (llama.cpp) models. For additional backends (ExLlamaV3, Transformers), training, image generation, and extensions, see Installation. Features Chat & generation — instruct mode for instruction-following (like ChatGPT), and chat-instruct/chat modes for talking to custom characters. Prompts are…

GitHub

Reviews

Built by

oobabooga

Imported from GitHub · not yet claimed on GitPalace

View developer pageSign in with GitHub to claim

Maintain oobabooga/textgen? Claiming verifies admin access through your GitHub account and gives you control of this listing.

You might also like

build-your-own-x

Developer Tools

Master programming by recreating your favorite technologies from scratch.

★ New545.6K stars

by codecrafters-io

awesome

Developer Tools

😎 Awesome lists about all kinds of interesting topics [NOTE: Pull requests are temporarily disabled until I have a chan

★ New503.7K stars

by sindresorhus

public-apis

Developer Tools

A collective list of free APIs

★ New476.5K stars

by public-apis

free-programming-books

Developer Tools

:books: Freely available programming books

★ New396.1K stars

by EbookFoundation