text-generation-webui
by oobaboogaGradio web UI for running LLMs locally. Supports every major loader (Transformers, llama.cpp, ExLlamaV2, AWQ).
About text-generation-webui
text-generation-webui is a Python open-source local llm runtimes project by oobabooga. Gradio web UI for running LLMs locally. Supports every major loader (Transformers, llama.cpp, ExLlamaV2, AWQ). With 43,000 GitHub stars and 0forks, it's one of the Local LLM Runtimes tools worth knowing. You can download the source, browse it on GitHub, or read the full setup guide in the README below.
From the project README
TextGen
A desktop app for local LLMs. Open source, no telemetry. Text, vision, tool-calling, web search. UI + API.
[[image: GitHub stars]](https://github.com/oobabooga/textgen)
[[image: Chat mode]](https://raw.githubusercontent.com/oobabooga/screenshots/refs/heads/main/CHAT-4.8.png)
Get started in 1 minute
Download, unzip, double-click textgen. A window opens.
https://github.com/oobabooga/textgen/releases
Portable builds for Linux, Windows, and macOS with CUDA, Vulkan, ROCm, and CPU-only options. All dependencies included. Compatible with GGUF (llama.cpp) models.
For additional backends (ExLlamaV3, Transformers), training, image generation, and extensions, see Installation.
Features
Chat & generation
instructmode for instruction-following (like ChatGPT), andchat-instruct/chatmodes for talking to custom characters. Prompts are automatically formatted with Jinja2 templates.- Vision (multimodal): Attach images to messages for visual understanding (tutorial).
- File attachments: Upload text files, PDF documents, and .docx documents to talk about their contents.
- Edit messages, navigate between message versions, and branch conversations at any point.
- Notebook tab for free-form text generation outside of chat turns.
Backends & API
This is an excerpt from the project's own README, quoted here for reference. Read the full README on GitHub →
text-generation-webui — FAQ
What is text-generation-webui?
Gradio web UI for running LLMs locally. Supports every major loader (Transformers, llama.cpp, ExLlamaV2, AWQ).
Is text-generation-webui free to use?
Yes. text-generation-webui is open-source and free. You can browse the source on GitHub or download it here at no cost — no signup required.
How do I install and run text-generation-webui?
Download the latest source as a ZIP from GitHub (or clone the main branch), then follow the setup steps in the README below.
What language is text-generation-webui written in?
text-generation-webui is primarily written in Python.
How popular is text-generation-webui?
text-generation-webui has 43,000 stars and 0 forks on GitHub — a useful signal of how actively it's maintained and trusted by developers.