Back to Integrations
āļø
Local
Text Generation WebUI
Text Generation WebUI (by oobabooga) is the most feature-complete open-source UI for running local language models. It supports a vast range of model formats (GGUF, GPTQ, AWQ, EXL2, and more), backends (llama.cpp, ExLlamaV2, TGI), and extensions including a characters/roleplay system, a notebook mode, and an OpenAI-compatible API. It is the go-to tool for power users and researchers who want maximum control over their local LLM setup.
Try Our Agents ā github.com/oobabooga/text-generation-webui
Features & Capabilities
Multi-backend support (llama.cpp
ExLlamaV2)
Many model formats (GGUF
GPTQ
AWQ)
OpenAI-compatible API
Extensions and plugins
Character/roleplay mode
Notebook mode
Training UI
šÆ Best for power users, researchers, and developers who need maximum control over local LLM inference.
ā Advantages
- Maximum flexibility
- Huge extension library
- All model formats
- Active community
- Research-grade features
ā Disadvantages
- āComplex installation
- āCLI-heavy setup
- āNot beginner-friendly
- āResource intensive
- āFrequent breaking changes
š° Pricing
Free and open-source. Hardware costs only.
Compatible Agents
Other Integrations
š¦Local AI
Ollama
Run open-source AI models locally. Full privacy and control.
šļøLocal
LM Studio
Desktop app for discovering, downloading, and running local LLMs with a polished GUI ā no coding needed.
š§Local
AnythingLLM
All-in-one AI app with RAG, agents, and multi-user support ā works with local or cloud LLMs.