Text-Generation-Webui

Visit Tool

text-generation-webui is an open-source local LLM interface that supports text, vision, tool-calling, and training. It offers a UI and API, operating 100% offline and privately for enhanced security and control.

Claim this tool

29Views

At a glance

Pricing

Open Source

Free tier

Yes

API

Yes

Skill level

Technical

About

What is text-generation-webui?

text-generation-webui is a comprehensive, open-source local LLM interface designed for a wide range of AI tasks including text generation, vision capabilities, tool-calling, and model training. It provides both a user-friendly UI and an API, ensuring 100% offline and private operation with zero telemetry or external requests. The tool supports various backends like llama.cpp, Transformers, and ExLlamaV3, and is compatible with GGUF models. Key features include instruct and chat modes, multimodal vision for image understanding, file attachments for content analysis, and the ability to fine-tune LoRAs. It also offers image generation with diffusers models and supports 4-bit/8-bit quantization, making it a versatile solution for local AI deployment.

Best used for

Ideal for developers and researchers who need to run and experiment with large language models locally, fine-tune custom models, and integrate AI capabilities into their applications. Especially valuable for those requiring 100% offline operation, privacy, and control over their AI environment.

Common actions

generate text

train AI models

process images

deploy LLMs locally

create AI tools

low-code/no-codedeepfakeworkflowsautomated workflowopen-sourcecollaborationgithub copilotface swapping"AI Agents"

Capabilities

Key features

Local LLM interface
Text generation
Vision (multimodal)
Tool-calling
LoRA training
Image generation
Offline and private

Target Audience

developersai researchersdata scientistshobbyists

Integrations

Not yet documented

Pricing & Plans

Open Source

Free

FAQs

What types of models are compatible with text-generation-webui?

text-generation-webui is compatible with GGUF (llama.cpp) models, and also supports additional backends like ExLlamaV3, Transformers, and TensorRT-LLM. This allows users to switch between various model types without needing to restart the application.

Can I use text-generation-webui for image generation?

Yes, text-generation-webui includes a dedicated tab for image generation using diffusers models, such as Z-Image-Turbo. It also offers features like 4-bit/8-bit quantization and a persistent gallery for managing generated images with metadata.

Does text-generation-webui support tool-calling for models?

Yes, models within text-generation-webui can call custom functions during chat interactions. This includes capabilities like web search, page fetching, and mathematical operations, with each tool implemented as a single Python file. MCP servers are also supported.

Trending

Subcategories trending in Coding & Development

Open Source & Models Code Assistants DevOps & Infrastructure No-Code / Low-Code Testing & QA Backend & APIs

Trending

Also listed in

This tool also appears in

Content & Design › AI Writing Assistants Content & Design › Image Generation

Explore

Browse AI tools by category

Content & Design Productivity & Business Coding & Development AI Agents & Automation Research & Education Wellness & Lifestyle Career Development Marketing & Growth Data & Analytics Customer Support & CX Finance E-commerce