LLMs-Local

Visit Tool

LLMs-local is a documentation tool that provides a curated list of platforms, tools, and resources for running Large Language Models locally. It assists developers in setting up and utilizing LLMs on local machines.

Claim this tool

No Views Yet

At a glance

Pricing

Open Source

Free tier

Yes

API

Skill level

Technical

About

What is LLMs-local?

LLMs-local is a comprehensive GitHub repository offering a curated list of platforms, tools, and resources specifically designed for running Large Language Models (LLMs) locally. This resource is invaluable for developers and researchers looking to explore, deploy, and manage LLMs without relying on cloud-based services. It categorizes tools into inference platforms, inference engines, user interfaces, and various types of models including general purpose, coding, multimodal, image, and audio. Additionally, it covers agent frameworks, model context protocols, retrieval-augmented generation (RAG) tools, and miscellaneous utilities, providing a one-stop solution for local LLM development and experimentation.

Best used for

Ideal for developers and data scientists who need to set up and experiment with Large Language Models on their local machines, explore various inference engines and user interfaces, and implement advanced AI functionalities like agent frameworks or Retrieval-Augmented Generation. Especially valuable for those seeking to build custom, offline-capable AI applications.

Common actions

run LLMs locally

explore LLM tools

develop AI agents

implement RAG

low-code/no-codeautomated workflowdeepfakeopen-sourcecollaborationgithub copilotworkflows"AI Agents"face swapping

Capabilities

Key features

Local LLM inference platforms
LLM inference engines
User interfaces for LLMs
Specific LLM models
Agent frameworks
Retrieval-Augmented Generation tools
Model context protocols

Target Audience

developerdata scientiststartup founder

Integrations

Not yet documented

Pricing & Plans

Open Source

Free

FAQs

What types of LLM resources are listed in LLMs-local?

LLMs-local lists a wide range of resources including inference platforms like LM Studio and Jan, inference engines such as ollama and llama.cpp, various user interfaces like Open WebUI, and specific models for general purpose, coding, multimodal, image, and audio tasks. It also covers agent frameworks and RAG tools.

Does LLMs-local provide actual LLM models or just tools?

LLMs-local provides a comprehensive list that includes both tools and specific LLM models. It features model providers like Qwen and Mistral AI, along with specific models such as Qwen3-Next, Gemma 3, and various coding and multimodal models, enabling users to find suitable LLMs for local deployment.

Is LLMs-local suitable for beginners in AI?

LLMs-local is primarily aimed at technical users, including developers and data scientists, who have some familiarity with AI and Large Language Models. While it provides a curated list, setting up and running many of the listed tools and models locally often requires advanced technical skills.

Trending

Subcategories trending in Coding & Development

Open Source & Models Code Assistants DevOps & Infrastructure No-Code / Low-Code Testing & QA Backend & APIs

Trending

Explore

Browse AI tools by category

Content & Design Productivity & Business Coding & Development AI Agents & Automation Research & Education Wellness & Lifestyle Career Development Marketing & Growth Data & Analytics Customer Support & CX Finance E-commerce