Shypd.aiThe largest open index of AI toolsnode-llama-cpp is a Coding & Development tool that enables running AI models locally on your machine using Node.js bindings for llama.cpp. It supports enforcing JSON schemas on model output and provides pre-built binaries for ease of use.
Trending
About
node-llama-cpp provides Node.js bindings for llama.cpp, allowing developers to run AI models directly on their local machines. It supports various hardware accelerations including Metal, CUDA, and Vulkan, adapting automatically without manual configuration. A key feature is the ability to enforce a JSON schema on the model's output, ensuring parseable and structured generation. The tool comes with pre-built binaries for macOS, Linux, and Windows, with a fallback to building from source using CMake if binaries are unavailable. It offers a complete suite for LLM integration, including embedding and reranking support, function calling, and a CLI for direct model interaction. The project emphasizes a great developer experience with full TypeScript support and comprehensive documentation.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
