Shypd.aiThe largest open index of AI toolswllama is an AI Frameworks & Infra tool that provides WebAssembly binding for llama.cpp, enabling on-browser LLM inference. It allows running inference directly in the browser without needing a backend or GPU.
Trending
Also listed in
About
wllama is a WebAssembly binding for llama.cpp, designed to enable on-browser LLM inference. This tool allows developers to run large language models directly within a web browser using WebAssembly SIMD, eliminating the need for a backend server or a dedicated GPU. It offers comprehensive TypeScript support and provides both high-level APIs for completions and embeddings, as well as low-level APIs for fine-grained control over tokenization, KV cache, and sampling. A key feature is its ability to automatically switch between single-thread and multi-thread builds based on browser support, ensuring optimal performance. Models can be split into smaller files for parallel downloading, improving load times and handling models larger than 2GB. wllama also includes pre-built npm packages and supports custom logging.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
