Shypd.aiThe largest open index of AI toolsmnn-llm is an open-source AI tool for deploying large language models (LLMs) based on MNN (Mobile Neural Network). It provides examples and build scripts for various platforms like Android, iOS, web, and Python, enabling efficient LLM deployment.
Trending
About
mnn-llm is an open-source project designed for deploying large language models (LLMs) using MNN (Mobile Neural Network). The project has been integrated into the main MNN repository, offering a robust solution for running LLMs on diverse platforms. It includes comprehensive examples and build scripts for Android, iOS, web, and Python, making it accessible for developers targeting different environments. The tool supports various LLM models, including Qwen, ChatGLM, Llama, and more, and allows for model export to ONNX and MNN formats. It also features capabilities like vision processing and performance data dumping, providing flexibility and insights for deployment. This project is ideal for technical users looking to integrate LLMs into their applications across multiple operating systems.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
