Shypd.aiThe largest open index of AI toolsAnemll is an open-source machine learning library that accelerates the porting of Large Language Models (LLMs) to tensor processors, specifically the Apple Neural Engine (ANE). It provides a full pipeline from model conversion to on-device inference for low-power applications.
Trending
Also listed in
About
Anemll (pronounced like "animal") is an open-source project designed to accelerate the porting of Large Language Models (LLMs) to tensor processors, with a primary focus on the Apple Neural Engine (ANE). It offers a comprehensive, open-source pipeline for model conversion and inference, enabling seamless integration and on-device inference for low-power applications on edge devices. This is crucial for autonomous applications requiring privacy and security without an internet connection. Key components include LLM conversion tools, an ANE Profiler, a Swift reference implementation, Python sample code, and iOS/macOS sample applications. The library supports various LLM architectures like Gemma 3, LLaMA, Qwen, and DeepSeek, providing pre-converted models and extensive testing infrastructure.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
