Shypd.aiThe largest open index of AI toolsFirefly is an open-source AI framework that supports training large language models. It enables pre-training, instruction fine-tuning, and DPO for a wide range of models including Qwen2.5, Llama3, and Gemma.
Trending
About
Firefly is a comprehensive open-source project designed for training large language models, offering support for pre-training, instruction fine-tuning, and DPO (Direct Preference Optimization). It is compatible with numerous mainstream models such as Qwen2.5, Qwen2, Yi1.5, Phi-3, Llama3, Gemma, MiniCPM, and many others. The platform facilitates full parameter training, as well as efficient training methods like LoRA and QLoRA, making it accessible even with limited computational resources. Firefly also integrates with Unsloth for accelerated training and reduced VRAM usage, and provides curated instruction fine-tuning datasets. It offers pre-trained Firefly series models and has demonstrated effectiveness on the Open LLM Leaderboard.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
