Shypd.aiThe largest open index of AI toolsPlatypus is an Open Source & Models tool that provides code for fine-tuning Platypus family LLMs using LoRA. It leverages LLaMA and LLaMa-2 transformer architectures for quick and powerful refinement.
Trending
About
Platypus offers a comprehensive set of code and resources for fine-tuning large language models (LLMs) from the Platypus family. Utilizing LoRA (Low-Rank Adaptation) and PEFT (Parameter-Efficient Fine-Tuning) techniques, it enables efficient and powerful refinement of models based on the LLaMA and LLaMa-2 transformer architectures. The repository includes scripts for fine-tuning, merging LoRA weights, and performing inference. It also provides a data pipeline for refining datasets, including keyword search, duplicate removal, and similarity checks using SentenceTransformers embeddings. Platypus is designed to be multi-GPU friendly, supporting both model and data parallelism, and offers guidance on reproducing benchmark evaluation results.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
