Shypd.aiThe largest open index of AI toolsChatGLM-Finetuning is an open-source tool for fine-tuning ChatGLM models (6B, 2-6B, 3-6B) for specific downstream tasks. It supports various methods like Freeze, Lora, P-tuning, and full parameter fine-tuning, enabling both single-card and multi-card training.
Trending
About
ChatGLM-Finetuning is a comprehensive open-source project designed for fine-tuning ChatGLM-6B, ChatGLM2-6B, and ChatGLM3-6B models. It offers a variety of fine-tuning methods, including Freeze, Lora, P-tuning, and full parameter fine-tuning, allowing users to select the most suitable approach for their specific needs. The tool supports both single-card and multi-card training environments, making it adaptable to different hardware setups. It is particularly useful for tasks such as information extraction, generation, and classification. The project emphasizes maintaining model performance without severe catastrophic forgetting, even after fine-tuning. It also provides detailed instructions and code examples for implementing each fine-tuning method, along with memory usage benchmarks for different configurations, aiding developers in optimizing their training processes.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
