Shypd.aiThe largest open index of AI toolsDistillKit is an open-source toolkit for large language model knowledge distillation, supporting both online and offline workflows. It features advanced logit compression for efficient training.
Trending
Also listed in
About
DistillKit is an open-source toolkit designed for the knowledge distillation of large language models (LLMs). It offers flexible and production-ready solutions for both online and offline distillation workflows, including advanced logit compression techniques. The toolkit is battle-tested, powering the training of Arcee's popular open-source models like Virtuoso, SuperNova Medius, and Blitz. Key features include real-time teacher inference for online distillation, training from pre-captured teacher outputs with compression for offline distillation, and novel polynomial approximation, quantization, and bit-packing for logit compression. It also provides flexible loss functions, sparse and dense distribution support, and HuggingFace integration, making it a robust solution for LLM optimization.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
