Shypd.aiThe largest open index of AI toolsRepDistiller is an open-source tool for Contrastive Representation Distillation (CRD) and benchmarking knowledge distillation methods. It provides implementations for 12 state-of-the-art knowledge distillation techniques in PyTorch.
Trending
About
RepDistiller is an open-source project that implements Contrastive Representation Distillation (CRD), as detailed in its ICLR 2020 paper. Beyond CRD, it serves as a comprehensive benchmark for 12 state-of-the-art knowledge distillation methods within the PyTorch framework. This tool enables users to run various distillation experiments, train student networks from pre-trained teacher models, and combine different distillation objectives. It provides scripts for fetching pre-trained teachers and running distillation processes, making it a valuable resource for researchers and developers working on model compression and efficiency.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
Also listed in
