Shypd.aiThe largest open index of AI toolsAwesome-LLM-Compression is a Research & Education tool that curates research papers and tools for LLM compression. It aims to accelerate LLM training and inference through various techniques.
Trending
Also listed in
About
Awesome-LLM-Compression is a comprehensive GitHub repository dedicated to collecting and organizing research papers and tools focused on Large Language Model (LLM) compression. This resource is invaluable for researchers and practitioners looking to optimize LLM training and inference processes. The collection covers a wide array of compression techniques, including quantization, pruning and sparsity, distillation, efficient prompting, and KV cache compression. It provides direct links to papers, and in some cases, associated code and tutorials, making it a central hub for staying updated on the latest advancements in efficient LLM deployment and operation.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
