Shypd.aiThe largest open index of AI toolsLLaDA is an AI Frameworks & Infra tool that provides the official PyTorch implementation for Large Language Diffusion Models. It enables the development and training of diffusion models for natural language processing tasks, rivaling LLaMA3 8B in performance.
Trending
Also listed in
About
LLaDA (Large Language Diffusion with Masking) offers the official PyTorch implementation for Large Language Diffusion Models, providing a robust framework for developing and training diffusion models for natural language processing tasks. This open-source tool introduces an unprecedented 8B scale diffusion model, trained from scratch, demonstrating performance comparable to LLaMA3 8B. Key features include support for conditional likelihood evaluation and conditional generation, with pre-trained models available on Huggingface. LLaDA also offers guidelines for pre-training and Supervised Fine-Tuning, making it adaptable for researchers and developers. It explores a theoretically complete language modeling approach, distinguishing itself from BERT by using a varying masking ratio and serving as a generative model capable of in-context learning and instruction-following.
Capabilities
Pricing & Plans
Open Source
Free
FAQs
Trending
