Shypd.aiThe largest open index of AI tools
Cerebras-GPT is an Open Source & Models tool that provides a family of open, compute-efficient large language models. These models range from 111 million to 13 billion parameters, trained using the Chinchilla formula for high accuracy and efficiency.
Trending
About
Cerebras-GPT offers a family of seven open-source large language models, ranging from 111 million to 13 billion parameters. These models are specifically designed for compute efficiency, trained using the Chinchilla formula to achieve high accuracy for a given compute budget. They boast faster training times, lower training costs, and reduced energy consumption compared to other publicly available models. All models were trained on Cerebras CS-2 systems, part of the Andromeda AI supercomputer, utilizing a simple, data-parallel weight streaming architecture. This approach simplifies the training process by eliminating the need for model partitioning, allowing for rapid development. Cerebras-GPT also introduces a new scaling law that predicts model performance for public datasets, making it a valuable resource for AI research and development. The models, weights, and checkpoints are openly available on Hugging Face and GitHub under the Apache 2.0 license, promoting accessibility and reproducibility for both research and commercial applications.
Capabilities
Pricing & Plans
Open Source · Freemium · Paid · Enterprise
Open Source
FAQs
Trending
