RWKV-LM
Visit ToolRWKV-LM is an Open Source & Models tool that provides an RNN architecture with LLM performance. It can be trained like a GPT transformer, offering linear time, constant space, and fast training.
At a glance
Trending
RWKV-LM is an Open Source & Models tool that provides an RNN architecture with LLM performance. It can be trained like a GPT transformer, offering linear time, constant space, and fast training.
Trending
About
RWKV-LM, pronounced RwaKuv, is an innovative RNN architecture designed to achieve Large Language Model (LLM) performance. It uniquely combines the strengths of both RNNs and transformers, allowing it to be directly trained like a GPT transformer while maintaining linear time complexity and constant space usage (without a KV-cache). This results in fast training, infinite context length capabilities, and free sentence embedding. The project is currently at RWKV-7 "Goose" and is a Linux Foundation AI project, making it completely free to use. It offers efficient inference and training, with specific instructions and reference implementations available for various versions, including RWKV-7 and RWKV-6.
Capabilities
Pricing & Plans
Open Source ยท Free
Free
FAQs
Trending