RWKV-LM 产品
来源: githubOPEN_SOURCE开源PythonApache-2.0发布于 2021-08-08
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
14524
Stars
1009
Forks
4
技术栈
0
替代方案
0
相关事件