RWKV-LM 产品

来源: githubOPEN_SOURCE开源PythonApache-2.0发布于 2021-08-08

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

14524

Stars

1009

Forks

4

技术栈

0

替代方案

0

相关事件

开发者/公司

暂无数据

相关技术查看全部 (4)

PyTorchframework
GPTarchitecture
Pythonlanguage

替代方案

暂无数据

相关事件

暂无数据

相关文章

暂无数据