LightLLM 产品

来源: githubOPEN_SOURCE开源PythonApache-2.0发布于 2023-07-22

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

4056

Stars

327

Forks

3

技术栈

0

替代方案

0

相关事件

LightLLM · 相关技术

相关技术

LLaMAarchitecture
GPTarchitecture
Pythonlanguage