rtp-llm 产品

来源: githubOPEN_SOURCE开源CudaApache-2.0发布于 2023-12-27

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.