[TRT-LLM] TRT-LLM部署流程

TRT-LLM部署流程 1. 编译trt-cpp文件 cd TensorRT-LLM/cpp/build export TRT_LIB_DIR=/usr/local/tensorrt export TRT_INCLUDE_DIR=/usr/local/tensorrt/include/ cmake
posted @ 2024-06-29 12:49  wildkid1024  阅读(3)  评论(0)  编辑  收藏  举报