Skip to content

Commit

Permalink
update docs
Browse files Browse the repository at this point in the history
  • Loading branch information
irexyc committed May 18, 2023
1 parent 5a2b1bf commit 8d45c25
Show file tree
Hide file tree
Showing 2 changed files with 8 additions and 0 deletions.
4 changes: 4 additions & 0 deletions docs/en/02-how-to-run/triton_server.md
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,10 @@ a) Using Docker images

For ease of use, we provide a Docker image to support the deployment of models converted by MMDeploy. The image supports Tensorrt and ONNX Runtime as backends. If you need other backends, you can choose build from source.

```
docker run -it --rm --gpus all openmmlab/mmdeploy:triton-22.12
```

b) Build from source

You can refer [build from source](../01-how-to-build/build_from_source.md) to build MMDeploy. In order to build MMDeploy Triton Backend, you need to add `-DTRITON_MMDEPLOY_BACKEND=ON` to cmake configure command. By default, the latest version of Triton Backend is used. If you want to use an older version of Triton Backend, you can add `-DTRITON_TAG=r22.12` to the cmake configure command.
Expand Down
4 changes: 4 additions & 0 deletions docs/zh_cn/02-how-to-run/triton_server.md
Original file line number Diff line number Diff line change
Expand Up @@ -29,6 +29,10 @@ a) 使用 Docker 镜像

为了方便使用,我们提供了 Docker 镜像,支持对通过 MMDeploy 转换的模型进行部署。镜像支持 Tensorrt 以及 ONNX Runtime 作为后端。若需要其他后端,可选择从源码进行编译。

```
docker run -it --rm --gpus all openmmlab/mmdeploy:triton-22.12
```

b) 从源码编译

从源码编译 MMDeploy 的方式可参考[源码手动安装](../01-how-to-build/build_from_source.md),要编译 MMDeploy Triton Backend,需要在编译命令中添加:`-DTRITON_MMDEPLOY_BACKEND=ON`。默认使用最新版本的 Triton Backend,若要使用旧版本的 Triton Backend,可在编译命令中添加`-DTRITON_TAG=r22.12`
Expand Down

0 comments on commit 8d45c25

Please sign in to comment.