question about tensorrt - batch > 1.

[YoungjaeDev]

1. Is trt-engine foward currently available regardless of batch size?
2. Can you tell me the exact reason why only single batch inference is possible in the current state?
   I think it will be helpful in implementing c++, so please reply.

[fcakyon]

CUrrent implementation has a limitation of 1 batch size. sahi==0.12.0 will be fixing this limitation.

[luan1412167]

Hi @fcakyon, when sahi==0.12.0 with batch inference release?