Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Plugin load error in board infer #2800

Open
3 tasks done
Mandylove1993 opened this issue Jul 18, 2024 · 3 comments
Open
3 tasks done

[Bug] Plugin load error in board infer #2800

Mandylove1993 opened this issue Jul 18, 2024 · 3 comments

Comments

@Mandylove1993
Copy link

Mandylove1993 commented Jul 18, 2024

Checklist

  • I have searched related issues but cannot get the expected help.
  • 2. I have read the FAQ documentation but cannot get the expected help.
  • 3. The bug has not been fixed in the latest version.

Describe the bug

I use mmdeploy exported XXX.trt, but when I use the XXX.trt, it output the error:
image

Reproduction

I what use mmdeploy's plugin so to my deployment code,how can I link it? I want to run my model in OrinX

Environment

TensorRT:8.6
cuda 11.3
torch 1.10.1

Error traceback

No response

@Mandylove1993 Mandylove1993 changed the title Plugin load error in board infer [Bug] [Bug] Plugin load error in board infer Jul 18, 2024
@matthost
Copy link

matthost commented Aug 5, 2024

Assuming plain TensorRT library inference using C++ based on the screenshot. My understanding is we need to load the plugins by (1) loading the libmmdeploy_tensorrt_ops.so library, (2) calling initLibNvInferPlugins in the C++ code before using the model.

For some reason compiling my code with the ops library using target_link_libraries in CMake was not fixing it, and I don't see the library linked with ldd on my exe either. But loading at runtime using dlopen is removing the plugin not found error. Curious if anyone has an idea what I am doing wrong with the former approach.

@Mandylove1993
Copy link
Author

Assuming plain TensorRT library inference using C++ based on the screenshot. My understanding is we need to load the plugins by (1) loading the libmmdeploy_tensorrt_ops.so library, (2) calling initLibNvInferPlugins in the C++ code before using the model.

For some reason compiling my code with the ops library using target_link_libraries in CMake was not fixing it, and I don't see the library linked with ldd on my exe either. But loading at runtime using dlopen is removing the plugin not found error. Curious if anyone has an idea what I am doing wrong with the former approach.

Me too!

@matthost
Copy link

matthost commented Aug 7, 2024

I also don't see initLibNvInferPlugins here in the mmdeploy repo. Not sure how they are doing it so far

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants