New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

int8量化后的trt模型可视化 #220

Open

PrinceDouble opened this issue Sep 11, 2024 · 0 comments

PrinceDouble commented Sep 11, 2024

请教一下：
1、int8量化后的trt模型可以可视化分析每一层的输入输出类型吗，与fp16和fp32进行对比，因为int8量化后的模型不一定每一层都是int8吧，有可能是混合精度推理模型；
2、对于一些对输出精度要求高的层，怎么细粒度到设置该层为float输出呀？谢谢啦！

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment