Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BUG: using delegate with transformer | AttributeError: 'NoneType' object has no attribute 'c_void_p' #758

Open
federicoparra opened this issue Feb 15, 2024 · 22 comments
Assignees
Labels
TIME WAIT Waiting for an approppriate period for a response before closing the issue.

Comments

@federicoparra
Copy link

federicoparra commented Feb 15, 2024

Running it on Orange Pi 5B
Python 3.11
tflite_runtime 2.14.0
Installation of ARMNN etc works fine with other models (example: runs fine with mirNET)

Link to tflite model that causes the error:
https://drive.google.com/file/d/1uX7sZn2idpQOqHwcLFhEvCmHhTJJlfPZ/view?usp=drive_link (3gb download)

code snippet:
import tflite_runtime.interpreter as tflite
armnn_delegate = tf.lite.experimental.load_delegate( library="/home/federico/Documents/code/ARM/aarch64_build/delegate/libarmnnDelegate.so",
options={"backends": "CpuAcc,GpuAcc,CpuRef", "logging-severity":"trace"})
try:
model = tf.lite.Interpreter(model_path="../models/stablelm16.tflite", experimental_delegates=[armnn_delegate])
except Exception as e:
print(f"An error occurred: {e}")

Report:
Info: ArmNN v33.1.0
arm_release_ver: g13p0-01eac0, rk_so_ver: 3
arm_release_ver of this libmali is 'g6p0-01eac0', rk_so_ver is '7'.
Info: Initialization time: 17.17 ms.
INFO: TfLiteArmnnDelegate: Requested unknown backend CpuAcc
INFO: TfLiteArmnnDelegate: Added backend GpuAcc
INFO: TfLiteArmnnDelegate: Requested unknown backend CpuRef
INFO: TfLiteArmnnDelegate: Created TfLite ArmNN delegate.
WARNING: ADD: not supported by armnn: in validate_arguments_with_arithmetic_rules src/gpu/cl/kernels/ClElementwiseKernel.cpp:160: ITensor data type S64 not supported by this kernel
WARNING: MINIMUM: not supported by armnn: in validate_arguments_with_arithmetic_rules src/gpu/cl/kernels/ClElementwiseKernel.cpp:160: ITensor data type S64 not supported by this kernel
WARNING: MAXIMUM: not supported by armnn: in validate_arguments_with_arithmetic_rules src/gpu/cl/kernels/ClElementwiseKernel.cpp:160: ITensor data type S64 not supported by this kernel
WARNING: BROADCAST_TO: not supported by armnn
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/CL/kernels/CLGatherKernel.cpp:58: ITensor data type S64 not supported by this kernel
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/CL/kernels/CLGatherKernel.cpp:58: ITensor data type S64 not supported by this kernel
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/CL/kernels/CLGatherKernel.cpp:58: ITensor data type S64 not supported by this kernel
Info: ArmnnSubgraph creation
WARNING: CONSTANT: not supported by armnn: Unsupported DataType
An error occurred:
Exception ignored in: <function Delegate.del at 0xffff2c7dc360>
Traceback (most recent call last):
File "/home/federico/miniconda3/envs/mlc-chat-venv/lib/python3.11/site-packages/tensorflow/lite/python/interpreter.py", line 110, in del
AttributeError: 'NoneType' object has no attribute 'c_void_p'

Info: Shutdown time: 2.70 ms.

@federicoparra federicoparra changed the title BUG: using delegate with transformer | AttributeError: 'NoneType' object has no attribute "'c_void_p'" BUG: using delegate with transformer | AttributeError: 'NoneType' object has no attribute 'c_void_p' Feb 15, 2024
@federicoparra
Copy link
Author

Anyone please?

@tracyn-arm
Copy link
Collaborator

Hi. I am not able to access the link to your model file. A suggestion though is to see if the model loads another way such as:
build-x86_64/debug/armnn/tests/ExecuteNetwork -c CpuAcc -m $model -T delegate # Fix path for your config
Also, it looks like you are on a recent version of Arm NN but not the associated Tensorflow. We have updated to Tensorflow 2.15 so something else to check. Thanks.

@federicoparra
Copy link
Author

Hi. I am not able to access the link to your model file. A suggestion though is to see if the model loads another way such as: build-x86_64/debug/armnn/tests/ExecuteNetwork -c CpuAcc -m $model -T delegate # Fix path for your config Also, it looks like you are on a recent version of Arm NN but not the associated Tensorflow. We have updated to Tensorflow 2.15 so something else to check. Thanks.

sorry file was deleted by mistake, I'll upload again but in the meantime this one https://drive.google.com/file/d/13dJeJgs2l562YnOWph4lku650rzymUnA/view?usp=drive_link is the same the only difference is it has dynamic inputs which will throw a warning but the crash is the same above (so the crash is not because of the dynamic inputs, I have tried it with fixed inputs and get the same crash).

I have not been able to obtain anything newer than 2.14 for tflite_runtime module using pip, I'll check by using their repo or by compiling it on my own (they might not have 2.15 in arch64).

I'll also check using execute network and report back.

@tracyn-arm tracyn-arm added the TIME WAIT Waiting for an approppriate period for a response before closing the issue. label Feb 27, 2024
@federicoparra
Copy link
Author

Hi @tracyn-arm I've tried with Tensorflow 2.15 and with the new (last week) version of ARMNN.
I don't have ExecuteNetwork compiled so I could not try that (I don't know how to compile it).
Could you please try the network yourself? https://drive.google.com/file/d/13dJeJgs2l562YnOWph4lku650rzymUnA/view?usp=drive_link

@catcor01 catcor01 self-assigned this Mar 11, 2024
@catcor01
Copy link
Collaborator

Hi @federicoparra,

ExecuteNetwork is available to run in the following prebuilt binaries for the 24.02 release: https://github.com/ARM-software/armnn/releases/tag/v24.02. You can download and unzip the binary that is required for your specific architecture and run the model with ExecuteNetwork (see comment from @tracyn-arm above for command) . I will pick this up during the week to investigate further the above error. If possible could you open access to the google drive link provided as I am getting permission denied error.

Regards, Cathal.

@catcor01
Copy link
Collaborator

Hi again,

Unfortunately, we have a restriction on not being able to download privately supplied models to us. Would the model you have supplied be available publically somewhere which would allow us to download and use it?

Regards, Cathal.

@federicoparra
Copy link
Author

Hi @federicoparra,

ExecuteNetwork is available to run in the following prebuilt binaries for the 24.02 release: https://github.com/ARM-software/armnn/releases/tag/v24.02. You can download and unzip the binary that is required for your specific architecture and run the model with ExecuteNetwork (see comment from @tracyn-arm above for command) . I will pick this up during the week to investigate further the above error. If possible could you open access to the google drive link provided as I am getting permission denied error.

Regards, Cathal.

I compiled ARMNN myself using the scripts provided - is there a script to compile execute network? My understanding is that your releases for LINUX do not support the Delegate (just the parser), and I want to use the Delegate in Linux (my compiled version works well with most TFlite networks, just not with the one I'm talking about in this bug repport).

About the link, I apoligize once more, I realize it wasn't shared publically, here's the link it works now: https://drive.google.com/file/d/13dJeJgs2l562YnOWph4lku650rzymUnA/view?usp=sharing

@federicoparra
Copy link
Author

Hi again,

Unfortunately, we have a restriction on not being able to download privately supplied models to us. Would the model you have supplied be available publically somewhere which would allow us to download and use it?

Regards, Cathal.

The network is publically available here https://huggingface.co/stabilityai/stablelm-2-zephyr-1_6b but it's a pytorch network.
Transforming it to tensorflow lite is not trivial. I can assure you that the tflite version I shared above (https://drive.google.com/file/d/13dJeJgs2l562YnOWph4lku650rzymUnA/view?usp=sharing) works perfectly fine when using it without the ARMNN delegate, and produces the exact same results as the pytorch original one.

@catcor01
Copy link
Collaborator

All release prebuilt binaries should have ExecuteNetwork included: for example, linux-aarch64 here: https://github.com/ARM-software/armnn/releases/download/v24.02/ArmNN-linux-aarch64.tar.gz

To manually build ArmNN, you can use the build tool (documentation here). Please use main as there were some recent changes to the build tool. I have just realized that the build-armnn.sh script does not include ExecuteNetwork in the output tar file. I am going to create a patch to fix this. In the meantime you should be able get ExecuteNetwork in the output source/ directory.

Regards, Cathal.

@catcor01
Copy link
Collaborator

Hello, I have created a patch that is currently in review to build ExecuteNetwork using the build-tool. Please feel free to use.

11282: Enable build of execute network in build tool. | https://review.mlplatform.org/c/ml/armnn/+/11282

MatthewARM pushed a commit that referenced this issue Mar 13, 2024
  * Help with issue #758

Signed-off-by: Cathal Corbett <[email protected]>
Change-Id: Ic9f4ff54e1e5a26b16c3d869815d09036ce5806c
@federicoparra
Copy link
Author

Hi! I was finally able to run the model with ExecuteNetwork, this is the output:

$ LD_LIBRARY_PATH=. ./ExecuteNetwork -c CpuAcc GpuAcc -m ../models/stablelm16fixed.tflite -T delegate > output_file.txt
INFO: TfLiteArmnnDelegate: Added backend CpuAcc
INFO: TfLiteArmnnDelegate: Created TfLite ArmNN delegate.
WARNING: ADD: not supported by armnn: in validate_arguments src/cpu/kernels/CpuAddKernel.cpp:114: ITensor data type S64 not supported by this kernel
ERROR: ADD: not supported by any specified backend
WARNING: COMPARISON: not supported by armnn: in validate_arguments src/cpu/kernels/CpuElementwiseKernel.cpp:488: ITensor data type S64 not supported by this kernel
ERROR: COMPARISON: not supported by any specified backend
WARNING: MINIMUM: not supported by armnn: in validate_arguments src/cpu/kernels/CpuElementwiseKernel.cpp:328: ITensor data type S64 not supported by this kernel
ERROR: MINIMUM: not supported by any specified backend
WARNING: MAXIMUM: not supported by armnn: in validate_arguments src/cpu/kernels/CpuElementwiseKernel.cpp:328: ITensor data type S64 not supported by this kernel
ERROR: MAXIMUM: not supported by any specified backend
WARNING: BROADCAST_TO: not supported by armnn
ERROR: BROADCAST_TO: not supported by any specified backend
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/NEON/kernels/NEGatherKernel.cpp:65: ITensor data type S64 not supported by this kernel
ERROR: GATHER: not supported by any specified backend
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/NEON/kernels/NEGatherKernel.cpp:65: ITensor data type S64 not supported by this kernel
ERROR: GATHER: not supported by any specified backend
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/NEON/kernels/NEGatherKernel.cpp:65: ITensor data type S64 not supported by this kernel
ERROR: GATHER: not supported by any specified backend
ERROR: Operator ADD [0] is not supported by armnn_delegate.
ERROR: Operator GATHER [36] is not supported by armnn_delegate.
ERROR: Operator MAXIMUM [55] is not supported by armnn_delegate.
ERROR: Operator MINIMUM [57] is not supported by armnn_delegate.
ERROR: Operator LESS [58] is not supported by armnn_delegate.
ERROR: Operator SELECT [64] is not supported by armnn_delegate.
ERROR: Operator SELECT_V2 [123] is not supported by armnn_delegate.
ERROR: Operator BROADCAST_TO [130] is not supported by armnn_delegate.
Warning: No input files provided, input tensors will be filled with 0s.
Info: ArmNN v33.1.0
arm_release_ver: g13p0-01eac0, rk_so_ver: 3
arm_release_ver of this libmali is 'g6p0-01eac0', rk_so_ver is '7'.
Info: Initialization time: 19.51 ms.
Info: ArmnnSubgraph creation
Info: Parse nodes to ArmNN time: 1751.37 ms
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: ConvertConstDequantisationLayersToConstLayersImpl::ReplaceConstDequantisationLayer()
Info: constantInfo datatype:Float16inputDequantizeInfo datatype:Float16outputDequantizeInfo datatype:Float32
Info: ConvertConstDequantisationLayersToConstLayersImpl:: Converting FP16 -> FP32
Info: Optimize ArmnnSubgraph time: 8591.94 ms
Error: An error occurred when preparing the network workloads: ReshapeQueueDescriptor: Tensor type is not supported.
Fatal: TfLiteArmnnDelegate: Exception (TfLiteArmnnDelegate: Network could not be loaded: An error occurred when preparing the network workloads: ReshapeQueueDescriptor: Tensor type is not supported.) caught from LoadNetwork.
Info: Shutdown time: 0.57 ms.

@federicoparra
Copy link
Author

changing the order of the backends (putting gpu first):

$ LD_LIBRARY_PATH=. ./ExecuteNetwork -c GpuAcc CpuAcc -m ../models/stablelm16fixed.tflite -T delegate
Warning: No input files provided, input tensors will be filled with 0s.
Info: ArmNN v33.1.0
arm_release_ver: g13p0-01eac0, rk_so_ver: 3
arm_release_ver of this libmali is 'g6p0-01eac0', rk_so_ver is '7'.
Info: Initialization time: 17.03 ms.
INFO: TfLiteArmnnDelegate: Added backend GpuAcc
INFO: TfLiteArmnnDelegate: Created TfLite ArmNN delegate.
WARNING: ADD: not supported by armnn: in validate_arguments_with_arithmetic_rules src/gpu/cl/kernels/ClElementwiseKernel.cpp:160: ITensor data type S64 not supported by this kernel
ERROR: ADD: not supported by any specified backend
WARNING: MINIMUM: not supported by armnn: in validate_arguments_with_arithmetic_rules src/gpu/cl/kernels/ClElementwiseKernel.cpp:160: ITensor data type S64 not supported by this kernel
ERROR: MINIMUM: not supported by any specified backend
WARNING: MAXIMUM: not supported by armnn: in validate_arguments_with_arithmetic_rules src/gpu/cl/kernels/ClElementwiseKernel.cpp:160: ITensor data type S64 not supported by this kernel
ERROR: MAXIMUM: not supported by any specified backend
WARNING: BROADCAST_TO: not supported by armnn
ERROR: BROADCAST_TO: not supported by any specified backend
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/CL/kernels/CLGatherKernel.cpp:58: ITensor data type S64 not supported by this kernel
ERROR: GATHER: not supported by any specified backend
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/CL/kernels/CLGatherKernel.cpp:58: ITensor data type S64 not supported by this kernel
ERROR: GATHER: not supported by any specified backend
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/CL/kernels/CLGatherKernel.cpp:58: ITensor data type S64 not supported by this kernel
ERROR: GATHER: not supported by any specified backend
ERROR: Operator ADD [0] is not supported by armnn_delegate.
ERROR: Operator GATHER [36] is not supported by armnn_delegate.
ERROR: Operator MAXIMUM [55] is not supported by armnn_delegate.
ERROR: Operator MINIMUM [57] is not supported by armnn_delegate.
ERROR: Operator SELECT [64] is not supported by armnn_delegate.
ERROR: Operator SELECT_V2 [123] is not supported by armnn_delegate.
ERROR: Operator BROADCAST_TO [130] is not supported by armnn_delegate.
Info: ArmnnSubgraph creation
WARNING: CONSTANT: not supported by armnn: Unsupported DataType
ERROR: CONSTANT: not supported by any specified backend
Fatal:
Info: Shutdown time: 0.56 ms.

@federicoparra
Copy link
Author

federicoparra commented Mar 17, 2024

@catcor01 @tracyn-arm Could it be simply that ARMNN delegate doesn't support constant inputs tensors?
This network is an LLM, as such it needs as inputs INT32 tensors (the tokens) and also outputs INT32 tensors.
Does ARMNN delegate support this?

@catcor01
Copy link
Collaborator

For GpuAcc: It looks constant is not supported (in ArmNN or the delegate) due to datatype but INT32 is one of the supported datatypes. I can see there are some INT64 operators in your model. I am wondering if any of your constant/inputs are INT64. I can see INT64 input is not supported here in ExecuteNetwork: https://github.com/ARM-software/armnn/blob/branches/armnn_24_02/tests/ExecuteNetwork/TfliteExecutor.cpp#L180. I am going to follow up with the team and check if it is on our radar to add INT64 in ExecuteNetwork.

Although the above statement seems to be conflicting because I would expect the same failure to happen in the first test but in that test the model seem to get parsed fine through the delegate. Running on only 1 backend might isolate the problem more. It may be that fallback from one backend to another is somehow allowing operators to get supported in the first case and not in the second.

@federicoparra
Copy link
Author

I went back and made sure that the model did not include any int64 input or operator; indeed there were, and I went ahead and modified it to make sure it exclusively uses int32, never int64.

This is the modified model: https://drive.google.com/file/d/1lLtmUjoTvvllNw6fR5Af0pct-agCJ3s5/view?usp=sharing

unfortunately this changed nothing:

Info: ArmNN v33.1.0
arm_release_ver: g13p0-01eac0, rk_so_ver: 3
arm_release_ver of this libmali is 'g6p0-01eac0', rk_so_ver is '7'.
Info: Initialization time: 19.57 ms.
Info: ArmnnSubgraph creation
INFO: TfLiteArmnnDelegate: Added backend GpuAcc
INFO: TfLiteArmnnDelegate: Added backend CpuAcc
INFO: TfLiteArmnnDelegate: Created TfLite ArmNN delegate.
WARNING: CAST: not supported by armnn: in validate_arguments src/gpu/cl/kernels/ClCastKernel.cpp:59: ITensor data type S64 not supported by this kernel
WARNING: ADD: not supported by armnn: in validate_arguments_with_arithmetic_rules src/gpu/cl/kernels/ClElementwiseKernel.cpp:160: ITensor data type S64 not supported by this kernel
WARNING: ADD: not supported by armnn: in validate_arguments src/cpu/kernels/CpuAddKernel.cpp:114: ITensor data type S64 not supported by this kernel
WARNING: MINIMUM: not supported by armnn: in validate_arguments_with_arithmetic_rules src/gpu/cl/kernels/ClElementwiseKernel.cpp:160: ITensor data type S64 not supported by this kernel
WARNING: MINIMUM: not supported by armnn: in validate_arguments src/cpu/kernels/CpuElementwiseKernel.cpp:328: ITensor data type S64 not supported by this kernel
WARNING: MAXIMUM: not supported by armnn: in validate_arguments_with_arithmetic_rules src/gpu/cl/kernels/ClElementwiseKernel.cpp:160: ITensor data type S64 not supported by this kernel
WARNING: MAXIMUM: not supported by armnn: in validate_arguments src/cpu/kernels/CpuElementwiseKernel.cpp:328: ITensor data type S64 not supported by this kernel
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/CL/kernels/CLGatherKernel.cpp:58: ITensor data type S64 not supported by this kernel
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/NEON/kernels/NEGatherKernel.cpp:65: ITensor data type S64 not supported by this kernel
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/CL/kernels/CLGatherKernel.cpp:58: ITensor data type S64 not supported by this kernel
WARNING: GATHER: not supported by armnn: in validate_arguments src/core/NEON/kernels/NEGatherKernel.cpp:65: ITensor data type S64 not supported by this kernel
WARNING: CONSTANT: not supported by armnn: Unsupported DataType
WARNING: CONSTANT: not supported by armnn: Unsupported DataType

So it is still saying CONSTANT not supported for INT32.

The same is true when using just one delegate (gpu or cpu) and the same is true when using ExecuteNetwork:

ExecuteNetwork -c GpuAcc -m ../wallE/stablelm16fixed.tflite -T delegate

Error: An error occurred when preparing the network workloads: StridedSliceQueueDescriptor: Tensor type is not supported.
Fatal: TfLiteArmnnDelegate: Exception (TfLiteArmnnDelegate: Network could not be loaded: An error occurred when preparing the network workloads: StridedSliceQueueDescriptor: Tensor type is not supported.) caught from LoadNetwork.
Info: Shutdown time: 2.09 ms.

@federicoparra
Copy link
Author

I also don't undertand all these warnings: isn't ARMNN supposed to be compatible with ALL ops, falling back to standard tensorflow lite implementation (i.e., CPU) when an op is not optimized ?

Please, do test the model and help me

@federicoparra
Copy link
Author

federicoparra commented Apr 2, 2024

As requested on #762 by @Colm-in-Arm here is the license statement for my TFLITE conversion of StableLm-2:

I want to assert here that the converted tflite model which is causing the bug described in this bug report and that can be downloaded from the following link https://drive.google.com/file/d/1lLtmUjoTvvllNw6fR5Af0pct-agCJ3s5/view?usp=sharing, which is based on https://huggingface.co/stabilityai/stablelm-2-zephyr-1_6b, was shared here under license CC BY-NC-SA 4.0

I hope this allows you to experiment with the model and hopefully find out why it doesn't load up using the ARMNN delegate (but does when using the interpreter without the delegate).

@Colm-in-Arm
Copy link
Collaborator

Hello Federico,

I tried this model - it's big! Very big!

I started with the changes I'd made for #762 , https://review.mlplatform.org/c/ml/armnn/+/11379

For CpuRef one additional change was required to get the model to execute:

diff --git a/src/backends/reference/RefLayerSupport.cpp b/src/backends/reference/RefLayerSupport.cpp
index 3e04a19df..b1fa83e83 100644
--- a/src/backends/reference/RefLayerSupport.cpp
+++ b/src/backends/reference/RefLayerSupport.cpp
@@ -862,8 +862,7 @@ bool RefLayerSupport::IsCastSupported(const TensorInfo& input,
DataType::QAsymmS8,
DataType::QAsymmU8,
DataType::QSymmS16,

  •            DataType::Signed32,
    
  •            DataType::Signed64
    
  •            DataType::Signed32
       };
    

    bool supported = true;

I'll have to see if this an appropriate change. We could instead fully implement the Signed64 Cast operation.

As the model file is so large I couldn't easily get it onto an Android device but I did try it on an aarch64 Ubuntu device. It failed in a StridedSlice layer. I'll investigate that next.

Colm.

@Colm-in-Arm Colm-in-Arm removed the TIME WAIT Waiting for an approppriate period for a response before closing the issue. label Apr 9, 2024
@Colm-in-Arm Colm-in-Arm self-assigned this Apr 9, 2024
@federicoparra
Copy link
Author

Amazing @Colm-in-Arm ! keep us posted if you get it to work past the StridedSlice layer error - I'll be using it in Ubuntu so I'm happy that's how you are testing it!

@Colm-in-Arm
Copy link
Collaborator

Hello Federico,

It only required one additional change to get past the StridedSlice error. However, as model loading continued it started consuming massive amounts of memory exceeding the 16Gb available on the device I was using resulting in a SIGKILL. This happened with both CpuAcc and CpuRef. I don't have access to a device with more memory. Do you?

The patch required to get it this is attached.
GitHub_758.txt

@federicoparra
Copy link
Author

federicoparra commented Apr 17, 2024

Hello Federico,

It only required one additional change to get past the StridedSlice error. However, as model loading continued it started consuming massive amounts of memory exceeding the 16Gb available on the device I was using resulting in a SIGKILL. This happened with both CpuAcc and CpuRef. I don't have access to a device with more memory. Do you?

The patch required to get it this is attached. GitHub_758.txt

@Colm-in-Arm

Hey! here you have the 8bit version https://drive.google.com/file/d/1uuuLCO_cD9cd2B06BnfAo0eq5KcJ0q_a/view?usp=sharing

I don't know why the 16 bit version takes up so much ram (in my own attempt just right now loading it in Google collab it took 13gb).

The 8bit version takes very little RAM.

As you posted on the other bug report, I'm assuming the 8bit versions of tflite models get accelerated by ARMNN correct? I wonder if the models run faster, or slower, compared to their 32bit counterparts?

Thank you!

@federicoparra
Copy link
Author

Update @Colm-in-Arm : the 8-bit version I just shared with you above, with the changes in your patch, does load ! I will be testing it in the next few days to see if inference work as expected but at least the model does load :)

@Colm-in-Arm Colm-in-Arm added the TIME WAIT Waiting for an approppriate period for a response before closing the issue. label Jun 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
TIME WAIT Waiting for an approppriate period for a response before closing the issue.
Projects
None yet
Development

No branches or pull requests

4 participants