Recent benchdnn matmul tolerence change is failing on aarch64 #2089
Labels
platform:cpu-aarch64
Codeowner: @oneapi-src/onednn-cpu-aarch64
sighting
Suspicious library behavior. Should be promoted to a bug when confirmed
Summary
The recent change introduced by a8b478b causes a failure on aarch64.
Version
oneDNN v3.7.0 (commit a8b478b)
Environment
flags:
fp asimd evtstrm aes pmull sha1 sha2 crc32 atomics fphp asimdhp cpuid asimdrdm jscvt fcma lrcpc dcpop sha3 sm3 sm4 asimddp sha512 sve asimdfhm dit uscat ilrcpc flagm ssbs paca pacg dcpodp svei8mm svebf16 i8mm bf16 dgh rng
linux-6.5.0 22.04.1-Ubuntu
gcc-10, g++10
3.22.1
CXX=g++-10 CC=gcc-10 cmake .. -DCMAKE_BUILD_TYPE=Debug -DDNNL_AARCH64_USE_ACL=1 -DDNNL_BUILD_FOR_CI=ON -DDNNL_TEST_SET=NIGHTLY -DCMAKE_EXPORT_COMPILE_COMMANDS=ON -DONEDNN_BUILD_GRAPH=0 -DDNNL_ENABLE_JIT_PROFILING=0 -DDNNL_OMP_RUNTIME=1
Steps to reproduce
Failure only appears in Release build.
ONEDNN_VERBOSE=all ./build/tests/benchdnn/benchdnn --matmul --skip-impl=ref --dt=s8:s8:f32 --stag=ab --wtag=ab --dtag=ab --bia_dt=u8 --attr-scales=src:common:0.25+dst:common:2.25+wei:common:0.5 --attr-zero-points=src:common:1+dst:common:2+wei:common:-1 --attr-post-ops=sum 1x30:30x20
Observed behavior
Expected behavior
The returned value of
0
seems reasonably close to the expected1.49012e-08
. Could you share the rational behind changing the threshold? Thank you.@dzarukin
The text was updated successfully, but these errors were encountered: