Support cuTensor?

[wxj6000]

I haven't see the complete documentation of this project. But the binding for cuTensor is not found in the repo. I wonder if there is any plan for supporting general tensor contractions?

[leofang]

Hi @wxj6000 thanks for reaching out and opening the very first issue in this repo! 😄

cuTENSOR support is on our roadmap but there is no ETA yet. I am sure you are aware that both CuPy and cuQuantum Python support cuTENSOR. We would be very curious to learn what use cases that you have in mind are not already covered by these projects. It would help us prioritize for new features.

FYI, the documentation will be live next week.

[wxj6000]

@leofang Thanks. I was trying to understand the scope of the project and show my interest.

CuPy and cuQuantum Python do have the support for cuTensor. My collaborator and I am considering the kernel fusion of two tensor contraction kernels. For example,

c = contract('ijk,ko->ijo', a, b)
d = contract('ijo,ilo->jl', c, c)