https://github.com/fabianmcg commented: In general LGTM! One NIT, GPU mma ops do not support masking, thus, the description of the PR should read simpler (no need to involve transposes, etc...), please fix that. https://github.com/llvm/llvm-project/pull/226732