https://github.com/egebeysel approved this pull request. LGTM, thanks! I have a few questions regarding the masks and lowering to contractions directly, but we can leave them to different PRs. https://github.com/llvm/llvm-project/pull/208226