https://github.com/krzysz00 requested changes to this pull request. Hold for semantics questions, and @llvm/pr-subscribers-mlir-nvgpu for input on Nvidia semantics while I wait on AMD answers https://github.com/llvm/llvm-project/pull/141965