[all-commits] [llvm/llvm-project] c20c91: [AMDGPU] Fix missed WMMA C-operand co-exec hazard
Petar Jovanovic via All-commits
all-commits at lists.llvm.org
Tue Sep 29 00:15:09 PDT 2026
Branch: refs/heads/users/petar-jovanovic/amdgpu-wmma-coexec-c-hazard
Home: https://github.com/llvm/llvm-project
Commit: c20c91f49ecc1eb54547b6d1499bf0f7f505e2b8
https://github.com/llvm/llvm-project/commit/c20c91f49ecc1eb54547b6d1499bf0f7f505e2b8
Author: Petar Jovanovic <petar.jovanovic at amd.com>
Date: 2026-09-29 (Tue, 29 Sep 2026)
Changed paths:
M llvm/lib/Target/AMDGPU/GCNHazardRecognizer.cpp
M llvm/test/CodeGen/AMDGPU/wmma-coexecution-valu-hazards.mir
Log Message:
-----------
[AMDGPU] Fix missed WMMA C-operand co-exec hazard
The gfx1250 WMMA co-execution hazard check treats only A, B and the
SWMMAC index as registers the in-flight MMA still reads. C (src2 of a
non-SWMMAC WMMA) is missing, so a VALU scheduled into the MMA's shadow
can clobber C and the MMA consumes the new value.
This is latent while C is tied to vdst, since the existing D check then
covers it. It miscompiles where the tie does not hold: for
v_wmma_bf16f32_16x16x32_bf16, whose D is narrower than C, and for the
_threeaddr form of any WMMA.
Add src2 to the checked set for non-SWMMAC WMMAs.
To unsubscribe from these emails, change your notification settings at https://github.com/llvm/llvm-project/settings/notifications
More information about the All-commits
mailing list