[all-commits] [llvm/llvm-project] 917dc9: [AMDGPU] Fix missed WMMA C-operand co-exec hazard

Petar Jovanovic via All-commits all-commits at lists.llvm.org
Mon Sep 28 04:36:39 PDT 2026


  Branch: refs/heads/users/petar-jovanovic/amdgpu-wmma-coexec-c-hazard
  Home:   https://github.com/llvm/llvm-project
  Commit: 917dc9ebfe13f6b9e57681283a5dc9b78df29a0a
      https://github.com/llvm/llvm-project/commit/917dc9ebfe13f6b9e57681283a5dc9b78df29a0a
  Author: Petar Jovanovic <petar.jovanovic at amd.com>
  Date:   2026-09-28 (Mon, 28 Sep 2026)

  Changed paths:
    M llvm/lib/Target/AMDGPU/GCNHazardRecognizer.cpp
    M llvm/test/CodeGen/AMDGPU/wmma-coexecution-valu-hazards.mir

  Log Message:
  -----------
  [AMDGPU] Fix missed WMMA C-operand co-exec hazard

The gfx1250 WMMA co-execution hazard check treats only A, B and the
SWMMAC index as registers the in-flight MMA still reads. C (src2 of a
non-SWMMAC WMMA) is missing, so a VALU scheduled into the MMA's shadow
can clobber C and the MMA consumes the new value.

This is latent while C is tied to vdst, since the existing D check then
covers it. It miscompiles where the tie does not hold: for
v_wmma_bf16f32_16x16x32_bf16, whose D is narrower than C, and for the
_threeaddr form of any WMMA.

Add src2 to the checked set for non-SWMMAC WMMAs.



To unsubscribe from these emails, change your notification settings at https://github.com/llvm/llvm-project/settings/notifications


More information about the All-commits mailing list