[Mlir-commits] [mlir] [MLIR][XeGPU] Lower vector.multi_reduction before linearization in XeGPUVectorLinearize (PR #190272)
Jianhui Li
llvmlistbot at llvm.org
Fri Apr 3 14:52:43 PDT 2026
================
@@ -51,6 +51,46 @@ struct XeGPUVectorLinearizePass final
return signalPassFailure();
}
+ // Lower vector.multi_reduction before linearization. Linearization flattens
+ // nD vectors to 1D, destroying axis information that multi_reduction relies
+ // on to know which elements to group together. By unrolling multi_reduction
+ // into row-wise shuffle + scalar reduction ops first, the IR contains only
+ // shape-agnostic ops by the time linearization runs.
+ //
+ // Two pattern sets are applied in order:
+ // 1. ReorderPatterns (InnerOuterDimReductionConversion): inserts
+ // vector.transpose to move all reduction dims to either the innermost
+ // or outermost positions. This normalizes arbitrary reductions into a
+ // canonical 2-D form that the unrolling patterns can handle.
+ // 2. UnrollingPatterns: with InnerParallel mode, the reduction dims are
+ // outermost, so the inner (parallel) dims are treated as rows and the
+ // outer loop is unrolled into a sequence of element-wise arith ops
+ // (TwoDimMultiReductionToElementWise). Any remaining 1-D
+ // multi_reduction is converted to vector.reduction
+ // (OneDimMultiReductionToReduction).
+ // Example: reduce 4x8 matrix along rows (dim 0):
+ // %0 = vector.multi_reduction <add>, %arg0, %acc [0]
----------------
Jianhui-Li wrote:
How come the source is 2D after sg distribution?
https://github.com/llvm/llvm-project/pull/190272
More information about the Mlir-commits
mailing list