[llvm] [SLP] Check for extracts, being replaced by original scalars, for user nodes (PR #149572)
Alexey Bataev via llvm-commits
llvm-commits at lists.llvm.org
Tue Aug 5 08:20:34 PDT 2025
================
@@ -9151,6 +9165,93 @@ getVectorCallCosts(CallInst *CI, FixedVectorType *VecTy,
return {IntrinsicCost, LibCost};
}
+/// Check if extracts are cheaper than the original scalars.
+static bool
+areExtractsCheaperThanScalars(TargetTransformInfo &TTI, Type *UserScalarTy,
+ VectorType *UserVecTy, const APInt &DemandedElts,
+ const InstructionCost UserScalarsCost,
+ Type *ScalarTy, unsigned VF, ArrayRef<int> Mask,
+ InstructionCost UserEntryCost) {
+ constexpr TTI::TargetCostKind CostKind = TTI::TCK_RecipThroughput;
+ // If extracts are cheaper than the original scalars - success.
+ InstructionCost ExtractCost =
+ ::getScalarizationOverhead(TTI, UserScalarTy, UserVecTy, DemandedElts,
+ /*Insert=*/false, /*Extract=*/true, CostKind);
+ if (ExtractCost <= UserScalarsCost)
+ return true;
+ // The node is profitable for vectorization - success.
+ if (ExtractCost <= UserEntryCost)
+ return true;
+ auto *VecTy = getWidenedType(ScalarTy, VF);
+ InstructionCost ScalarsCost =
+ ::getScalarizationOverhead(TTI, ScalarTy, VecTy, APInt::getAllOnes(VF),
+ /*Insert=*/true, /*Extract=*/false, CostKind);
+ if (!Mask.empty())
+ ScalarsCost +=
+ getShuffleCost(TTI, TTI::SK_PermuteSingleSrc, VecTy, Mask, CostKind);
+ return ExtractCost < UserScalarsCost + ScalarsCost;
----------------
alexey-bataev wrote:
The original logic is easier to understand:
1. If extract cheaper than scalarization - we can live with extracts.
2. If extracts are cheaper than the vectorization benefits - we can live with extracts.
These 2 checks are extracted from the extract-to-scalars analysis
3. Last shot. If extracts cheaper than scalarization of the user + its operands - still try to live with extracts, it will be more profitable
https://github.com/llvm/llvm-project/pull/149572
More information about the llvm-commits
mailing list