[llvm] [VPlan] Don't use the legacy cost model for loop conditions (PR #156864)
David Sherwood via llvm-commits
llvm-commits at lists.llvm.org
Wed Jun 3 02:53:09 PDT 2026
================
@@ -1288,20 +1288,30 @@ InstructionCost VPInstruction::computeCost(ElementCount VF,
return Ctx.TTI.getIndexedVectorInstrCostFromEnd(Instruction::ExtractElement,
VecTy, Ctx.CostKind, 0);
}
- case Instruction::FCmp:
- case Instruction::ICmp: {
- // FIXME: We don't handle scalar compares inside the loop here yet, as loop
- // exit conditions are handled by the legacy cost model and avoiding all
- // scalar compares is the simplest way to avoid double-counting compares
- // that compute the loop exit condition.
- bool IsScalar = vputils::onlyFirstLaneUsed(this);
- const VPRegionBlock *Region = getRegion();
- if (IsScalar && Region &&
- Region == Region->getPlan()->getVectorLoopRegion())
+ case VPInstruction::BranchOnCount: {
+ // If TC <= VF then this is just a branch.
+ // FIXME: Removing the branch happens in simplifyBranchConditionForVFAndUF
+ // where it checks TC <= VF * UF, but we don't know UF yet. This means in
+ // some cases we get a cost that's too high due to counting a cmp that
+ // later gets removed.
+ // FIXME: The compare could also be removed if TC = M * vscale,
+ // VF = N * vscale, and M <= N. Detecting that would require having the
+ // trip count as a SCEV though.
+ Value *TC = getParent()->getPlan()->getTripCount()->getUnderlyingValue();
+ ConstantInt *TCConst = dyn_cast_if_present<ConstantInt>(TC);
+ if (TCConst && TCConst->getValue().ule(VF.getKnownMinValue()))
return 0;
- return getCostForRecipeWithOpcode(
- getOpcode(), IsScalar ? ElementCount::getFixed(1) : VF, Ctx);
+ // Otherwise BranchOnCount generates ICmpEQ followed by a branch.
+ Type *ValTy = Ctx.Types.inferScalarType(getOperand(0));
----------------
david-arm wrote:
I think this PR probably needs a rebase, since `inferScalarType` doesn't exist in HEAD>
https://github.com/llvm/llvm-project/pull/156864
More information about the llvm-commits
mailing list