[PATCH] D27690: [LV] Don't vectorize when we have a static bound on trip count

Michael Kuperstein via llvm-commits llvm-commits at lists.llvm.org
Tue Dec 13 11:17:42 PST 2016

> > b) Remainder loops for hand-vectorized code. These will also not be
> unrolled - the trip-count is unknown, and doesn't have a known multiple.
> (We may end up with runtime unrolling and yet another "remainder loop",
> which doesn't really improve things.) And, of course, it's almost always a
> bad idea to vectorize these. (The exception may be something like
> hand-vectorization by 16, with a scalar remainder loop. We may want to
> vectorize that remainder by 4 and leave a smaller scalar remainder, but
> that sounds like a very small win.)
> I agree, but I think we're going about this the wrong way. The cost of the
> branching and runtime checks need to be factored into the cost model (which
> will be relevant for low-trip-count loops), and that should naturally
> prevent this kind of messiness. Just not vectorizing low-trip-count loops
> is suboptimial because it will miss cases where vectorization is quite
> profitable.
You're completely right, but this isn't new - it's just that it's being
applied non-uniformly, depending on what exactly we know about the trip
count. That is, we do it "the wrong way" for loops with a known exact trip
count, and don't do it at all with loop with a known upper bound.

I want us to start treating all three cases (static exact, static bound,
dynamic) in the same way, by using the "right" number for the trip-count.
Using this number in a smarter way (by estimating the overhead cost, and
then dividing it by the trip-count to get the per-iteration cost*) is, I
think, orthogonal to actually getting the number right.

* Well, almost. For a loop with 7 iterations that we vectorize by 4, we
aren't really spreading the cost among "1.75" vectorized iterations, but
just the one. This is negligible for high trip counts, but the whole point
is to evaluate it correctly for the low case.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-commits/attachments/20161213/88636b49/attachment.html>

More information about the llvm-commits mailing list