[PATCH] D76288: [lit] Add builtin support for flaky tests in lit

[Reid Kleckner via Phabricator via llvm-commits]

rnk accepted this revision.
rnk added a subscriber: yln.
rnk added a comment.
This revision is now accepted and ready to land.

lgtm

As far as code ownership goes, I think @yln has been actively working on lit recently, and might be a good reviewer. I think @delcypher has moved on to other projects, but I can't speak for them.



================
Comment at: llvm/utils/lit/lit/TestRunner.py:1508
+    # Re-run failed tests up to test.allowed_retries times.
+    attempts = test.allowed_retries + 1
     for i in range(attempts):
----------------
I'm curious, do you find this logic of having one try and then adding N retries reasonable or confusing? I wasn't sure about it when I wrote it. Should the term "retry" be exclusive from the first try?


================
Comment at: llvm/utils/lit/tests/allow-retries.py:3
+
+# RUN: rm -f %t.counter
+# RUN: %{lit} -j 1 %{inputs}/allow-retries/succeeds-within-limit.py -Dcounter=%t.counter -Dpython=%{python} | FileCheck --check-prefix=CHECK-TEST1 %s
----------------
I see, cleaning up the counter file is taken care of at a higher level.


Repository:
  rG LLVM Github Monorepo

CHANGES SINCE LAST ACTION
  https://reviews.llvm.org/D76288/new/

https://reviews.llvm.org/D76288