[PATCH] D78078: [lit] Add FILTERED test result category
Julian Lettner via Phabricator via llvm-commits
llvm-commits at lists.llvm.org
Tue Apr 21 15:44:31 PDT 2020
yln marked 2 inline comments as done.
yln added inline comments.
================
Comment at: llvm/utils/lit/tests/selecting.py:25
# CHECK-FILTER: Testing: 2 of 5 tests
+# CHECK-FILTER: Filtered Tests : 3
----------------
serge-sans-paille wrote:
> It's not a strong opinion, but seeing that, `Testing: 2 of 5 tests` already contains all the information, and `Filtered Tests : 3` looks redundant :-/
Note that with the status bar (`-sv`, which is the default if you do `ninja check-...`) the "Testing: x of y tests" header goes away when the status bar is cleared and the summary is printed. Without a status bar (e.g., in our CI runs) this header can be thousands of lines above the summary.
This line is also only printed if you filter your tests (`--filter`, `--max-tests`, sharding feature). It shouldn't "visually bother" you if you aren not filtering your tests.
In addition, it might not be very useful in the common case, but it might be *very* useful in cases where you are not aware that some filtering is going on (and your test suite passes, because you run less tests than intended).
Repository:
rG LLVM Github Monorepo
CHANGES SINCE LAST ACTION
https://reviews.llvm.org/D78078/new/
https://reviews.llvm.org/D78078
More information about the llvm-commits
mailing list