[all-commits] [llvm/llvm-project] cbe42a: [lit] Add SKIPPED test result category

[Julian Lettner via All-commits]

  Branch: refs/heads/master
  Home:   https://github.com/llvm/llvm-project
  Commit: cbe42a9d5fa76eb56cbe615bd64cff2e6a8a9d65
      https://github.com/llvm/llvm-project/commit/cbe42a9d5fa76eb56cbe615bd64cff2e6a8a9d65
  Author: Julian Lettner <julian.lettner at gmail.com>
  Date:   2020-04-10 (Fri, 10 Apr 2020)

  Changed paths:
    M llvm/utils/lit/lit/Test.py
    M llvm/utils/lit/lit/main.py
    M llvm/utils/lit/lit/run.py
    A llvm/utils/lit/tests/Inputs/max-time/fast.txt
    A llvm/utils/lit/tests/Inputs/max-time/lit.cfg
    A llvm/utils/lit/tests/Inputs/max-time/slow.txt
    M llvm/utils/lit/tests/max-failures.py
    A llvm/utils/lit/tests/max-time.py

  Log Message:
  -----------
  [lit] Add SKIPPED test result category

Track and print the number of skipped tests.  Skipped tests are tests
that should have been executed but weren't due to:
  * user interrupt [Ctrl+C]
  * --max-time (overall lit timeout)
  * --max-failures

This is part of a larger effort to ensure that all discovered tests are
properly accounted for.

Add test for overall lit timeout feature (`--max-time` option) to
observe skipped tests.  Extend test for `--max-failures` option.

Reviewed By: jdenny

Differential Revision: https://reviews.llvm.org/D77819