[all-commits] [llvm/llvm-project] 968f58: [lit] Include unexecuted tests in xUnit report

[Julian Lettner via All-commits]

  Branch: refs/heads/master
  Home:   https://github.com/llvm/llvm-project
  Commit: 968f58c68421bd18f09754bf11135803243a0226
      https://github.com/llvm/llvm-project/commit/968f58c68421bd18f09754bf11135803243a0226
  Author: Julian Lettner <julian.lettner at apple.com>
  Date:   2020-06-15 (Mon, 15 Jun 2020)

  Changed paths:
    M llvm/utils/lit/lit/main.py
    M llvm/utils/lit/lit/reports.py
    M llvm/utils/lit/tests/Inputs/xunit-output/dummy_format.py
    A llvm/utils/lit/tests/Inputs/xunit-output/excluded.ini
    A llvm/utils/lit/tests/Inputs/xunit-output/missing_feature.ini
    A llvm/utils/lit/tests/Inputs/xunit-output/pass.ini
    A llvm/utils/lit/tests/Inputs/xunit-output/unsupported.ini
    M llvm/utils/lit/tests/shtest-format.py
    M llvm/utils/lit/tests/xunit-output.py

  Log Message:
  -----------
  [lit] Include unexecuted tests in xUnit report

Pass in all discovered tests to report generators.

The XunitReport generator now creates testcase items for unexecuted
tests and documents why they have been skipped.  This makes it easier
to compare test runs with different filters or configurations, or across
platforms.

I don't know who is using the JsonReport generator and what the
expectations there are (it doesn't have tests), so decided to preserve
the old behavior by filtering out the unexecuted tests.

Reviewed By: jdenny

Differential Revision: https://reviews.llvm.org/D81316