[all-commits] [llvm/llvm-project] 9f89d3: [lldb][test] Mark gtest cases as XFAIL if the test...

[Kendal Harland via All-commits]

  Branch: refs/heads/main
  Home:   https://github.com/llvm/llvm-project
  Commit: 9f89d31d5185015f8eea9c0f3d35e7ba9d353e67
      https://github.com/llvm/llvm-project/commit/9f89d31d5185015f8eea9c0f3d35e7ba9d353e67
  Author: Kendal Harland <3987220+kendalharland at users.noreply.github.com>
  Date:   2024-08-16 (Fri, 16 Aug 2024)

  Changed paths:
    M llvm/utils/lit/lit/formats/googletest.py

  Log Message:
  -----------
  [lldb][test] Mark gtest cases as XFAIL if the test suite is XFAIL (#102986)

When a test case inside of a gtest suite fails, we report a failure
which causes the entire `ninja check-lldb` invocation to fail, even if
the outer test case is marked as XFAIL - each test case result is
reported as its own lit test run. This PR updates lit so it checks
whether each test case's parent test suite is XFAIL before setting the
status to FAIL.

This is especially problematic because the failing tests can't manually
be marked as XFAIL, due to
https://github.com/llvm/llvm-project/issues/102264.

Fixes https://github.com/llvm/llvm-project/issues/102265

### Repro instructions

1. Modify any gtest test case to generate a failure.
2. Mark the outer lit test with XFAIL using either `--xfail-tests` flag
or `LIT_XFAIL` env var.
3. Run the tests
4. Observe the lit test is XFAIL as expected, but the failed child test
cases show up as separate failures.

Co-authored-by: kendal <kendal at thebrowser.company>



To unsubscribe from these emails, change your notification settings at https://github.com/llvm/llvm-project/settings/notifications