<table border="1" cellspacing="0" cellpadding="8">
    <tr>
        <th>Issue</th>
        <td>
            <a href=https://github.com/llvm/llvm-project/issues/87642>87642</a>
        </td>
    </tr>

    <tr>
        <th>Summary</th>
        <td>
            lit - test failures on LLVM 18.x on windows.
        </td>
    </tr>

    <tr>
      <th>Labels</th>
      <td>
            test-suite,
            llvm-lit
      </td>
    </tr>

    <tr>
      <th>Assignees</th>
      <td>
            jdenny-ornl
      </td>
    </tr>

    <tr>
      <th>Reporter</th>
      <td>
          tru
      </td>
    </tr>
</table>

<pre>
    I see the following LIT tests fail with LLVM 18 on Windows:

```
15:52:00   lit :: per-test-coverage-by-lit-cfg.py
15:52:00   lit :: per-test-coverage.py
15:52:00   lit :: shtest-external-shell-kill.py
15:52:00   lit :: shtest-format.py
15:52:00   lit :: shtest-run-at-line.py
```

This is the output for per-test-coverage.py:

```
FAIL: lit :: per-test-coverage.py (1 of 1)
******************** TEST 'lit :: per-test-coverage.py' FAILED ********************
Exit Code: 1

Command Output (stdout):
--
# RUN: at line 3
env -u FILECHECK_OPTS "c:\code\llvm\llvm.packageci\build\python-env\Scripts\python.exe" C:\code\llvm\llvm.packageci\git\llvm-project\llvm\utils\lit\lit.py -j1 --order=lexical -a -vv --per-test-coverage -Dexecute_external=False Inputs/per-test-coverage/per-test-coverage.py |    FileCheck -DOUT=stdout C:\code\llvm\llvm.packageci\build\llvm-final-windows\utils\lit\tests\per-test-coverage.py
# executed command: env -u FILECHECK_OPTS 'c:\code\llvm\llvm.packageci\build\python-env\Scripts\python.exe' 'C:\code\llvm\llvm.packageci\git\llvm-project\llvm\utils\lit\lit.py' -j1 --order=lexical -a -vv --per-test-coverage -Dexecute_external=False Inputs/per-test-coverage/per-test-coverage.py
# executed command: FileCheck -DOUT=stdout 'C:\code\llvm\llvm.packageci\build\llvm-final-windows\utils\lit\tests\per-test-coverage.py'
# RUN: at line 7
env -u FILECHECK_OPTS "c:\code\llvm\llvm.packageci\build\python-env\Scripts\python.exe" C:\code\llvm\llvm.packageci\git\llvm-project\llvm\utils\lit\lit.py -j1 --order=lexical -a -vv --per-test-coverage -Dexecute_external=True Inputs/per-test-coverage/per-test-coverage.py |    FileCheck -DOUT=stderr C:\code\llvm\llvm.packageci\build\llvm-final-windows\utils\lit\tests\per-test-coverage.py
# executed command: env -u FILECHECK_OPTS 'c:\code\llvm\llvm.packageci\build\python-env\Scripts\python.exe' 'C:\code\llvm\llvm.packageci\git\llvm-project\llvm\utils\lit\lit.py' -j1 --order=lexical -a -vv --per-test-coverage -Dexecute_external=True Inputs/per-test-coverage/per-test-coverage.py
# .---command stderr------------
# | lit.py: C:\code\llvm\llvm.packageci\git\llvm-project\llvm\utils\lit\lit\LitConfig.py:181: note: bash command failed: "c:\windows\system32\bash.exe" "-c" "[[ -f "c:\\windows\\system32\\bash.exe" ]]"
# | lit.py: C:\code\llvm\llvm.packageci\git\llvm-project\llvm\utils\lit\lit\LitConfig.py:187: warning: Unable to find a usable version of bash.
# `-----------------------------
# error: command failed with exit status: 1
# executed command: FileCheck -DOUT=stderr 'C:\code\llvm\llvm.packageci\build\llvm-final-windows\utils\lit\tests\per-test-coverage.py'
# .---command stderr------------
# | C:\code\llvm\llvm.packageci\build\llvm-final-windows\utils\lit\tests\per-test-coverage.py:11:10: error: CHECK: expected string not found in input
# | # CHECK: {{^}}PASS: per-test-coverage :: per-test-coverage.py ({{[^)]*}})
# |          ^
# | <stdin>:1:1: note: scanning from here
# | -- Testing: 1 tests, 1 workers --
# | ^
# | <stdin>:2:1: note: possible intended match here
# | FAIL: per-test-coverage :: per-test-coverage.py (1 of 1)
# | ^
# |
# | Input file: <stdin>
# | Check file: C:\code\llvm\llvm.packageci\build\llvm-final-windows\utils\lit\tests\per-test-coverage.py
# |
# | -dump-input=help explains the following input dump.
# |
# | Input was:
# | <<<<<<
# |             1: -- Testing: 1 tests, 1 workers --
# | check:11'0     X~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ error: no match found
# |             2: FAIL: per-test-coverage :: per-test-coverage.py (1 of 1)
# | check:11'0 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
# | check:11'1 ?                                                         possible intended match
# |             3: ******************** TEST 'per-test-coverage :: per-test-coverage.py' FAILED ********************
# | check:11'0 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
# |             4: Exit Code: 255
# | check:11'0     ~~~~~~~~~~~~~~~
# | 5:
# | check:11'0     ~
# |             6: Command Output (stdout):
# | check:11'0     ~~~~~~~~~~~~~~~~~~~~~~~~~
# | 7: --
# | check:11'0     ~~~
# |             .
# | .
# |             .
# | >>>>>>
# `-----------------------------
# error: command failed with exit status: 1
--
```

The other test failures looks similar. I know you did some work around this recently @jdenny-ornl - was the test not updated correctly ? I checked main as well but didn't see any changes in the test itself, but maybe I am missing something else in the setup?


</pre>
<img width="1px" height="1px" alt="" src="http://email.email.llvm.org/o/eJzsWU9z6roV_zRic0aMLeM4LFhwTZgyTXvfNNy2uzfCPsa6ERIjySFs-tk7kiH8CQSS5r10cTVOACEd_c7_cwS3VswV4oCk3whjP0tUak21UZIwRtJRhzeu1mbgTNOZ6XI9mIBFBFcjVFpKvRJqDveTKTi0zkLFhYSVcDXc3__zbxDfglbwL6FKvbIkGZJoRKLt_5to84SPcUqSYcpIMowiAJDCgd-QDGGJhnrqtNBPaPgc6WxNpXC0qObd5frd26_YY-uwA58dGsUltTVKSR-FlNdvrrRZcHf9etMoyh2VQu0QHsmo_T-thQVhgw5045aNg0qb03y-KfLxcHLvAVwQFhB2G4OuICasvyHEPv7A9O5hCoRll3TEMvAI70bwvxzXAr57Fg5yXaI_Ld6XSa4XC65K-N5KkrBb60rdOM_rVnqUbtlO4B8__u5pcAdeU5C036B6AtrAeHJ_l__lLv_r799_mz4AYazwRNK88EenuZRPi81Ld8mLRz7HQpA0nzVCliTNl2tXa0VRPZE0fyiMWDr7Mt3FZySMQX4Vyblwm2m6NPonFm63uHFCerqyXSO8lQL9GQOl2pRoSDKS-CwKLoFyoE9PQOkrFQEd4TMWjcPft35CktGYS4swUcvGWcLGr3admgs2luUAAGMhMa-xeAQ6-v5jSpJRq40rmd7KMbBdCe-6q03wOeY6xCsv27PhwWt7w2EJRWsmXvXndJ19uq4zT_WPUbcn_qUaf1vGZ-3gaoF8limw7KzvZ798_8ASpqb5bNdHY365_v-t639M4TsRdymlG-lCq2y6N3brvIVssCfDP8IHSJrfC5drVYl5e0p8G_uzlHahZJhxW28NIRS5GOxh5-Q7W7Nr63CRMK9vbuut5xLGaLF542vt9BvQao_AAY1DMseU0pF_GPtiAWX-rBU3Sqi5f_tD8ZlEcBoqoUrg0Ngw8YTGCq18BRnY2IN9E9G3xp4zGqONP-RQB22rgb64s467xu6Xd-9JLT7OfGlqeY8r_Lkok2HsXSGOQgDc6iGEvzDzvMTCi9g643tBpX070qgShALhY8MheP_6splk3_yT3pFsRLLRb8OHh5PtwKX2ZEsnkGL94B7DluZez5JsU007_NpDaEluXSkUSe48w5u_lxhgC668rUNl9AJqNHi4nVKYonUbb4jbjpiwHGJYafOIxsKxJi9AYMcQltpa4X1KKIeqxBIW3BX1CTDb3u7donzV6Z1GevhtyAFQCRlQ7jNxaLjB7bbLviivvwJPy2axpK2pJqMa5dIbteRC2aN7jrAG_PLuRWGs-N6Fx067x89p0wSAoPcPmFThZdw6LcuiQOrf_7k0dn6t9Makgg-fh8dCKP1kIzvCfhH2ufEG1RhIMoaPjjP-d15MSVslfMJtybtk_Kl3J5-tnQ-qcX_0POMHdzosTS_6wZvk01feeorCeUg3IaRdcZl0PcBzULM2NFxD7jzewwh2_PGNlSE1HT5_TkH3sv30pSiCdjWaECMDtcagBan1owUrFkJy04UJPCq9grVuoBQlWL3AEEmBm1CzuFpYMFigcnINpBftXYgD9UE9pIRwhq90mmXJ2_rSGCzCnmQMk1YbITwIBdzCCqWEmU8eolSEZS7conO1hqLmao7WV0svlIWzKCsf5_2WBV_PECbAF7AQ1vpE5HG72r9DaXG716JrliQZ78ulUw6Ssp_0eQcHcRYz1mNZP-vUg97NLE6qqqpmUZ_14h5jLImTIuFlesP6VdQRAxaxXtSLenEv7adpNyn7s7Ifl8UswrTXi0kvwgUXshtytjbzjrC2wcFtdtNjHclnKO3mZ4UQn2wjnG9gCMsJYyGf-7zd_sxgBmFi1swt6UVSWGd3dJ1wEgdSOKBH6tVq-0ND99l_2JQG3U5j5KB2bhmSMBsTNp4LVzezbqEXhI1DtdG-vHQ_bBzw-1Y2sPDfAAAA__9dhpnY">