<table border="1" cellspacing="0" cellpadding="8">
    <tr>
        <th>Issue</th>
        <td>
            <a href=https://github.com/llvm/llvm-project/issues/54154>54154</a>
        </td>
    </tr>

    <tr>
        <th>Summary</th>
        <td>
            check-all target runs much less regression tests if check-runtimes fails
        </td>
    </tr>

    <tr>
      <th>Labels</th>
      <td>
            cmake,
            regression
      </td>
    </tr>

    <tr>
      <th>Assignees</th>
      <td>
      </td>
    </tr>

    <tr>
      <th>Reporter</th>
      <td>
          DimitryAndric
      </td>
    </tr>
</table>

<pre>
    Now that releases via the `llvm/utils/release/test-release.sh` script are using `LLVM_ENABLE_RUNTIMES` for e.g. compiler-rt and libcxx, it turns out that the `check-all` target may run much less regression tests. This is most likely because `check-all` depends (via CMake's `add_dependencies()`) on `check-runtimes`, if runtimes are enabled. I.e., if `check-runtimes` results in any failure whatsoever, none of the other tests under `check-all` are even tried.

We might need to make `check-runtimes` failures not block the rest of `check-all` to run, or maybe splice all the tests from `check-runtimes` and `check-all` into one big bucket?

See also https://discourse.llvm.org/t/14-0-0-rc2-has-been-tagged/60621/3
</pre>
<img width="1px" height="1px" alt="" src="http://email.email.llvm.org/o/eJx9U8lu2zAQ_RrpMpAgS7YsH3RwNiBAkkOTtseAy0hiTYkGlyT--w5lx22aoLDMkTjbe49DbuShfTCv4AfmwaJG5tDBi2K0g5DUhdYvY1LeBK-0I3sKoTePzmenz9wNFApOWLX3wCxCcGrqY_7d3Y_75-uH7cXd9fO37w9Pt_fXjzG2MxYw73MQZtwrjTazlDlJ0IqLt7ekvATlwQc7OTDBHwGeMIkBxS5jWsdCntkePYzsADZMMAYxgEbniE1vySozQcTqcngalAN6RuM89dmhPgBHwYL7XFbiHifpICmbqMblPdsR67WLgUzK56MfJ6GQdGmSckMOWoHanWsRIK9GCoguItTB-84sEk6Ma5Q53OaYnwK-yiUqLmhP2CeS6AAdUzpQ_itp4gy-oI3Jk5kQTDeLZGixR9oQCKb9xG_u_4KkjVUEISmukmJ7XH8ijKofPEyIErwhbXf4NbATEkfNPXBtxG5uTzs-Qvl0ViYKEMHS6dOJcQS310ogUMCceYTcWTN-3TBOyL9V1UR1I3mueuBB7NAn1c3fjB4xdnAGBu_3Lqm2NL_0SOWECZbmN055bmwf55r-i2VW0M-KMhuYyzjilHnW9yjJWRd1uSBbpbKt5KbasNQrr7E9g3qfSQLu_jOQ8bg_Mpz1dGmwuv2ItFd-CDynu0IfpysZTba35heKiFk5F-Io3qyWi9UyHVoUC17zQix517Fu3dTrVb1uNiuUdVfwpks146hdm6wukrIU4zzgZTwcMn-wxr3VVarasijLoqJlsWiWZV4VsuqaoubrxXLTdCxZFjgS_LOWqW1niDz0jpxaxTt4djIq3tOAze2pPgt-MLa9UqPy9rCdpFUinTm1M6HfX4uLhQ">