<table border="1" cellspacing="0" cellpadding="8">
<tr>
<th>Issue</th>
<td>
<a href=https://github.com/llvm/llvm-project/issues/61761>61761</a>
</td>
</tr>
<tr>
<th>Summary</th>
<td>
Test test/tools/llvm-reduce/file-output-type.test is intermittently failing
</td>
</tr>
<tr>
<th>Labels</th>
<td>
new issue
</td>
</tr>
<tr>
<th>Assignees</th>
<td>
</td>
</tr>
<tr>
<th>Reporter</th>
<td>
max-quazan
</td>
</tr>
</table>
<pre>
I notited it often happening in our regular LLVM merge process with ~25% chance. It's very annoying, and it always passes on rerun. The failure looks like:
```
FAIL: LLVM :: tools/llvm-reduce/file-output-type.test (45893 of 47450)
******************** TEST 'LLVM :: tools/llvm-reduce/file-output-type.test' FAILED ********************
Script:
--
: 'RUN: at line 2'; rm -f reduced.ll reduced.bc
: 'RUN: at line 4'; /home/user/build/bin/llvm-as -o test-output-format.bc /builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/Inputs/test-output-format.ll
: 'RUN: at line 7'; llvm-reduce --delta-passes=instructions --test /home/user/build/bin/FileCheck --test-arg /builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/file-output-type.test --test-arg --input-file /builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/Inputs/test-output-format.ll
: 'RUN: at line 8'; /home/user/build/bin/llvm-as -disable-output reduced.ll
: 'RUN: at line 12'; rm -f reduced.ll reduced.bc
: 'RUN: at line 13'; llvm-reduce --delta-passes=instructions --test "/usr/local/bin/python3.6" --test-arg /builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/Inputs/llvm-dis-and-filecheck.py --test-arg /home/user/build/bin/llvm-dis --test-arg /home/user/build/bin/FileCheck --test-arg /builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/file-output-type.test test-output-format.bc
: 'RUN: at line 14'; /home/user/build/bin/llvm-dis -disable-output reduced.bc
: 'RUN: at line 18'; llvm-reduce --delta-passes=instructions -o /home/user/build/test/tools/llvm-reduce/Output/file-output-type.test.tmp.0.bc --test "/usr/local/bin/python3.6" --test-arg /builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/Inputs/llvm-dis-and-filecheck.py --test-arg /home/user/build/bin/llvm-dis --test-arg /home/user/build/bin/FileCheck --test-arg /builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/file-output-type.test test-output-format.bc
: 'RUN: at line 19'; /home/user/build/bin/llvm-dis -disable-output /home/user/build/test/tools/llvm-reduce/Output/file-output-type.test.tmp.0.bc
: 'RUN: at line 23'; rm -f reduced.ll reduced.bc
: 'RUN: at line 24'; llvm-reduce --delta-passes=instructions -o /home/user/build/test/tools/llvm-reduce/Output/file-output-type.test.tmp.0.ll --test "/usr/local/bin/python3.6" --test-arg /builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/Inputs/llvm-dis-and-filecheck.py --test-arg /home/user/build/bin/llvm-dis --test-arg /home/user/build/bin/FileCheck --test-arg /builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/file-output-type.test test-output-format.bc
: 'RUN: at line 25'; /home/user/build/bin/llvm-dis -disable-output /home/user/build/test/tools/llvm-reduce/Output/file-output-type.test.tmp.0.ll
: 'RUN: at line 29'; llvm-reduce -o /home/user/build/test/tools/llvm-reduce/Output/file-output-type.test.tmp.1.bc --delta-passes=instructions --test /home/user/build/bin/FileCheck --test-arg /builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/file-output-type.test --test-arg --input-file /builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/Inputs/test-output-format.ll
: 'RUN: at line 30'; /home/user/build/bin/llvm-as -disable-output /home/user/build/test/tools/llvm-reduce/Output/file-output-type.test.tmp.1.bc
: 'RUN: at line 34'; llvm-reduce -output-bitcode -o /home/user/build/test/tools/llvm-reduce/Output/file-output-type.test.tmp.2_no_suffix --delta-passes=instructions --test /home/user/build/bin/FileCheck --test-arg /builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/file-output-type.test --test-arg --input-file /builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/Inputs/test-output-format.ll
: 'RUN: at line 35'; /home/user/build/bin/llvm-dis -disable-output /home/user/build/test/tools/llvm-reduce/Output/file-output-type.test.tmp.2_no_suffix
: 'RUN: at line 39'; llvm-reduce -output-bitcode -o /home/user/build/test/tools/llvm-reduce/Output/file-output-type.test.tmp.2.ll --delta-passes=instructions --test /home/user/build/bin/FileCheck --test-arg /builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/file-output-type.test --test-arg --input-file /builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/Inputs/test-output-format.ll
: 'RUN: at line 40'; /home/user/build/bin/llvm-dis -disable-output /home/user/build/test/tools/llvm-reduce/Output/file-output-type.test.tmp.2.ll
: 'RUN: at line 44'; llvm-reduce -output-bitcode --delta-passes=instructions -o /home/user/build/test/tools/llvm-reduce/Output/file-output-type.test.tmp.3 --test /home/user/build/bin/FileCheck --test-arg --check-prefix=MIR --test-arg /builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/file-output-type.test --test-arg --input-file /builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/Inputs/test-output-format.mir
: 'RUN: at line 45'; /home/user/build/bin/llc -x mir -run-pass=none -o /dev/null /home/user/build/test/tools/llvm-reduce/Output/file-output-type.test.tmp.3
--
Exit Code: 1
Command Output (stderr):
--
*** Reducing Instructions...
/builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/file-output-type.test:48:10: error: CHECK: expected string not found in input
# CHECK: store i32 0
^
/tmp/lit-tmp-slhbp6p_/llvm-reduce-eb907c.ll:1:1: note: scanning from here
; ModuleID = '/builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/Inputs/test-output-format.ll'
^
/tmp/lit-tmp-slhbp6p_/llvm-reduce-eb907c.ll:4:23: note: possible intended match here
define void @foo(ptr %ptr) {
^
Input file: /tmp/lit-tmp-slhbp6p_/llvm-reduce-eb907c.ll
Check file: /builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/file-output-type.test
-dump-input=help explains the following input dump.
Input was:
<<<<<<
1: ; ModuleID = '/builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/Inputs/test-output-format.ll'
check:48'0 X~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ error: no match found
2: source_filename = "/builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/Inputs/test-output-format.ll"
check:48'0 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
3:
check:48'0 ~
4: define void @foo(ptr %ptr) {
check:48'0 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
check:48'1 ? possible intended match
5: ret void
check:48'0 ~~~~~~~~~~
6: }
check:48'0 ~~
>>>>>>
**** SUCCESS | Saved new best reduction to reduced.ll
/builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/file-output-type.test:48:10: error: CHECK: expected string not found in input
# CHECK: store i32 0
^
/tmp/lit-tmp-slhbp6p_/llvm-reduce-07fa69.ll:1:1: note: scanning from here
; ModuleID = '/builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/Inputs/test-output-format.ll'
^
/tmp/lit-tmp-slhbp6p_/llvm-reduce-07fa69.ll:4:23: note: possible intended match here
define void @foo(ptr %ptr) {
^
Input file: /tmp/lit-tmp-slhbp6p_/llvm-reduce-07fa69.ll
Check file: /builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/file-output-type.test
-dump-input=help explains the following input dump.
Input was:
<<<<<<
1: ; ModuleID = '/builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/Inputs/test-output-format.ll'
check:48'0 X~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ error: no match found
2: source_filename = "/builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/Inputs/test-output-format.ll"
check:48'0 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
3:
check:48'0 ~
4: define void @foo(ptr %ptr) {
check:48'0 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
check:48'1 ? possible intended match
5: ret void
check:48'0 ~~~~~~~~~~
6: }
check:48'0 ~~
>>>>>>
/builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/file-output-type.test:48:10: error: CHECK: expected string not found in input
# CHECK: store i32 0
^
/tmp/lit-tmp-slhbp6p_/llvm-reduce-1d185b.ll:1:1: note: scanning from here
; ModuleID = '/builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/Inputs/test-output-format.ll'
^
/tmp/lit-tmp-slhbp6p_/llvm-reduce-1d185b.ll:4:23: note: possible intended match here
define void @foo(ptr %ptr) {
^
Input file: /tmp/lit-tmp-slhbp6p_/llvm-reduce-1d185b.ll
Check file: /builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/file-output-type.test
-dump-input=help explains the following input dump.
Input was:
<<<<<<
1: ; ModuleID = '/builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/Inputs/test-output-format.ll'
check:48'0 X~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ error: no match found
2: source_filename = "/builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/Inputs/test-output-format.ll"
check:48'0 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
3:
check:48'0 ~
4: define void @foo(ptr %ptr) {
check:48'0 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
check:48'1 ? possible intended match
5: ret void
check:48'0 ~~~~~~~~~~
6: }
check:48'0 ~~
>>>>>>
----------------------------
*** Reducing Instructions...
/builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/file-output-type.test:48:10: error: CHECK: expected string not found in input
# CHECK: store i32 0
^
/tmp/lit-tmp-slhbp6p_/llvm-reduce-641f58.ll:1:1: note: scanning from here
; ModuleID = '/builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/Inputs/test-output-format.ll'
^
/tmp/lit-tmp-slhbp6p_/llvm-reduce-641f58.ll:4:23: note: possible intended match here
define void @foo(ptr %ptr) {
^
Input file: /tmp/lit-tmp-slhbp6p_/llvm-reduce-641f58.ll
Check file: /builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/file-output-type.test
-dump-input=help explains the following input dump.
Input was:
<<<<<<
1: ; ModuleID = '/builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/Inputs/test-output-format.ll'
check:48'0 X~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ error: no match found
2: source_filename = "/builds/dev/llvm-merge/llvm/test/tools/llvm-reduce/Inputs/test-output-format.ll"
check:48'0 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
3:
check:48'0 ~
4: define void @foo(ptr %ptr) {
check:48'0 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
check:48'1 ? possible intended match
5: ret void
check:48'0 ~~~~~~~~~~
6: }
check:48'0 ~~
>>>>>>
----------------------------
Done reducing! Reduced testcase: reduced.ll
/home/user/build/bin/llvm-as: reduced.ll:8:1: error: expected top-level entity
, ptr %ptr, align 4
^
--
********************
Testing: 0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90.
.
********************
Failed Tests (1):
LLVM :: tools/llvm-reduce/file-output-type.test
```
I don't understand what this test is doing. Can someone who knows this stuff please take a look?
</pre>
<img width="1px" height="1px" alt="" src="http://email.email.llvm.org/o/eJzsW9tu2zoW_Rr6ZUOCRNmS_eAH144xwbRzgCZnMG8FLVIWJxSpIalc5qHffkBKdtRcnObiNOiRoLK2K5Frba69F6sLMYZvJWNzNPmEJqsRaWyp9Lwi18H_GvJ_IkcbRW_mpyCV5ZZR4BZUYZmEktQ1k1xugUtQjQbNto0gGj5__vcXqJjeMqi1ypkxcMVtCd_xBOEJ5CWROQvh1CKcGbhk-gaIlOqGyy3CSyDSD0LEFbkxUBNjmAElQTPdyBDOSwYF4aLRDIRSFwYEv2AoWaBohaIFSqNu91_Xi9PPKFm0mNxByQKsUsIgvBbisgo0o03OEF4XXLBANbZubGBvahZaZiwgPB1PprMEVAHjbDyJEJ51A-GX73B-cnYOCGcvhIVwBo7ZyQpeA6MlcpZrXtt9AIOg45csHMKvf_7LfSIWBJcMMMIZSj4BgK4gKKDFSUMh9h83-aEOxvsOEF6XqnIcG8M0wutNwwV1f3O5CwMxEChwlHcxKJSuiA03OezOcDGj7HJ3ihde9wXhdRuu9cPBPZV1Y0131J0RhDhEI9vT6PUIQUCZsCRoRYuSFZfG6ia3XEkDQdBJ6iDvNRdsWbL8ojs-IHr7Flwf1ndvjCDg0vPngv3a4E6frRHKDdns-fVUeWiY-NVijpPXyAB7Wo6VUDkRe1b1jS2VTMIUYfzGItjPif-ZchMQSf2M505yYX1zZ8Ano0-5ecYp7yvuB-vGwfl8XnXy3B-R3hMDTV8iHPU4qoPR-cNDeyxMoa3qMHIVdVDmx1Xm7NXKPKp2Dq4ZktfWWbzLy4-SLEIMyfJxk8X9P-PjJsvhRQmePewMR5Rz3Nb-Yen6BkvXJHrt2vWo03wQ-vgR5bWdbbjNFT2uEvE3qb6Zpij49SDINxLkB66Fvek-SOGxkviOwmwdf1DkGyhy_LwS-b6KfAr7T9bIX7Y0TV6jwyDwy8eg1sylZLL6cvr1d9ZpxfXByX5G6cwhuIaKawh0I_28o2QlldyVpRa9bIQ44tz_eAH35JpbWCrKHKe4_W2pqopICn_s8mhqLGVaIzy7fwF4f7X6qwPB5RZOezIOw3B33HFUgZLFeIqSRRw5Akxrpd2H5T9Olv_0v1zXLLeMgrHagZPKQqEaSYFL8CLa4UtuTzJWaQY8wdDdIAA0OdnzsFXtsHEb2KoOjCg3dVp_-xFuwDazKMtdoUgWcffHDe7jbHIi_T2RQqsKSqbZTmGf4IuijWCnK0DJysnt-FUYZ93or-E4RskCJ32StTKGbwQDLi2TlFGoiM3LHl3KCpdBl4pTQOOoUArhaW01IDyprZMboOzT3RnwbMCJoU3I52JtJe6rWq-T44izTRXaVHVbsFCyKpmonSoF4dKALRkUSgh11d4ic9Tc4WGf6xUxt3eukuXdvY1Pb_Na-1VaghaP94g2OXEWwX--H3W7TXypOpn5JL8fG-zzTzU6Z9_cnElSsS48-B3Cgx8Oz3Gj025dLHyOPozCbd_vh8ylNvxcrh7o92loP5wVA0rWHYBHKsl9pBPPTTPb4XwazP0-Up882eqxidql4cndvStT_Ru4Z38ulydnZ4CyJZyRS0ZBsivYuMWMV4yzSLDq_p2ov5lZRllB0tnvbZZ9jh_dLG-xDmY5mOVgloNZ9oPyZmb5d7O5mMbTyeb3trk-x49uc7dYB5sbbG6wucHm-kF5M5sLDmzDRdRDBTodx8Vk-nsbZp_jRzfMW6yDYQ6GORjmYJj9oLyjYa6UZO1VU_86UNz6JqP-KcCcGF-QHriq-hOPWt05M1lMd8azT4-9HVpVB4JdMgFMWm5vduMsoT-pSyCCbyWM7zjEPfd_8cs558xYFwg3cVEYQuwa7JrENWPXTFyTuiZzzdQ1s6grkeHOH94I0JpwwSg4XAYQnsb9W8fw0vesOnQ_vrvV1XigSiKcWWgkZdpYIilclcSCLbnxsgBugCoutyEsiQSjKuZUdFUquJDqyrRHGtsUBdSCEcPAkgsGxL9A5hJpROcJnSUzMmLzOJ1GUTTNsvGonKc0Ged5immR03SaRlmczhjdzGKSbHCU4xGf4wgnUYKncRKlcRTm40mcEZJO09k03cRjNI5YRbgIXRhCpbcjbkzD5mmcpfFIkA0Txr98h7FkV-D_0RXbyWqk5z50m2Zr0DgS3Fhz24vlVrD5-e4B2Wc-ccGNrxa64tYyacWNf6eOy-2o0WJeWlt7T8VrhNdbbstmE-aquq3yfoxaq_-y3A3tUbuxPau_AgAA__8EbyjQ">