[PATCH] D107695: [llvm] [lit] Support forcing lexical test order

Wed Jun 29 17:16:59 PDT 2022

ychen added a comment.

In D107695#3620822 <https://reviews.llvm.org/D107695#3620822>, @dyung wrote:

> In D107695#3617159 <https://reviews.llvm.org/D107695#3617159>, @MatzeB wrote:
>
>> Hey, I don't know if this has anything to do with this change.
>>
>> But I see the "llvm-clang-x86_64-sie-win" buildbot (https://lab.llvm.org/buildbot/#/builders/216) failing the reorder.py testcase randomly every 10-20 builds.
>>
>> See https://lab.llvm.org/buildbot/#/builders/216 for the list of recent builds.
>>
>> I didn't look deeply into the root cause here, but thought it would be good to ping here in case anyone has an idea to get the bot more stable.
>
> I'm the owner of that buildbot, but unfortunately have not been able to get the failure to reproduce outside of the buildbot initiated build environment, so I haven't been able to really look into the issue. Any ideas how to possibly debug and/or fix the issue would be greatly appreciated as I've been a bit stuck on how to get it more stable!

It's kind of concerning that the test (reorder.py) writes to the source-controlled input file. I'm not sure if using a temporary directory to save intermediate files (like most other tests do) would fix the issue.
Alternatively, as the last resort, I'd suggest temporarily inserting some extra RUN lines in the test to help debug the random failure.

Repository:
  rG LLVM Github Monorepo

CHANGES SINCE LAST ACTION
  https://reviews.llvm.org/D107695/new/

https://reviews.llvm.org/D107695