[clang] [llvm] [Clang-Repl] Add support for out-of-process execution. (PR #110418)

Tue Nov 12 04:28:39 PST 2024

llvm-ci wrote:

LLVM Buildbot has detected a new failure on builder `sanitizer-x86_64-linux-bootstrap-msan` running on `sanitizer-buildbot5` while building `clang` at step 2 "annotate".

Full details are available at: https://lab.llvm.org/buildbot/#/builders/164/builds/4509

<details>
<summary>Here is the relevant piece of the build log for the reference</summary>

```
Step 2 (annotate) failure: 'python ../sanitizer_buildbot/sanitizers/zorg/buildbot/builders/sanitizers/buildbot_selector.py' (failure)
...
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/lld-link
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld.lld: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/ld.lld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/lld-link
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/main.py:72: note: The test suite configuration requested an individual test timeout of 0 seconds but a timeout of 900 seconds was requested on the command line. Forcing timeout to be 900 seconds.
-- Testing: 87077 tests, 88 workers --
Testing:  0.. 10
FAIL: Clang :: Interpreter/out-of-process.cpp (12578 of 87077)
******************** TEST 'Clang :: Interpreter/out-of-process.cpp' FAILED ********************
Exit Code: 2

Command Output (stderr):
--
RUN: at line 3: cat /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp | /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/clang-repl -oop-executor -orc-runtime | /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/FileCheck /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/clang-repl -oop-executor -orc-runtime
+ /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/FileCheck /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ cat /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
clang-repl: No such file or directory
FileCheck error: '<stdin>' is empty.
FileCheck command line:  /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/FileCheck /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp

--

********************
Testing:  0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90.. 
Slowest Tests:
--------------------------------------------------------------------------
152.64s: LLVM :: CodeGen/AMDGPU/memintrinsic-unroll.ll
144.10s: LLVM :: CodeGen/AMDGPU/sched-group-barrier-pipeline-solver.mir
86.24s: Clang :: Analysis/runtime-regression.c
63.93s: Clang :: CodeGen/aarch64-sve-intrinsics/acle_sve_reinterpret.c
56.88s: Clang :: CodeGen/aarch64-sve-intrinsics/acle_sve_reinterpret-bfloat.c
56.48s: LLVM :: MC/Mips/mips-jump-pc-region.s
50.45s: Clang :: Preprocessor/riscv-target-features.c
46.12s: Clang :: Driver/fsanitize.c
44.30s: Clang :: OpenMP/target_defaultmap_codegen_01.cpp
43.58s: LLVM :: CodeGen/X86/vector-interleaved-load-i8-stride-8.ll
42.91s: Clang :: OpenMP/target_update_codegen.cpp
42.58s: Clang :: CodeGen/X86/rot-intrinsics.c
41.96s: Clang :: CodeGen/X86/avx-builtins.c
41.85s: Clang :: CodeGen/X86/sse2-builtins.c
41.15s: LLVM :: CodeGen/RISCV/rvv/expandload.ll
34.33s: LLVM :: CodeGen/AMDGPU/flat_atomics_i64_system.ll
33.88s: LLVM :: CodeGen/X86/vector-interleaved-load-i16-stride-8.ll
33.46s: Clang :: Driver/arm-cortex-cpus-2.c
33.32s: Clang :: Driver/arm-cortex-cpus-1.c
Step 10 (stage2/msan check) failure: stage2/msan check (failure)
...
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/lld-link
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld.lld: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/ld.lld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/lld-link
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/main.py:72: note: The test suite configuration requested an individual test timeout of 0 seconds but a timeout of 900 seconds was requested on the command line. Forcing timeout to be 900 seconds.
-- Testing: 87077 tests, 88 workers --
Testing:  0.. 10
FAIL: Clang :: Interpreter/out-of-process.cpp (12578 of 87077)
******************** TEST 'Clang :: Interpreter/out-of-process.cpp' FAILED ********************
Exit Code: 2

Command Output (stderr):
--
RUN: at line 3: cat /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp | /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/clang-repl -oop-executor -orc-runtime | /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/FileCheck /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/clang-repl -oop-executor -orc-runtime
+ /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/FileCheck /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ cat /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
clang-repl: No such file or directory
FileCheck error: '<stdin>' is empty.
FileCheck command line:  /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build_msan/bin/FileCheck /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp

--

********************
Testing:  0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90.. 
Slowest Tests:
--------------------------------------------------------------------------
152.64s: LLVM :: CodeGen/AMDGPU/memintrinsic-unroll.ll
144.10s: LLVM :: CodeGen/AMDGPU/sched-group-barrier-pipeline-solver.mir
86.24s: Clang :: Analysis/runtime-regression.c
63.93s: Clang :: CodeGen/aarch64-sve-intrinsics/acle_sve_reinterpret.c
56.88s: Clang :: CodeGen/aarch64-sve-intrinsics/acle_sve_reinterpret-bfloat.c
56.48s: LLVM :: MC/Mips/mips-jump-pc-region.s
50.45s: Clang :: Preprocessor/riscv-target-features.c
46.12s: Clang :: Driver/fsanitize.c
44.30s: Clang :: OpenMP/target_defaultmap_codegen_01.cpp
43.58s: LLVM :: CodeGen/X86/vector-interleaved-load-i8-stride-8.ll
42.91s: Clang :: OpenMP/target_update_codegen.cpp
42.58s: Clang :: CodeGen/X86/rot-intrinsics.c
41.96s: Clang :: CodeGen/X86/avx-builtins.c
41.85s: Clang :: CodeGen/X86/sse2-builtins.c
41.15s: LLVM :: CodeGen/RISCV/rvv/expandload.ll
34.33s: LLVM :: CodeGen/AMDGPU/flat_atomics_i64_system.ll
33.88s: LLVM :: CodeGen/X86/vector-interleaved-load-i16-stride-8.ll
33.46s: Clang :: Driver/arm-cortex-cpus-2.c
33.32s: Clang :: Driver/arm-cortex-cpus-1.c
Step 13 (stage3/msan check) failure: stage3/msan check (failure)
...
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build2_msan/bin/lld-link
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build2_msan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build2_msan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld.lld: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build2_msan/bin/ld.lld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build2_msan/bin/lld-link
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build2_msan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build2_msan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/main.py:72: note: The test suite configuration requested an individual test timeout of 0 seconds but a timeout of 900 seconds was requested on the command line. Forcing timeout to be 900 seconds.
-- Testing: 84188 tests, 88 workers --
Testing:  0.. 10
FAIL: Clang :: Interpreter/out-of-process.cpp (12578 of 84188)
******************** TEST 'Clang :: Interpreter/out-of-process.cpp' FAILED ********************
Exit Code: 2

Command Output (stderr):
--
RUN: at line 3: cat /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp | /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build2_msan/bin/clang-repl -oop-executor -orc-runtime | /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build2_msan/bin/FileCheck /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ cat /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build2_msan/bin/clang-repl -oop-executor -orc-runtime
+ /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build2_msan/bin/FileCheck /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
clang-repl: No such file or directory
FileCheck error: '<stdin>' is empty.
FileCheck command line:  /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm_build2_msan/bin/FileCheck /home/b/sanitizer-x86_64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp

--

********************
Testing:  0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90.. 
Slowest Tests:
--------------------------------------------------------------------------
23.39s: LLVM :: tools/llvm-reduce/parallel-workitem-kill.ll
15.43s: LLVM :: CodeGen/AMDGPU/memintrinsic-unroll.ll
13.67s: Clang :: Analysis/runtime-regression.c
12.98s: Clang :: Driver/fsanitize.c
11.86s: LLVM :: CodeGen/AMDGPU/sched-group-barrier-pipeline-solver.mir
11.44s: Clang :: CodeGen/aarch64-sve-intrinsics/acle_sve_reinterpret.c
10.82s: Clang :: Preprocessor/riscv-target-features.c
10.01s: LLVM-Unit :: Support/./SupportTests/ProgramEnvTest/TestExecuteNoWaitDetached
9.69s: Clang :: OpenMP/target_update_codegen.cpp
9.39s: Clang :: OpenMP/target_defaultmap_codegen_01.cpp
9.11s: Clang :: CodeGen/aarch64-sve-intrinsics/acle_sve_reinterpret-bfloat.c
8.89s: Clang :: Driver/arm-cortex-cpus-2.c
8.82s: Clang :: Driver/arm-cortex-cpus-1.c
8.43s: lit :: shtest-define.py
7.81s: Clang :: Analysis/a_flaky_crash.cpp
7.79s: Clang :: OpenMP/target_teams_distribute_parallel_for_simd_codegen_registration.cpp
7.19s: LLVM :: CodeGen/X86/vector-interleaved-load-i8-stride-8.ll
7.18s: LLVM :: CodeGen/AMDGPU/llvm.amdgcn.permlane.ll
7.12s: LLVM :: MC/Mips/mips-jump-pc-region.s

```

</details>

https://github.com/llvm/llvm-project/pull/110418