[clang] [llvm] [Clang-Repl] Add support for out-of-process execution. (PR #110418)

Wed Nov 13 04:30:43 PST 2024

llvm-ci wrote:

LLVM Buildbot has detected a new failure on builder `sanitizer-aarch64-linux-bootstrap-msan` running on `sanitizer-buildbot10` while building `clang` at step 2 "annotate".

Full details are available at: https://lab.llvm.org/buildbot/#/builders/94/builds/2344

<details>
<summary>Here is the relevant piece of the build log for the reference</summary>

```
Step 2 (annotate) failure: 'python ../sanitizer_buildbot/sanitizers/zorg/buildbot/builders/sanitizers/buildbot_selector.py' (failure)
...
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/lld-link
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld.lld: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/ld.lld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/lld-link
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/main.py:72: note: The test suite configuration requested an individual test timeout of 0 seconds but a timeout of 900 seconds was requested on the command line. Forcing timeout to be 900 seconds.
-- Testing: 83686 tests, 48 workers --
Testing:  0.. 10
FAIL: Clang :: Interpreter/out-of-process.cpp (12607 of 83686)
******************** TEST 'Clang :: Interpreter/out-of-process.cpp' FAILED ********************
Exit Code: 2

Command Output (stderr):
--
RUN: at line 3: cat /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp | /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/clang-repl -oop-executor -orc-runtime | /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/FileCheck /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/FileCheck /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/clang-repl -oop-executor -orc-runtime
+ cat /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
clang-repl: No such file or directory
FileCheck error: '<stdin>' is empty.
FileCheck command line:  /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/FileCheck /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp

--

********************
Testing:  0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90.. 
Slowest Tests:
--------------------------------------------------------------------------
177.25s: Clang :: Analysis/runtime-regression.c
175.74s: LLVM :: CodeGen/AMDGPU/memintrinsic-unroll.ll
150.37s: Clang :: CodeGen/X86/rot-intrinsics.c
143.15s: Clang :: CodeGen/X86/avx-builtins.c
136.93s: Clang :: CodeGen/X86/sse2-builtins.c
132.16s: Clang :: CodeGen/aarch64-sve-intrinsics/acle_sve_reinterpret.c
128.50s: LLVM :: CodeGen/AMDGPU/sched-group-barrier-pipeline-solver.mir
122.89s: Clang :: CodeGen/aarch64-sve-intrinsics/acle_sve_reinterpret-bfloat.c
107.64s: Clang :: CodeGen/X86/mmx-builtins.c
104.90s: Clang :: CodeGen/X86/avx2-builtins.c
104.67s: Clang :: CodeGen/X86/x86_64-xsave.c
102.65s: Clang :: CodeGen/X86/sse-builtins-constrained.c
101.98s: Clang :: CodeGen/X86/fma-builtins-constrained.c
101.72s: Clang :: Headers/arm-neon-header.c
100.65s: Clang :: CodeGen/X86/sse42-builtins.c
100.28s: Clang :: CodeGen/X86/sse41-builtins.c
87.49s: Clang :: CodeGen/X86/avx512f-builtins.c
82.29s: Clang :: CodeGen/X86/x86_32-xsave.c
77.73s: Clang :: CodeGen/PowerPC/ppc-smmintrin.c
Step 10 (stage2/msan check) failure: stage2/msan check (failure)
...
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/lld-link
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld.lld: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/ld.lld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/lld-link
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/main.py:72: note: The test suite configuration requested an individual test timeout of 0 seconds but a timeout of 900 seconds was requested on the command line. Forcing timeout to be 900 seconds.
-- Testing: 83686 tests, 48 workers --
Testing:  0.. 10
FAIL: Clang :: Interpreter/out-of-process.cpp (12607 of 83686)
******************** TEST 'Clang :: Interpreter/out-of-process.cpp' FAILED ********************
Exit Code: 2

Command Output (stderr):
--
RUN: at line 3: cat /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp | /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/clang-repl -oop-executor -orc-runtime | /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/FileCheck /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/FileCheck /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/clang-repl -oop-executor -orc-runtime
+ cat /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
clang-repl: No such file or directory
FileCheck error: '<stdin>' is empty.
FileCheck command line:  /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build_msan/bin/FileCheck /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp

--

********************
Testing:  0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90.. 
Slowest Tests:
--------------------------------------------------------------------------
177.25s: Clang :: Analysis/runtime-regression.c
175.74s: LLVM :: CodeGen/AMDGPU/memintrinsic-unroll.ll
150.37s: Clang :: CodeGen/X86/rot-intrinsics.c
143.15s: Clang :: CodeGen/X86/avx-builtins.c
136.93s: Clang :: CodeGen/X86/sse2-builtins.c
132.16s: Clang :: CodeGen/aarch64-sve-intrinsics/acle_sve_reinterpret.c
128.50s: LLVM :: CodeGen/AMDGPU/sched-group-barrier-pipeline-solver.mir
122.89s: Clang :: CodeGen/aarch64-sve-intrinsics/acle_sve_reinterpret-bfloat.c
107.64s: Clang :: CodeGen/X86/mmx-builtins.c
104.90s: Clang :: CodeGen/X86/avx2-builtins.c
104.67s: Clang :: CodeGen/X86/x86_64-xsave.c
102.65s: Clang :: CodeGen/X86/sse-builtins-constrained.c
101.98s: Clang :: CodeGen/X86/fma-builtins-constrained.c
101.72s: Clang :: Headers/arm-neon-header.c
100.65s: Clang :: CodeGen/X86/sse42-builtins.c
100.28s: Clang :: CodeGen/X86/sse41-builtins.c
87.49s: Clang :: CodeGen/X86/avx512f-builtins.c
82.29s: Clang :: CodeGen/X86/x86_32-xsave.c
77.73s: Clang :: CodeGen/PowerPC/ppc-smmintrin.c
Step 13 (stage3/msan check) failure: stage3/msan check (failure)
...
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build2_msan/bin/lld-link
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build2_msan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build2_msan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld.lld: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build2_msan/bin/ld.lld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build2_msan/bin/lld-link
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build2_msan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build2_msan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/llvm/utils/lit/lit/main.py:72: note: The test suite configuration requested an individual test timeout of 0 seconds but a timeout of 900 seconds was requested on the command line. Forcing timeout to be 900 seconds.
-- Testing: 80986 tests, 48 workers --
Testing:  0.. 10
FAIL: Clang :: Interpreter/out-of-process.cpp (12605 of 80986)
******************** TEST 'Clang :: Interpreter/out-of-process.cpp' FAILED ********************
Exit Code: 2

Command Output (stderr):
--
RUN: at line 3: cat /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp | /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build2_msan/bin/clang-repl -oop-executor -orc-runtime | /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build2_msan/bin/FileCheck /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build2_msan/bin/FileCheck /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build2_msan/bin/clang-repl -oop-executor -orc-runtime
+ cat /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
clang-repl: No such file or directory
FileCheck error: '<stdin>' is empty.
FileCheck command line:  /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm_build2_msan/bin/FileCheck /home/b/sanitizer-aarch64-linux-bootstrap-msan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp

--

********************
Testing:  0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90.. 
Slowest Tests:
--------------------------------------------------------------------------
33.44s: Clang :: CodeGen/aarch64-sve-intrinsics/acle_sve_reinterpret.c
32.02s: Clang :: Driver/fsanitize.c
29.81s: Clang :: CodeGen/aarch64-sve-intrinsics/acle_sve_reinterpret-bfloat.c
29.28s: Clang :: CodeGen/X86/rot-intrinsics.c
28.45s: Clang :: CodeGen/X86/avx-builtins.c
27.91s: Clang :: Headers/arm-neon-header.c
27.84s: Clang :: Analysis/runtime-regression.c
26.75s: LLVM :: CodeGen/AMDGPU/memintrinsic-unroll.ll
26.67s: Clang :: Preprocessor/riscv-target-features.c
26.29s: Clang :: CodeGen/X86/sse2-builtins.c
25.79s: Clang :: OpenMP/target_update_codegen.cpp
25.04s: Clang :: OpenMP/target_defaultmap_codegen_01.cpp
24.80s: LLVM :: tools/llvm-reduce/parallel-workitem-kill.ll
24.33s: lit :: shtest-define.py
22.32s: Clang :: Driver/arm-cortex-cpus-2.c
21.34s: Clang :: Driver/arm-cortex-cpus-1.c
21.20s: Clang :: CodeGen/X86/avx2-builtins.c
20.17s: Clang :: CodeGen/X86/x86_64-xsave.c
19.98s: Clang :: CodeGen/X86/fma-builtins-constrained.c

```

</details>

https://github.com/llvm/llvm-project/pull/110418