[clang] [llvm] [Clang-Repl] Add support for out-of-process execution. (PR #110418)

Tue Nov 12 17:58:11 PST 2024

llvm-ci wrote:

LLVM Buildbot has detected a new failure on builder `sanitizer-aarch64-linux-bootstrap-ubsan` running on `sanitizer-buildbot10` while building `clang` at step 2 "annotate".

Full details are available at: https://lab.llvm.org/buildbot/#/builders/85/builds/2726

<details>
<summary>Here is the relevant piece of the build log for the reference</summary>

```
Step 2 (annotate) failure: 'python ../sanitizer_buildbot/sanitizers/zorg/buildbot/builders/sanitizers/buildbot_selector.py' (failure)
...
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/lld-link
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld.lld: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/ld.lld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/lld-link
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/main.py:72: note: The test suite configuration requested an individual test timeout of 0 seconds but a timeout of 900 seconds was requested on the command line. Forcing timeout to be 900 seconds.
-- Testing: 83688 tests, 48 workers --
Testing:  0.. 10
FAIL: Clang :: Interpreter/out-of-process.cpp (12606 of 83688)
******************** TEST 'Clang :: Interpreter/out-of-process.cpp' FAILED ********************
Exit Code: 2

Command Output (stderr):
--
RUN: at line 3: cat /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp | /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/clang-repl -oop-executor -orc-runtime | /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/FileCheck /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/clang-repl -oop-executor -orc-runtime
+ cat /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/FileCheck /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
clang-repl: No such file or directory
FileCheck error: '<stdin>' is empty.
FileCheck command line:  /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/FileCheck /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp

--

********************
Testing:  0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90.. 
Slowest Tests:
--------------------------------------------------------------------------
101.62s: Clang :: Driver/fsanitize.c
85.30s: Clang :: Preprocessor/riscv-target-features.c
81.31s: Clang :: OpenMP/target_update_codegen.cpp
79.37s: Clang :: Driver/arm-cortex-cpus-2.c
79.34s: Clang :: Driver/arm-cortex-cpus-1.c
79.32s: LLVM :: CodeGen/AMDGPU/memintrinsic-unroll.ll
76.40s: Clang :: OpenMP/target_defaultmap_codegen_01.cpp
66.53s: Clang :: Preprocessor/arm-target-features.c
66.40s: Clang :: Preprocessor/aarch64-target-features.c
65.24s: Clang :: Analysis/a_flaky_crash.cpp
58.17s: Clang :: Preprocessor/predefined-arch-macros.c
57.91s: Clang :: CodeGen/aarch64-sve-intrinsics/acle_sve_reinterpret.c
56.35s: Clang :: Driver/clang_f_opts.c
51.07s: Clang :: Driver/linux-ld.c
49.04s: Clang :: Driver/cl-options.c
43.91s: Clang :: CodeGen/X86/avx-builtins.c
43.77s: Clang :: CodeGen/X86/rot-intrinsics.c
43.59s: LLVM :: CodeGen/RISCV/attributes.ll
43.51s: Clang :: Preprocessor/predefined-macros-no-warnings.c
Step 10 (stage2/ubsan check) failure: stage2/ubsan check (failure)
...
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/lld-link
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld.lld: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/ld.lld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/lld-link
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/main.py:72: note: The test suite configuration requested an individual test timeout of 0 seconds but a timeout of 900 seconds was requested on the command line. Forcing timeout to be 900 seconds.
-- Testing: 83688 tests, 48 workers --
Testing:  0.. 10
FAIL: Clang :: Interpreter/out-of-process.cpp (12606 of 83688)
******************** TEST 'Clang :: Interpreter/out-of-process.cpp' FAILED ********************
Exit Code: 2

Command Output (stderr):
--
RUN: at line 3: cat /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp | /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/clang-repl -oop-executor -orc-runtime | /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/FileCheck /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/clang-repl -oop-executor -orc-runtime
+ cat /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/FileCheck /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
clang-repl: No such file or directory
FileCheck error: '<stdin>' is empty.
FileCheck command line:  /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/FileCheck /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp

--

********************
Testing:  0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90.. 
Slowest Tests:
--------------------------------------------------------------------------
101.62s: Clang :: Driver/fsanitize.c
85.30s: Clang :: Preprocessor/riscv-target-features.c
81.31s: Clang :: OpenMP/target_update_codegen.cpp
79.37s: Clang :: Driver/arm-cortex-cpus-2.c
79.34s: Clang :: Driver/arm-cortex-cpus-1.c
79.32s: LLVM :: CodeGen/AMDGPU/memintrinsic-unroll.ll
76.40s: Clang :: OpenMP/target_defaultmap_codegen_01.cpp
66.53s: Clang :: Preprocessor/arm-target-features.c
66.40s: Clang :: Preprocessor/aarch64-target-features.c
65.24s: Clang :: Analysis/a_flaky_crash.cpp
58.17s: Clang :: Preprocessor/predefined-arch-macros.c
57.91s: Clang :: CodeGen/aarch64-sve-intrinsics/acle_sve_reinterpret.c
56.35s: Clang :: Driver/clang_f_opts.c
51.07s: Clang :: Driver/linux-ld.c
49.04s: Clang :: Driver/cl-options.c
43.91s: Clang :: CodeGen/X86/avx-builtins.c
43.77s: Clang :: CodeGen/X86/rot-intrinsics.c
43.59s: LLVM :: CodeGen/RISCV/attributes.ll
43.51s: Clang :: Preprocessor/predefined-macros-no-warnings.c
Step 13 (stage3/ubsan check) failure: stage3/ubsan check (failure)
...
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/lld-link
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld.lld: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/ld.lld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/lld-link
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/main.py:72: note: The test suite configuration requested an individual test timeout of 0 seconds but a timeout of 900 seconds was requested on the command line. Forcing timeout to be 900 seconds.
-- Testing: 80986 tests, 48 workers --
Testing:  0.. 10
FAIL: Clang :: Interpreter/out-of-process.cpp (12604 of 80986)
******************** TEST 'Clang :: Interpreter/out-of-process.cpp' FAILED ********************
Exit Code: 2

Command Output (stderr):
--
RUN: at line 3: cat /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp | /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/clang-repl -oop-executor -orc-runtime | /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/FileCheck /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/FileCheck /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/clang-repl -oop-executor -orc-runtime
+ cat /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
clang-repl: No such file or directory
FileCheck error: '<stdin>' is empty.
FileCheck command line:  /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/FileCheck /home/b/sanitizer-aarch64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp

--

********************
Testing:  0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90.. 
Slowest Tests:
--------------------------------------------------------------------------
34.92s: Clang :: CodeGen/aarch64-sve-intrinsics/acle_sve_reinterpret.c
33.39s: Clang :: Driver/fsanitize.c
28.13s: Clang :: CodeGen/aarch64-sve-intrinsics/acle_sve_reinterpret-bfloat.c
28.08s: Clang :: Analysis/runtime-regression.c
27.58s: Clang :: Preprocessor/riscv-target-features.c
27.41s: Clang :: Headers/arm-neon-header.c
26.53s: Clang :: CodeGen/X86/rot-intrinsics.c
26.31s: Clang :: CodeGen/X86/avx-builtins.c
26.23s: LLVM :: CodeGen/AMDGPU/memintrinsic-unroll.ll
25.96s: Clang :: OpenMP/target_defaultmap_codegen_01.cpp
25.67s: Clang :: OpenMP/target_update_codegen.cpp
24.82s: LLVM :: tools/llvm-reduce/parallel-workitem-kill.ll
24.29s: Clang :: CodeGen/X86/sse2-builtins.c
24.02s: lit :: shtest-define.py
22.19s: Clang :: Driver/arm-cortex-cpus-1.c
22.15s: Clang :: Driver/arm-cortex-cpus-2.c
20.99s: Clang :: CodeGen/X86/mmx-builtins.c
20.59s: Clang :: CodeGen/X86/avx2-builtins.c
20.58s: Clang :: CodeGen/X86/fma-builtins-constrained.c

```

</details>

https://github.com/llvm/llvm-project/pull/110418