[clang] [llvm] [Clang-Repl] Add support for out-of-process execution. (PR #110418)

Tue Nov 12 06:05:08 PST 2024

llvm-ci wrote:

LLVM Buildbot has detected a new failure on builder `sanitizer-x86_64-linux-bootstrap-ubsan` running on `sanitizer-buildbot3` while building `clang` at step 2 "annotate".

Full details are available at: https://lab.llvm.org/buildbot/#/builders/25/builds/4070

<details>
<summary>Here is the relevant piece of the build log for the reference</summary>

```
Step 2 (annotate) failure: 'python ../sanitizer_buildbot/sanitizers/zorg/buildbot/builders/sanitizers/buildbot_selector.py' (failure)
...
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/lld-link
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld.lld: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/ld.lld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/lld-link
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/main.py:72: note: The test suite configuration requested an individual test timeout of 0 seconds but a timeout of 900 seconds was requested on the command line. Forcing timeout to be 900 seconds.
-- Testing: 87080 tests, 88 workers --
Testing:  0.. 10
FAIL: Clang :: Interpreter/out-of-process.cpp (12572 of 87080)
******************** TEST 'Clang :: Interpreter/out-of-process.cpp' FAILED ********************
Exit Code: 2

Command Output (stderr):
--
RUN: at line 3: cat /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp | /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/clang-repl -oop-executor -orc-runtime | /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/FileCheck /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/clang-repl -oop-executor -orc-runtime
+ cat /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/FileCheck /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
clang-repl: No such file or directory
FileCheck error: '<stdin>' is empty.
FileCheck command line:  /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/FileCheck /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp

--

********************
Testing:  0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90.. 
Slowest Tests:
--------------------------------------------------------------------------
89.94s: Clang :: Driver/fsanitize.c
73.41s: Clang :: Preprocessor/riscv-target-features.c
70.46s: Clang :: OpenMP/target_defaultmap_codegen_01.cpp
68.64s: Clang :: Driver/arm-cortex-cpus-2.c
66.59s: Clang :: Driver/arm-cortex-cpus-1.c
63.89s: Clang :: OpenMP/target_update_codegen.cpp
62.22s: LLVM :: CodeGen/AMDGPU/memintrinsic-unroll.ll
53.48s: Clang :: Preprocessor/aarch64-target-features.c
53.15s: Clang :: Preprocessor/arm-target-features.c
50.51s: Clang :: Analysis/a_flaky_crash.cpp
47.67s: Clang :: Preprocessor/predefined-arch-macros.c
44.53s: Clang :: Driver/linux-ld.c
44.05s: Clang :: Driver/clang_f_opts.c
42.05s: Clang :: Driver/x86-target-features.c
41.87s: LLVM :: CodeGen/AMDGPU/sched-group-barrier-pipeline-solver.mir
41.03s: Clang :: CodeGen/aarch64-sve-intrinsics/acle_sve_reinterpret.c
40.65s: Clang :: Analysis/runtime-regression.c
40.06s: Clang :: Driver/cl-options.c
36.26s: Clang :: Preprocessor/predefined-macros-no-warnings.c
Step 10 (stage2/ubsan check) failure: stage2/ubsan check (failure)
...
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/lld-link
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld.lld: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/ld.lld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/lld-link
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/main.py:72: note: The test suite configuration requested an individual test timeout of 0 seconds but a timeout of 900 seconds was requested on the command line. Forcing timeout to be 900 seconds.
-- Testing: 87080 tests, 88 workers --
Testing:  0.. 10
FAIL: Clang :: Interpreter/out-of-process.cpp (12572 of 87080)
******************** TEST 'Clang :: Interpreter/out-of-process.cpp' FAILED ********************
Exit Code: 2

Command Output (stderr):
--
RUN: at line 3: cat /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp | /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/clang-repl -oop-executor -orc-runtime | /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/FileCheck /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/clang-repl -oop-executor -orc-runtime
+ cat /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/FileCheck /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
clang-repl: No such file or directory
FileCheck error: '<stdin>' is empty.
FileCheck command line:  /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build_ubsan/bin/FileCheck /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp

--

********************
Testing:  0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90.. 
Slowest Tests:
--------------------------------------------------------------------------
89.94s: Clang :: Driver/fsanitize.c
73.41s: Clang :: Preprocessor/riscv-target-features.c
70.46s: Clang :: OpenMP/target_defaultmap_codegen_01.cpp
68.64s: Clang :: Driver/arm-cortex-cpus-2.c
66.59s: Clang :: Driver/arm-cortex-cpus-1.c
63.89s: Clang :: OpenMP/target_update_codegen.cpp
62.22s: LLVM :: CodeGen/AMDGPU/memintrinsic-unroll.ll
53.48s: Clang :: Preprocessor/aarch64-target-features.c
53.15s: Clang :: Preprocessor/arm-target-features.c
50.51s: Clang :: Analysis/a_flaky_crash.cpp
47.67s: Clang :: Preprocessor/predefined-arch-macros.c
44.53s: Clang :: Driver/linux-ld.c
44.05s: Clang :: Driver/clang_f_opts.c
42.05s: Clang :: Driver/x86-target-features.c
41.87s: LLVM :: CodeGen/AMDGPU/sched-group-barrier-pipeline-solver.mir
41.03s: Clang :: CodeGen/aarch64-sve-intrinsics/acle_sve_reinterpret.c
40.65s: Clang :: Analysis/runtime-regression.c
40.06s: Clang :: Driver/cl-options.c
36.26s: Clang :: Preprocessor/predefined-macros-no-warnings.c
Step 13 (stage3/ubsan check) failure: stage3/ubsan check (failure)
...
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/lld-link
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld.lld: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/ld.lld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using lld-link: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/lld-link
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using ld64.lld: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/ld64.lld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/llvm/config.py:506: note: using wasm-ld: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/wasm-ld
llvm-lit: /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/llvm/utils/lit/lit/main.py:72: note: The test suite configuration requested an individual test timeout of 0 seconds but a timeout of 900 seconds was requested on the command line. Forcing timeout to be 900 seconds.
-- Testing: 84188 tests, 88 workers --
Testing:  0.. 10
FAIL: Clang :: Interpreter/out-of-process.cpp (12577 of 84188)
******************** TEST 'Clang :: Interpreter/out-of-process.cpp' FAILED ********************
Exit Code: 2

Command Output (stderr):
--
RUN: at line 3: cat /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp | /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/clang-repl -oop-executor -orc-runtime | /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/FileCheck /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/FileCheck /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
+ /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/clang-repl -oop-executor -orc-runtime
+ cat /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp
clang-repl: No such file or directory
FileCheck error: '<stdin>' is empty.
FileCheck command line:  /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm_build2_ubsan/bin/FileCheck /home/b/sanitizer-x86_64-linux-bootstrap-ubsan/build/llvm-project/clang/test/Interpreter/out-of-process.cpp

--

********************
Testing:  0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90.. 
Slowest Tests:
--------------------------------------------------------------------------
35.08s: Clang :: OpenMP/target_update_codegen.cpp
34.81s: Clang :: OpenMP/target_defaultmap_codegen_01.cpp
32.02s: lld :: COFF/incremental.test
31.75s: LLVM :: CodeGen/AMDGPU/memintrinsic-unroll.ll
30.53s: Clang :: Driver/fsanitize.c
29.71s: lld :: COFF/export.test
28.91s: lld :: COFF/debug-dwarf.test
27.07s: LLVM :: CodeGen/AMDGPU/sched-group-barrier-pipeline-solver.mir
26.29s: lld :: COFF/icf-simple.test
26.22s: lld :: COFF/functionpadmin.test
24.09s: lld :: COFF/export-all.s
23.73s: lld :: COFF/implib-name.test
23.71s: LLVM :: tools/llvm-reduce/parallel-workitem-kill.ll
23.19s: Clang :: OpenMP/target_parallel_for_codegen_registration.cpp
23.03s: Clang :: CodeGen/aarch64-sve-intrinsics/acle_sve_reinterpret.c
22.62s: lld :: COFF/dll.test
22.57s: lld :: COFF/lto-cache.ll
22.54s: Clang :: OpenMP/target_teams_distribute_parallel_for_simd_codegen_registration.cpp
22.42s: LLVM :: tools/llvm-readobj/ELF/AMDGPU/elf-headers.test

```

</details>

https://github.com/llvm/llvm-project/pull/110418