[llvm] [CAS] Add OnDiskGraphDB and OnDiskKeyValueDB (PR #114102)

Paul Osmialowski via llvm-commits llvm-commits at lists.llvm.org
Fri Oct 24 02:09:34 PDT 2025


pawosm-arm wrote:

The error log on RHEL10:

```
23:14:23  llvm-lit: /workspace/src/libcxx/utils/libcxx/test/config.py:24: note: (llvm-libunwind-static.cfg.in) Using %{cxx} substitution: '/workspace/build/stage/bootstrap_compiler/bin/clang++'
23:14:23  llvm-lit: /workspace/src/libcxx/utils/libcxx/test/config.py:24: note: (llvm-libunwind-static.cfg.in) Using %{flags} substitution: ' --target=aarch64-unknown-linux-gnu'
23:14:23  llvm-lit: /workspace/src/libcxx/utils/libcxx/test/config.py:24: note: (llvm-libunwind-static.cfg.in) Using %{compile_flags} substitution: '-nostdinc++ -I %{include} -funwind-tables -std=c++26 -Werror -Wall -Wctad-maybe-unsupported -Wextra -Wshadow -Wundef -Wunused-template -Wno-unused-command-line-argument -Wno-attributes -Wno-pessimizing-move -Wno-noexcept-type -Wno-atomic-alignment -Wno-reserved-module-identifier -Wdeprecated-copy -Wdeprecated-copy-dtor -Wshift-negative-value -Wno-user-defined-literals -Wno-tautological-compare -Wsign-compare -Wunused-variable -Wunused-parameter -Wunreachable-code -Wno-unused-local-typedef -Wno-local-type-template-args -Wno-c++11-extensions -Wno-unknown-pragmas -Wno-pass-failed -Wno-mismatched-new-delete -Wno-redundant-move -Wno-self-move -Wno-nullability-completeness -flax-vector-conversions=none -D_LIBCPP_HAS_NO_PRAGMA_SYSTEM_HEADER -Wuser-defined-warnings'
23:14:23  llvm-lit: /workspace/src/libcxx/utils/libcxx/test/config.py:24: note: (llvm-libunwind-static.cfg.in) Using %{link_flags} substitution: '%{lib}/libunwind.a -lpthread -Wl,--export-dynamic -ldl -latomic'
23:14:23  llvm-lit: /workspace/src/libcxx/utils/libcxx/test/config.py:24: note: (llvm-libunwind-static.cfg.in) Using %{benchmark_flags} substitution: ''
23:14:23  llvm-lit: /workspace/src/libcxx/utils/libcxx/test/config.py:24: note: (llvm-libunwind-static.cfg.in) Using %{exec} substitution: '%{executor} --execdir %{temp} -- '
23:14:23  llvm-lit: /workspace/src/libcxx/utils/libcxx/test/config.py:24: note: (llvm-libunwind-static.cfg.in) All available features: add-latomic-workaround, buildhost=linux, c++26, can-create-symlinks, character-conversion-warnings, clang, clang-22, clang-22.0, clang-22.0.0, diagnose-if-support, enable-benchmarks=run, gcc-style-warnings, glibc-old-ru_RU-decimal-point, has-fblocks, has-fconstexpr-steps, has-unix-headers, large_tests, libcpp-has-no-experimental-hardening-observe-semantic, libcpp-has-no-experimental-syncstream, libcpp-has-no-experimental-tzdb, libcpp-has-no-incomplete-pstl, linux, long_tests, objcopy-available, objective-c++, optimization=none, std-at-least-c++03, std-at-least-c++11, std-at-least-c++14, std-at-least-c++17, std-at-least-c++20, std-at-least-c++23, std-at-least-c++26, stdlib=libc++, stdlib=llvm-libc++, target=aarch64-unknown-linux-gnu, verify-support, win32-broken-utf8-wchar-ctype
23:14:24  llvm-lit: /workspace/src/llvm/utils/lit/lit/llvm/config.py:531: note: using ld.lld: /workspace/build/stage/bootstrap_compiler/bin/ld.lld
23:14:24  llvm-lit: /workspace/src/llvm/utils/lit/lit/llvm/config.py:531: note: using lld-link: /workspace/build/stage/bootstrap_compiler/bin/lld-link
23:14:24  llvm-lit: /workspace/src/llvm/utils/lit/lit/llvm/config.py:531: note: using ld64.lld: /workspace/build/stage/bootstrap_compiler/bin/ld64.lld
23:14:24  llvm-lit: /workspace/src/llvm/utils/lit/lit/llvm/config.py:531: note: using wasm-ld: /workspace/build/stage/bootstrap_compiler/bin/wasm-ld
23:14:25  -- Testing: 87987 tests, 64 workers --
23:15:37  Testing:  0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90
23:15:37  FAIL: LLVM-Unit :: CAS/./CASTests/1/22 (82348 of 87987)
23:15:37  ******************** TEST 'LLVM-Unit :: CAS/./CASTests/1/22' FAILED ********************
23:15:37  Script(shard):
23:15:37  --
23:15:37  GTEST_OUTPUT=json:/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests-LLVM-Unit-19360-1-22.json GTEST_SHUFFLE=0 GTEST_TOTAL_SHARDS=22 GTEST_SHARD_INDEX=1 /workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests
23:15:37  --
23:15:37  
23:15:37  Note: This is test shard 2 of 22.
23:15:37  [==========] Running 1 test from 1 test suite.
23:15:37  [----------] Global test environment set-up.
23:15:37  [----------] 1 test from OnDiskCASTest
23:15:37  [ RUN      ] OnDiskCASTest.OnDiskGraphDBFaultInSingleNode
23:15:37  Failure value returned from cantFail wrapped call
23:15:37  data record span passed the end of the data pool
23:15:37  UNREACHABLE executed at /workspace/src/llvm/include/llvm/Support/Error.h:810!
23:15:37   #0 0x00000000004673b0 llvm::sys::PrintStackTrace(llvm::raw_ostream&, int) (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x4673b0)
23:15:37   #1 0x0000000000464f98 SignalHandler(int, siginfo_t*, void*) Signals.cpp:0:0
23:15:37   #2 0x0000f3550d546968 (linux-vdso.so.1+0x968)
23:15:37   #3 0x0000f3550d06b880 __pthread_kill_implementation (/lib64/libc.so.6+0x8b880)
23:15:37   #4 0x0000f3550d01aa40 gsignal (/lib64/libc.so.6+0x3aa40)
23:15:37   #5 0x0000f3550d005988 abort (/lib64/libc.so.6+0x25988)
23:15:37   #6 0x000000000044ffac (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x44ffac)
23:15:37   #7 0x0000000000494684 getContentFromHandle(llvm::cas::OnDiskDataAllocator const&, llvm::cas::ondisk::ObjectHandle) OnDiskGraphDB.cpp:0:0
23:15:37   #8 0x000000000049477c llvm::cas::ondisk::OnDiskGraphDB::getObjectData(llvm::cas::ondisk::ObjectHandle) const (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x49477c)
23:15:37   #9 0x0000000000498e7c llvm::cas::ondisk::OnDiskGraphDB::importSingleNode(llvm::cas::ondisk::ObjectID, llvm::cas::ondisk::ObjectHandle) (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x498e7c)
23:15:37  #10 0x000000000049a224 llvm::cas::ondisk::OnDiskGraphDB::faultInFromUpstream(llvm::cas::ondisk::ObjectID) (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x49a224)
23:15:37  #11 0x0000000000499304 llvm::cas::ondisk::OnDiskGraphDB::load(llvm::cas::ondisk::ObjectID) (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x499304)
23:15:37  #12 0x0000000000426a6c OnDiskCASTest_OnDiskGraphDBFaultInSingleNode_Test::TestBody() (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x426a6c)
23:15:37  #13 0x00000000004b7b10 testing::Test::Run() (.part.0) gtest-all.cc:0:0
23:15:37  #14 0x00000000004be3b0 testing::TestInfo::Run() (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x4be3b0)
23:15:37  #15 0x00000000004c88c0 testing::TestSuite::Run() (.part.0) gtest-all.cc:0:0
23:15:37  #16 0x00000000004c93a4 testing::internal::UnitTestImpl::RunAllTests() (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x4c93a4)
23:15:37  #17 0x00000000004c993c testing::UnitTest::Run() (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x4c993c)
23:15:37  #18 0x0000000000408d70 main (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x408d70)
23:15:37  #19 0x0000f3550d00609c __libc_start_call_main (/lib64/libc.so.6+0x2609c)
23:15:37  #20 0x0000f3550d00617c __libc_start_main at GLIBC_2.17 (/lib64/libc.so.6+0x2617c)
23:15:37  #21 0x00000000004093f0 _start (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x4093f0)
23:15:37  
23:15:37  --
23:15:37  exit: -6
23:15:37  --
23:15:37  shard JSON output does not exist: /workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests-LLVM-Unit-19360-1-22.json
23:15:37  ********************
23:15:37  Testing:  0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90
23:15:37  FAIL: LLVM-Unit :: CAS/./CASTests/2/22 (82363 of 87987)
23:15:37  ******************** TEST 'LLVM-Unit :: CAS/./CASTests/2/22' FAILED ********************
23:15:37  Script(shard):
23:15:37  --
23:15:37  GTEST_OUTPUT=json:/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests-LLVM-Unit-19360-2-22.json GTEST_SHUFFLE=0 GTEST_TOTAL_SHARDS=22 GTEST_SHARD_INDEX=2 /workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests
23:15:37  --
23:15:37  
23:15:37  Note: This is test shard 3 of 22.
23:15:37  [==========] Running 1 test from 1 test suite.
23:15:37  [----------] Global test environment set-up.
23:15:37  [----------] 1 test from OnDiskCASTest
23:15:37  [ RUN      ] OnDiskCASTest.OnDiskGraphDBFaultInFullTree
23:15:37  Failure value returned from cantFail wrapped call
23:15:37  data record span passed the end of the data pool
23:15:37  UNREACHABLE executed at /workspace/src/llvm/include/llvm/Support/Error.h:810!
23:15:37   #0 0x00000000004673b0 llvm::sys::PrintStackTrace(llvm::raw_ostream&, int) (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x4673b0)
23:15:37   #1 0x0000000000464f98 SignalHandler(int, siginfo_t*, void*) Signals.cpp:0:0
23:15:37   #2 0x0000fa0cabe31968 (linux-vdso.so.1+0x968)
23:15:37   #3 0x0000fa0cab94b880 __pthread_kill_implementation (/lib64/libc.so.6+0x8b880)
23:15:37   #4 0x0000fa0cab8faa40 gsignal (/lib64/libc.so.6+0x3aa40)
23:15:37   #5 0x0000fa0cab8e5988 abort (/lib64/libc.so.6+0x25988)
23:15:37   #6 0x000000000044ffac (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x44ffac)
23:15:37   #7 0x0000000000494684 getContentFromHandle(llvm::cas::OnDiskDataAllocator const&, llvm::cas::ondisk::ObjectHandle) OnDiskGraphDB.cpp:0:0
23:15:37   #8 0x0000000000494858 llvm::cas::ondisk::OnDiskGraphDB::getInternalRefs(llvm::cas::ondisk::ObjectHandle) const (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x494858)
23:15:37   #9 0x0000000000494a44 llvm::cas::ondisk::OnDiskGraphDB::importFullTree(llvm::cas::ondisk::ObjectID, llvm::cas::ondisk::ObjectHandle)::'lambda'(llvm::cas::ondisk::ObjectID, std::optional<llvm::cas::ondisk::ObjectHandle>)::operator()(llvm::cas::ondisk::ObjectID, std::optional<llvm::cas::ondisk::ObjectHandle>) const (.isra.0) OnDiskGraphDB.cpp:0:0
23:15:37  #10 0x0000000000499a4c llvm::cas::ondisk::OnDiskGraphDB::importFullTree(llvm::cas::ondisk::ObjectID, llvm::cas::ondisk::ObjectHandle) (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x499a4c)
23:15:37  #11 0x000000000049a2f8 llvm::cas::ondisk::OnDiskGraphDB::faultInFromUpstream(llvm::cas::ondisk::ObjectID) (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x49a2f8)
23:15:37  #12 0x0000000000499304 llvm::cas::ondisk::OnDiskGraphDB::load(llvm::cas::ondisk::ObjectID) (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x499304)
23:15:37  #13 0x0000000000428bec OnDiskCASTest_OnDiskGraphDBFaultInFullTree_Test::TestBody() (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x428bec)
23:15:37  #14 0x00000000004b7b10 testing::Test::Run() (.part.0) gtest-all.cc:0:0
23:15:37  #15 0x00000000004be3b0 testing::TestInfo::Run() (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x4be3b0)
23:15:37  #16 0x00000000004c88c0 testing::TestSuite::Run() (.part.0) gtest-all.cc:0:0
23:15:37  #17 0x00000000004c93a4 testing::internal::UnitTestImpl::RunAllTests() (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x4c93a4)
23:15:37  #18 0x00000000004c993c testing::UnitTest::Run() (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x4c993c)
23:15:37  #19 0x0000000000408d70 main (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x408d70)
23:15:37  #20 0x0000fa0cab8e609c __libc_start_call_main (/lib64/libc.so.6+0x2609c)
23:15:37  #21 0x0000fa0cab8e617c __libc_start_main at GLIBC_2.17 (/lib64/libc.so.6+0x2617c)
23:15:37  #22 0x00000000004093f0 _start (/workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests+0x4093f0)
23:15:37  
23:15:37  --
23:15:37  exit: -6
23:15:37  --
23:15:37  shard JSON output does not exist: /workspace/build/stage/bootstrap_compiler/unittests/CAS/./CASTests-LLVM-Unit-19360-2-22.json
23:15:37  ********************
23:16:02  Testing:  0.. 10.. 20.. 30.. 40.. 50.. 60.. 70.. 80.. 90.. 
23:16:02  ********************
23:16:02  Failed Tests (2):
23:16:02    LLVM-Unit :: CAS/./CASTests/1/22
23:16:02    LLVM-Unit :: CAS/./CASTests/2/22
23:16:02  
23:16:02  
23:16:02  Testing Time: 95.25s
23:16:02  
23:16:02  Total Discovered Tests: 121755
23:16:02    Skipped          :   218 (0.18%)
23:16:02    Unsupported      : 44287 (36.37%)
23:16:02    Passed           : 77170 (63.38%)
23:16:02    Expectedly Failed:    78 (0.06%)
23:16:02    Failed           :     2 (0.00%)
23:16:02  FAILED: CMakeFiles/check-all /workspace/build/stage/bootstrap_compiler/CMakeFiles/check-all 
```

https://github.com/llvm/llvm-project/pull/114102


More information about the llvm-commits mailing list