[llvm] [MemProf] Use radix tree for alloc contexts in bitcode summaries (PR #117066)

Fri Nov 22 14:54:01 PST 2024

llvm-ci wrote:

LLVM Buildbot has detected a new failure on builder `flang-aarch64-libcxx` running on `linaro-flang-aarch64-libcxx` while building `llvm` at step 5 "build-unified-tree".

Full details are available at: https://lab.llvm.org/buildbot/#/builders/89/builds/11187

<details>
<summary>Here is the relevant piece of the build log for the reference</summary>

```
Step 5 (build-unified-tree) failure: build (failure)
...
42.832 [2561/15/4701] Creating library symlink lib/libMLIRShapeToStandard.so
42.833 [2561/14/4702] Creating library symlink lib/libMLIRTosaToSCF.so
42.833 [2561/13/4703] Creating library symlink lib/libMLIRTosaToTensor.so
42.833 [2561/12/4704] Creating library symlink lib/libMLIREmitCTransforms.so
42.840 [2561/11/4705] Linking CXX shared library lib/libMLIRXeGPUTransforms.so.20.0git
42.849 [2561/10/4706] Creating library symlink lib/libMLIRBufferizationTransforms.so
42.850 [2561/9/4707] Linking CXX shared library lib/libLLVMIRPrinter.so.20.0git
42.854 [2561/8/4708] Linking CXX shared library lib/libMLIRMeshTransforms.so.20.0git
42.878 [2561/7/4709] Linking CXX shared library lib/libLLVMFrontendAtomic.so.20.0git
42.902 [2551/16/4710] Linking CXX shared library lib/libLLVMBitWriter.so.20.0git
FAILED: lib/libLLVMBitWriter.so.20.0git 
: && /usr/local/bin/c++ -fPIC -stdlib=libc++ -fPIC -fno-semantic-interposition -fvisibility-inlines-hidden -Werror=date-time -Werror=unguarded-availability-new -Wall -Wextra -Wno-unused-parameter -Wwrite-strings -Wcast-qual -Wmissing-field-initializers -pedantic -Wno-long-long -Wc++98-compat-extra-semi -Wimplicit-fallthrough -Wcovered-switch-default -Wno-noexcept-type -Wnon-virtual-dtor -Wdelete-non-virtual-dtor -Wsuggest-override -Wstring-conversion -Wmisleading-indentation -Wctad-maybe-unsupported -fdiagnostics-color -ffunction-sections -fdata-sections -O3 -DNDEBUG  -stdlib=libc++ -Wl,-z,defs -Wl,-z,nodelete   -Wl,-rpath-link,/home/tcwg-buildbot/worker/flang-aarch64-libcxx/build/./lib  -Wl,--gc-sections -shared -Wl,-soname,libLLVMBitWriter.so.20.0git -o lib/libLLVMBitWriter.so.20.0git lib/Bitcode/Writer/CMakeFiles/LLVMBitWriter.dir/BitWriter.cpp.o lib/Bitcode/Writer/CMakeFiles/LLVMBitWriter.dir/BitcodeWriter.cpp.o lib/Bitcode/Writer/CMakeFiles/LLVMBitWriter.dir/BitcodeWriterPass.cpp.o lib/Bitcode/Writer/CMakeFiles/LLVMBitWriter.dir/ValueEnumerator.cpp.o  -Wl,-rpath,"\$ORIGIN/../lib:/home/tcwg-buildbot/worker/flang-aarch64-libcxx/build/lib:"  lib/libLLVMAnalysis.so.20.0git  lib/libLLVMObject.so.20.0git  lib/libLLVMCore.so.20.0git  lib/libLLVMMC.so.20.0git  lib/libLLVMTargetParser.so.20.0git  lib/libLLVMSupport.so.20.0git  -Wl,-rpath-link,/home/tcwg-buildbot/worker/flang-aarch64-libcxx/build/lib && :
/usr/bin/ld: lib/Bitcode/Writer/CMakeFiles/LLVMBitWriter.dir/BitcodeWriter.cpp.o: in function `writeMemoryProfileRadixTree(llvm::MapVector<unsigned long, llvm::SmallVector<unsigned int, 12u>, llvm::DenseMap<unsigned long, unsigned int, llvm::DenseMapInfo<unsigned long, void>, llvm::detail::DenseMapPair<unsigned long, unsigned int> >, llvm::SmallVector<std::__1::pair<unsigned long, llvm::SmallVector<unsigned int, 12u> >, 0u> >&&, llvm::BitstreamWriter&, unsigned int)':
BitcodeWriter.cpp:(.text._ZL27writeMemoryProfileRadixTreeON4llvm9MapVectorImNS_11SmallVectorIjLj12EEENS_8DenseMapImjNS_12DenseMapInfoImvEENS_6detail12DenseMapPairImjEEEENS1_INSt3__14pairImS2_EELj0EEEEERNS_15BitstreamWriterEj+0x34): undefined reference to `llvm::DenseMap<unsigned int, llvm::memprof::FrameStat, llvm::DenseMapInfo<unsigned int, void>, llvm::detail::DenseMapPair<unsigned int, llvm::memprof::FrameStat> > llvm::memprof::computeFrameHistogram<unsigned int>(llvm::MapVector<unsigned long, llvm::SmallVector<unsigned int, CalculateSmallVectorDefaultInlinedElements<unsigned int>::value>, llvm::DenseMap<unsigned long, unsigned int, llvm::DenseMapInfo<unsigned long, void>, llvm::detail::DenseMapPair<unsigned long, unsigned int> >, llvm::SmallVector<std::__1::pair<unsigned long, llvm::SmallVector<unsigned int, CalculateSmallVectorDefaultInlinedElements<unsigned int>::value> >, 0u> >&)'
/usr/bin/ld: BitcodeWriter.cpp:(.text._ZL27writeMemoryProfileRadixTreeON4llvm9MapVectorImNS_11SmallVectorIjLj12EEENS_8DenseMapImjNS_12DenseMapInfoImvEENS_6detail12DenseMapPairImjEEEENS1_INSt3__14pairImS2_EELj0EEEEERNS_15BitstreamWriterEj+0x68): undefined reference to `llvm::memprof::CallStackRadixTreeBuilder<unsigned int>::build(llvm::MapVector<unsigned long, llvm::SmallVector<unsigned int, 12u>, llvm::DenseMap<unsigned long, unsigned int, llvm::DenseMapInfo<unsigned long, void>, llvm::detail::DenseMapPair<unsigned long, unsigned int> >, llvm::SmallVector<std::__1::pair<unsigned long, llvm::SmallVector<unsigned int, 12u> >, 0u> >&&, std::__1::optional<llvm::DenseMap<unsigned int, unsigned int, llvm::DenseMapInfo<unsigned int, void>, llvm::detail::DenseMapPair<unsigned int, unsigned int> > const>, llvm::DenseMap<unsigned int, llvm::memprof::FrameStat, llvm::DenseMapInfo<unsigned int, void>, llvm::detail::DenseMapPair<unsigned int, llvm::memprof::FrameStat> >&)'
clang++: error: linker command failed with exit code 1 (use -v to see invocation)
42.902 [2551/15/4711] Creating library symlink lib/libLLVMIRPrinter.so
42.903 [2551/14/4712] Creating library symlink lib/libLLVMFrontendAtomic.so
42.903 [2551/13/4713] Creating library symlink lib/libMLIRLinalgDialect.so
42.903 [2551/12/4714] Creating library symlink lib/libMLIRMeshTransforms.so
42.912 [2551/11/4715] Creating library symlink lib/libMLIRNVGPUTransforms.so
42.922 [2551/10/4716] Linking CXX shared library lib/libLLVMFrontendDriver.so.20.0git
42.939 [2551/9/4717] Linking CXX shared library lib/libLLVMTarget.so.20.0git
42.952 [2551/8/4718] Creating library symlink lib/libMLIRMLProgramDialect.so
42.999 [2551/7/4719] Linking CXX shared library lib/libLLVMSandboxIR.so.20.0git
43.030 [2551/6/4720] Linking CXX shared library lib/libMLIRArithToEmitC.so.20.0git
43.037 [2551/5/4721] Linking CXX shared library lib/libMLIRControlFlowTransforms.so.20.0git
43.068 [2551/4/4722] Linking CXX shared library lib/libMLIRBufferizationToMemRef.so.20.0git
43.082 [2551/3/4723] Linking CXX shared library lib/libMLIRArithTransforms.so.20.0git
43.135 [2551/2/4724] Linking CXX shared library lib/libLLVMTransformUtils.so.20.0git
43.829 [2551/1/4725] Linking CXX shared library lib/libMLIRSPIRVDialect.so.20.0git
ninja: build stopped: subcommand failed.

```

</details>

https://github.com/llvm/llvm-project/pull/117066