[Openmp-dev] undefined reference to `cuDevicePri maryCtxSetFlags_v2

[Itaru Kitayama via Openmp-dev]

During my Spack build of llvm; spack install
llvm at master+cuda+omp_debug cuda_arch=60

I see an error below:


[ 19%] Linking CXX shared library ../../../../../lib/libomptarget.rtl.cuda.so
cd /tmp/c74014k/spack-stage/spack-stage-llvm-master-mltbsk3jqenb432mhtmj35kzln3j
hkgd/spack-build-mltbsk3/projects/openmp/libomptarget/plugins/cuda && /home/usr4
/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/cmake-3.1
8.4-badptdltaz5mv4ustly6b7uwqqfbhl6d/bin/cmake -E cmake_link_script CMakeFiles/o
mptarget.rtl.cuda.dir/link.txt --verbose=1
/home/usr4/c74014k/projects/spack/lib/spack/env/gcc/g++ -fPIC -std=c++11 -fPIC -
fvisibility-inlines-hidden -Werror=date-time -Wall -Wextra -Wno-unused-parameter
 -Wwrite-strings -Wcast-qual -Wno-missing-field-initializers -pedantic -Wno-long
-long -Wimplicit-fallthrough -Wno-maybe-uninitialized -Wno-class-memaccess -Wno-
redundant-move -Wno-noexcept-type -Wdelete-non-virtual-dtor -Wsuggest-override -
Wno-comment -ffunction-sections -fdata-sections -Wall -Wcast-qual -Wimplicit-fal
lthrough -Wsign-compare -Wno-extra -Wno-pedantic -Wno-maybe-uninitialized -std=g
nu++14 -O3 -DNDEBUG  -Wl,-z,defs -Wl,-z,nodelete -shared -Wl,-soname,libomptarge
t.rtl.cuda.so -o ../../../../../lib/libomptarget.rtl.cuda.so CMakeFiles/omptarge
t.rtl.cuda.dir/src/rtl.cpp.o  -Wl,-rpath,/home/usr4/c74014k/projects/spack/opt/s
pack/linux-rhel7-skylake_avx512/gcc-9.2.0/llvm-master-mltbsk3jqenb432mhtmj35kzln
3jhkgd/lib:/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx51
2/gcc-9.2.0/llvm-master-mltbsk3jqenb432mhtmj35kzln3jhkgd/lib64:/home/usr4/c74014
k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/binutils-2.35-3m
v4pivamhjchgilb2ddjzd5sa32mife/lib:/home/usr4/c74014k/projects/spack/opt/spack/l
inux-rhel7-skylake_avx512/gcc-9.2.0/gettext-0.21-jzxk7h66byfwb6a67ht3otnffsqc7rg
f/lib:/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc
-9.2.0/bzip2-1.0.8-sfff3gmddyhohnazndpjahorqcbawydk/lib:/home/usr4/c74014k/proje
cts/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/libiconv-1.16-2jop6oms2
nkxp4m6ocwigvwirt5l45mz/lib:/home/usr4/c74014k/projects/spack/opt/spack/linux-rh
el7-skylake_avx512/gcc-9.2.0/libxml2-2.9.10-6eowqiak3hjhpbag6hbmc5zvlm2feupw/lib
:/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.
0/xz-5.2.5-fm3loqpcrue3cs5anr2qbzql5wdgofpb/lib:/home/usr4/c74014k/projects/spac
k/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/zlib-1.2.11-3tf73445h7qjg2jagzw
py465s3oy5svv/lib:/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylak
e_avx512/gcc-9.2.0/ncurses-6.2-srkcdwf5osbc77viq73qr3yehktfe7yt/lib:/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/hwloc-2.2.0-e5lgxjj62kk66huloc25yzkrjo74sei2/lib:/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/libpciaccess-0.16-2m5w66g253ak7kybvni7uxfsn3lktisr/lib:/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/libedit-3.1-20191231-rbyrtene2owbwuiyccwq3tchzcz2chdv/lib:/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/libelf-0.8.13-23noufqx3idfewmywtaktcn7jzc5jjmr/lib:/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/libffi-3.3-h5lqxmpi54pptizdtbw6mw3elpzwpwc3/lib:/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/pcre-8.44-kodtymmgdketlimdkbhqtr3jxmfrm6dr/lib:/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/z3-4.8.7-px5o5njvu5lv23mvpoxfoda2jl36v2an/lib:/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/python-3.8.6-cfc57do4l72mm2z7ft4puiehpognfxc5/lib:/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/expat-2.2.9-folheje5clwvu7cj3p7xrj4jfytichq6/lib:/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/libbsd-0.10.0-2sd55x3kimooqmasydy4npxflf2rkezp/lib:/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/gdbm-1.18.1-quk7qsmdvfymwzblo5qqckl4xiy2xmif/lib:/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/readline-8.0-6haccr42yho5h5mvbhgid4d4zp6ppavm/lib:/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/libuuid-1.0.3-7juj5yf66ccoizbnsey67tqpueud4azm/lib:/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/openssl-1.1.1h-n6ids3v55t4q5uf2t46gabum2hqcvqwd/lib:/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/sqlite-3.33.0-bqgnewbs23g3xu3c6jzkkodsl5nswe5f/lib:/home/app/cuda/11.0/lib64:/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/libffi-3.3-h5lqxmpi54pptizdtbw6mw3elpzwpwc3/lib64
/usr/lib64/libcuda.so
/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/libelf-0.8.13-23noufqx3idfewmywtaktcn7jzc5jjmr/lib/libelf.so
-Wl,--version-script=/tmp/c74014k/spack-stage/spack-stage-llvm-master-mltbsk3jqenb432mhtmj35kzln3jhkgd/spack-src/openmp/libomptarget/plugins/cuda/../exports
/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/binutils-2.35-3mv4pivamhjchgilb2ddjzd5sa32mife/bin/ld:
CMakeFiles/omptarget.rtl.cuda.dir/src/rtl.cpp.o: in function
`(anonymous namespace)::DeviceRTLTy::~DeviceRTLTy()':
rtl.cpp:(.text._ZN12_GLOBAL__N_111DeviceRTLTyD2Ev+0x285): undefined
reference to `cuDevicePrimaryCtxRelease_v2'
/home/usr4/c74014k/projects/spack/opt/spack/linux-rhel7-skylake_avx512/gcc-9.2.0/binutils-2.35-3mv4pivamhjchgilb2ddjzd5sa32mife/bin/ld:
CMakeFiles/omptarget.rtl.cuda.dir/src/rtl.cpp.o: in function
`__tgt_rtl_init_device':
rtl.cpp:(.text.__tgt_rtl_init_device+0x118): undefined reference to
`cuDevicePrimaryCtxSetFlags_v2'
collect2: error: ld returned 1 exit status
make[2]: *** [lib/libomptarget.rtl.cuda.so] Error 1
make[2]: Leaving directory
`/tmp/c74014k/spack-stage/spack-stage-llvm-master-mltbsk3jqenb432mhtmj35kzln3jhkgd/spack-build-mltbsk3'
make[1]: *** [projects/openmp/libomptarget/plugins/cuda/CMakeFiles/omptarget.rtl.cuda.dir/all]
Error 2
make[1]: *** Waiting for unfinished jobs....