<span style=" font-size:10pt;font-family:sans-serif">Hi Gabriele,</span><br><br><span style=" font-size:10pt;font-family:sans-serif">Did you set the
CUDA_VISIBLE_DEVICES env var?</span><br><span style=" font-size:10pt;font-family:sans-serif">If not you should
set it to: CUDA_VISIBLE_DEVICES=0,1,2,3</span><br><br><span style=" font-size:10pt;font-family:sans-serif">Which CUDA version
are you using? Any mismatch between the version used to build Clang and
the version used to compile/run the program will lead to such errors.</span><br><br><span style=" font-size:10pt;font-family:sans-serif">Are you compiling
and running your program on the same machine where you built Clang?</span><br><br><span style=" font-size:10pt;font-family:sans-serif">When building
Clang I see you have:</span><br><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">-DCLANG_OPENMP_NVPTX_DEFAULT_ARCH=sm_60</span></p><p style="margin-top:0px;margin-Bottom:0px"></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:10pt;font-family:sans-serif">you
should change that to:</span></p><p style="margin-top:0px;margin-Bottom:0px"></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">-DCLANG_OPENMP_NVPTX_DEFAULT_ARCH=sm_70</span></p><p style="margin-top:0px;margin-Bottom:0px"></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">for
the V100 GPUs.</span></p><p style="margin-top:0px;margin-Bottom:0px"></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">In
addition you should also use this flag to build Clang:</span></p><p style="margin-top:0px;margin-Bottom:0px"></p><br><span style=" font-size:12pt">-DLIBOMPTARGET_NVPTX_COMPUTE_CAPABILITIES=70</span><br><br><span style=" font-size:12pt">Here you can specify several compute
capabilities.</span><br><br><span style=" font-size:10pt;font-family:sans-serif">Thanks a lot,</span><br><br><span style=" font-size:10pt;font-family:sans-serif">--Doru</span><br><br><p style="margin-top:0px;margin-Bottom:0px"></p><br><br><br><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif">From:
</span><span style=" font-size:9pt;font-family:sans-serif">"Jost,
Gabriele (ARC-TNC)[Supersmith]" <gabriele.jost@nasa.gov></span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif">To:
</span><span style=" font-size:9pt;font-family:sans-serif">Gheorghe-Teod
Bercea <Gheorghe-Teod.Bercea@ibm.com></span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif">Cc:
</span><span style=" font-size:9pt;font-family:sans-serif">"openmp-dev@lists.llvm.org"
<openmp-dev@lists.llvm.org></span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif">Date:
</span><span style=" font-size:9pt;font-family:sans-serif">12/01/2019
04:42 PM</span><br><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif">Subject:
</span><span style=" font-size:9pt;font-family:sans-serif">Re:
[EXTERNAL] Re: [Openmp-dev] clang 9.0.0 + libstdc++ problem</span><br><hr noshade><br><br><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri">Hi
Doru and all,</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri">I
now have an install of clang + OpenMP target-offload using the old toolchain.</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri">The
benchmarks build, but when trying to run I get the following error:</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri">pfe25.gjost
89> more sp.A.out.txt</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri">libomptarget
fatal error 1: failure of target construct while offloading is mand</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri">atory</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri">I
am using a Skylake node with 4 V100 GPUs, using only one of the GPUs. Would
you have suggestions on how I can narrow down this issue? Should I rebuild
libomp in debug mode?</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri">Thanks
in advance and best regards,</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri">Gabriele
Jost</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt">************************************************************************</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt">Gabriele
Jost NASA Ames Research Center</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt">Email:
Gabriele.Jost@nasa.gov Mail Stop 258-6</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt">Work
Phone: (650) 604-0468 Bldg. 258, Rm. 232-4</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt">Scientific
& HPC Application P.O. Box 1</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt">Development/Optimization
Moffett Field, CA 94035-0001</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt">************************************************************************</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Calibri"><b>From:
</b>"Jost, Gabriele (ARC-TNC)[Supersmith]" <gabriele.jost@nasa.gov><b><br>Date: </b>Wednesday, November 27, 2019 at 1:08 PM<b><br>To: </b>Gheorghe-Teod Bercea <Gheorghe-Teod.Bercea@ibm.com><b><br>Cc: </b>"openmp-dev@lists.llvm.org" <openmp-dev@lists.llvm.org><b><br>Subject: </b>Re: [EXTERNAL] Re: [Openmp-dev] clang 9.0.0 + libstdc++ problem</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri">Thanks,
Doru.</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri">I
have for now installed as below. I will try what you suggested next week!</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri">Gabriele
Jost</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt">************************************************************************</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt">Gabriele
Jost NASA Ames Research Center</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt">Email:
Gabriele.Jost@nasa.gov Mail Stop 258-6</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt">Work
Phone: (650) 604-0468 Bldg. 258, Rm. 232-4</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt">Scientific
& HPC Application P.O. Box 1</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt">Development/Optimization
Moffett Field, CA 94035-0001</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt">************************************************************************</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt;font-family:Calibri"><b>From:
</b>Gheorghe-Teod Bercea <Gheorghe-Teod.Bercea@ibm.com><b><br>Date: </b>Wednesday, November 27, 2019 at 12:59 PM<b><br>To: </b>"Jost, Gabriele (ARC-TNC)[Supersmith]" <gabriele.jost@nasa.gov><b><br>Cc: </b>"openmp-dev@lists.llvm.org" <openmp-dev@lists.llvm.org><b><br>Subject: </b>[EXTERNAL] Re: [Openmp-dev] clang 9.0.0 + libstdc++ problem</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:10pt;font-family:Arial">Hi
Gabriele,</span><span style=" font-size:11pt;font-family:Calibri"><br></span><span style=" font-size:10pt;font-family:Arial"><br>You can set the -DGCC_INSTALL_PREFIX to point to the folder with the desired
version of GCC.</span><span style=" font-size:11pt;font-family:Calibri"><br></span><span style=" font-size:10pt;font-family:Arial"><br>The GCC folder you want to point to is the one containing the lib and include
folders. I use GCC 6.4.</span><span style=" font-size:11pt;font-family:Calibri"><br></span><span style=" font-size:10pt;font-family:Arial"><br>Thanks a lot,</span><span style=" font-size:11pt;font-family:Calibri"><br></span><span style=" font-size:10pt;font-family:Arial"><br>--Doru</span><span style=" font-size:11pt;font-family:Calibri"><br><br><br></span><span style=" font-size:10pt;font-family:Arial"><br></span><span style=" font-size:11pt;font-family:Calibri"><br><br><br><br></span><span style=" font-size:9pt;color:#5f5f5f;font-family:Arial"><br>From: </span><span style=" font-size:9pt;font-family:Arial">"Jost,
Gabriele \(ARC-TNC\)\[Supersmith\] via Openmp-dev" <openmp-dev@lists.llvm.org></span><span style=" font-size:9pt;color:#5f5f5f;font-family:Arial"><br>To: </span><span style=" font-size:9pt;font-family:Arial">"openmp-dev@lists.llvm.org"
<openmp-dev@lists.llvm.org></span><span style=" font-size:9pt;color:#5f5f5f;font-family:Arial"><br>Date: </span><span style=" font-size:9pt;font-family:Arial">11/27/2019
03:17 PM</span><span style=" font-size:9pt;color:#5f5f5f;font-family:Arial"><br>Subject: </span><span style=" font-size:9pt;font-family:Arial">[EXTERNAL]
[Openmp-dev] clang 9.0.0 + libstdc++ problem</span><span style=" font-size:9pt;color:#5f5f5f;font-family:Arial"><br>Sent by: </span><span style=" font-size:9pt;font-family:Arial">"Openmp-dev"
<openmp-dev-bounces@lists.llvm.org></span></p><div align=center><hr noshade></div><p style="margin-top:0px;margin-Bottom:240px"><span style=" font-size:11pt;font-family:Calibri"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">Hello
llvm developers!</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">I
am trying to build the OpenMP runtime with clang 9.0.0. The clang compiler
fails to find the libstdc++ library.</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">I
specified the pathname, but it does not help.</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">I
had to resort to configuring like this:</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">cmake
-DCMAKE_BUILD_TYPE=Release \</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">-DCMAKE_INSTALL_PREFIX="/nobackupnfs2/clang-install"\</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">-DCMAKE_C_COMPILER=/nobackupnfs2/clang-install/bin/clang\</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">-DCMAKE_CXX_COMPILER=/nobackupnfs2/clang-install/bin/clang++\</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">-DLIBOMPTARGET_DEP_LIBELF_LIBRARIES:FILEPATH=/usr/lib64/libelf.so.1
\</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">-DLLVM_LIBSTDCXX:FILEPATH=/usr/lib64/libstdc++.so.6\</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">-DLLVM_TEMPORARILY_ALLOW_OLD_TOOLCHAIN=ON\</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">-DCLANG_OPENMP_NVPTX_DEFAULT_ARCH=sm_60
\</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">-DLIBOMPTARGET_NVPTX_COMPUTE_CAPABILITIES=35,60,70
../llvm-9.0.0.src</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">Is
there a way to tell clang to use the correct library? It complains that
the library is too old, but I think it is because it does not find the
right one.</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">Gabriele
Jost</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt"> </span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">************************************************************************</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">Gabriele
Jost NASA Ames Research Center</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">Email:
Gabriele.Jost@nasa.gov Mail Stop 258-6</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">Work
Phone: (650) 604-0468 Bldg. 258, Rm. 232-4</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">Scientific
& HPC Application P.O. Box 1</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">Development/Optimization
Moffett Field, CA 94035-0001</span></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:12pt">************************************************************************</span><span style=" font-size:10pt;font-family:Courier New">_______________________________________________<br>Openmp-dev mailing list<br>Openmp-dev@lists.llvm.org</span><span style=" font-size:12pt;color:blue"><u><br></u></span><a href="https://lists.llvm.org/cgi-bin/mailman/listinfo/openmp-dev"><span style=" font-size:10pt;color:blue;font-family:Courier New"><u>https://lists.llvm.org/cgi-bin/mailman/listinfo/openmp-dev</u></span></a></p><p style="margin-top:0px;margin-Bottom:0px"><span style=" font-size:11pt;font-family:Calibri"><br><br></span></p><p style="margin-top:0px;margin-Bottom:0px"></p><p style="margin-top:0px;margin-Bottom:0px"></p><BR>