<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div class=""><div><br class=""><blockquote type="cite" class=""><div class="">On 27 Oct 2020, at 15:00, Kelvin Li <<a href="mailto:kli@ca.ibm.com" class="">kli@ca.ibm.com</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><span style=" font-size:10pt;font-family:sans-serif" class="">I don't think that
is the case.  There is only one task "-np 1" on one node.
 Both './a.out' and 'mpirun -np 1 ./a.out' are issued on the same
node which has the same library in /home/kli/clang-install/lib.  That
is puzzling me!<br class=""><br class=""></span></div></blockquote>It really looks as if you’re getting two different versions of the runtime, though, so having the runtime tell you its properties is still likely useful.<div class="">If nothing else, it may show up that you’re not propagating envirables as you might have hoped (if the MPI version doesn’t print anything !)<br class=""><div><br class=""></div><div>-- Jim<br class="">James Cownie <<a href="mailto:jcownie@gmail.com" class="">jcownie@gmail.com</a>><br class="">Mob: +44 780 637 7146</div></div><blockquote type="cite" class=""><div class=""><span style=" font-size:10pt;font-family:sans-serif" class="">Kelvin<br class=""></span><br class=""><br class=""><br class=""><br class=""><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif" class="">From:
       </span><span style=" font-size:9pt;font-family:sans-serif" class="">Jim
Cownie via Openmp-dev <<a href="mailto:openmp-dev@lists.llvm.org" class="">openmp-dev@lists.llvm.org</a>></span><br class=""><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif" class="">To:
       </span><span style=" font-size:9pt;font-family:sans-serif" class="">via
Openmp-dev <<a href="mailto:openmp-dev@lists.llvm.org" class="">openmp-dev@lists.llvm.org</a>>, <a href="mailto:openmp-dev-request@lists.llvm.org" class="">openmp-dev-request@lists.llvm.org</a></span><br class=""><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif" class="">Date:
       </span><span style=" font-size:9pt;font-family:sans-serif" class="">2020/10/27
04:46 AM</span><br class=""><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif" class="">Subject:
       </span><span style=" font-size:9pt;font-family:sans-serif" class="">[EXTERNAL]
Re: [Openmp-dev] :  undefined symbol: ompt_start_tool</span><br class=""><span style=" font-size:9pt;color:#5f5f5f;font-family:sans-serif" class="">Sent
by:        </span><span style=" font-size:9pt;font-family:sans-serif" class="">"Openmp-dev"
<<a href="mailto:openmp-dev-bounces@lists.llvm.org" class="">openmp-dev-bounces@lists.llvm.org</a>></span><br class=""><hr noshade="" class=""><br class=""><br class=""><br class=""><span style=" font-size:1pt;color:white" class="">Message: 1 Date: Mon, 26 Oct
2020 15:18:45 -0500 From: Kelvin Li via Openmp-dev...      
                     
                     
                     
                     
                     
                     
                     
                     </span><table width="100%" style="border-collapse:collapse;" class=""><tbody class=""><tr height="8" class=""><td width="100%" bgcolor="#9ca3a7" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:16px 16px;" class=""><table width="494" align="center" style="border-collapse:collapse;" class=""><tbody class=""><tr valign="top" height="8" class=""><td width="494" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" class=""><table width="248" align="center" style="border-collapse:collapse;" class=""><tbody class=""><tr valign="top" height="8" class=""><td width="248" bgcolor="#9ca3a7" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" class=""><table width="125" align="center" style="border-collapse:collapse;" class=""><tbody class=""><tr height="8" class=""><td width="125" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" class=""><span style=" font-size:14pt;font-family:Helvetica" class=""><b class="">This
Message Is From an External Sender</b></span></td></tr><tr height="8" class=""><td width="125" style="border-style:none none none none;border-color:#000000;border-width:0px 0px 0px 0px;padding:0px 0px;" class=""><span style=" font-size:10pt;font-family:Helvetica" class="">This
message came from outside your organization.</span></td></tr></tbody></table><p style="margin-top:0px;margin-Bottom:0px" class=""></p></td></tr></tbody></table><p style="margin-top:0px;margin-Bottom:0px" class=""></p></td></tr></tbody></table><p style="margin-top:0px;margin-Bottom:0px" class=""></p></td></tr></tbody></table><br class=""><span style=" font-size:12pt" class="">Message: 1<br class="">Date: Mon, 26 Oct 2020 15:18:45 -0500<br class="">From: Kelvin Li via Openmp-dev <</span><a href="mailto:openmp-dev@lists.llvm.org" class=""><span style=" font-size:12pt;color:blue" class=""><u class="">openmp-dev@lists.llvm.org</u></span></a><span style=" font-size:12pt" class="">><br class="">To: </span><a href="mailto:openmp-dev@lists.llvm.org" class=""><span style=" font-size:12pt;color:blue" class=""><u class="">openmp-dev@lists.llvm.org</u></span></a><span style=" font-size:12pt" class=""><br class="">Subject: [Openmp-dev] undefined symbol: ompt_start_tool<br class="">Message-ID:<br class=""><</span><a href="mailto:OFF5259549.0EC65D66-ON8525860D.006EC181-8525860D.006F94A6@notes.na.collabserv.com" class=""><span style=" font-size:12pt;color:blue" class=""><u class="">OFF5259549.0EC65D66-ON8525860D.006EC181-8525860D.006F94A6@notes.na.collabserv.com</u></span></a><span style=" font-size:12pt" class="">><br class=""><br class="">Content-Type: text/plain; charset="utf-8"<br class=""><br class="">Has anyone encounter the following error?  I am wondering if it is
<br class="">something to do with how I build libomp.so.<br class=""><br class="">$ LD_LIBRARY_PATH=/home/kli/clang-install/lib mpirun -np 1 ./a.out<br class="">a.out: symbol lookup error: /home/kli/clang-install/lib/libomp.so: <br class="">undefined symbol: ompt_start_tool<br class="">--------------------------------------------------------------------------<br class="">Primary job  terminated normally, but 1 process returned<br class="">a non-zero exit code. Per user-direction, the job has been aborted.<br class="">--------------------------------------------------------------------------<br class="">--------------------------------------------------------------------------<br class="">mpirun detected that one or more processes exited with non-zero status,
<br class="">thus causing<br class="">the job to be terminated. The first process to do so was:<br class=""><br class=""> Process name: [[14546,1],0]<br class=""> Exit code:    127<br class="">--------------------------------------------------------------------------<br class=""><br class="">But it works without mpirun.<br class=""><br class="">$ LD_LIBRARY_PATH=/home/kli/clang-install/lib ./a.out<br class="">0<br class="">1<br class="">2<br class="">3<br class=""><br class=""><br class="">Kelvin</span><br class=""><span style=" font-size:12pt" class="">Are you confident that </span><span style=" font-size:12pt;font-family:Courier New" class="">/homie/kli/clang-install/lib</span><span style=" font-size:12pt" class="">is the same on all of the nodes used by the MPI program?</span><br class=""><span style=" font-size:12pt" class="">And that it contains the same version
of</span><span style=" font-size:12pt;font-family:Courier New" class=""> libomp.so
</span><span style=" font-size:12pt" class="">everywhere?</span><br class=""><br class=""><span style=" font-size:12pt" class="">Perhaps you should also set an envirable
to have the OpenMP runtime print its version, something like this </span><br class=""><span style=" font-size:12pt;font-family:Courier New" class="">$ KMP_VERSION=1
./a.out</span><br class=""><span style=" font-size:12pt;font-family:Courier New" class="">LLVM OMP version:
5.0.20140926</span><br class=""><span style=" font-size:12pt;font-family:Courier New" class="">LLVM OMP library
type: performance</span><br class=""><span style=" font-size:12pt;font-family:Courier New" class="">LLVM OMP link
type: dynamic</span><br class=""><span style=" font-size:12pt;font-family:Courier New" class="">LLVM OMP build
time: no_timestamp</span><br class=""><span style=" font-size:12pt;font-family:Courier New" class="">LLVM OMP build
compiler: Clang 12.0</span><br class=""><span style=" font-size:12pt;font-family:Courier New" class="">LLVM OMP alternative
compiler support: yes</span><br class=""><span style=" font-size:12pt;font-family:Courier New" class="">LLVM OMP API
version: 5.0 (201611)</span><br class=""><span style=" font-size:12pt;font-family:Courier New" class="">LLVM OMP dynamic
error checking: no</span><br class=""><span style=" font-size:12pt;font-family:Courier New" class="">LLVM OMP thread
affinity support: no</span><br class=""><br class=""><span style=" font-size:12pt" class="">On 26 Oct 2020, at 23:44, via Openmp-dev
<</span><a href="mailto:openmp-dev@lists.llvm.org" class=""><span style=" font-size:12pt;color:blue" class=""><u class="">openmp-dev@lists.llvm.org</u></span></a><span style=" font-size:12pt" class="">>
wrote:</span><br class=""><br class=""><span style=" font-size:12pt" class="">Send Openmp-dev mailing list submissions
to</span><span style=" font-size:12pt;color:blue" class=""><u class=""><br class=""></u></span><a href="mailto:openmp-dev@lists.llvm.org" class=""><span style=" font-size:12pt;color:blue" class=""><u class="">openmp-dev@lists.llvm.org</u></span></a><span style=" font-size:12pt" class=""><br class=""><br class="">To subscribe or unsubscribe via the World Wide Web, visit</span><span style=" font-size:12pt;color:blue" class=""><u class=""><br class=""></u></span><a href="https://lists.llvm.org/cgi-bin/mailman/listinfo/openmp-dev" class=""><span style=" font-size:12pt;color:blue" class=""><u class="">https://lists.llvm.org/cgi-bin/mailman/listinfo/openmp-dev</u></span></a><span style=" font-size:12pt" class=""><br class="">or, via email, send a message with subject or body 'help' to<br class=""><a href="mailto:openmp-dev-request@lists.llvm.org" class="">openmp-dev-request@lists.llvm.org</a><br class=""><br class="">You can reach the person managing the list at<br class="">openmp-dev-owner@lists.llvm.org<br class=""><br class="">When replying, please edit your Subject line so it is more specific<br class="">than "Re: Contents of Openmp-dev digest..."<br class=""><br class=""><br class="">Today's Topics:<br class=""><br class="">  1. undefined symbol: ompt_start_tool (Kelvin Li via Openmp-dev)<br class="">  2. Re: Declare target functions and libomptarget image<br class="">     registration order (Manoel Römmer via Openmp-dev)<br class="">  3. Re: Declare target functions and libomptarget image<br class="">     registration order (Johannes Doerfert via Openmp-dev)<br class="">  4. Re: Declare target functions and libomptarget image<br class="">     registration order (Narayanaswamy, Ravi via Openmp-dev)<br class=""><br class=""><br class="">----------------------------------------------------------------------<br class=""><br class="">Message: 1<br class="">Date: Mon, 26 Oct 2020 15:18:45 -0500<br class="">From: Kelvin Li via Openmp-dev <openmp-dev@lists.llvm.org><br class="">To: openmp-dev@lists.llvm.org<br class="">Subject: [Openmp-dev] undefined symbol: ompt_start_tool<br class="">Message-ID:<br class=""><OFF5259549.0EC65D66-ON8525860D.006EC181-8525860D.006F94A6@notes.na.collabserv.com><br class=""><br class="">Content-Type: text/plain; charset="utf-8"<br class=""><br class="">Has anyone encounter the following error?  I am wondering if it is
<br class="">something to do with how I build libomp.so.<br class=""><br class="">$ LD_LIBRARY_PATH=/home/kli/clang-install/lib mpirun -np 1 ./a.out<br class="">a.out: symbol lookup error: /home/kli/clang-install/lib/libomp.so: <br class="">undefined symbol: ompt_start_tool<br class="">--------------------------------------------------------------------------<br class="">Primary job  terminated normally, but 1 process returned<br class="">a non-zero exit code. Per user-direction, the job has been aborted.<br class="">--------------------------------------------------------------------------<br class="">--------------------------------------------------------------------------<br class="">mpirun detected that one or more processes exited with non-zero status,
<br class="">thus causing<br class="">the job to be terminated. The first process to do so was:<br class=""><br class=""> Process name: [[14546,1],0]<br class=""> Exit code:    127<br class="">--------------------------------------------------------------------------<br class=""><br class="">But it works without mpirun.<br class=""><br class="">$ LD_LIBRARY_PATH=/home/kli/clang-install/lib ./a.out<br class="">0<br class="">1<br class="">2<br class="">3<br class=""><br class=""><br class="">Kelvin<br class=""></span><br class=""><br class="">
</div></blockquote></div><br class=""><div class="">
<div style="color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div class=""><br class=""><br class=""><br class=""></div></div>

</div>
<br class=""></div></body></html>