<div dir="ltr">Alexey,<div>Am still seeing the issue on POWER8 at JSC:</div><div>[New Thread 0x10008b9ff180 (LWP 79809)]<br>[Switching focus to CUDA kernel 0, grid 2, block (0,0,0), thread (0,0,0), device 0, sm 0, warp 1, lane 0]<br>0x00000000145f0868 in __omp_offloading_3b_8077e6c5__ZN4nest20EventDeliveryManager15deliver_events_INS_9SpikeDataEEEbiRKSt6vectorIT_SaIS4_EE_l666<<<(1,1,1),(128,1,1)>>> (<br> nranks=<error reading variable: Error: Failed to read local memory at address 0xc8f0308 on device 0 sm 0 warp 1 lane 0, error=CUDBG_ERROR_INVALID_MEMORY_ACCESS(0x8).<br>>,<br> vla=<error reading variable: Error: Failed to read local memory at address 0xc8f0310 on device 0 sm 0 warp 1 lane 0, error=CUDBG_ERROR_INVALID_MEMORY_ACCESS(0x8).<br>>,<br> r_buf=<error reading variable: Error: Failed to read local memory at address 0xc8f0318 on device 0 sm 0 warp 1 lane 0, error=CUDBG_ERROR_INVALID_MEMORY_ACCESS(0x8).<br>>,<br> send_recv_count_spike_data_per_rank=<error reading variable: Error: Failed to read local memory at address 0xc8f0320 on device 0 sm 0 warp 1 lane 0, error=CUDBG_ERROR_INVALID_MEMORY_ACCESS(0x8).<br>>,<br> are_others_completed=<error reading variable: Error: Failed to read local memory at address 0xc8f0328 on device 0 sm 0 warp 1 lane 0, error=CUDBG_ERROR_INVALID_MEMORY_ACCESS(0x8).<br>>,<br> spike_data=<error reading variable: Error: Failed to read local memory at address 0xc8f0330 on device 0 sm 0 warp 1 lane 0, error=CUDBG_ERROR_INVALID_MEMORY_ACCESS(0x8).<br>>,<br> tid=<error reading variable: Error: Failed to read local memory at address 0xc8f0338 on device 0 sm 0 warp 1 lane 0, error=CUDBG_ERROR_INVALID_MEMORY_ACCESS(0x8).<br>>,<br> se=<error reading variable: Error: Failed to read local memory at address 0xc8f0340 on device 0 sm 0 warp 1 lane 0, error=CUDBG_ERROR_INVALID_MEMORY_ACCESS(0x8).<br>>,<br> vla=<error reading variable: Error: Failed to read local memory at address 0xc8f0310 on device 0 sm 0 warp 1 lane 0, error=CUDBG_ERROR_INVALID_MEMORY_ACCESS(0x8).<br>>,<br> prepared_timestamps=<error reading variable: Error: Failed to read local memory at address 0xc8f0350 on device 0 sm 0 warp 1 lane 0, error=CUDBG_ERROR_INVALID_MEMORY_ACCESS(0x8).<br>>,<br></div><div><br></div><div>How do I work-around this?</div><div>Thanks,</div><div>Itaru.</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Fri, Jan 17, 2020 at 12:46 PM Alexey Bataev <<a href="mailto:a.bataev@outlook.com">a.bataev@outlook.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div dir="auto">
There is a small issue with the debig info, will try to fix it soon. You can make a single step and after that you should be in the context of the function with correct debug info. (such functions has suffix _debug__).<br>
<br>
<div dir="ltr">Best regards,
<div>Alexey Bataev</div>
</div>
<div dir="ltr"><br>
<blockquote type="cite">16 янв. 2020 г., в 15:38, Itaru Kitayama <<a href="mailto:itaru.kitayama@gmail.com" target="_blank">itaru.kitayama@gmail.com</a>> написал(а):<br>
<br>
</blockquote>
</div>
<blockquote type="cite">
<div dir="ltr">
<div dir="ltr">Sure, if I code it in a sample code that works (offloaded properly), as expected.</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Fri, Jan 17, 2020 at 10:37 AM Itaru Kitayama <<a href="mailto:itaru.kitayama@gmail.com" target="_blank">itaru.kitayama@gmail.com</a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div dir="ltr">
<div>In CUDA-GDB.</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Fri, Jan 17, 2020 at 10:34 AM Alexey Bataev <<a href="mailto:a.bataev@outlook.com" target="_blank">a.bataev@outlook.com</a>> wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div>
<p>This is what you see in cuda-gdb? Or at the runtime when you run the program directly?<br>
</p>
<pre cols="72">-------------
Best regards,
Alexey Bataev</pre>
<div>16.01.2020 3:22 PM, Itaru Kitayama via Openmp-dev пишет:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Hi,
<div>Adding this small loop to my app:</div>
<div><br>
</div>
#pragma omp target parallel for map(to: nranks)<br>
for (int i=0;i<0;i++) {<br>
printf("%d\n", nranks);<br>
<div> }</div>
<div><br>
</div>
<div>leads to a run-time error on device. See below:</div>
<div><br>
</div>
<div>[New Thread 0x10008b9ff180 (LWP 103236)]<br>
</div>
<div>[Switching focus to CUDA kernel 0, grid 2, block (0,0,0), thread (0,0,0), device 0, sm 0, warp 0, lane 0]<br>
0x0000000014588068 in __omp_offloading_3b_801278cf__ZN4nest20EventDeliveryManager15deliver_events_INS_9SpikeDataEEEbiRKSt6vectorIT_SaIS4_EE_l666<<<(1,1,1),(128,1,1)>>> (<br>
nranks=<error reading variable: Error: Failed to read local memory at address 0xc8ee158 on device 0 sm 0 warp 0 lane 0, error=CUDBG_ERROR_INVALID_MEMORY_ACCESS(0x8).<br>
>) at /p/project/cpcp0/pcp0151/projects/nest-simulator/nestkernel/event_delivery_manager.cpp:667<br>
667 for (int i=0;i<0;i++) {<br>
</div>
<div><br>
</div>
<div>I am using the latest trunk Clang for this.</div>
</div>
<br>
<fieldset></fieldset>
<pre>_______________________________________________
Openmp-dev mailing list
<a href="mailto:Openmp-dev@lists.llvm.org" target="_blank">Openmp-dev@lists.llvm.org</a>
<a href="https://lists.llvm.org/cgi-bin/mailman/listinfo/openmp-dev" target="_blank">https://lists.llvm.org/cgi-bin/mailman/listinfo/openmp-dev</a>
</pre>
</blockquote>
</div>
</blockquote>
</div>
</div>
</blockquote>
</div>
</div>
</blockquote>
</div>
</blockquote></div>