<div dir="ltr">The bot was happy for one build, then became red for other reason. <div>So, I think this one is fixed. </div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Jun 7, 2016 at 9:15 AM, Kostya Serebryany <span dir="ltr"><<a href="mailto:kcc@google.com" target="_blank">kcc@google.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">So, there is a large malloc coming from libstdc++. Weird.. <div>I'd try two solutions: </div><div> 1. change the test to make much bigger allocations (1 Mb total at least) so that they are still on top. <br></div><div><div> 2. change the test to be pure C so that there is no libstdc++</div></div><div><br></div><div>Trying 1) first: r<span style="color:rgb(0,0,0)">272020, let's watch the bot. </span></div><div><br></div></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Jun 7, 2016 at 4:30 AM, Kuba Brecka <span dir="ltr"><<a href="mailto:jbrecka@apple.com" target="_blank">jbrecka@apple.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word"><div>I can reproduce this on my Linux machine. The output of the test:</div><div><br></div><blockquote style="margin:0 0 0 40px;border:none;padding:0px"><div>Live Heap Allocations: 76107 bytes from 61 allocations; showing top 100%<br>72704 byte(s) (95%) in 1 allocation(s)<br> #0 0x4b447d (/home/kuba/llvm-ninja-release/projects/compiler-rt/test/asan/X86_64LinuxConfig/TestCases/Linux/Output/print_memory_profile_test.cc.tmp+0x4b447d)<br> #1 0x7ffff7ae11ff (/usr/lib/x86_64-linux-gnu/libstdc++.so.6+0x8a1ff)<br><br>2227 byte(s) (2%) in 17 allocation(s)<br> #0 0x4e03db (/home/kuba/llvm-ninja-release/projects/compiler-rt/test/asan/X86_64LinuxConfig/TestCases/Linux/Output/print_memory_profile_test.cc.tmp+0x4e03db)<br> #1 0x4e2502 (/home/kuba/llvm-ninja-release/projects/compiler-rt/test/asan/X86_64LinuxConfig/TestCases/Linux/Output/print_memory_profile_test.cc.tmp+0x4e2502)<br> #2 0x7ffff6b64a3f (/lib/x86_64-linux-gnu/libc.so.6+0x20a3f)<br><br>1008 byte(s) (1%) in 42 allocation(s)<br> #0 0x4e03db (/home/kuba/llvm-ninja-release/projects/compiler-rt/test/asan/X86_64LinuxConfig/TestCases/Linux/Output/print_memory_profile_test.cc.tmp+0x4e03db)<br> #1 0x4e257c (/home/kuba/llvm-ninja-release/projects/compiler-rt/test/asan/X86_64LinuxConfig/TestCases/Linux/Output/print_memory_profile_test.cc.tmp+0x4e257c)<br> #2 0x7ffff6b64a3f (/lib/x86_64-linux-gnu/libc.so.6+0x20a3f)<br><br>168 byte(s) (0%) in 1 allocation(s)<br> #0 0x4b447d (/home/kuba/llvm-ninja-release/projects/compiler-rt/test/asan/X86_64LinuxConfig/TestCases/Linux/Output/print_memory_profile_test.cc.tmp+0x4b447d)<br> #1 0x7ffff7de921f (/lib64/ld-linux-x86-64.so.2+0x1021f)<br> #2 0x2d6d766c6c2f6161 (<unknown module>)<br><br>Live Heap Allocations: 76107 bytes from 61 allocations; showing top 50%<br>72704 byte(s) (95%) in 1 allocation(s)<br> #0 0x4b447d (/home/kuba/llvm-ninja-release/projects/compiler-rt/test/asan/X86_64LinuxConfig/TestCases/Linux/Output/print_memory_profile_test.cc.tmp+0x4b447d)<br> #1 0x7ffff7ae11ff (/usr/lib/x86_64-linux-gnu/libstdc++.so.6+0x8a1ff)<br><br></div></blockquote><div>Symbolicated:</div><div><br></div><blockquote style="margin:0 0 0 40px;border:none;padding:0px"><div>Live Heap Allocations: 76107 bytes from 61 allocations; showing top 100%<br>72704 byte(s) (95%) in 1 allocation(s)<br> #0 0x4b447d <__interceptor_malloc()+173><br> #1 0x7ffff7ae11ff (/usr/lib/x86_64-linux-gnu/libstdc++.so.6+0x8a1ff)<br><br>2227 byte(s) (2%) in 17 allocation(s)<br> #0 0x4e03db <operator new[]()+155><br> #1 0x4e2502 <main()+50><br> #2 0x7ffff6b64a3f <__libc_start_main+239><br><br>1008 byte(s) (1%) in 42 allocation(s)<br> #0 0x4e03db <operator new[]()+155><br> #1 0x4e257c <main()+172><br> #2 0x7ffff6b64a3f <__libc_start_main+239><br><br>168 byte(s) (0%) in 1 allocation(s)<br> #0 0x4b447d <__interceptor_malloc()+173><br> #1 0x7ffff7de921f <_dl_signal_error+111><br> #2 0x2d6d766c6c2f6161 (<unknown module>)<br><br>Live Heap Allocations: 76107 bytes from 61 allocations; showing top 50%<br>72704 byte(s) (95%) in 1 allocation(s)<br> #0 0x4b447d <__interceptor_malloc()+173><br> #1 0x7ffff7ae11ff (/usr/lib/x86_64-linux-gnu/libstdc++.so.6+0x8a1ff)<br><br></div></blockquote>Stack traces of the two not-from-main allocations:<div><br></div><div>1) size 168:</div><div><br></div><blockquote style="margin:0 0 0 40px;border:none;padding:0px"><div>#0 __interceptor_malloc () at /home/kuba/llvm/projects/compiler-rt/lib/asan/asan_malloc_linux.cc:61<br>#1 0x00007ffff7de9220 in _dl_signal_error (errcode=errcode@entry=0, <br> objname=objname@entry=0x7fffffffe730 "/home/kuba/llvm-ninja-release/projects/compiler-rt/test/asan/X86_64LinuxConfig/TestCases/Linux/Output/print_memory_profile_test.cc.tmp", <br> occation=occation@entry=0x7ffff7df6a18 "symbol lookup error", errstring=errstring@entry=0x7fffffffe0d0 "undefined symbol: swift_demangle") at dl-error.c:90<br>#2 0x00007ffff7de93e3 in _dl_signal_cerror (errcode=0, <br> objname=0x7fffffffe730 "/home/kuba/llvm-ninja-release/projects/compiler-rt/test/asan/X86_64LinuxConfig/TestCases/Linux/Output/print_memory_profile_test.cc.tmp", <br> occation=0x7ffff7df6a18 "symbol lookup error", errstring=0x7fffffffe0d0 "undefined symbol: swift_demangle") at dl-error.c:155<br>#3 0x00007ffff7de4455 in _dl_lookup_symbol_x (undef_name=0x4f40ae <.L.str9> "swift_demangle", undef_map=0x7ffff7ffe188, ref=0x7fffffffe238, symbol_scope=0x7ffff7ffe4e0, version=<optimized out>, <br> type_class=0, flags=3, skip_map=0x0) at dl-lookup.c:817<br>#4 0x00007ffff6c872b1 in do_sym (handle=0x0, name=0x4f40ae <.L.str9> "swift_demangle", who=<optimized out>, vers=vers@entry=0x0, flags=flags@entry=2) at dl-sym.c:161<br>#5 0x00007ffff6c876cd in _dl_sym (handle=<optimized out>, name=<optimized out>, who=<optimized out>) at dl-sym.c:273<br>#6 0x00007ffff71260f4 in dlsym_doit (a=a@entry=0x7fffffffe430) at dlsym.c:50<br>#7 0x00007ffff7de9464 in _dl_catch_error (objname=0x72f720 <alloc_memory_for_dlsym+16>, errstring=0x72f728 <alloc_memory_for_dlsym+24>, mallocedp=0x72f718 <alloc_memory_for_dlsym+8>, <br> operate=0x7ffff71260e0 <dlsym_doit>, args=0x7fffffffe430) at dl-error.c:187<br>#8 0x00007ffff712662d in _dlerror_run (operate=operate@entry=0x7ffff71260e0 <dlsym_doit>, args=args@entry=0x7fffffffe430) at dlerror.c:163<br>#9 0x00007ffff7126148 in __dlsym (handle=<optimized out>, name=<optimized out>) at dlsym.c:70<br>#10 0x00000000004d7564 in InitializeSwiftDemangler () at /home/kuba/llvm/projects/compiler-rt/lib/sanitizer_common/sanitizer_symbolizer_posix_libcdep.cc:78<br>#11 LateInitialize () at /home/kuba/llvm/projects/compiler-rt/lib/sanitizer_common/sanitizer_symbolizer_posix_libcdep.cc:496<br>#12 0x00000000004be1a5 in AsanInitInternal () at /home/kuba/llvm/projects/compiler-rt/lib/asan/asan_rtl.cc:568<br>#13 0x00007ffff7de9722 in _dl_init (main_map=0x7ffff7ffe188, argc=1, argv=0x7fffffffe518, env=0x7fffffffe528) at dl-init.c:105<br>#14 0x00007ffff7dd9d0a in _dl_start_user () from /lib64/ld-linux-x86-64.so.2<br><br></div></blockquote>2) size 72704:<div><br></div><blockquote style="margin:0 0 0 40px;border:none;padding:0px"><div>#0 __interceptor_malloc () at /home/kuba/llvm/projects/compiler-rt/lib/asan/asan_malloc_linux.cc:61<br>#1 0x00007ffff7ae1200 in ?? () from /usr/lib/x86_64-linux-gnu/libstdc++.so.6<br>#2 0x00007ffff7de95ba in call_init (l=<optimized out>, argc=argc@entry=1, argv=argv@entry=0x7fffffffe518, env=env@entry=0x7fffffffe528) at dl-init.c:72<br>#3 0x00007ffff7de96cb in call_init (env=<optimized out>, argv=<optimized out>, argc=<optimized out>, l=<optimized out>) at dl-init.c:30<br>#4 _dl_init (main_map=0x7ffff7ffe188, argc=1, argv=0x7fffffffe518, env=0x7fffffffe528) at dl-init.c:120<br>#5 0x00007ffff7dd9d0a in _dl_start_user () from /lib64/ld-linux-x86-64.so.2<br><br></div></blockquote><div><div><span><font color="#888888"><div>Kuba</div></font></span><div><div><br><div><blockquote type="cite"><div>On 7 Jun 2016, at 03:18, Kostya Serebryany <<a href="mailto:kcc@google.com" target="_blank">kcc@google.com</a>> wrote:</div><br><div><div dir="ltr">Interesting. <div>Our bots don't see this and are green (except for an unrelated msan failure).</div><div><a href="http://lab.llvm.org:8011/builders/sanitizer-x86_64-linux" target="_blank">http://lab.llvm.org:8011/builders/sanitizer-x86_64-linux</a><br></div><div><a href="http://lab.llvm.org:8011/builders/sanitizer-x86_64-linux-bootstrap" target="_blank">http://lab.llvm.org:8011/builders/sanitizer-x86_64-linux-bootstrap</a><br></div><div><br></div><div>Can you or someone reproduce this locally and send the full output of the test?</div><div><br></div><div>>>> <span style="font-size:12.8px">(this was accidentally turned off for about a week)</span></div><div><span style="font-size:12.8px">OUCH! </span></div><div><br></div><div><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Jun 6, 2016 at 10:08 AM, Kuba Brecka <span dir="ltr"><<a href="mailto:jbrecka@apple.com" target="_blank">jbrecka@apple.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div style="word-wrap:break-word">Hi Kostya,<div><br></div><div>my recent change started running ASan tests during “check-all” again (this was accidentally turned off for about a week), and this bot is complaining about print_memory_profile_test.cc (which I guess is your quite new test). Could you look into that?</div><div><br></div><div>Thanks,</div><div>Kuba<br><div><br><blockquote type="cite"><div>Begin forwarded message:</div><br><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px"><span style="font-family:-webkit-system-font,'Helvetica Neue',Helvetica,sans-serif"><b>From: </b></span><span style="font-family:-webkit-system-font,Helvetica Neue,Helvetica,sans-serif"><a href="mailto:llvm.buildmaster@lab.llvm.org" target="_blank">llvm.buildmaster@lab.llvm.org</a><br></span></div><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px"><span style="font-family:-webkit-system-font,'Helvetica Neue',Helvetica,sans-serif"><b>Subject: </b></span><span style="font-family:-webkit-system-font,Helvetica Neue,Helvetica,sans-serif"><b>buildbot failure in LLVM on llvm-clang-lld-x86_64-debian-fast</b><br></span></div><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px"><span style="font-family:-webkit-system-font,'Helvetica Neue',Helvetica,sans-serif"><b>Date: </b></span><span style="font-family:-webkit-system-font,Helvetica Neue,Helvetica,sans-serif">6 June 2016 at 18:59:39 GMT+2<br></span></div><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px"><span style="font-family:-webkit-system-font,'Helvetica Neue',Helvetica,sans-serif"><b>To: </b></span><span style="font-family:-webkit-system-font,Helvetica Neue,Helvetica,sans-serif">Kuba Brecka <<a href="mailto:kuba.brecka@gmail.com" target="_blank">kuba.brecka@gmail.com</a>><br></span></div><div style="margin-top:0px;margin-right:0px;margin-bottom:0px;margin-left:0px"><span style="font-family:-webkit-system-font,'Helvetica Neue',Helvetica,sans-serif"><b>Cc: </b></span><span style="font-family:-webkit-system-font,Helvetica Neue,Helvetica,sans-serif"><a href="mailto:gkistanova@gmail.com" target="_blank">gkistanova@gmail.com</a><br></span></div><br><div><div>The Buildbot has detected a new failure on builder llvm-clang-lld-x86_64-debian-fast while building compiler-rt.<br>Full details are available at:<br> <a href="http://lab.llvm.org:8011/builders/llvm-clang-lld-x86_64-debian-fast/builds/38714" target="_blank">http://lab.llvm.org:8011/builders/llvm-clang-lld-x86_64-debian-fast/builds/38714</a><br><br>Buildbot URL: <a href="http://lab.llvm.org:8011/" target="_blank">http://lab.llvm.org:8011/</a><br><br>Buildslave for this Build: gribozavr4<br><br>Build Reason: scheduler<br>Build Source Stamp: [branch trunk] 271906<br>Blamelist: kuba.brecka<br><br>BUILD FAILED: failed test<br><br>sincerely,<br> -The Buildbot<br><br><br><br></div></div></blockquote></div><br></div></div></blockquote></div><br></div>
</div></blockquote></div><br></div></div></div></div></div></blockquote></div><br></div>
</div></div></blockquote></div><br></div>