[llvm-dev] [cfe-dev] 3.7.1-rc1 has been tagged. Let's begin testing!

Tim Halloran via llvm-dev llvm-dev at lists.llvm.org
Thu Nov 19 08:20:56 PST 2015 

On Thu, Nov 19, 2015 at 10:13 AM, Tom Stellard via cfe-dev <
cfe-dev at lists.llvm.org> wrote:

>
>
> Are these tests below new failing tests, or did they fail in 3.7.0 too?
>
> -Tom
>

It looks the same, below is a run I did this morning on 3.7.0 (Ubuntu
15.10) built with itself (but using /lib/x86_64-linux-gnu library
libstdc++.so.6.0.21 libc-2.21.so libgcc_s.so.1 libdl-2.21.so librt-2.21.so)
-- this is why I thought something might be amiss with my runtime setup (on
Ubuntu) because 3.7.0 did the same as rc1.

Tim

********************
Testing Time: 248.88s
********************
Failing Tests (154):
    LeakSanitizer-AddressSanitizer :: TestCases/cleanup_in_tsd_destructor.cc
    LeakSanitizer-AddressSanitizer :: TestCases/disabler.cc
    LeakSanitizer-AddressSanitizer ::
TestCases/disabler_in_tsd_destructor.cc
    LeakSanitizer-AddressSanitizer :: TestCases/ignore_object.cc
    LeakSanitizer-Standalone :: TestCases/cleanup_in_tsd_destructor.cc
    LeakSanitizer-Standalone :: TestCases/disabler.cc
    LeakSanitizer-Standalone :: TestCases/disabler_in_tsd_destructor.cc
    LeakSanitizer-Standalone :: TestCases/ignore_object.cc
    MemorySanitizer :: Linux/fopencookie.cc
    MemorySanitizer :: Linux/getresid.cc
    MemorySanitizer :: Linux/glob.cc
    MemorySanitizer :: Linux/glob_altdirfunc.cc
    MemorySanitizer :: Linux/glob_nomatch.cc
    MemorySanitizer :: Linux/ioctl_sound.cc
    MemorySanitizer :: Linux/mallinfo.cc
    MemorySanitizer :: Linux/obstack.cc
    MemorySanitizer :: Linux/sunrpc.cc
    MemorySanitizer :: Linux/sunrpc_bytes.cc
    MemorySanitizer :: Linux/sunrpc_string.cc
    MemorySanitizer :: Linux/syscalls.cc
    MemorySanitizer :: Linux/tcgetattr.cc
    MemorySanitizer :: Linux/xattr.cc
    MemorySanitizer :: allocator_returns_null.cc
    MemorySanitizer :: backtrace.cc
    MemorySanitizer :: c-strdup.c
    MemorySanitizer :: chained_origin.cc
    MemorySanitizer :: chained_origin_empty_stack.cc
    MemorySanitizer :: chained_origin_limits.cc
    MemorySanitizer :: chained_origin_memcpy.cc
    MemorySanitizer :: chained_origin_with_signals.cc
    MemorySanitizer :: check_mem_is_initialized.cc
    MemorySanitizer :: coverage-levels.cc
    MemorySanitizer :: cxa_atexit.cc
    MemorySanitizer :: death-callback.cc
    MemorySanitizer :: dlerror.cc
    MemorySanitizer :: dso-origin.cc
    MemorySanitizer :: dtls_test.c
    MemorySanitizer :: errno.cc
    MemorySanitizer :: fork.cc
    MemorySanitizer :: ftime.cc
    MemorySanitizer :: getaddrinfo-positive.cc
    MemorySanitizer :: getaddrinfo.cc
    MemorySanitizer :: getc_unlocked.c
    MemorySanitizer :: getline.cc
    MemorySanitizer :: heap-origin.cc
    MemorySanitizer :: iconv.cc
    MemorySanitizer :: if_indextoname.cc
    MemorySanitizer :: ifaddrs.cc
    MemorySanitizer :: initgroups.cc
    MemorySanitizer :: inline.cc
    MemorySanitizer :: insertvalue_origin.cc
    MemorySanitizer :: ioctl.cc
    MemorySanitizer :: ioctl_custom.cc
    MemorySanitizer :: mktime.cc
    MemorySanitizer :: mmap.cc
    MemorySanitizer :: mmap_below_shadow.cc
    MemorySanitizer :: msan_check_mem_is_initialized.cc
    MemorySanitizer :: msan_dump_shadow.cc
    MemorySanitizer :: msan_print_shadow.cc
    MemorySanitizer :: msan_print_shadow2.cc
    MemorySanitizer :: msan_print_shadow3.cc
    MemorySanitizer :: mul_by_const.cc
    MemorySanitizer :: no_sanitize_memory.cc
    MemorySanitizer :: no_sanitize_memory_prop.cc
    MemorySanitizer :: origin-store-long.cc
    MemorySanitizer :: param_tls_limit.cc
    MemorySanitizer :: poison_in_free.cc
    MemorySanitizer :: print_stats.cc
    MemorySanitizer :: pthread_getattr_np_deadlock.cc
    MemorySanitizer :: rand_r.cc
    MemorySanitizer :: readdir64.cc
    MemorySanitizer :: realloc-large-origin.cc
    MemorySanitizer :: realloc-origin.cc
    MemorySanitizer :: report-demangling.cc
    MemorySanitizer :: scandir.cc
    MemorySanitizer :: scandir_null.cc
    MemorySanitizer :: select.cc
    MemorySanitizer :: select_float_origin.cc
    MemorySanitizer :: select_origin.cc
    MemorySanitizer :: setlocale.cc
    MemorySanitizer :: signal_stress_test.cc
    MemorySanitizer :: sigwait.cc
    MemorySanitizer :: sigwaitinfo.cc
    MemorySanitizer :: stack-origin.cc
    MemorySanitizer :: stack-origin2.cc
    MemorySanitizer :: strerror_r-non-gnu.c
    MemorySanitizer :: strlen_of_shadow.cc
    MemorySanitizer :: strxfrm.cc
    MemorySanitizer :: sync_lock_set_and_test.cc
    MemorySanitizer :: textdomain.cc
    MemorySanitizer :: times.cc
    MemorySanitizer :: tls_reuse.cc
    MemorySanitizer :: tsearch.cc
    MemorySanitizer :: tzset.cc
    MemorySanitizer :: unaligned_read_origin.cc
    MemorySanitizer :: unpoison_string.cc
    MemorySanitizer :: use-after-free.cc
    MemorySanitizer :: vector_cvt.cc
    SanitizerCommon-msan :: Linux/aligned_alloc.c
    SanitizerCommon-msan :: Linux/clock_gettime.c
    SanitizerCommon-msan :: Linux/getpass.cc
    SanitizerCommon-msan :: Linux/getpwnam_r_invalid_user.cc
    SanitizerCommon-msan :: Linux/mlock_test.cc
    SanitizerCommon-msan :: Linux/open_memstream.cc
    SanitizerCommon-msan :: Linux/ptrace.cc
    SanitizerCommon-msan :: Linux/sanitizer_set_death_callback_test.cc
    SanitizerCommon-msan :: Linux/sched_getparam.cc
    SanitizerCommon-msan :: Linux/signal_segv_handler.cc
    SanitizerCommon-msan :: Linux/timerfd.cc
    SanitizerCommon-msan :: Posix/decorate_proc_maps.cc
    SanitizerCommon-msan :: corelimit.cc
    SanitizerCommon-msan :: malloc_hook.cc
    SanitizerCommon-msan :: options-help.cc
    SanitizerCommon-msan :: options-include.cc
    SanitizerCommon-msan :: options-invalid.cc
    SanitizerCommon-msan :: print-stack-trace.cc
    SanitizerCommon-msan :: pthread_mutexattr_get.cc
    SanitizerCommon-msan :: strcasestr.c
    SanitizerCommon-msan :: strcspn.c
    SanitizerCommon-msan :: strpbrk.c
    SanitizerCommon-msan :: strspn.c
    SanitizerCommon-msan :: strstr.c
    UBSan-MSan-x86_64 :: TestCases/Float/cast-overflow.cpp
    UBSan-MSan-x86_64 :: TestCases/Integer/add-overflow.cpp
    UBSan-MSan-x86_64 :: TestCases/Integer/div-overflow.cpp
    UBSan-MSan-x86_64 :: TestCases/Integer/div-zero.cpp
    UBSan-MSan-x86_64 :: TestCases/Integer/incdec-overflow.cpp
    UBSan-MSan-x86_64 :: TestCases/Integer/mul-overflow.cpp
    UBSan-MSan-x86_64 :: TestCases/Integer/negate-overflow.cpp
    UBSan-MSan-x86_64 :: TestCases/Integer/no-recover.cpp
    UBSan-MSan-x86_64 :: TestCases/Integer/shift.cpp
    UBSan-MSan-x86_64 :: TestCases/Integer/sub-overflow.cpp
    UBSan-MSan-x86_64 :: TestCases/Integer/uadd-overflow.cpp
    UBSan-MSan-x86_64 :: TestCases/Integer/uincdec-overflow.cpp
    UBSan-MSan-x86_64 :: TestCases/Integer/umul-overflow.cpp
    UBSan-MSan-x86_64 :: TestCases/Integer/usub-overflow.cpp
    UBSan-MSan-x86_64 :: TestCases/Misc/Linux/coverage-levels.cc
    UBSan-MSan-x86_64 :: TestCases/Misc/Linux/ubsan_options.cc
    UBSan-MSan-x86_64 :: TestCases/Misc/bool.cpp
    UBSan-MSan-x86_64 :: TestCases/Misc/bounds.cpp
    UBSan-MSan-x86_64 :: TestCases/Misc/deduplication.cpp
    UBSan-MSan-x86_64 :: TestCases/Misc/enum.cpp
    UBSan-MSan-x86_64 :: TestCases/Misc/log-path_test.cc
    UBSan-MSan-x86_64 :: TestCases/Misc/missing_return.cpp
    UBSan-MSan-x86_64 :: TestCases/Misc/nonnull-arg.cpp
    UBSan-MSan-x86_64 :: TestCases/Misc/nonnull.cpp
    UBSan-MSan-x86_64 :: TestCases/Misc/unreachable.cpp
    UBSan-MSan-x86_64 :: TestCases/Misc/vla.c
    UBSan-MSan-x86_64 :: TestCases/TypeCheck/Function/function.cpp
    UBSan-MSan-x86_64 :: TestCases/TypeCheck/misaligned.cpp
    UBSan-MSan-x86_64 :: TestCases/TypeCheck/null.cpp
    UBSan-MSan-x86_64 ::
TestCases/TypeCheck/vptr-virtual-base-construction.cpp
    UBSan-MSan-x86_64 :: TestCases/TypeCheck/vptr-virtual-base.cpp
    UBSan-MSan-x86_64 :: TestCases/TypeCheck/vptr.cpp

  Expected Passes    : 23524
  Expected Failures  : 138
  Unsupported Tests  : 376
  Unexpected Failures: 154
CMakeFiles/check-all.dir/build.make:57: recipe for target
'CMakeFiles/check-all' failed
make[3]: *** [CMakeFiles/check-all] Error 1
CMakeFiles/Makefile2:140: recipe for target 'CMakeFiles/check-all.dir/all'
failed
make[2]: *** [CMakeFiles/check-all.dir/all] Error 2
CMakeFiles/Makefile2:147: recipe for target 'CMakeFiles/check-all.dir/rule'
failed
make[1]: *** [CMakeFiles/check-all.dir/rule] Error 2
Makefile:184: recipe for target 'check-all' failed
make: *** [check-all] Error 2
{tim at arkham:~/Source/llvm-3.7.0/build}


>
> > Failing Tests (154):
> >     LeakSanitizer-AddressSanitizer ::
> > TestCases/cleanup_in_tsd_destructor.cc
> >     LeakSanitizer-AddressSanitizer :: TestCases/disabler.cc
> >     LeakSanitizer-AddressSanitizer ::
> > TestCases/disabler_in_tsd_destructor.cc
> >     LeakSanitizer-AddressSanitizer :: TestCases/ignore_object.cc
> >     LeakSanitizer-Standalone :: TestCases/cleanup_in_tsd_destructor.cc
> >     LeakSanitizer-Standalone :: TestCases/disabler.cc
> >     LeakSanitizer-Standalone :: TestCases/disabler_in_tsd_destructor.cc
> >     LeakSanitizer-Standalone :: TestCases/ignore_object.cc
> >     MemorySanitizer :: Linux/fopencookie.cc
> >     MemorySanitizer :: Linux/getresid.cc
> >     MemorySanitizer :: Linux/glob.cc
> >     MemorySanitizer :: Linux/glob_altdirfunc.cc
> >     MemorySanitizer :: Linux/glob_nomatch.cc
> >     MemorySanitizer :: Linux/ioctl_sound.cc
> >     MemorySanitizer :: Linux/mallinfo.cc
> >     MemorySanitizer :: Linux/obstack.cc
> >     MemorySanitizer :: Linux/sunrpc.cc
> >     MemorySanitizer :: Linux/sunrpc_bytes.cc
> >     MemorySanitizer :: Linux/sunrpc_string.cc
> >     MemorySanitizer :: Linux/syscalls.cc
> >     MemorySanitizer :: Linux/tcgetattr.cc
> >     MemorySanitizer :: Linux/xattr.cc
> >     MemorySanitizer :: allocator_returns_null.cc
> >     MemorySanitizer :: backtrace.cc
> >     MemorySanitizer :: c-strdup.c
> >     MemorySanitizer :: chained_origin.cc
> >     MemorySanitizer :: chained_origin_empty_stack.cc
> >     MemorySanitizer :: chained_origin_limits.cc
> >     MemorySanitizer :: chained_origin_memcpy.cc
> >     MemorySanitizer :: chained_origin_with_signals.cc
> >     MemorySanitizer :: check_mem_is_initialized.cc
> >     MemorySanitizer :: coverage-levels.cc
> >     MemorySanitizer :: cxa_atexit.cc
> >     MemorySanitizer :: death-callback.cc
> >     MemorySanitizer :: dlerror.cc
> >     MemorySanitizer :: dso-origin.cc
> >     MemorySanitizer :: dtls_test.c
> >     MemorySanitizer :: errno.cc
> >     MemorySanitizer :: fork.cc
> >     MemorySanitizer :: ftime.cc
> >     MemorySanitizer :: getaddrinfo-positive.cc
> >     MemorySanitizer :: getaddrinfo.cc
> >     MemorySanitizer :: getc_unlocked.c
> >     MemorySanitizer :: getline.cc
> >     MemorySanitizer :: heap-origin.cc
> >     MemorySanitizer :: iconv.cc
> >     MemorySanitizer :: if_indextoname.cc
> >     MemorySanitizer :: ifaddrs.cc
> >     MemorySanitizer :: initgroups.cc
> >     MemorySanitizer :: inline.cc
> >     MemorySanitizer :: insertvalue_origin.cc
> >     MemorySanitizer :: ioctl.cc
> >     MemorySanitizer :: ioctl_custom.cc
> >     MemorySanitizer :: mktime.cc
> >     MemorySanitizer :: mmap.cc
> >     MemorySanitizer :: mmap_below_shadow.cc
> >     MemorySanitizer :: msan_check_mem_is_initialized.cc
> >     MemorySanitizer :: msan_dump_shadow.cc
> >     MemorySanitizer :: msan_print_shadow.cc
> >     MemorySanitizer :: msan_print_shadow2.cc
> >     MemorySanitizer :: msan_print_shadow3.cc
> >     MemorySanitizer :: mul_by_const.cc
> >     MemorySanitizer :: no_sanitize_memory.cc
> >     MemorySanitizer :: no_sanitize_memory_prop.cc
> >     MemorySanitizer :: origin-store-long.cc
> >     MemorySanitizer :: param_tls_limit.cc
> >     MemorySanitizer :: poison_in_free.cc
> >     MemorySanitizer :: print_stats.cc
> >     MemorySanitizer :: pthread_getattr_np_deadlock.cc
> >     MemorySanitizer :: rand_r.cc
> >     MemorySanitizer :: readdir64.cc
> >     MemorySanitizer :: realloc-large-origin.cc
> >     MemorySanitizer :: realloc-origin.cc
> >     MemorySanitizer :: report-demangling.cc
> >     MemorySanitizer :: scandir.cc
> >     MemorySanitizer :: scandir_null.cc
> >     MemorySanitizer :: select.cc
> >     MemorySanitizer :: select_float_origin.cc
> >     MemorySanitizer :: select_origin.cc
> >     MemorySanitizer :: setlocale.cc
> >     MemorySanitizer :: signal_stress_test.cc
> >     MemorySanitizer :: sigwait.cc
> >     MemorySanitizer :: sigwaitinfo.cc
> >     MemorySanitizer :: stack-origin.cc
> >     MemorySanitizer :: stack-origin2.cc
> >     MemorySanitizer :: strerror_r-non-gnu.c
> >     MemorySanitizer :: strlen_of_shadow.cc
> >     MemorySanitizer :: strxfrm.cc
> >     MemorySanitizer :: sync_lock_set_and_test.cc
> >     MemorySanitizer :: textdomain.cc
> >     MemorySanitizer :: times.cc
> >     MemorySanitizer :: tls_reuse.cc
> >     MemorySanitizer :: tsearch.cc
> >     MemorySanitizer :: tzset.cc
> >     MemorySanitizer :
> > 1 warning(s) in tests.
> > : unaligned_read_origin.cc
> >     MemorySanitizer :: unpoison_string.cc
> >     MemorySanitizer :: use-after-free.cc
> >     MemorySanitizer :: vector_cvt.cc
> >     SanitizerCommon-msan :: Linux/aligned_alloc.c
> >     SanitizerCommon-msan :: Linux/clock_gettime.c
> >     SanitizerCommon-msan :: Linux/getpass.cc
> >     SanitizerCommon-msan :: Linux/getpwnam_r_invalid_user.cc
> >     SanitizerCommon-msan :: Linux/mlock_test.cc
> >     SanitizerCommon-msan :: Linux/open_memstream.cc
> >     SanitizerCommon-msan :: Linux/ptrace.cc
> >     SanitizerCommon-msan :: Linux/sanitizer_set_death_callback_test.cc
> >     SanitizerCommon-msan :: Linux/sched_getparam.cc
> >     SanitizerCommon-msan :: Linux/signal_segv_handler.cc
> >     SanitizerCommon-msan :: Linux/timerfd.cc
> >     SanitizerCommon-msan :: Posix/decorate_proc_maps.cc
> >     SanitizerCommon-msan :: corelimit.cc
> >     SanitizerCommon-msan :: malloc_hook.cc
> >     SanitizerCommon-msan :: options-help.cc
> >     SanitizerCommon-msan :: options-include.cc
> >     SanitizerCommon-msan :: options-invalid.cc
> >     SanitizerCommon-msan :: print-stack-trace.cc
> >     SanitizerCommon-msan :: pthread_mutexattr_get.cc
> >     SanitizerCommon-msan :: strcasestr.c
> >     SanitizerCommon-msan :: strcspn.c
> >     SanitizerCommon-msan :: strpbrk.c
> >     SanitizerCommon-msan :: strspn.c
> >     SanitizerCommon-msan :: strstr.c
> >     UBSan-MSan-x86_64 :: TestCases/Float/cast-overflow.cpp
> >     UBSan-MSan-x86_64 :: TestCases/Integer/add-overflow.cpp
> >     UBSan-MSan-x86_64 :: TestCases/Integer/div-overflow.cpp
> >     UBSan-MSan-x86_64 :: TestCases/Integer/div-zero.cpp
> >     UBSan-MSan-x86_64 :: TestCases/Integer/incdec-overflow.cpp
> >     UBSan-MSan-x86_64 :: TestCases/Integer/mul-overflow.cpp
> >     UBSan-MSan-x86_64 :: TestCases/Integer/negate-overflow.cpp
> >     UBSan-MSan-x86_64 :: TestCases/Integer/no-recover.cpp
> >     UBSan-MSan-x86_64 :: TestCases/Integer/shift.cpp
> >     UBSan-MSan-x86_64 :: TestCases/Integer/sub-overflow.cpp
> >     UBSan-MSan-x86_64 :: TestCases/Integer/uadd-overflow.cpp
> >     UBSan-MSan-x86_64 :: TestCases/Integer/uincdec-overflow.cpp
> >     UBSan-MSan-x86_64 :: TestCases/Integer/umul-overflow.cpp
> >     UBSan-MSan-x86_64 :: TestCases/Integer/usub-overflow.cpp
> >     UBSan-MSan-x86_64 :: TestCases/Misc/Linux/coverage-levels.cc
> >     UBSan-MSan-x86_64 :: TestCases/Misc/Linux/ubsan_options.cc
> >     UBSan-MSan-x86_64 :: TestCases/Misc/bool.cpp
> >     UBSan-MSan-x86_64 :: TestCases/Misc/bounds.cpp
> >     UBSan-MSan-x86_64 :: TestCases/Misc/deduplication.cpp
> >     UBSan-MSan-x86_64 :: TestCases/Misc/enum.cpp
> >     UBSan-MSan-x86_64 :: TestCases/Misc/log-path_test.cc
> >     UBSan-MSan-x86_64 :: TestCases/Misc/missing_return.cpp
> >     UBSan-MSan-x86_64 :: TestCases/Misc/nonnull-arg.cpp
> >     UBSan-MSan-x86_64 :: TestCases/Misc/nonnull.cpp
> >     UBSan-MSan-x86_64 :: TestCases/Misc/unreachable.cpp
> >     UBSan-MSan-x86_64 :: TestCases/Misc/vla.c
> >     UBSan-MSan-x86_64 :: TestCases/TypeCheck/Function/function.cpp
> >     UBSan-MSan-x86_64 :: TestCases/TypeCheck/misaligned.cpp
> >     UBSan-MSan-x86_64 :: TestCases/TypeCheck/null.cpp
> >     UBSan-MSan-x86_64 ::
> > TestCases/TypeCheck/vptr-virtual-base-construction.cpp
> >     UBSan-MSan-x86_64 :: TestCases/TypeCheck/vptr-virtual-base.cpp
> >     UBSan-MSan-x86_64 :: TestCases/TypeCheck/vptr.cpp
> >
> >   Expected Passes    : 24015
> >   Expected Failures  : 138
> >   Unsupported Tests  : 498
> >   Unexpected Failures: 154
> >
> > Ben
> _______________________________________________
> cfe-dev mailing list
> cfe-dev at lists.llvm.org
> http://lists.llvm.org/cgi-bin/mailman/listinfo/cfe-dev
>



-- 
Tim Halloran
SureLogic, Inc.
5808 Forbes Avenue, Pittsburgh PA 15217-1602
(412) 722-3338
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20151119/b2612e64/attachment.html>

More information about the llvm-dev mailing list