[llvm-dev] 3.7.1-rc1 has been tagged. Let's begin testing!
Ben Pope via llvm-dev
llvm-dev at lists.llvm.org
Wed Nov 18 07:47:28 PST 2015
On Tuesday, November 17, 2015 11:32 AM, Tom Stellard wrote:
> Hi,
>
> I have just tagged 3.7.1-rc1, so it is ready for testing. As a
> reminder, when doing regression testing, use the 3.7.0 release
> as your baseline.
Ubuntu 15.10 x64 uploaded:
clang+llvm-3.7.1-rc1-x86_64-linux-gnu-ubuntu-15.10.tar.xz
The regression run seems very good compared to the 3.7.0 run (I have a
faster SSD now, which may be relevant, I'll rerun the tests another
time), but PolyBench may have some significant regressions.
Performance Regressions 18 0
Performance Improvements 463 0
Unchanged Tests 1013 1494
*Total Tests* *1494*
Performance Regressions - Execution Time Δ ▴ Previous
Current σ Δ (B) σ (B)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation
<http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.193=3>
357.01% 0.9829 4.4920 - 0.00% -
SingleSource/Benchmarks/Polybench/datamining/covariance/covariance
<http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.28=3>
292.68% 1.1368 4.4640 - 0.00% -
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin
<http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.284=3>
156.05% 0.1406 0.3600 - 0.00% -
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt
<http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.453=3>
79.10% 0.1273 0.2280 - 0.00% -
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver
<http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.478=3>
48.34% 0.1564 0.2320 - 0.00% -
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm
<http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.367=3>
46.46% 4.1840 6.1280 - 0.00% -
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4
<http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.355=3>
44.21% 0.2108 0.3040 - 0.00% -
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm
<http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.65=3>
24.87% 15.0882 18.8400 - 0.00% -
SingleSource/Benchmarks/Shootout-C++/hash2
<http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.46=3>
19.16% 1.3796 1.6440 - 0.00% -
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm
<http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.150=3>
14.45% 11.2117 12.8320 - 0.00% -
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg
<http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.255=3>
14.29% 0.0945 0.1080 - 0.00% -
MultiSource/Benchmarks/Olden/treeadd/treeadd
<http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.198=3>
13.38% 0.0882 0.1000 - 0.00% -
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl
<http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.135=3>
11.98% 1.6967 1.9000 - 0.00% -
MultiSource/Benchmarks/VersaBench/bmm/bmm
<http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.410=3>
7.16% 1.3662 1.4640 - 0.00% -
SingleSource/Benchmarks/Dhrystone/dry
<http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.153=3>
4.23% 0.3684 0.3840 - 0.00% -
MultiSource/Benchmarks/Ptrdist/anagram/anagram
<http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.128=3>
3.38% 0.6384 0.6600 - 0.00% -
Failing Tests (154):
LeakSanitizer-AddressSanitizer ::
TestCases/cleanup_in_tsd_destructor.cc
LeakSanitizer-AddressSanitizer :: TestCases/disabler.cc
LeakSanitizer-AddressSanitizer ::
TestCases/disabler_in_tsd_destructor.cc
LeakSanitizer-AddressSanitizer :: TestCases/ignore_object.cc
LeakSanitizer-Standalone :: TestCases/cleanup_in_tsd_destructor.cc
LeakSanitizer-Standalone :: TestCases/disabler.cc
LeakSanitizer-Standalone :: TestCases/disabler_in_tsd_destructor.cc
LeakSanitizer-Standalone :: TestCases/ignore_object.cc
MemorySanitizer :: Linux/fopencookie.cc
MemorySanitizer :: Linux/getresid.cc
MemorySanitizer :: Linux/glob.cc
MemorySanitizer :: Linux/glob_altdirfunc.cc
MemorySanitizer :: Linux/glob_nomatch.cc
MemorySanitizer :: Linux/ioctl_sound.cc
MemorySanitizer :: Linux/mallinfo.cc
MemorySanitizer :: Linux/obstack.cc
MemorySanitizer :: Linux/sunrpc.cc
MemorySanitizer :: Linux/sunrpc_bytes.cc
MemorySanitizer :: Linux/sunrpc_string.cc
MemorySanitizer :: Linux/syscalls.cc
MemorySanitizer :: Linux/tcgetattr.cc
MemorySanitizer :: Linux/xattr.cc
MemorySanitizer :: allocator_returns_null.cc
MemorySanitizer :: backtrace.cc
MemorySanitizer :: c-strdup.c
MemorySanitizer :: chained_origin.cc
MemorySanitizer :: chained_origin_empty_stack.cc
MemorySanitizer :: chained_origin_limits.cc
MemorySanitizer :: chained_origin_memcpy.cc
MemorySanitizer :: chained_origin_with_signals.cc
MemorySanitizer :: check_mem_is_initialized.cc
MemorySanitizer :: coverage-levels.cc
MemorySanitizer :: cxa_atexit.cc
MemorySanitizer :: death-callback.cc
MemorySanitizer :: dlerror.cc
MemorySanitizer :: dso-origin.cc
MemorySanitizer :: dtls_test.c
MemorySanitizer :: errno.cc
MemorySanitizer :: fork.cc
MemorySanitizer :: ftime.cc
MemorySanitizer :: getaddrinfo-positive.cc
MemorySanitizer :: getaddrinfo.cc
MemorySanitizer :: getc_unlocked.c
MemorySanitizer :: getline.cc
MemorySanitizer :: heap-origin.cc
MemorySanitizer :: iconv.cc
MemorySanitizer :: if_indextoname.cc
MemorySanitizer :: ifaddrs.cc
MemorySanitizer :: initgroups.cc
MemorySanitizer :: inline.cc
MemorySanitizer :: insertvalue_origin.cc
MemorySanitizer :: ioctl.cc
MemorySanitizer :: ioctl_custom.cc
MemorySanitizer :: mktime.cc
MemorySanitizer :: mmap.cc
MemorySanitizer :: mmap_below_shadow.cc
MemorySanitizer :: msan_check_mem_is_initialized.cc
MemorySanitizer :: msan_dump_shadow.cc
MemorySanitizer :: msan_print_shadow.cc
MemorySanitizer :: msan_print_shadow2.cc
MemorySanitizer :: msan_print_shadow3.cc
MemorySanitizer :: mul_by_const.cc
MemorySanitizer :: no_sanitize_memory.cc
MemorySanitizer :: no_sanitize_memory_prop.cc
MemorySanitizer :: origin-store-long.cc
MemorySanitizer :: param_tls_limit.cc
MemorySanitizer :: poison_in_free.cc
MemorySanitizer :: print_stats.cc
MemorySanitizer :: pthread_getattr_np_deadlock.cc
MemorySanitizer :: rand_r.cc
MemorySanitizer :: readdir64.cc
MemorySanitizer :: realloc-large-origin.cc
MemorySanitizer :: realloc-origin.cc
MemorySanitizer :: report-demangling.cc
MemorySanitizer :: scandir.cc
MemorySanitizer :: scandir_null.cc
MemorySanitizer :: select.cc
MemorySanitizer :: select_float_origin.cc
MemorySanitizer :: select_origin.cc
MemorySanitizer :: setlocale.cc
MemorySanitizer :: signal_stress_test.cc
MemorySanitizer :: sigwait.cc
MemorySanitizer :: sigwaitinfo.cc
MemorySanitizer :: stack-origin.cc
MemorySanitizer :: stack-origin2.cc
MemorySanitizer :: strerror_r-non-gnu.c
MemorySanitizer :: strlen_of_shadow.cc
MemorySanitizer :: strxfrm.cc
MemorySanitizer :: sync_lock_set_and_test.cc
MemorySanitizer :: textdomain.cc
MemorySanitizer :: times.cc
MemorySanitizer :: tls_reuse.cc
MemorySanitizer :: tsearch.cc
MemorySanitizer :: tzset.cc
MemorySanitizer :
1 warning(s) in tests.
: unaligned_read_origin.cc
MemorySanitizer :: unpoison_string.cc
MemorySanitizer :: use-after-free.cc
MemorySanitizer :: vector_cvt.cc
SanitizerCommon-msan :: Linux/aligned_alloc.c
SanitizerCommon-msan :: Linux/clock_gettime.c
SanitizerCommon-msan :: Linux/getpass.cc
SanitizerCommon-msan :: Linux/getpwnam_r_invalid_user.cc
SanitizerCommon-msan :: Linux/mlock_test.cc
SanitizerCommon-msan :: Linux/open_memstream.cc
SanitizerCommon-msan :: Linux/ptrace.cc
SanitizerCommon-msan :: Linux/sanitizer_set_death_callback_test.cc
SanitizerCommon-msan :: Linux/sched_getparam.cc
SanitizerCommon-msan :: Linux/signal_segv_handler.cc
SanitizerCommon-msan :: Linux/timerfd.cc
SanitizerCommon-msan :: Posix/decorate_proc_maps.cc
SanitizerCommon-msan :: corelimit.cc
SanitizerCommon-msan :: malloc_hook.cc
SanitizerCommon-msan :: options-help.cc
SanitizerCommon-msan :: options-include.cc
SanitizerCommon-msan :: options-invalid.cc
SanitizerCommon-msan :: print-stack-trace.cc
SanitizerCommon-msan :: pthread_mutexattr_get.cc
SanitizerCommon-msan :: strcasestr.c
SanitizerCommon-msan :: strcspn.c
SanitizerCommon-msan :: strpbrk.c
SanitizerCommon-msan :: strspn.c
SanitizerCommon-msan :: strstr.c
UBSan-MSan-x86_64 :: TestCases/Float/cast-overflow.cpp
UBSan-MSan-x86_64 :: TestCases/Integer/add-overflow.cpp
UBSan-MSan-x86_64 :: TestCases/Integer/div-overflow.cpp
UBSan-MSan-x86_64 :: TestCases/Integer/div-zero.cpp
UBSan-MSan-x86_64 :: TestCases/Integer/incdec-overflow.cpp
UBSan-MSan-x86_64 :: TestCases/Integer/mul-overflow.cpp
UBSan-MSan-x86_64 :: TestCases/Integer/negate-overflow.cpp
UBSan-MSan-x86_64 :: TestCases/Integer/no-recover.cpp
UBSan-MSan-x86_64 :: TestCases/Integer/shift.cpp
UBSan-MSan-x86_64 :: TestCases/Integer/sub-overflow.cpp
UBSan-MSan-x86_64 :: TestCases/Integer/uadd-overflow.cpp
UBSan-MSan-x86_64 :: TestCases/Integer/uincdec-overflow.cpp
UBSan-MSan-x86_64 :: TestCases/Integer/umul-overflow.cpp
UBSan-MSan-x86_64 :: TestCases/Integer/usub-overflow.cpp
UBSan-MSan-x86_64 :: TestCases/Misc/Linux/coverage-levels.cc
UBSan-MSan-x86_64 :: TestCases/Misc/Linux/ubsan_options.cc
UBSan-MSan-x86_64 :: TestCases/Misc/bool.cpp
UBSan-MSan-x86_64 :: TestCases/Misc/bounds.cpp
UBSan-MSan-x86_64 :: TestCases/Misc/deduplication.cpp
UBSan-MSan-x86_64 :: TestCases/Misc/enum.cpp
UBSan-MSan-x86_64 :: TestCases/Misc/log-path_test.cc
UBSan-MSan-x86_64 :: TestCases/Misc/missing_return.cpp
UBSan-MSan-x86_64 :: TestCases/Misc/nonnull-arg.cpp
UBSan-MSan-x86_64 :: TestCases/Misc/nonnull.cpp
UBSan-MSan-x86_64 :: TestCases/Misc/unreachable.cpp
UBSan-MSan-x86_64 :: TestCases/Misc/vla.c
UBSan-MSan-x86_64 :: TestCases/TypeCheck/Function/function.cpp
UBSan-MSan-x86_64 :: TestCases/TypeCheck/misaligned.cpp
UBSan-MSan-x86_64 :: TestCases/TypeCheck/null.cpp
UBSan-MSan-x86_64 ::
TestCases/TypeCheck/vptr-virtual-base-construction.cpp
UBSan-MSan-x86_64 :: TestCases/TypeCheck/vptr-virtual-base.cpp
UBSan-MSan-x86_64 :: TestCases/TypeCheck/vptr.cpp
Expected Passes : 24015
Expected Failures : 138
Unsupported Tests : 498
Unexpected Failures: 154
Ben
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20151118/beffdfff/attachment.html>
More information about the llvm-dev
mailing list