<html>
<head>
<meta content="text/html; charset=utf-8" http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<div class="moz-cite-prefix">On Tuesday, November 17, 2015 11:32 AM,
Tom Stellard wrote:<br>
</div>
<blockquote cite="mid:20151117033228.GB5502@yyz" type="cite">
<pre wrap="">Hi,
I have just tagged 3.7.1-rc1, so it is ready for testing. As a
reminder, when doing regression testing, use the 3.7.0 release
as your baseline.
</pre>
</blockquote>
<br>
Ubuntu 15.10 x64 uploaded: <br>
clang+llvm-3.7.1-rc1-x86_64-linux-gnu-ubuntu-15.10.tar.xz <br>
<br>
The regression run seems very good compared to the 3.7.0 run (I have
a faster SSD now, which may be relevant, I'll rerun the tests
another time), but PolyBench may have some significant regressions.
<br>
Performance Regressions 18 0 <br>
Performance Improvements 463 0 <br>
Unchanged Tests 1013 1494 <br>
<b class="moz-txt-star"><span class="moz-txt-tag">*</span>Total
Tests<span class="moz-txt-tag">*</span></b> *1494* <br>
<br>
<br>
Performance Regressions - Execution Time Δ ▴ Previous
Current σ Δ (B) σ (B) <br>
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation
<a class="moz-txt-link-rfc2396E"
href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.193=3"><http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.193=3></a>
357.01% 0.9829 4.4920 - 0.00% - <br>
SingleSource/Benchmarks/Polybench/datamining/covariance/covariance <a
class="moz-txt-link-rfc2396E"
href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.28=3"><a class="moz-txt-link-rfc2396E" href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.28=3"><http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.28=3></a></a>
292.68% 1.1368 4.4640 - 0.00% - <br>
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin
<a class="moz-txt-link-rfc2396E"
href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.284=3"><http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.284=3></a>
156.05% 0.1406 0.3600 - 0.00% - <br>
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt <a
class="moz-txt-link-rfc2396E"
href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.453=3"><a class="moz-txt-link-rfc2396E" href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.453=3"><http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.453=3></a></a>
79.10% 0.1273 0.2280 - 0.00% - <br>
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver
<a class="moz-txt-link-rfc2396E"
href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.478=3"><http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.478=3></a>
48.34% 0.1564 0.2320 - 0.00% - <br>
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm <a
class="moz-txt-link-rfc2396E"
href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.367=3"><a class="moz-txt-link-rfc2396E" href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.367=3"><http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.367=3></a></a>
46.46% 4.1840 6.1280 - 0.00% - <br>
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4 <a
class="moz-txt-link-rfc2396E"
href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.355=3"><a class="moz-txt-link-rfc2396E" href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.355=3"><http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.355=3></a></a>
44.21% 0.2108 0.3040 - 0.00% - <br>
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm <a
class="moz-txt-link-rfc2396E"
href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.65=3"><a class="moz-txt-link-rfc2396E" href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.65=3"><http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.65=3></a></a>
24.87% 15.0882 18.8400 - 0.00% - <br>
SingleSource/Benchmarks/Shootout-C++/hash2 <a
class="moz-txt-link-rfc2396E"
href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.46=3"><a class="moz-txt-link-rfc2396E" href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.46=3"><http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.46=3></a></a>
19.16% 1.3796 1.6440 - 0.00% - <br>
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm <a
class="moz-txt-link-rfc2396E"
href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.150=3"><a class="moz-txt-link-rfc2396E" href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.150=3"><http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.150=3></a></a>
14.45% 11.2117 12.8320 - 0.00% - <br>
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg <a
class="moz-txt-link-rfc2396E"
href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.255=3"><a class="moz-txt-link-rfc2396E" href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.255=3"><http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.255=3></a></a>
14.29% 0.0945 0.1080 - 0.00% - <br>
MultiSource/Benchmarks/Olden/treeadd/treeadd <a
class="moz-txt-link-rfc2396E"
href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.198=3"><a class="moz-txt-link-rfc2396E" href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.198=3"><http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.198=3></a></a>
13.38% 0.0882 0.1000 - 0.00% - <br>
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl <a
class="moz-txt-link-rfc2396E"
href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.135=3"><a class="moz-txt-link-rfc2396E" href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.135=3"><http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.135=3></a></a>
11.98% 1.6967 1.9000 - 0.00% - <br>
MultiSource/Benchmarks/VersaBench/bmm/bmm <a
class="moz-txt-link-rfc2396E"
href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.410=3"><a class="moz-txt-link-rfc2396E" href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.410=3"><http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.410=3></a></a>
7.16% 1.3662 1.4640 - 0.00% - <br>
SingleSource/Benchmarks/Dhrystone/dry <a
class="moz-txt-link-rfc2396E"
href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.153=3"><a class="moz-txt-link-rfc2396E" href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.153=3"><http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.153=3></a></a>
4.23% 0.3684 0.3840 - 0.00% - <br>
MultiSource/Benchmarks/Ptrdist/anagram/anagram <a
class="moz-txt-link-rfc2396E"
href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.128=3"><a class="moz-txt-link-rfc2396E" href="http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.128=3"><http://192.168.18.12:8000/db_default/v4/nts/44/graph?test.128=3></a></a>
3.38% 0.6384 0.6600 - 0.00% - <br>
<br>
<br>
<br>
Failing Tests (154): <br>
LeakSanitizer-AddressSanitizer ::
TestCases/cleanup_in_tsd_destructor.cc <br>
LeakSanitizer-AddressSanitizer :: TestCases/disabler.cc <br>
LeakSanitizer-AddressSanitizer ::
TestCases/disabler_in_tsd_destructor.cc <br>
LeakSanitizer-AddressSanitizer :: TestCases/ignore_object.cc <br>
LeakSanitizer-Standalone ::
TestCases/cleanup_in_tsd_destructor.cc <br>
LeakSanitizer-Standalone :: TestCases/disabler.cc <br>
LeakSanitizer-Standalone ::
TestCases/disabler_in_tsd_destructor.cc <br>
LeakSanitizer-Standalone :: TestCases/ignore_object.cc <br>
MemorySanitizer :: Linux/fopencookie.cc <br>
MemorySanitizer :: Linux/getresid.cc <br>
MemorySanitizer :: Linux/glob.cc <br>
MemorySanitizer :: Linux/glob_altdirfunc.cc <br>
MemorySanitizer :: Linux/glob_nomatch.cc <br>
MemorySanitizer :: Linux/ioctl_sound.cc <br>
MemorySanitizer :: Linux/mallinfo.cc <br>
MemorySanitizer :: Linux/obstack.cc <br>
MemorySanitizer :: Linux/sunrpc.cc <br>
MemorySanitizer :: Linux/sunrpc_bytes.cc <br>
MemorySanitizer :: Linux/sunrpc_string.cc <br>
MemorySanitizer :: Linux/syscalls.cc <br>
MemorySanitizer :: Linux/tcgetattr.cc <br>
MemorySanitizer :: Linux/xattr.cc <br>
MemorySanitizer :: allocator_returns_null.cc <br>
MemorySanitizer :: backtrace.cc <br>
MemorySanitizer :: c-strdup.c <br>
MemorySanitizer :: chained_origin.cc <br>
MemorySanitizer :: chained_origin_empty_stack.cc <br>
MemorySanitizer :: chained_origin_limits.cc <br>
MemorySanitizer :: chained_origin_memcpy.cc <br>
MemorySanitizer :: chained_origin_with_signals.cc <br>
MemorySanitizer :: check_mem_is_initialized.cc <br>
MemorySanitizer :: coverage-levels.cc <br>
MemorySanitizer :: cxa_atexit.cc <br>
MemorySanitizer :: death-callback.cc <br>
MemorySanitizer :: dlerror.cc <br>
MemorySanitizer :: dso-origin.cc <br>
MemorySanitizer :: dtls_test.c <br>
MemorySanitizer :: errno.cc <br>
MemorySanitizer :: fork.cc <br>
MemorySanitizer :: ftime.cc <br>
MemorySanitizer :: getaddrinfo-positive.cc <br>
MemorySanitizer :: getaddrinfo.cc <br>
MemorySanitizer :: getc_unlocked.c <br>
MemorySanitizer :: getline.cc <br>
MemorySanitizer :: heap-origin.cc <br>
MemorySanitizer :: iconv.cc <br>
MemorySanitizer :: if_indextoname.cc <br>
MemorySanitizer :: ifaddrs.cc <br>
MemorySanitizer :: initgroups.cc <br>
MemorySanitizer :: inline.cc <br>
MemorySanitizer :: insertvalue_origin.cc <br>
MemorySanitizer :: ioctl.cc <br>
MemorySanitizer :: ioctl_custom.cc <br>
MemorySanitizer :: mktime.cc <br>
MemorySanitizer :: mmap.cc <br>
MemorySanitizer :: mmap_below_shadow.cc <br>
MemorySanitizer :: msan_check_mem_is_initialized.cc <br>
MemorySanitizer :: msan_dump_shadow.cc <br>
MemorySanitizer :: msan_print_shadow.cc <br>
MemorySanitizer :: msan_print_shadow2.cc <br>
MemorySanitizer :: msan_print_shadow3.cc <br>
MemorySanitizer :: mul_by_const.cc <br>
MemorySanitizer :: no_sanitize_memory.cc <br>
MemorySanitizer :: no_sanitize_memory_prop.cc <br>
MemorySanitizer :: origin-store-long.cc <br>
MemorySanitizer :: param_tls_limit.cc <br>
MemorySanitizer :: poison_in_free.cc <br>
MemorySanitizer :: print_stats.cc <br>
MemorySanitizer :: pthread_getattr_np_deadlock.cc <br>
MemorySanitizer :: rand_r.cc <br>
MemorySanitizer :: readdir64.cc <br>
MemorySanitizer :: realloc-large-origin.cc <br>
MemorySanitizer :: realloc-origin.cc <br>
MemorySanitizer :: report-demangling.cc <br>
MemorySanitizer :: scandir.cc <br>
MemorySanitizer :: scandir_null.cc <br>
MemorySanitizer :: select.cc <br>
MemorySanitizer :: select_float_origin.cc <br>
MemorySanitizer :: select_origin.cc <br>
MemorySanitizer :: setlocale.cc <br>
MemorySanitizer :: signal_stress_test.cc <br>
MemorySanitizer :: sigwait.cc <br>
MemorySanitizer :: sigwaitinfo.cc <br>
MemorySanitizer :: stack-origin.cc <br>
MemorySanitizer :: stack-origin2.cc <br>
MemorySanitizer :: strerror_r-non-gnu.c <br>
MemorySanitizer :: strlen_of_shadow.cc <br>
MemorySanitizer :: strxfrm.cc <br>
MemorySanitizer :: sync_lock_set_and_test.cc <br>
MemorySanitizer :: textdomain.cc <br>
MemorySanitizer :: times.cc <br>
MemorySanitizer :: tls_reuse.cc <br>
MemorySanitizer :: tsearch.cc <br>
MemorySanitizer :: tzset.cc <br>
MemorySanitizer : <br>
1 warning(s) in tests. <br>
: unaligned_read_origin.cc <br>
MemorySanitizer :: unpoison_string.cc <br>
MemorySanitizer :: use-after-free.cc <br>
MemorySanitizer :: vector_cvt.cc <br>
SanitizerCommon-msan :: Linux/aligned_alloc.c <br>
SanitizerCommon-msan :: Linux/clock_gettime.c <br>
SanitizerCommon-msan :: Linux/getpass.cc <br>
SanitizerCommon-msan :: Linux/getpwnam_r_invalid_user.cc <br>
SanitizerCommon-msan :: Linux/mlock_test.cc <br>
SanitizerCommon-msan :: Linux/open_memstream.cc <br>
SanitizerCommon-msan :: Linux/ptrace.cc <br>
SanitizerCommon-msan ::
Linux/sanitizer_set_death_callback_test.cc <br>
SanitizerCommon-msan :: Linux/sched_getparam.cc <br>
SanitizerCommon-msan :: Linux/signal_segv_handler.cc <br>
SanitizerCommon-msan :: Linux/timerfd.cc <br>
SanitizerCommon-msan :: Posix/decorate_proc_maps.cc <br>
SanitizerCommon-msan :: corelimit.cc <br>
SanitizerCommon-msan :: malloc_hook.cc <br>
SanitizerCommon-msan :: options-help.cc <br>
SanitizerCommon-msan :: options-include.cc <br>
SanitizerCommon-msan :: options-invalid.cc <br>
SanitizerCommon-msan :: print-stack-trace.cc <br>
SanitizerCommon-msan :: pthread_mutexattr_get.cc <br>
SanitizerCommon-msan :: strcasestr.c <br>
SanitizerCommon-msan :: strcspn.c <br>
SanitizerCommon-msan :: strpbrk.c <br>
SanitizerCommon-msan :: strspn.c <br>
SanitizerCommon-msan :: strstr.c <br>
UBSan-MSan-x86_64 :: TestCases/Float/cast-overflow.cpp <br>
UBSan-MSan-x86_64 :: TestCases/Integer/add-overflow.cpp <br>
UBSan-MSan-x86_64 :: TestCases/Integer/div-overflow.cpp <br>
UBSan-MSan-x86_64 :: TestCases/Integer/div-zero.cpp <br>
UBSan-MSan-x86_64 :: TestCases/Integer/incdec-overflow.cpp <br>
UBSan-MSan-x86_64 :: TestCases/Integer/mul-overflow.cpp <br>
UBSan-MSan-x86_64 :: TestCases/Integer/negate-overflow.cpp <br>
UBSan-MSan-x86_64 :: TestCases/Integer/no-recover.cpp <br>
UBSan-MSan-x86_64 :: TestCases/Integer/shift.cpp <br>
UBSan-MSan-x86_64 :: TestCases/Integer/sub-overflow.cpp <br>
UBSan-MSan-x86_64 :: TestCases/Integer/uadd-overflow.cpp <br>
UBSan-MSan-x86_64 :: TestCases/Integer/uincdec-overflow.cpp <br>
UBSan-MSan-x86_64 :: TestCases/Integer/umul-overflow.cpp <br>
UBSan-MSan-x86_64 :: TestCases/Integer/usub-overflow.cpp <br>
UBSan-MSan-x86_64 :: TestCases/Misc/Linux/coverage-levels.cc <br>
UBSan-MSan-x86_64 :: TestCases/Misc/Linux/ubsan_options.cc <br>
UBSan-MSan-x86_64 :: TestCases/Misc/bool.cpp <br>
UBSan-MSan-x86_64 :: TestCases/Misc/bounds.cpp <br>
UBSan-MSan-x86_64 :: TestCases/Misc/deduplication.cpp <br>
UBSan-MSan-x86_64 :: TestCases/Misc/enum.cpp <br>
UBSan-MSan-x86_64 :: TestCases/Misc/log-path_test.cc <br>
UBSan-MSan-x86_64 :: TestCases/Misc/missing_return.cpp <br>
UBSan-MSan-x86_64 :: TestCases/Misc/nonnull-arg.cpp <br>
UBSan-MSan-x86_64 :: TestCases/Misc/nonnull.cpp <br>
UBSan-MSan-x86_64 :: TestCases/Misc/unreachable.cpp <br>
UBSan-MSan-x86_64 :: TestCases/Misc/vla.c <br>
UBSan-MSan-x86_64 :: TestCases/TypeCheck/Function/function.cpp <br>
UBSan-MSan-x86_64 :: TestCases/TypeCheck/misaligned.cpp <br>
UBSan-MSan-x86_64 :: TestCases/TypeCheck/null.cpp <br>
UBSan-MSan-x86_64 ::
TestCases/TypeCheck/vptr-virtual-base-construction.cpp <br>
UBSan-MSan-x86_64 :: TestCases/TypeCheck/vptr-virtual-base.cpp <br>
UBSan-MSan-x86_64 :: TestCases/TypeCheck/vptr.cpp <br>
<br>
Expected Passes : 24015 <br>
Expected Failures : 138 <br>
Unsupported Tests : 498 <br>
Unexpected Failures: 154 <br>
<br>
Ben <br>
</body>
</html>