[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Thu Apr 25 13:37:18 PDT 2013
http://llvm.org/perf/db_default/v4/nts/11024?compare_to=11021&baseline=9029
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:11
Comparing:
Run: 11024, Order: 180271, Start Time: 2013-04-25 18:47:49, End Time: 2013-04-25 20:37:14
To: 11021, Order: 180268, Start Time: 2013-04-25 16:45:10, End Time: 2013-04-25 18:25:40
Baseline: 9029, Order: 176363, Start Time: 2013-03-01 19:08:40, End Time: 2013-03-01 20:55:00
===============
Tests Summary
===============
New Failures: 0 (1 on baseline)
New Passes: 0 (13 on baseline)
Performance Regressions: 47 (105 on baseline)
Performance Improvements: 1 (59 on baseline)
Removed Tests: 0 (2 on baseline)
Added Tests: 0 (4 on baseline)
Existing Failures: 20 (19 on baseline)
Unchanged Tests: 1040 (905 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 64.13% (0.0683 => 0.1121, std.dev.: 0.0055)
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 40.52% (0.2495 => 0.3506, std.dev.: 0.0224)
MultiSource/Benchmarks/BitBench/five11/five11: 36.57% (0.0607 => 0.0829, std.dev.: 0.0051)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 26.67% (0.9430 => 1.1945, std.dev.: 0.0553)
MultiSource/Applications/hbd/hbd: 24.89% (1.5545 => 1.9414, std.dev.: 0.0574)
MultiSource/Applications/treecc/treecc: 22.45% (2.2368 => 2.7390, std.dev.: 0.1890)
MultiSource/Applications/SPASS/SPASS: 14.25% (16.4723 => 18.8200, std.dev.: 0.1260)
MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 12.00% (0.0908 => 0.1017, std.dev.: 0.0028)
MultiSource/Applications/sqlite3/sqlite3: 11.63% (16.3377 => 18.2373, std.dev.: 0.0537)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.38% (1.3993 => 1.5445, std.dev.: 0.0206)
MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 9.14% (0.6870 => 0.7498, std.dev.: 0.0153)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 8.40% (0.3726 => 0.4039, std.dev.: 0.0083)
MultiSource/Applications/JM/lencod/lencod: 7.96% (16.3886 => 17.6934, std.dev.: 0.4502)
MultiSource/Applications/kimwitu++/kc: 7.85% (18.8084 => 20.2848, std.dev.: 0.5570)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 7.44% (1.3682 => 1.4700, std.dev.: 0.0387)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 6.82% (1.6565 => 1.7695, std.dev.: 0.0039)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 6.66% (1.0629 => 1.1337, std.dev.: 0.0219)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.53% (1.3906 => 1.4814, std.dev.: 0.0341)
MultiSource/Benchmarks/McCat/05-eks/eks: 5.61% (0.5025 => 0.5307, std.dev.: 0.0018)
MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 5.49% (1.6530 => 1.7438, std.dev.: 0.0261)
MultiSource/Benchmarks/Prolangs-C/football/football: 3.98% (0.9729 => 1.0116, std.dev.: 0.0130)
MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 3.81% (0.3623 => 0.3761, std.dev.: 0.0049)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.53% (7.2117 => 7.4665, std.dev.: 0.0539)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.11% (5.3918 => 5.5593, std.dev.: 0.0424)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.10% (1.1381 => 1.1620, std.dev.: 0.0083)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Applications/SPASS/SPASS: 24.61% (8.0409 => 10.0194, std.dev.: 0.4633)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.21% (2.5550 => 2.9946, std.dev.: 0.0580)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 12.01% (43.1373 => 48.3167, std.dev.: 0.2420)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 11.08% (0.3313 => 0.3680, std.dev.: 0.0027)
SingleSource/Benchmarks/Misc/flops: 8.69% (9.3669 => 10.1811, std.dev.: 0.0149)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.92% (7.0093 => 7.5647, std.dev.: 0.0724)
MultiSource/Applications/sqlite3/sqlite3: 5.60% (4.4164 => 4.6638, std.dev.: 0.0868)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.14% (15.3806 => 16.0174, std.dev.: 0.1185)
SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.72% (3.0387 => 3.1516, std.dev.: 0.0113)
MultiSource/Applications/SIBsim4/SIBsim4: 3.59% (3.1888 => 3.3032, std.dev.: 0.0257)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.24% (39.7134 => 41.0015, std.dev.: 0.2888)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.00% (0.4865 => 0.5011, std.dev.: 0.0037)
MultiSource/Benchmarks/PAQ8p/paq8p: 2.46% (90.7850 => 93.0201, std.dev.: 0.6838)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.46% (2.6269 => 2.6914, std.dev.: 0.0136)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.42% (4.0651 => 4.1634, std.dev.: 0.0230)
MultiSource/Applications/JM/lencod/lencod: 2.06% (7.0761 => 7.2221, std.dev.: 0.0336)
SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.01% (1.6049 => 1.6371, std.dev.: 0.0097)
SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.80% (1.5660 => 1.5942, std.dev.: 0.0086)
SingleSource/Benchmarks/BenchmarkGame/n-body: 1.65% (1.4807 => 1.5051, std.dev.: 0.0079)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.64% (1.8613 => 1.8918, std.dev.: 0.0025)
SingleSource/Benchmarks/BenchmarkGame/recursive: 1.32% (2.4741 => 2.5067, std.dev.: 0.0117)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.17% (3.5327 => 3.5740, std.dev.: 0.0118)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.36% (0.3213 => 0.3073, std.dev.: 0.0054)
Existing Failures - Compile Time
--------------------------------
MultiSource/Applications/obsequi/Obsequi
MultiSource/Applications/obsequi/Obsequi: 4.23% (1.1429 => 1.1912, std.dev.: 0.0849)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ALAC/decode/alacconvert-decode
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/lua/lua
MultiSource/Applications/obsequi/Obsequi
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
MultiSource/Benchmarks/MiBench/security-sha/security-sha
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
MultiSource/Benchmarks/mediabench/g721/g721encode/encode
MultiSource/Benchmarks/mediabench/gsm/toast/toast
SingleSource/Regression/C/2003-05-21-UnionBitfields
SingleSource/Regression/C/2003-05-21-UnionTest
SingleSource/UnitTests/2005-07-15-Bitfield-ABI
SingleSource/UnitTests/2006-01-23-UnionInit
SingleSource/UnitTests/2007-04-10-BitfieldTest
SingleSource/UnitTests/SignlessTypes/Large/cast
SingleSource/UnitTests/Vectorizer/gcc-loops
MultiSource/Applications/ALAC/decode/alacconvert-decode: 44.17% (0.0163 => 0.0235, std.dev.: 0.0048)
MultiSource/Applications/ClamAV/clamscan: 2.47% (0.1497 => 0.1534, std.dev.: 0.0237)
MultiSource/Applications/lua/lua: 0.71% (27.4522 => 27.6459, std.dev.: 1.7183)
MultiSource/Applications/obsequi/Obsequi: -100.00% (0.0001 => 0.0000, std.dev.: 0.0001)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -3.28% (0.1188 => 0.1149, std.dev.: 0.0024)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0001)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 6.64% (0.0557 => 0.0594, std.dev.: 0.0002)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: 26.34% (0.0186 => 0.0235, std.dev.: 0.0013)
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 3400.00% (0.0001 => 0.0035, std.dev.: 0.0003)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 1500.00% (0.0001 => 0.0016, std.dev.: 0.0011)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 11.93% (0.0570 => 0.0638, std.dev.: 0.0034)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: 30.66% (0.0212 => 0.0277, std.dev.: 0.0059)
SingleSource/Regression/C/2003-05-21-UnionBitfields: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001)
SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004)
SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004)
SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001)
SingleSource/UnitTests/SignlessTypes/Large/cast: -20.90% (0.0067 => 0.0053, std.dev.: 0.0051)
SingleSource/UnitTests/Vectorizer/gcc-loops: -0.45% (22.9623 => 22.8585, std.dev.: 0.0887)
================================
Run-Over-Baseline Changes Detail
================================
New Failures - Execution Time
-----------------------------
MultiSource/Applications/lua/lua
MultiSource/Applications/lua/lua: -1.86% (28.1709 => 27.6459, std.dev.: 1.7183)
New Passes - Execution Time
---------------------------
MultiSource/Applications/Burg/burg
MultiSource/Applications/lemon/lemon
MultiSource/Benchmarks/McCat/12-IOtest/iotest
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft
MultiSource/Benchmarks/Ptrdist/anagram/anagram
SingleSource/Benchmarks/BenchmarkGame/puzzle
SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression
SingleSource/UnitTests/Vector/Altivec/alti_expandfft
SingleSource/UnitTests/Vector/Altivec/alti_isamax
SingleSource/UnitTests/Vector/Altivec/alti_sdot
SingleSource/UnitTests/Vector/Altivec/alti_stepfft
SingleSource/UnitTests/Vector/Altivec/casts
SingleSource/UnitTests/Vector/Altivec/test1
MultiSource/Applications/Burg/burg: 15.38% (0.0013 => 0.0015, std.dev.: 0.0002)
MultiSource/Applications/lemon/lemon: 10.65% (1.1794 => 1.3050, std.dev.: 0.2601)
MultiSource/Benchmarks/McCat/12-IOtest/iotest: 6.18% (0.4125 => 0.4380, std.dev.: 0.0143)
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -18.70% (0.0663 => 0.0539, std.dev.: 0.0035)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: 12.98% (1.1660 => 1.3173, std.dev.: 0.0115)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -32.69% (1.6803 => 1.1310, std.dev.: 0.0184)
SingleSource/UnitTests/Vector/Altivec/2007-01-07-lvsl-lvsr-Regression: - (0.0001 => 0.0001, std.dev.: 0.0003)
SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -3.54% (29.7937 => 28.7390, std.dev.: 0.8073)
SingleSource/UnitTests/Vector/Altivec/alti_isamax: -88.89% (0.0009 => 0.0001, std.dev.: 0.0005)
SingleSource/UnitTests/Vector/Altivec/alti_sdot: - (0.0001 => 0.0001, std.dev.: 0.0001)
SingleSource/UnitTests/Vector/Altivec/alti_stepfft: -96.55% (0.0029 => 0.0001, std.dev.: 0.0024)
SingleSource/UnitTests/Vector/Altivec/casts: - (0.0001 => 0.0001, std.dev.: 0.0003)
SingleSource/UnitTests/Vector/Altivec/test1: -83.33% (0.0006 => 0.0001, std.dev.: 0.0005)
Performance Regressions - Compile Time
--------------------------------------
SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 63.89% (0.0684 => 0.1121, std.dev.: 0.0055)
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 41.43% (0.2479 => 0.3506, std.dev.: 0.0224)
MultiSource/Benchmarks/BitBench/five11/five11: 41.23% (0.0587 => 0.0829, std.dev.: 0.0051)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 40.12% (1.1023 => 1.5445, std.dev.: 0.0206)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 35.31% (1.0864 => 1.4700, std.dev.: 0.0387)
MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 35.19% (1.0958 => 1.4814, std.dev.: 0.0341)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 34.75% (1.0617 => 1.4306, std.dev.: 0.0311)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 34.10% (1.0951 => 1.4685, std.dev.: 0.0394)
MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 33.70% (1.0507 => 1.4048, std.dev.: 0.0752)
MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 33.27% (1.1744 => 1.5651, std.dev.: 0.0342)
MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 33.04% (1.0418 => 1.3860, std.dev.: 0.1247)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 32.87% (1.0890 => 1.4470, std.dev.: 0.0409)
MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 32.46% (1.1209 => 1.4848, std.dev.: 0.0461)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 32.14% (1.0528 => 1.3912, std.dev.: 0.0606)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 31.82% (1.0526 => 1.3875, std.dev.: 0.0299)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 31.76% (0.9066 => 1.1945, std.dev.: 0.0553)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 29.98% (1.1428 => 1.4854, std.dev.: 0.0361)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 27.46% (1.3313 => 1.6969, std.dev.: 0.0446)
MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 27.36% (1.3692 => 1.7438, std.dev.: 0.0261)
MultiSource/Applications/hbd/hbd: 26.83% (1.5307 => 1.9414, std.dev.: 0.0574)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 26.38% (1.2270 => 1.5507, std.dev.: 0.0707)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 26.35% (1.4005 => 1.7695, std.dev.: 0.0039)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 25.30% (1.3046 => 1.6347, std.dev.: 0.0261)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 25.20% (1.2537 => 1.5696, std.dev.: 0.0597)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 25.03% (1.2835 => 1.6047, std.dev.: 0.0389)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 24.86% (1.1727 => 1.4642, std.dev.: 0.1118)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 24.58% (1.2723 => 1.5850, std.dev.: 0.0437)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 24.36% (1.3491 => 1.6777, std.dev.: 0.0921)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 24.25% (1.2419 => 1.5431, std.dev.: 0.0431)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 23.49% (1.2853 => 1.5872, std.dev.: 0.0354)
MultiSource/Applications/treecc/treecc: 23.28% (2.2217 => 2.7390, std.dev.: 0.1890)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 23.13% (1.4622 => 1.8004, std.dev.: 0.0349)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 22.62% (1.2929 => 1.5854, std.dev.: 0.0449)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 21.90% (1.2925 => 1.5756, std.dev.: 0.0821)
MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 21.75% (1.2704 => 1.5467, std.dev.: 0.0408)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 21.50% (1.3638 => 1.6570, std.dev.: 0.0699)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 18.55% (0.8843 => 1.0483, std.dev.: 0.0599)
MultiSource/Applications/SPASS/SPASS: 15.25% (16.3304 => 18.8200, std.dev.: 0.1260)
MultiSource/Applications/sqlite3/sqlite3: 12.65% (16.1895 => 18.2373, std.dev.: 0.0537)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.43% (23.8286 => 26.7897, std.dev.: 0.4226)
MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 11.27% (0.0914 => 0.1017, std.dev.: 0.0028)
MultiSource/Benchmarks/McCat/05-eks/eks: 10.61% (0.4798 => 0.5307, std.dev.: 0.0018)
MultiSource/Applications/kimwitu++/kc: 9.96% (18.4474 => 20.2848, std.dev.: 0.5570)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 6.49% (0.3793 => 0.4039, std.dev.: 0.0083)
MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 5.99% (0.7074 => 0.7498, std.dev.: 0.0153)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 5.17% (7.0997 => 7.4665, std.dev.: 0.0539)
MultiSource/Benchmarks/McCat/09-vor/vor: 4.56% (0.3358 => 0.3511, std.dev.: 0.0026)
MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.34% (5.3794 => 5.5593, std.dev.: 0.0424)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Benchmarks/BitBench/drop3/drop3: 54.45% (0.3010 => 0.4649, std.dev.: 0.0356)
SingleSource/Benchmarks/Misc/lowercase: 46.83% (0.7986 => 1.1726, std.dev.: 0.0034)
SingleSource/Benchmarks/Misc/fp-convert: 39.95% (5.6800 => 7.9492, std.dev.: 0.0338)
SingleSource/Benchmarks/Shootout-C++/methcall: 33.00% (8.6184 => 11.4624, std.dev.: 0.0879)
MultiSource/Benchmarks/Ptrdist/ks/ks: 30.15% (1.1586 => 1.5079, std.dev.: 0.0082)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 26.49% (12.6632 => 16.0174, std.dev.: 0.1185)
SingleSource/Benchmarks/Shootout-C++/ary: 24.75% (0.0505 => 0.0630, std.dev.: 0.0044)
SingleSource/Benchmarks/Shootout/hash: 23.61% (4.1780 => 5.1646, std.dev.: 0.1816)
SingleSource/Benchmarks/Shootout-C++/matrix: 21.00% (2.8804 => 3.4852, std.dev.: 0.0047)
MultiSource/Applications/lambda-0_1_3/lambda: 19.53% (6.9897 => 8.3548, std.dev.: 0.0711)
MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 19.51% (3.7569 => 4.4898, std.dev.: 0.0321)
MultiSource/Applications/SPASS/SPASS: 18.25% (8.4733 => 10.0194, std.dev.: 0.4633)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 16.78% (4.8478 => 5.6612, std.dev.: 0.0763)
MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.71% (2.5659 => 2.9946, std.dev.: 0.0580)
MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 16.59% (4.5865 => 5.3475, std.dev.: 0.0838)
MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 14.11% (8.7510 => 9.9858, std.dev.: 0.0108)
SingleSource/Benchmarks/Shootout-C++/hash: 13.59% (0.6540 => 0.7429, std.dev.: 0.0169)
MultiSource/Benchmarks/Olden/tsp/tsp: 13.58% (1.4232 => 1.6165, std.dev.: 0.0371)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 12.22% (2.5283 => 2.8372, std.dev.: 0.1125)
SingleSource/Benchmarks/Shootout/sieve: 11.46% (6.8087 => 7.5888, std.dev.: 0.0154)
SingleSource/Benchmarks/Shootout/matrix: 11.37% (1.5499 => 1.7261, std.dev.: 0.0102)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 11.26% (2.4191 => 2.6914, std.dev.: 0.0136)
MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 11.18% (4.8642 => 5.4078, std.dev.: 0.1324)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 10.79% (43.6112 => 48.3167, std.dev.: 0.2420)
MultiSource/Applications/hexxagon/hexxagon: 9.46% (14.4795 => 15.8488, std.dev.: 0.0737)
MultiSource/Applications/sqlite3/sqlite3: 9.03% (4.2776 => 4.6638, std.dev.: 0.0868)
SingleSource/Benchmarks/Misc/flops: 8.59% (9.3754 => 10.1811, std.dev.: 0.0149)
MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.17% (2.5458 => 2.7284, std.dev.: 0.0369)
MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.53% (4.7982 => 5.1117, std.dev.: 0.0604)
SingleSource/Benchmarks/Shootout-C++/hash2: 6.20% (3.3943 => 3.6046, std.dev.: 0.0066)
SingleSource/Benchmarks/BenchmarkGame/recursive: 5.89% (2.3673 => 2.5067, std.dev.: 0.0117)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 5.74% (1.0331 => 1.0924, std.dev.: 0.0139)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.73% (7.1548 => 7.5647, std.dev.: 0.0724)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.68% (5.0818 => 5.3703, std.dev.: 0.0266)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 5.67% (9.0122 => 9.5228, std.dev.: 0.0089)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 5.05% (5.1346 => 5.3940, std.dev.: 0.0240)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.90% (2.7893 => 2.9261, std.dev.: 0.0040)
SingleSource/Benchmarks/Dhrystone/fldry: 4.49% (0.6480 => 0.6771, std.dev.: 0.0058)
SingleSource/Benchmarks/Misc/whetstone: 4.32% (3.4590 => 3.6085, std.dev.: 0.0082)
SingleSource/Benchmarks/CoyoteBench/huffbench: 4.09% (23.4908 => 24.4527, std.dev.: 0.0456)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.99% (1.0374 => 1.0788, std.dev.: 0.0053)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.98% (0.3539 => 0.3680, std.dev.: 0.0027)
MultiSource/Applications/aha/aha: 3.95% (3.4994 => 3.6375, std.dev.: 0.0248)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 3.91% (1.0088 => 1.0482, std.dev.: 0.0113)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.41% (5.1006 => 5.2745, std.dev.: 0.0089)
MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.37% (6.1397 => 6.3466, std.dev.: 0.0343)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 3.11% (2.4484 => 2.5246, std.dev.: 0.0155)
MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.89% (9.6958 => 9.9764, std.dev.: 0.0244)
MultiSource/Benchmarks/PAQ8p/paq8p: 2.69% (90.5803 => 93.0201, std.dev.: 0.6838)
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.41% (2.0956 => 2.1461, std.dev.: 0.0019)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.30% (40.0804 => 41.0015, std.dev.: 0.2888)
SingleSource/Benchmarks/Misc/matmul_f64_4x4: 2.19% (1.4499 => 1.4816, std.dev.: 0.0010)
MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 2.13% (4.1182 => 4.2058, std.dev.: 0.0222)
MultiSource/Benchmarks/Olden/bh/bh: 1.99% (2.3749 => 2.4222, std.dev.: 0.0043)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.63% (4.0968 => 4.1634, std.dev.: 0.0230)
SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.56% (1.6120 => 1.6371, std.dev.: 0.0097)
SingleSource/Benchmarks/Misc/richards_benchmark: 1.09% (1.3414 => 1.3560, std.dev.: 0.0040)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Regression/C/sumarraymalloc: -48.52% (0.0810 => 0.0417, std.dev.: 0.0011)
SingleSource/Benchmarks/BenchmarkGame/fannkuch: -21.19% (0.0604 => 0.0476, std.dev.: 0.0030)
MultiSource/Benchmarks/FreeBench/neural/neural: -21.13% (0.2542 => 0.2005, std.dev.: 0.0084)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -14.51% (0.0937 => 0.0801, std.dev.: 0.0047)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.12% (0.1176 => 0.1010, std.dev.: 0.0048)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -10.76% (0.0985 => 0.0879, std.dev.: 0.0003)
MultiSource/Benchmarks/McCat/04-bisect/bisect: -9.50% (0.1495 => 0.1353, std.dev.: 0.0024)
MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -7.16% (0.4051 => 0.3761, std.dev.: 0.0049)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/FreeBench/neural/neural: -72.38% (1.0845 => 0.2995, std.dev.: 0.0139)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -64.34% (0.3861 => 0.1377, std.dev.: 0.0057)
SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -57.10% (3.4380 => 1.4748, std.dev.: 0.0044)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -56.80% (3.8940 => 1.6824, std.dev.: 0.0076)
MultiSource/Benchmarks/FreeBench/mason/mason: -45.23% (0.5213 => 0.2855, std.dev.: 0.0148)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -42.64% (0.3091 => 0.1773, std.dev.: 0.0332)
MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -32.94% (6.8267 => 4.5781, std.dev.: 0.0060)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -27.68% (0.4520 => 0.3269, std.dev.: 0.0067)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -26.66% (0.4111 => 0.3015, std.dev.: 0.0066)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -24.96% (0.2316 => 0.1738, std.dev.: 0.0024)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -24.70% (0.4368 => 0.3289, std.dev.: 0.0316)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -23.25% (0.1871 => 0.1436, std.dev.: 0.0011)
SingleSource/Benchmarks/Misc/perlin: -20.63% (4.5691 => 3.6266, std.dev.: 0.0034)
MultiSource/Benchmarks/mafft/pairlocalalign: -19.69% (57.5400 => 46.2122, std.dev.: 0.0391)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.45% (0.3279 => 0.2674, std.dev.: 0.0007)
MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -16.75% (6.0446 => 5.0324, std.dev.: 0.0409)
MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -16.43% (6.4626 => 5.4008, std.dev.: 0.0250)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -13.72% (6.7010 => 5.7817, std.dev.: 0.0151)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -12.54% (6.0602 => 5.3001, std.dev.: 0.0086)
SingleSource/Benchmarks/Misc/mandel: -11.40% (1.0882 => 0.9641, std.dev.: 0.0008)
SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -11.24% (3.5506 => 3.1516, std.dev.: 0.0113)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -10.25% (5.0054 => 4.4922, std.dev.: 0.0319)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -9.88% (5.8948 => 5.3121, std.dev.: 0.0837)
MultiSource/Benchmarks/McCat/18-imp/imp: -9.08% (0.1465 => 0.1332, std.dev.: 0.0029)
MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -8.83% (5.0816 => 4.6330, std.dev.: 0.0238)
MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.57% (9.5512 => 8.8279, std.dev.: 0.0342)
SingleSource/Benchmarks/McGill/queens: -7.48% (1.7928 => 1.6587, std.dev.: 0.0116)
MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -7.10% (3.3978 => 3.1565, std.dev.: 0.0098)
MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -7.01% (0.4924 => 0.4579, std.dev.: 0.0002)
MultiSource/Benchmarks/NPB-serial/is/is: -6.73% (13.2022 => 12.3131, std.dev.: 0.0075)
MultiSource/Applications/oggenc/oggenc: -5.91% (0.1826 => 0.1718, std.dev.: 0.0002)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -5.15% (3.9434 => 3.7404, std.dev.: 0.0058)
SingleSource/Benchmarks/Dhrystone/dry: -5.13% (0.5278 => 0.5007, std.dev.: 0.0016)
SingleSource/Benchmarks/Misc-C++/oopack_v1p8: -4.94% (0.2167 => 0.2060, std.dev.: 0.0023)
SingleSource/Benchmarks/BenchmarkGame/n-body: -4.61% (1.5779 => 1.5051, std.dev.: 0.0079)
SingleSource/Benchmarks/Misc/ReedSolomon: -4.50% (9.0356 => 8.6290, std.dev.: 0.0202)
MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -4.48% (3.3618 => 3.2112, std.dev.: 0.0040)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -4.47% (5.7666 => 5.5089, std.dev.: 0.0325)
MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.21% (5.6245 => 5.3876, std.dev.: 0.0207)
SingleSource/Benchmarks/Misc/fbench: -4.14% (4.9661 => 4.7607, std.dev.: 0.0152)
SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -4.03% (3.3922 => 3.2554, std.dev.: 0.0408)
MultiSource/Benchmarks/Olden/em3d/em3d: -3.90% (4.5899 => 4.4110, std.dev.: 0.0019)
MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -3.71% (4.4289 => 4.2644, std.dev.: 0.0098)
SingleSource/Benchmarks/Misc/ffbench: -3.63% (1.4279 => 1.3760, std.dev.: 0.0149)
MultiSource/Applications/SIBsim4/SIBsim4: -3.43% (3.4205 => 3.3032, std.dev.: 0.0257)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -3.30% (0.5182 => 0.5011, std.dev.: 0.0037)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.27% (4.3713 => 4.2284, std.dev.: 0.0051)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.95% (3.8286 => 3.7158, std.dev.: 0.0062)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.35% (6.7917 => 6.6322, std.dev.: 0.0227)
SingleSource/Benchmarks/CoyoteBench/almabench: -2.30% (35.0623 => 34.2568, std.dev.: 0.0618)
SingleSource/Benchmarks/Misc/flops-3: -1.32% (2.0809 => 2.0534, std.dev.: 0.0062)
Removed Tests - Compile Time
----------------------------
SingleSource/Benchmarks/Shootout-C++/except
Removed Tests - Execution Time
------------------------------
SingleSource/Benchmarks/Shootout-C++/except
Added Tests - Compile Time
--------------------------
SingleSource/Benchmarks/Shootout-C++/EH/except
SingleSource/Regression/C++/EH/recursive-throw
Added Tests - Execution Time
----------------------------
SingleSource/Benchmarks/Shootout-C++/EH/except
SingleSource/Regression/C++/EH/recursive-throw
Existing Failures - Compile Time
--------------------------------
MultiSource/Applications/obsequi/Obsequi
MultiSource/Applications/obsequi/Obsequi: 5.53% (1.1288 => 1.1912, std.dev.: 0.0849)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ALAC/decode/alacconvert-decode
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/obsequi/Obsequi
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael
MultiSource/Benchmarks/MiBench/security-sha/security-sha
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio
MultiSource/Benchmarks/mediabench/g721/g721encode/encode
MultiSource/Benchmarks/mediabench/gsm/toast/toast
SingleSource/Regression/C/2003-05-21-UnionBitfields
SingleSource/Regression/C/2003-05-21-UnionTest
SingleSource/UnitTests/2005-07-15-Bitfield-ABI
SingleSource/UnitTests/2006-01-23-UnionInit
SingleSource/UnitTests/2007-04-10-BitfieldTest
SingleSource/UnitTests/SignlessTypes/Large/cast
SingleSource/UnitTests/Vectorizer/gcc-loops
MultiSource/Applications/ALAC/decode/alacconvert-decode: -5.24% (0.0248 => 0.0235, std.dev.: 0.0048)
MultiSource/Applications/ClamAV/clamscan: 3.86% (0.1477 => 0.1534, std.dev.: 0.0237)
MultiSource/Applications/obsequi/Obsequi: - (0.0000 => 0.0000, std.dev.: 0.0001)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -12.22% (0.1309 => 0.1149, std.dev.: 0.0024)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 12.50% (0.0008 => 0.0009, std.dev.: 0.0001)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.10% (0.0613 => 0.0594, std.dev.: 0.0002)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: -14.86% (0.0276 => 0.0235, std.dev.: 0.0013)
MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 20.69% (0.0029 => 0.0035, std.dev.: 0.0003)
MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -40.74% (0.0027 => 0.0016, std.dev.: 0.0011)
MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 7.41% (0.0594 => 0.0638, std.dev.: 0.0034)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -23.27% (0.0361 => 0.0277, std.dev.: 0.0059)
SingleSource/Regression/C/2003-05-21-UnionBitfields: 700.00% (0.0001 => 0.0008, std.dev.: 0.0001)
SingleSource/Regression/C/2003-05-21-UnionTest: - (0.0001 => 0.0001, std.dev.: 0.0004)
SingleSource/UnitTests/2005-07-15-Bitfield-ABI: - (0.0001 => 0.0001, std.dev.: 0.0004)
SingleSource/UnitTests/2006-01-23-UnionInit: - (0.0001 => 0.0001, std.dev.: 0.0004)
SingleSource/UnitTests/2007-04-10-BitfieldTest: - (0.0001 => 0.0001)
SingleSource/UnitTests/SignlessTypes/Large/cast: -42.39% (0.0092 => 0.0053, std.dev.: 0.0051)
SingleSource/UnitTests/Vectorizer/gcc-loops: -15.09% (26.9213 => 22.8585, std.dev.: 0.0887)
Report Time: 0.84s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130425/4d1c2923/attachment.html>
More information about the llvm-testresults
mailing list