[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Tue Sep 24 16:19:23 PDT 2013
http://llvm.org/perf/db_default/v4/nts/15631?compare_to=15627&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16
Comparing:
Run: 15631, Order: 191334, Start Time: 2013-09-24 21:32:19, End Time: 2013-09-24 23:22:08
To: 15627, Order: 191325, Start Time: 2013-09-24 19:19:23, End Time: 2013-09-24 21:11:09
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18
===============
Tests Summary
===============
Performance Regressions: 41 (51 on baseline)
Performance Improvements: 39 (23 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1027 (1033 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 47.99% (0.1421 => 0.2103, std.dev.: 0.0260)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 44.35% (0.9449 => 1.3640, std.dev.: 0.1274)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 41.08% (0.2690 => 0.3795, std.dev.: 0.0242)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 34.36% (0.6747 => 0.9065, std.dev.: 0.0857)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 33.26% (9.8042 => 13.0648, std.dev.: 0.5918)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 33.15% (7.4316 => 9.8951, std.dev.: 0.4156)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 32.92% (1.4395 => 1.9134, std.dev.: 0.0934)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 31.51% (4.9314 => 6.4853, std.dev.: 0.5283)
MultiSource/Benchmarks/sim/sim: 18.71% (0.3810 => 0.4523, std.dev.: 0.0191)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 13.70% (1.3682 => 1.5556, std.dev.: 0.0407)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 13.62% (0.6396 => 0.7267, std.dev.: 0.0324)
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.86% (0.1691 => 0.1807, std.dev.: 0.0006)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.38% (1.2591 => 1.2891, std.dev.: 0.0115)
MultiSource/Applications/SIBsim4/SIBsim4: 1.17% (1.5754 => 1.5939, std.dev.: 0.0059)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Misc/pi: 58.00% (1.6524 => 2.6108, std.dev.: 0.0002)
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 33.06% (0.0620 => 0.0825, std.dev.: 0.0043)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 28.52% (2.4880 => 3.1976, std.dev.: 0.0302)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.77% (1.4856 => 1.8981, std.dev.: 0.0334)
SingleSource/Benchmarks/Shootout-C++/matrix: 26.80% (3.1137 => 3.9481, std.dev.: 0.0007)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 24.52% (0.2818 => 0.3509, std.dev.: 0.0256)
MultiSource/Benchmarks/llubenchmark/llu: 22.17% (1.9754 => 2.4134, std.dev.: 0.0720)
SingleSource/Benchmarks/Misc/ReedSolomon: 15.18% (8.4928 => 9.7817, std.dev.: 0.0047)
SingleSource/Benchmarks/Shootout/matrix: 11.71% (1.8901 => 2.1114, std.dev.: 0.0014)
MultiSource/Benchmarks/BitBench/drop3/drop3: 6.15% (0.4621 => 0.4905, std.dev.: 0.0079)
MultiSource/Benchmarks/Prolangs-C++/primes/primes: 5.95% (0.8436 => 0.8938, std.dev.: 0.0179)
MultiSource/Applications/aha/aha: 5.64% (3.5735 => 3.7751, std.dev.: 0.0060)
SingleSource/Regression/C/uint64_to_float: 4.61% (1.4172 => 1.4825, std.dev.: 0.0009)
SingleSource/Benchmarks/Stanford/FloatMM: 3.62% (0.7038 => 0.7293, std.dev.: 0.0000)
MultiSource/Applications/lua/lua: 3.18% (29.4708 => 30.4073, std.dev.: 0.3460)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.96% (5.8278 => 6.0005, std.dev.: 0.0498)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.87% (4.1846 => 4.3045, std.dev.: 0.0089)
SingleSource/UnitTests/Vectorizer/gcc-loops: 2.59% (18.1986 => 18.6691, std.dev.: 0.0694)
SingleSource/Benchmarks/Shootout-C++/methcall: 2.57% (12.3407 => 12.6579, std.dev.: 0.0060)
SingleSource/Benchmarks/Shootout-C++/hash2: 2.19% (3.6026 => 3.6816, std.dev.: 0.0009)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.10% (2.4894 => 2.5418, std.dev.: 0.0012)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.89% (6.5970 => 6.7216, std.dev.: 0.0046)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.64% (6.7111 => 6.8211, std.dev.: 0.0006)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.52% (1.0494 => 1.0653, std.dev.: 0.0012)
SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.20% (3.8849 => 3.9317, std.dev.: 0.0003)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.07% (3.1823 => 3.2164, std.dev.: 0.0007)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.01% (3.6110 => 3.6476, std.dev.: 0.0119)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Benchmarks/Dhrystone/dry: -26.74% (0.0778 => 0.0570, std.dev.: 0.0007)
SingleSource/Benchmarks/Shootout/nestedloop: -26.51% (0.0430 => 0.0316, std.dev.: 0.0007)
SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -14.09% (0.0894 => 0.0768, std.dev.: 0.0020)
SingleSource/Benchmarks/Misc-C++/stepanov_container: -11.45% (1.0061 => 0.8909, std.dev.: 0.0138)
SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: -10.05% (0.2378 => 0.2139, std.dev.: 0.0019)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -10.04% (0.7084 => 0.6373, std.dev.: 0.0125)
SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -9.28% (0.9109 => 0.8264, std.dev.: 0.0119)
SingleSource/UnitTests/Vector/constpool: -8.94% (9.9301 => 9.0419, std.dev.: 0.1163)
SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -8.79% (0.3277 => 0.2989, std.dev.: 0.0005)
SingleSource/Benchmarks/Shootout-C++/ary: -8.33% (0.2713 => 0.2487, std.dev.: 0.0002)
SingleSource/Benchmarks/CoyoteBench/fftbench: -8.25% (0.4317 => 0.3961, std.dev.: 0.0069)
MultiSource/Applications/Burg/burg: -8.22% (1.5524 => 1.4248, std.dev.: 0.0113)
SingleSource/Benchmarks/Misc-C++/Large/ray: -7.82% (0.3595 => 0.3314, std.dev.: 0.0035)
SingleSource/Benchmarks/Misc-C++/bigfib: -6.53% (0.7131 => 0.6665, std.dev.: 0.0031)
SingleSource/Benchmarks/Shootout-C++/hello: -5.63% (0.1900 => 0.1793, std.dev.: 0.0012)
SingleSource/Benchmarks/Shootout-C++/lists1: -3.77% (0.3240 => 0.3118, std.dev.: 0.0011)
SingleSource/Benchmarks/Shootout-C++/hash: -2.55% (0.4082 => 0.3978, std.dev.: 0.0029)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/CoyoteBench/fftbench: -40.20% (2.4400 => 1.4592, std.dev.: 0.2947)
SingleSource/Benchmarks/Shootout-C++/heapsort: -39.50% (4.6719 => 2.8267, std.dev.: 0.0044)
SingleSource/Benchmarks/Misc-C++/stepanov_container: -30.82% (6.5165 => 4.5081, std.dev.: 0.0763)
SingleSource/Benchmarks/Shootout/heapsort: -29.82% (4.2155 => 2.9584, std.dev.: 0.0168)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -14.85% (47.2981 => 40.2733, std.dev.: 2.5847)
SingleSource/Benchmarks/Shootout/nestedloop: -7.86% (0.1615 => 0.1488, std.dev.: 0.0044)
MultiSource/Applications/sgefa/sgefa: -7.78% (0.9095 => 0.8387, std.dev.: 0.0012)
SingleSource/Benchmarks/BenchmarkGame/recursive: -6.84% (2.4654 => 2.2968, std.dev.: 0.0424)
SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -6.19% (30.3648 => 28.4849, std.dev.: 0.4949)
SingleSource/Benchmarks/Shootout-C++/ary3: -4.97% (5.1567 => 4.9003, std.dev.: 0.0889)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.81% (0.7470 => 0.7111, std.dev.: 0.0096)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.67% (2.7560 => 2.6549, std.dev.: 0.0037)
SingleSource/Benchmarks/Dhrystone/dry: -3.43% (0.5039 => 0.4866, std.dev.: 0.0002)
MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.03% (41.5231 => 40.2629, std.dev.: 0.3569)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.91% (1.1218 => 1.0891, std.dev.: 0.0065)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.29% (4.8776 => 4.7660, std.dev.: 0.0137)
SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.27% (3.2702 => 3.1960, std.dev.: 0.0073)
SingleSource/Benchmarks/Shootout/hash: -2.07% (5.2509 => 5.1424, std.dev.: 0.0119)
SingleSource/Benchmarks/Dhrystone/fldry: -1.55% (0.6859 => 0.6753, std.dev.: 0.0001)
SingleSource/Benchmarks/Shootout-C++/fibo: -1.41% (5.0117 => 4.9410, std.dev.: 0.0058)
MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.19% (5.8361 => 5.7666, std.dev.: 0.0266)
MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.15% (1.6949 => 1.6754, std.dev.: 0.0048)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 1.12% (0.1339 => 0.1354, std.dev.: 0.0004)
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 50.00% (0.1402 => 0.2103, std.dev.: 0.0260)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 48.07% (0.9212 => 1.3640, std.dev.: 0.1274)
MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 39.73% (0.2716 => 0.3795, std.dev.: 0.0242)
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 37.00% (0.6617 => 0.9065, std.dev.: 0.0857)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 36.35% (1.4033 => 1.9134, std.dev.: 0.0934)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 36.18% (7.2661 => 9.8951, std.dev.: 0.4156)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 34.20% (9.7354 => 13.0648, std.dev.: 0.5918)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 32.07% (4.9105 => 6.4853, std.dev.: 0.5283)
MultiSource/Benchmarks/sim/sim: 21.20% (0.3732 => 0.4523, std.dev.: 0.0191)
MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 16.94% (1.3303 => 1.5556, std.dev.: 0.0407)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 15.42% (0.6296 => 0.7267, std.dev.: 0.0324)
MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 13.95% (1.2948 => 1.4754, std.dev.: 0.0686)
MultiSource/Applications/sqlite3/sqlite3: 7.30% (16.2888 => 17.4782, std.dev.: 0.3469)
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 5.92% (0.1706 => 0.1807, std.dev.: 0.0006)
MultiSource/Applications/SIBsim4/SIBsim4: 3.95% (1.5333 => 1.5939, std.dev.: 0.0059)
SingleSource/Benchmarks/Misc-C++/bigfib: 3.51% (0.6439 => 0.6665, std.dev.: 0.0031)
MultiSource/Applications/SPASS/SPASS: 3.48% (16.1646 => 16.7278, std.dev.: 0.1340)
MultiSource/Applications/treecc/treecc: 2.98% (2.2516 => 2.3188, std.dev.: 0.0107)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.75% (1.3036 => 1.3394, std.dev.: 0.0136)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 2.70% (1.2981 => 1.3331, std.dev.: 0.0133)
MultiSource/Applications/oggenc/oggenc: 2.46% (5.3339 => 5.4652, std.dev.: 0.0455)
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Shootout-C++/methcall: 65.62% (7.6426 => 12.6579, std.dev.: 0.0060)
SingleSource/Benchmarks/Misc/pi: 57.52% (1.6574 => 2.6108, std.dev.: 0.0002)
SingleSource/Benchmarks/Shootout-C++/matrix: 38.27% (2.8554 => 3.9481, std.dev.: 0.0007)
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 32.85% (0.0621 => 0.0825, std.dev.: 0.0043)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 29.18% (2.4753 => 3.1976, std.dev.: 0.0302)
MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.99% (1.4830 => 1.8981, std.dev.: 0.0334)
MultiSource/Benchmarks/llubenchmark/llu: 21.34% (1.9889 => 2.4134, std.dev.: 0.0720)
SingleSource/Benchmarks/Shootout/matrix: 18.56% (1.7809 => 2.1114, std.dev.: 0.0014)
SingleSource/Benchmarks/Misc/ReedSolomon: 14.73% (8.5256 => 9.7817, std.dev.: 0.0047)
MultiSource/Applications/obsequi/Obsequi: 12.50% (2.1884 => 2.4620, std.dev.: 0.1050)
MultiSource/Benchmarks/Prolangs-C++/primes/primes: 8.04% (0.8273 => 0.8938, std.dev.: 0.0179)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.68% (1.2516 => 1.3352, std.dev.: 0.0206)
SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0002)
MultiSource/Applications/lambda-0_1_3/lambda: 6.04% (8.1346 => 8.6263, std.dev.: 0.0521)
MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.76% (6.5990 => 6.9791, std.dev.: 0.1422)
MultiSource/Applications/spiff/spiff: 5.75% (2.8194 => 2.9815, std.dev.: 0.0334)
MultiSource/Applications/aha/aha: 5.65% (3.5731 => 3.7751, std.dev.: 0.0060)
SingleSource/Benchmarks/McGill/misr: 5.12% (0.3771 => 0.3964, std.dev.: 0.0000)
MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.19% (4.5744 => 4.7660, std.dev.: 0.0137)
MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.89% (5.7757 => 6.0005, std.dev.: 0.0498)
MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.91% (1.7652 => 1.8165, std.dev.: 0.0087)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.22% (3.5683 => 3.6476, std.dev.: 0.0119)
SingleSource/Regression/C/uint64_to_float: 2.04% (1.4528 => 1.4825, std.dev.: 0.0009)
SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.91% (3.8582 => 3.9317, std.dev.: 0.0003)
MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.80% (6.6028 => 6.7216, std.dev.: 0.0046)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.68% (1.0477 => 1.0653, std.dev.: 0.0012)
SingleSource/Benchmarks/Shootout/methcall: 1.63% (8.5434 => 8.6825, std.dev.: 0.0134)
SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.25% (1.5940 => 1.6140, std.dev.: 0.0061)
SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.16% (6.7429 => 6.8211, std.dev.: 0.0006)
SingleSource/Benchmarks/SmallPT/smallpt: 1.14% (16.7972 => 16.9885, std.dev.: 0.0356)
Performance Improvements - Compile Time
---------------------------------------
SingleSource/Benchmarks/CoyoteBench/lpbench: -8.79% (0.1195 => 0.1090, std.dev.: 0.0011)
SingleSource/Benchmarks/Shootout-C++/matrix: -7.55% (0.2571 => 0.2377, std.dev.: 0.0019)
Performance Improvements - Execution Time
-----------------------------------------
MultiSource/Benchmarks/FreeBench/neural/neural: -53.88% (0.5226 => 0.2410, std.dev.: 0.0615)
MultiSource/Applications/sgefa/sgefa: -46.88% (1.5790 => 0.8387, std.dev.: 0.0012)
SingleSource/Benchmarks/Linpack/linpack-pc: -43.12% (57.2347 => 32.5559, std.dev.: 7.1272)
SingleSource/Benchmarks/Shootout/heapsort: -17.59% (3.5900 => 2.9584, std.dev.: 0.0168)
MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.79% (15.9508 => 13.2732, std.dev.: 0.2960)
SingleSource/Benchmarks/Shootout-C++/ackermann: -12.17% (4.0006 => 3.5136, std.dev.: 0.1242)
SingleSource/UnitTests/Vectorizer/gcc-loops: -10.35% (20.8247 => 18.6691, std.dev.: 0.0694)
SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.99% (3.4956 => 3.2164, std.dev.: 0.0007)
MultiSource/Benchmarks/mafft/pairlocalalign: -7.39% (50.0284 => 46.3326, std.dev.: 0.3128)
SingleSource/Benchmarks/Shootout-C++/heapsort: -6.12% (3.0111 => 2.8267, std.dev.: 0.0044)
MultiSource/Applications/SIBsim4/SIBsim4: -5.90% (3.7437 => 3.5230, std.dev.: 0.0823)
SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.63% (30.1838 => 28.4849, std.dev.: 0.4949)
SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.86% (0.7474 => 0.7111, std.dev.: 0.0096)
SingleSource/Benchmarks/Misc/salsa20: -3.98% (7.7964 => 7.4858, std.dev.: 0.0560)
MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.21% (5.4473 => 5.2724, std.dev.: 0.0670)
SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.00% (2.5938 => 2.5418, std.dev.: 0.0012)
MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.95% (17.1431 => 16.8089, std.dev.: 0.0796)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.66% (1.1075 => 1.0891, std.dev.: 0.0065)
SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.25% (4.3592 => 4.3045, std.dev.: 0.0089)
SingleSource/Benchmarks/Shootout/hash: -1.12% (5.2009 => 5.1424, std.dev.: 0.0119)
MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.10% (2.1472 => 2.1235, std.dev.: 0.0037)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 0.45% (0.1348 => 0.1354, std.dev.: 0.0004)
Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130924/37e3df02/attachment.html>
More information about the llvm-testresults
mailing list