[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jul 24 13:12:14 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13719?compare_to=13715&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13719, Order: 187056, Start Time: 2013-07-24 18:22:16, End Time: 2013-07-24 20:13:50
      To: 13715, Order: 187048, Start Time: 2013-07-24 16:07:07, End Time: 2013-07-24 17:57:06
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 57 (48 on baseline)
Performance Improvements: 2 (5 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1048 (1054 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-10-29-ScalarReplBug: 154.63% (0.0108 => 0.0275, std.dev.: 0.0009)
  SingleSource/Regression/C/2003-05-21-UnionTest: 67.07% (0.0167 => 0.0279, std.dev.: 0.0014)
  SingleSource/UnitTests/2002-05-02-CastTest2: 58.65% (0.0208 => 0.0330, std.dev.: 0.0010)
  SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 57.73% (0.0220 => 0.0347, std.dev.: 0.0011)
  SingleSource/Regression/C/uint64_to_float: 54.10% (0.0427 => 0.0658, std.dev.: 0.0053)
  SingleSource/Benchmarks/Shootout/ary3: 50.94% (0.0373 => 0.0563, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout/ackermann: 50.00% (0.0248 => 0.0372, std.dev.: 0.0009)
  SingleSource/Benchmarks/Stanford/Towers: 47.09% (0.0533 => 0.0784, std.dev.: 0.0042)
  SingleSource/Regression/C/PR640: 43.39% (0.0242 => 0.0347, std.dev.: 0.0013)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 41.81% (0.0421 => 0.0597, std.dev.: 0.0056)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 41.70% (0.9778 => 1.3855, std.dev.: 0.0334)
  MultiSource/Applications/spiff/spiff: 35.37% (0.9487 => 1.2843, std.dev.: 0.0415)
  MultiSource/Applications/viterbi/viterbi: 33.57% (0.1814 => 0.2423, std.dev.: 0.0142)
  MultiSource/Applications/treecc/treecc: 30.62% (2.3633 => 3.0869, std.dev.: 0.0494)
  SingleSource/Benchmarks/Stanford/Perm: 30.53% (0.0380 => 0.0496, std.dev.: 0.0039)
  SingleSource/Benchmarks/Misc/mandel: 28.74% (0.0581 => 0.0748, std.dev.: 0.0053)
  MultiSource/Applications/ClamAV/clamscan: 18.42% (16.9777 => 20.1057, std.dev.: 0.7843)
  MultiSource/Applications/SPASS/SPASS: 16.93% (17.0898 => 19.9823, std.dev.: 0.4485)
  MultiSource/Applications/hexxagon/hexxagon: 14.65% (1.1155 => 1.2789, std.dev.: 0.0569)
  MultiSource/Applications/JM/lencod/lencod: 13.59% (17.3018 => 19.6536, std.dev.: 0.8347)
  MultiSource/Applications/sqlite3/sqlite3: 10.83% (17.3554 => 19.2348, std.dev.: 0.2468)
  SingleSource/UnitTests/Vector/constpool: 9.59% (9.7072 => 10.6380, std.dev.: 0.1581)
  MultiSource/Applications/minisat/minisat: 8.42% (0.7811 => 0.8469, std.dev.: 0.0247)
  SingleSource/UnitTests/Vector/Altivec/test1: 7.81% (0.1396 => 0.1505, std.dev.: 0.0038)
  MultiSource/Applications/oggenc/oggenc: 6.31% (5.7096 => 6.0701, std.dev.: 0.0362)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 6.31% (1.4853 => 1.5790, std.dev.: 0.0284)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.90% (1.5936 => 1.6876, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 5.61% (1.5357 => 1.6219, std.dev.: 0.0136)
  SingleSource/Benchmarks/Shootout-C++/matrix: 5.33% (0.2666 => 0.2808, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.29% (1.3751 => 1.4478, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.27% (1.4271 => 1.5023, std.dev.: 0.0088)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.00% (1.5135 => 1.5892, std.dev.: 0.0291)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.42% (1.3639 => 1.4242, std.dev.: 0.0204)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.65% (1.4416 => 1.4942, std.dev.: 0.0108)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.23% (0.9880 => 1.0199, std.dev.: 0.0104)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 37.84% (3.2654 => 4.5009, std.dev.: 0.1727)
  MultiSource/Applications/minisat/minisat: 30.44% (6.2229 => 8.1172, std.dev.: 0.1944)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 28.43% (1.4654 => 1.8820, std.dev.: 0.0073)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 27.68% (2.3186 => 2.9605, std.dev.: 0.1189)
  SingleSource/Benchmarks/Shootout-C++/moments: 20.10% (0.1035 => 0.1243, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout/heapsort: 18.18% (3.7689 => 4.4540, std.dev.: 0.1411)
  MultiSource/Applications/SPASS/SPASS: 16.42% (8.2037 => 9.5505, std.dev.: 0.0553)
  SingleSource/Benchmarks/Shootout/ary3: 15.06% (9.3801 => 10.7924, std.dev.: 0.3041)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 14.83% (0.3310 => 0.3801, std.dev.: 0.0096)
  SingleSource/Benchmarks/Shootout/strcat: 14.23% (0.1588 => 0.1814, std.dev.: 0.0077)
  SingleSource/Benchmarks/Linpack/linpack-pc: 13.70% (45.3595 => 51.5732, std.dev.: 0.2434)
  SingleSource/Benchmarks/Shootout/hash: 7.34% (4.2570 => 4.5694, std.dev.: 0.1196)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 5.06% (1.0526 => 1.1059, std.dev.: 0.0064)
  MultiSource/Applications/lua/lua: 3.90% (29.8740 => 31.0397, std.dev.: 0.2215)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.50% (91.4234 => 94.6214, std.dev.: 0.4858)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.71% (39.7556 => 40.8319, std.dev.: 0.0929)
  MultiSource/Applications/JM/lencod/lencod: 1.59% (7.1641 => 7.2777, std.dev.: 0.0361)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.48% (46.7681 => 47.4608, std.dev.: 0.2221)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.44% (3.4101 => 3.4592, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.27% (3.3435 => 3.3858, std.dev.: 0.0159)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.22% (5.8181 => 5.8893, std.dev.: 0.0091)
  MultiSource/Benchmarks/BitBench/five11/five11: 1.16% (5.6069 => 5.6717, std.dev.: 0.0247)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -12.05% (0.5154 => 0.4533, std.dev.: 0.0032)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.08% (2.6102 => 2.5560, std.dev.: 0.0171)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 21.04% (0.1312 => 0.1588, std.dev.: 0.0100)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2003-05-21-UnionTest: 71.17% (0.0163 => 0.0279, std.dev.: 0.0014)
  SingleSource/UnitTests/2003-10-29-ScalarReplBug: 69.75% (0.0162 => 0.0275, std.dev.: 0.0009)
  SingleSource/UnitTests/2002-05-02-CastTest2: 62.56% (0.0203 => 0.0330, std.dev.: 0.0010)
  SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 58.45% (0.0219 => 0.0347, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout/ary3: 57.26% (0.0358 => 0.0563, std.dev.: 0.0027)
  SingleSource/Regression/C/uint64_to_float: 55.19% (0.0424 => 0.0658, std.dev.: 0.0053)
  SingleSource/Benchmarks/Misc/mandel: 53.28% (0.0488 => 0.0748, std.dev.: 0.0053)
  SingleSource/Benchmarks/Shootout/ackermann: 52.46% (0.0244 => 0.0372, std.dev.: 0.0009)
  SingleSource/Regression/C/PR640: 47.66% (0.0235 => 0.0347, std.dev.: 0.0013)
  SingleSource/Benchmarks/Stanford/Towers: 47.65% (0.0531 => 0.0784, std.dev.: 0.0042)
  SingleSource/Benchmarks/Stanford/Perm: 40.11% (0.0354 => 0.0496, std.dev.: 0.0039)
  SingleSource/Benchmarks/McGill/queens: 35.45% (0.0536 => 0.0726, std.dev.: 0.0066)
  MultiSource/Applications/spiff/spiff: 34.09% (0.9578 => 1.2843, std.dev.: 0.0415)
  SingleSource/Benchmarks/Misc/flops-5: 32.44% (0.0336 => 0.0445, std.dev.: 0.0040)
  MultiSource/Applications/treecc/treecc: 30.52% (2.3651 => 3.0869, std.dev.: 0.0494)
  MultiSource/Applications/viterbi/viterbi: 27.19% (0.1905 => 0.2423, std.dev.: 0.0142)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.82% (1.1012 => 1.3855, std.dev.: 0.0334)
  SingleSource/UnitTests/Vector/constpool: 20.03% (8.8630 => 10.6380, std.dev.: 0.1581)
  MultiSource/Applications/SPASS/SPASS: 11.56% (17.9111 => 19.9823, std.dev.: 0.4485)
  SingleSource/Benchmarks/Shootout-C++/matrix: 7.63% (0.2609 => 0.2808, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 7.39% (6.4979 => 6.9778, std.dev.: 0.0646)
  SingleSource/Benchmarks/Shootout-C++/wc: 7.20% (0.2458 => 0.2635, std.dev.: 0.0048)
  SingleSource/UnitTests/Vector/Altivec/test1: 7.19% (0.1404 => 0.1505, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 5.82% (0.2318 => 0.2453, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 5.20% (0.4309 => 0.4533, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 5.01% (1.5037 => 1.5790, std.dev.: 0.0284)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 4.46% (0.2311 => 0.2414, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.27% (1.6185 => 1.6876, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.81% (1.3946 => 1.4478, std.dev.: 0.0102)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 85.57% (5.8158 => 10.7924, std.dev.: 0.3041)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 55.03% (2.9033 => 4.5009, std.dev.: 0.1727)
  SingleSource/Benchmarks/Shootout/heapsort: 52.94% (2.9123 => 4.4540, std.dev.: 0.1411)
  SingleSource/Benchmarks/Stanford/Towers: 36.20% (0.0279 => 0.0380, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 27.02% (2.9428 => 3.7379, std.dev.: 0.1895)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.22% (1.5030 => 1.8820, std.dev.: 0.0073)
  SingleSource/Benchmarks/Shootout-C++/moments: 17.49% (0.1058 => 0.1243, std.dev.: 0.0048)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 15.74% (2.1022 => 2.4331, std.dev.: 0.0782)
  SingleSource/Benchmarks/Shootout/strcat: 13.87% (0.1593 => 0.1814, std.dev.: 0.0077)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 13.46% (2.6094 => 2.9605, std.dev.: 0.1189)
  SingleSource/Benchmarks/Shootout/hash: 9.20% (4.1846 => 4.5694, std.dev.: 0.1196)
  SingleSource/Benchmarks/Linpack/linpack-pc: 6.72% (48.3256 => 51.5732, std.dev.: 0.2434)
  SingleSource/Benchmarks/Shootout-C++/matrix: 6.29% (2.8867 => 3.0682, std.dev.: 0.0702)
  SingleSource/Benchmarks/Shootout-C++/ary3: 4.55% (2.0229 => 2.1150, std.dev.: 0.0325)
  MultiSource/Applications/SPASS/SPASS: 3.56% (9.2220 => 9.5505, std.dev.: 0.0553)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.49% (3.4085 => 3.4592, std.dev.: 0.0061)
  MultiSource/Applications/JM/lencod/lencod: 1.36% (7.1799 => 7.2777, std.dev.: 0.0361)
  SingleSource/Benchmarks/Misc/dt: 1.35% (0.9776 => 0.9908, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout/fib2: 1.23% (4.9231 => 4.9836, std.dev.: 0.0114)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -22.52% (0.0675 => 0.0523, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -5.67% (1.5144 => 1.4286, std.dev.: 0.0304)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: -30.19% (0.1189 => 0.0830, std.dev.: 0.0088)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -28.68% (0.0816 => 0.0582, std.dev.: 0.0048)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.77% (0.6480 => 0.6365, std.dev.: 0.0037)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 15.24% (0.1378 => 0.1588, std.dev.: 0.0100)

Report Time: 0.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130724/10c227e4/attachment.html>


More information about the llvm-testresults mailing list