[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jun 25 17:16:43 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12757?compare_to=12753&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12757, Order: 184875, Start Time: 2013-06-25 22:23:34, End Time: 2013-06-26 00:17:46
      To: 12753, Order: 184873, Start Time: 2013-06-25 20:17:57, End Time: 2013-06-25 22:00:22
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 62 (57 on baseline)
Performance Improvements: 0 (23 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1045 (1027 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-10-13-SwitchTest: 80.14% (0.0146 => 0.0263, std.dev.: 0.0008)
  SingleSource/UnitTests/2002-10-12-StructureArgs: 71.26% (0.0167 => 0.0286, std.dev.: 0.0014)
  SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 69.44% (0.0144 => 0.0244, std.dev.: 0.0016)
  SingleSource/UnitTests/2003-05-26-Shorts: 68.40% (0.0231 => 0.0389, std.dev.: 0.0004)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 56.05% (1.1922 => 1.8604, std.dev.: 0.0426)
  SingleSource/UnitTests/2003-05-07-VarArgs: 53.36% (0.0268 => 0.0411, std.dev.: 0.0028)
  SingleSource/UnitTests/2003-07-09-LoadShorts: 52.45% (0.0265 => 0.0404, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 48.78% (0.0781 => 0.1162, std.dev.: 0.0073)
  MultiSource/Benchmarks/Olden/tsp/tsp: 42.41% (0.1337 => 0.1904, std.dev.: 0.0167)
  MultiSource/Benchmarks/MallocBench/gs/gs: 36.33% (4.6160 => 6.2930, std.dev.: 0.4530)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 36.21% (0.2273 => 0.3096, std.dev.: 0.0219)
  MultiSource/Benchmarks/Olden/mst/mst: 35.29% (0.1363 => 0.1844, std.dev.: 0.0172)
  MultiSource/Applications/hbd/hbd: 33.23% (1.6246 => 2.1644, std.dev.: 0.1109)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 25.08% (0.3306 => 0.4135, std.dev.: 0.0176)
  MultiSource/Applications/ClamAV/clamscan: 23.94% (16.7722 => 20.7879, std.dev.: 0.5284)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 22.00% (1.6226 => 1.9795, std.dev.: 0.0473)
  MultiSource/Applications/obsequi/Obsequi: 20.81% (1.1640 => 1.4062, std.dev.: 0.0541)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 12.79% (1.3911 => 1.5690, std.dev.: 0.0439)
  MultiSource/Applications/sqlite3/sqlite3: 9.72% (16.4759 => 18.0780, std.dev.: 0.1433)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 8.96% (0.1283 => 0.1398, std.dev.: 0.0009)
  MultiSource/Applications/SPASS/SPASS: 8.53% (16.8395 => 18.2762, std.dev.: 0.5511)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.61% (1.6835 => 1.8116, std.dev.: 0.0288)
  MultiSource/Applications/lemon/lemon: 7.17% (1.2186 => 1.3060, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 6.95% (1.7106 => 1.8295, std.dev.: 0.0388)
  SingleSource/Benchmarks/Shootout-C++/sieve: 6.75% (0.3083 => 0.3291, std.dev.: 0.0054)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.12% (25.6097 => 27.1760, std.dev.: 0.4815)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 6.03% (1.4734 => 1.5622, std.dev.: 0.0261)
  SingleSource/Benchmarks/Misc-C++/bigfib: 5.99% (0.7097 => 0.7522, std.dev.: 0.0027)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.81% (4.1786 => 4.4213, std.dev.: 0.0668)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.59% (1.3883 => 1.4659, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.55% (1.5169 => 1.6011, std.dev.: 0.0252)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.48% (1.4449 => 1.5241, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 5.36% (1.6680 => 1.7574, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 5.33% (1.6632 => 1.7518, std.dev.: 0.0071)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 81.35% (0.1335 => 0.2421, std.dev.: 0.0418)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 67.66% (0.0201 => 0.0337, std.dev.: 0.0004)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 66.19% (0.7595 => 1.2622, std.dev.: 0.0376)
  MultiSource/Applications/lemon/lemon: 60.53% (0.9252 => 1.4852, std.dev.: 0.1467)
  SingleSource/Benchmarks/Shootout/ary3: 56.39% (5.7918 => 9.0578, std.dev.: 0.7213)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 44.17% (0.0532 => 0.0767, std.dev.: 0.0076)
  SingleSource/Benchmarks/Shootout/heapsort: 42.06% (2.8913 => 4.1074, std.dev.: 0.2069)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 30.54% (1.2460 => 1.6265, std.dev.: 0.0309)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.28% (1.4749 => 1.8625, std.dev.: 0.0266)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 5.99% (60.9165 => 64.5679, std.dev.: 1.2168)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 5.35% (1.0555 => 1.1120, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc/flops-7: 5.34% (1.7293 => 1.8217, std.dev.: 0.0097)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.20% (90.3858 => 95.0821, std.dev.: 0.8177)
  SingleSource/Benchmarks/Shootout/hash: 5.02% (5.2342 => 5.4972, std.dev.: 0.0751)
  MultiSource/Applications/sqlite3/sqlite3: 3.83% (4.3116 => 4.4769, std.dev.: 0.0250)
  MultiSource/Applications/lua/lua: 3.70% (27.7155 => 28.7397, std.dev.: 0.2397)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.64% (3.2688 => 3.3877, std.dev.: 0.0281)
  MultiSource/Benchmarks/Olden/em3d/em3d: 3.50% (5.0073 => 5.1826, std.dev.: 0.0372)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.39% (3.4264 => 3.5427, std.dev.: 0.0330)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.31% (5.2607 => 5.4349, std.dev.: 0.0049)
  SingleSource/Benchmarks/Misc/ffbench: 3.19% (1.3699 => 1.4136, std.dev.: 0.0123)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 2.96% (2.4603 => 2.5331, std.dev.: 0.0219)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.39% (4.0486 => 4.1455, std.dev.: 0.0234)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.15% (4.7337 => 4.8355, std.dev.: 0.0167)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.99% (1.6310 => 1.6634, std.dev.: 0.0009)
  MultiSource/Applications/JM/lencod/lencod: 1.82% (7.0732 => 7.2020, std.dev.: 0.0472)
  MultiSource/Benchmarks/Olden/power/power: 1.11% (1.2524 => 1.2663, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.01% (5.4637 => 5.5187, std.dev.: 0.0187)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 5.49% (0.1422 => 0.1500, std.dev.: 0.0178)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2003-05-26-Shorts: 64.83% (0.0236 => 0.0389, std.dev.: 0.0004)
  SingleSource/UnitTests/2003-05-07-VarArgs: 59.30% (0.0258 => 0.0411, std.dev.: 0.0028)
  SingleSource/UnitTests/2002-10-12-StructureArgs: 58.01% (0.0181 => 0.0286, std.dev.: 0.0014)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 55.63% (1.1954 => 1.8604, std.dev.: 0.0426)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 51.30% (0.0768 => 0.1162, std.dev.: 0.0073)
  SingleSource/UnitTests/2003-07-09-LoadShorts: 47.99% (0.0273 => 0.0404, std.dev.: 0.0018)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 35.02% (0.2293 => 0.3096, std.dev.: 0.0219)
  MultiSource/Benchmarks/MallocBench/gs/gs: 33.63% (4.7091 => 6.2930, std.dev.: 0.4530)
  MultiSource/Benchmarks/Olden/tsp/tsp: 33.61% (0.1425 => 0.1904, std.dev.: 0.0167)
  MultiSource/Applications/hbd/hbd: 32.09% (1.6386 => 2.1644, std.dev.: 0.1109)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 24.80% (1.5862 => 1.9795, std.dev.: 0.0473)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 22.41% (0.3378 => 0.4135, std.dev.: 0.0176)
  MultiSource/Applications/ClamAV/clamscan: 20.00% (17.3229 => 20.7879, std.dev.: 0.5284)
  MultiSource/Applications/obsequi/Obsequi: 19.85% (1.1733 => 1.4062, std.dev.: 0.0541)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 13.38% (1.3838 => 1.5690, std.dev.: 0.0439)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 7.66% (1.6993 => 1.8295, std.dev.: 0.0388)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 7.04% (1.4238 => 1.5241, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.82% (1.4081 => 1.5042, std.dev.: 0.0364)
  SingleSource/Benchmarks/Shootout-C++/sieve: 6.57% (0.3088 => 0.3291, std.dev.: 0.0054)
  SingleSource/Benchmarks/Misc-C++/bigfib: 6.56% (0.7059 => 0.7522, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.55% (1.4131 => 1.5056, std.dev.: 0.0311)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 6.53% (1.7006 => 1.8116, std.dev.: 0.0288)
  MultiSource/Applications/sqlite3/sqlite3: 6.52% (16.9719 => 18.0780, std.dev.: 0.1433)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 6.10% (1.6563 => 1.7574, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 5.98% (1.5108 => 1.6011, std.dev.: 0.0252)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 5.97% (1.3833 => 1.4659, std.dev.: 0.0100)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.94% (4.1734 => 4.4213, std.dev.: 0.0668)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.86% (1.4757 => 1.5622, std.dev.: 0.0261)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 5.45% (2.6076 => 2.7496, std.dev.: 0.0545)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.79% (25.9348 => 27.1760, std.dev.: 0.4815)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 4.25% (1.6804 => 1.7518, std.dev.: 0.0071)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 56.85% (0.0489 => 0.0767, std.dev.: 0.0076)
  SingleSource/Benchmarks/Shootout/ary3: 50.66% (6.0122 => 9.0578, std.dev.: 0.7213)
  SingleSource/Benchmarks/Shootout/heapsort: 36.97% (2.9988 => 4.1074, std.dev.: 0.2069)
  MultiSource/Applications/sgefa/sgefa: 30.26% (1.1695 => 1.5234, std.dev.: 0.0038)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 23.13% (1.0251 => 1.2622, std.dev.: 0.0376)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 20.21% (1.3530 => 1.6265, std.dev.: 0.0309)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.57% (6.1372 => 7.1540, std.dev.: 0.0444)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.89% (0.9806 => 1.1364, std.dev.: 0.0085)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.16% (1.2224 => 1.3466, std.dev.: 0.0320)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.24% (5.2003 => 5.6288, std.dev.: 0.0675)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.35% (3.1853 => 3.3877, std.dev.: 0.0281)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 5.19% (1.0571 => 1.1120, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.09% (3.2201 => 3.3841, std.dev.: 0.0541)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.04% (4.6639 => 4.8989, std.dev.: 0.0257)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.54% (5.2788 => 5.5187, std.dev.: 0.0187)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 4.39% (3.9713 => 4.1455, std.dev.: 0.0234)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.26% (2.8994 => 3.0230, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.77% (5.9362 => 6.1602, std.dev.: 0.0490)
  SingleSource/Benchmarks/Misc/ffbench: 3.21% (1.3696 => 1.4136, std.dev.: 0.0123)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.14% (1.7925 => 1.8488, std.dev.: 0.0171)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.13% (5.5010 => 5.6731, std.dev.: 0.0485)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.75% (4.6379 => 4.7654, std.dev.: 0.0196)
  MultiSource/Applications/JM/lencod/lencod: 2.37% (7.0353 => 7.2020, std.dev.: 0.0472)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.97% (5.6582 => 5.7697, std.dev.: 0.0298)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.18% (1.6440 => 1.6634, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.13% (4.7814 => 4.8355, std.dev.: 0.0167)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/whetstone: -11.49% (0.1097 => 0.0971, std.dev.: 0.0023)
  MultiSource/Applications/oggenc/oggenc: -3.66% (5.9886 => 5.7695, std.dev.: 0.0795)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.13% (1.2911 => 0.7343, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -37.48% (4.4050 => 2.7539, std.dev.: 0.0479)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.16% (4.8986 => 3.8622, std.dev.: 0.3031)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -19.89% (5.7264 => 4.5873, std.dev.: 0.0672)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.31% (6.2328 => 5.0913, std.dev.: 0.0033)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.24% (25.3677 => 21.2474, std.dev.: 0.0631)
  MultiSource/Benchmarks/mafft/pairlocalalign: -13.74% (48.3307 => 41.6910, std.dev.: 0.0799)
  SingleSource/Benchmarks/Misc/salsa20: -12.80% (10.3398 => 9.0165, std.dev.: 0.0877)
  MultiSource/Applications/siod/siod: -9.22% (3.7240 => 3.3808, std.dev.: 0.0572)
  SingleSource/Benchmarks/Shootout-C++/hash: -8.82% (0.7941 => 0.7241, std.dev.: 0.0230)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.83% (4.5717 => 4.2593, std.dev.: 0.0438)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.51% (5.5889 => 5.2248, std.dev.: 0.0173)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.22% (0.1945 => 0.1824, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.15% (9.8728 => 9.2654, std.dev.: 0.1536)
  SingleSource/Benchmarks/Misc/flops: -3.73% (10.2170 => 9.8361, std.dev.: 0.0129)
  MultiSource/Applications/sqlite3/sqlite3: -3.43% (4.6358 => 4.4769, std.dev.: 0.0250)
  MultiSource/Applications/hexxagon/hexxagon: -3.35% (15.4979 => 14.9793, std.dev.: 0.1722)
  SingleSource/Benchmarks/Shootout/sieve: -2.91% (8.0178 => 7.7843, std.dev.: 0.0472)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.45% (3.8665 => 3.7719, std.dev.: 0.0274)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.97% (1.6980 => 1.6645, std.dev.: 0.0111)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.92% (8.5243 => 8.3604, std.dev.: 0.0277)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 4.09% (0.1441 => 0.1500, std.dev.: 0.0178)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130625/d663abf6/attachment.html>


More information about the llvm-testresults mailing list