[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Aug 18 10:33:13 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14535?compare_to=14532&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14535, Order: 188638, Start Time: 2013-08-18 15:51:17, End Time: 2013-08-18 17:35:18
      To: 14532, Order: 188637, Start Time: 2013-08-18 13:45:30, End Time: 2013-08-18 15:28:12
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 4 (35 on baseline)
Performance Improvements: 0 (94 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1103 (978 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 52.56% (1.6433 => 2.5070, std.dev.: 0.0025)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 22.27% (1.5239 => 1.8632, std.dev.: 0.0087)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.64% (44.9281 => 46.1154, std.dev.: 0.1413)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.59% (1.2634 => 1.2835, std.dev.: 0.0075)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.54% (0.1307 => 0.1314, std.dev.: 0.0090)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/bigstack: 37.98% (0.0466 => 0.0643, std.dev.: 0.0011)
  MultiSource/Benchmarks/FreeBench/distray/distray: 15.10% (0.1033 => 0.1189, std.dev.: 0.0047)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 74.06% (3.7285 => 6.4898, std.dev.: 0.0572)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.30% (2.8867 => 4.2809, std.dev.: 0.0381)
  MultiSource/Benchmarks/FreeBench/neural/neural: 33.68% (0.3171 => 0.4239, std.dev.: 0.0199)
  SingleSource/Benchmarks/Misc/pi: 26.39% (1.9835 => 2.5070, std.dev.: 0.0025)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 23.97% (1.5030 => 1.8632, std.dev.: 0.0087)
  SingleSource/Benchmarks/Shootout/hash: 23.03% (4.1846 => 5.1485, std.dev.: 0.2155)
  SingleSource/Benchmarks/Shootout-C++/hash: 16.00% (0.6295 => 0.7302, std.dev.: 0.0196)
  MultiSource/Applications/lambda-0_1_3/lambda: 11.02% (7.0762 => 7.8557, std.dev.: 0.0065)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.39% (1.2557 => 1.3611, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.34% (5.4910 => 5.9487, std.dev.: 0.0099)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.99% (48.3256 => 52.1854, std.dev.: 0.0333)
  MultiSource/Applications/JM/lencod/lencod: 7.22% (7.1799 => 7.6986, std.dev.: 0.1822)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.71% (3.2027 => 3.4177, std.dev.: 0.0242)
  SingleSource/Benchmarks/McGill/chomp: 6.43% (1.0051 => 1.0697, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.82% (5.3042 => 5.6131, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.53% (3.4085 => 3.5970, std.dev.: 0.0595)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.48% (5.5008 => 5.8025, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.25% (5.1471 => 5.3656, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.17% (4.3151 => 4.4949, std.dev.: 0.0179)
  SingleSource/Benchmarks/Misc/whetstone: 3.90% (3.4559 => 3.5907, std.dev.: 0.0087)
  MultiSource/Applications/siod/siod: 3.85% (3.3761 => 3.5061, std.dev.: 0.0481)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.46% (3.3384 => 3.4540, std.dev.: 0.0076)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.29% (6.1245 => 6.3263, std.dev.: 0.0119)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.25% (25.0200 => 25.8320, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.04% (4.8739 => 5.0222, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout-C++/hash2: 3.03% (3.3877 => 3.4902, std.dev.: 0.0011)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.72% (1.3104 => 1.3460, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.51% (12.8625 => 13.1849, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.82% (3.3464 => 3.4073, std.dev.: 0.0024)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.60% (1.4398 => 1.4628, std.dev.: 0.0027)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.55% (1.2639 => 1.2835, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.11% (4.9040 => 4.9583, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.00% (3.0680 => 3.0988, std.dev.: 0.0061)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: -34.33% (0.1072 => 0.0704, std.dev.: 0.0012)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -21.33% (0.0675 => 0.0531, std.dev.: 0.0016)
  MultiSource/Benchmarks/Olden/health/health: -20.47% (0.1993 => 0.1585, std.dev.: 0.0140)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.16% (1.5228 => 1.2158, std.dev.: 0.0069)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -19.66% (0.3576 => 0.2873, std.dev.: 0.0081)
  MultiSource/Applications/hbd/hbd: -17.34% (2.0193 => 1.6691, std.dev.: 0.0844)
  MultiSource/Applications/lua/lua: -17.05% (5.3200 => 4.4130, std.dev.: 0.0125)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -17.00% (0.1518 => 0.1260, std.dev.: 0.0004)
  MultiSource/Applications/hexxagon/hexxagon: -15.88% (1.3285 => 1.1175, std.dev.: 0.0325)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -13.66% (1.3985 => 1.2075, std.dev.: 0.0073)
  MultiSource/Applications/sgefa/sgefa: -13.27% (0.4809 => 0.4171, std.dev.: 0.0056)
  MultiSource/Applications/JM/ldecod/ldecod: -11.78% (8.6720 => 7.6502, std.dev.: 0.0472)
  MultiSource/Applications/ClamAV/clamscan: -11.53% (19.4145 => 17.1769, std.dev.: 0.6569)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -10.52% (1.7797 => 1.5925, std.dev.: 0.0021)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -9.41% (0.3655 => 0.3311, std.dev.: 0.0015)
  MultiSource/Applications/kimwitu++/kc: -7.48% (21.0770 => 19.5007, std.dev.: 0.4680)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -7.25% (1.4514 => 1.3462, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -7.13% (1.5144 => 1.4064, std.dev.: 0.0125)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.13% (0.2498 => 0.2320, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -7.05% (1.5426 => 1.4338, std.dev.: 0.0066)
  MultiSource/Applications/siod/siod: -6.84% (2.7150 => 2.5294, std.dev.: 0.0490)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.54% (1.4794 => 1.3827, std.dev.: 0.0136)
  MultiSource/Applications/Burg/burg: -6.46% (1.5733 => 1.4716, std.dev.: 0.0159)
  MultiSource/Applications/JM/lencod/lencod: -6.42% (18.5029 => 17.3142, std.dev.: 0.4468)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.05% (1.5239 => 1.4317, std.dev.: 0.0344)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.99% (1.4333 => 1.3475, std.dev.: 0.0120)
  MultiSource/Benchmarks/PAQ8p/paq8p: -5.70% (2.6853 => 2.5322, std.dev.: 0.0219)
  MultiSource/Applications/oggenc/oggenc: -5.68% (6.1121 => 5.7649, std.dev.: 0.0626)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.55% (1.5437 => 1.4580, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -5.13% (1.4721 => 1.3966, std.dev.: 0.0140)
  MultiSource/Applications/minisat/minisat: -5.10% (0.8278 => 0.7856, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -5.08% (1.4166 => 1.3446, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.85% (1.4506 => 1.3803, std.dev.: 0.0012)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.84% (27.6418 => 26.3048, std.dev.: 0.2624)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -4.32% (1.5629 => 1.4954, std.dev.: 0.0070)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.84% (0.3309 => 0.3182, std.dev.: 0.0021)
  MultiSource/Benchmarks/Bullet/bullet: -3.64% (37.4863 => 36.1236, std.dev.: 0.0614)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -3.57% (49.1253 => 47.3720, std.dev.: 0.1201)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.41% (1.5357 => 1.4833, std.dev.: 0.0150)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.85% (0.7189 => 0.6984, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.51% (1.3649 => 1.3307, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.43% (1.5416 => 1.5042, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -2.20% (1.6185 => 1.5829, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.85% (1.3952 => 1.3694, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.74% (1.3946 => 1.3704, std.dev.: 0.0045)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -37.96% (1.4194 => 0.8806, std.dev.: 0.0868)
  MultiSource/Benchmarks/MallocBench/gs/gs: -35.16% (0.1189 => 0.0771, std.dev.: 0.0091)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -34.80% (0.0816 => 0.0532, std.dev.: 0.0021)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.45% (2.1022 => 1.4200, std.dev.: 0.0075)
  MultiSource/Applications/viterbi/viterbi: -27.28% (3.4923 => 2.5396, std.dev.: 0.0239)
  MultiSource/Applications/JM/ldecod/ldecod: -25.61% (0.0859 => 0.0639, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.66% (6.9552 => 5.2399, std.dev.: 0.0317)
  MultiSource/Applications/minisat/minisat: -22.75% (8.0162 => 6.1925, std.dev.: 0.1802)
  SingleSource/Benchmarks/Misc/perlin: -21.53% (4.5989 => 3.6088, std.dev.: 0.0040)
  MultiSource/Applications/obsequi/Obsequi: -18.79% (2.6081 => 2.1180, std.dev.: 0.0839)
  SingleSource/Benchmarks/Misc/mandel: -14.62% (1.1996 => 1.0242, std.dev.: 0.0357)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.57% (0.3557 => 0.3110, std.dev.: 0.0134)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -11.82% (0.0956 => 0.0843, std.dev.: 0.0019)
  MultiSource/Applications/SPASS/SPASS: -11.29% (9.2220 => 8.1807, std.dev.: 0.0566)
  SingleSource/Benchmarks/Shootout/strcat: -7.91% (0.1593 => 0.1467, std.dev.: 0.0007)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -5.33% (0.4969 => 0.4704, std.dev.: 0.0017)
  SingleSource/Regression/C/uint64_to_float: -5.24% (1.5184 => 1.4389, std.dev.: 0.0041)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -4.77% (0.3773 => 0.3593, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.60% (3.8119 => 3.6367, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/fbench: -4.50% (4.9602 => 4.7368, std.dev.: 0.0015)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.32% (0.7355 => 0.7037, std.dev.: 0.0030)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.21% (1.1032 => 1.0568, std.dev.: 0.0076)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.16% (0.5097 => 0.4885, std.dev.: 0.0004)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -4.06% (1.7207 => 1.6508, std.dev.: 0.0077)
  MultiSource/Benchmarks/Bullet/bullet: -4.06% (7.2995 => 7.0034, std.dev.: 0.0106)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.77% (2.7049 => 2.6029, std.dev.: 0.0375)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.74% (21.6864 => 20.8757, std.dev.: 0.0749)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.48% (0.7806 => 0.7534, std.dev.: 0.0012)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -3.47% (0.4783 => 0.4617, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.44% (6.0444 => 5.8366, std.dev.: 0.0008)
  MultiSource/Benchmarks/PAQ8p/paq8p: -3.10% (93.6732 => 90.7676, std.dev.: 0.1822)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.02% (6.1482 => 5.9627, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.83% (5.2218 => 5.0741, std.dev.: 0.0051)
  MultiSource/Applications/sgefa/sgefa: -2.74% (1.4030 => 1.3646, std.dev.: 0.0033)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.71% (41.0210 => 39.9103, std.dev.: 0.2540)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.43% (8.6172 => 8.4080, std.dev.: 0.0108)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.35% (47.2250 => 46.1154, std.dev.: 0.1413)
  SingleSource/Benchmarks/Misc/oourafft: -2.19% (3.7891 => 3.7062, std.dev.: 0.0268)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.16% (1.0964 => 1.0727, std.dev.: 0.0019)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -2.03% (29.8131 => 29.2093, std.dev.: 0.0150)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.01% (34.8438 => 34.1433, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.60% (5.0180 => 4.9378, std.dev.: 0.0159)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.58% (1.6737 => 1.6472, std.dev.: 0.0067)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.49% (5.6678 => 5.5834, std.dev.: 0.0235)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.45% (5.8810 => 5.7955, std.dev.: 0.0030)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.41% (2.1343 => 2.1041, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.35% (4.9231 => 4.8568, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout/lists: -1.12% (7.2315 => 7.1505, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout-C++/lists: -1.11% (16.5294 => 16.3459, std.dev.: 0.0589)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.64% (0.1378 => 0.1314, std.dev.: 0.0090)

Report Time: 0.73s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130818/c8850c69/attachment.html>


More information about the llvm-testresults mailing list