[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jul 31 23:23:24 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13981?compare_to=13977&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13981, Order: 187555, Start Time: 2013-08-01 04:38:27, End Time: 2013-08-01 06:25:09
      To: 13977, Order: 187554, Start Time: 2013-08-01 02:29:42, End Time: 2013-08-01 04:14:25
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 7 (23 on baseline)
Performance Improvements: 1 (60 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1099 (1024 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 6.23% (0.2168 => 0.2303, std.dev.: 0.0013)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 12.46% (1.0786 => 1.2130, std.dev.: 0.0198)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 8.65% (0.2647 => 0.2876, std.dev.: 0.0048)
  MultiSource/Benchmarks/mafft/pairlocalalign: 6.02% (41.7843 => 44.3013, std.dev.: 0.2348)
  MultiSource/Benchmarks/Olden/health/health: 4.33% (0.3279 => 0.3421, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.78% (1.4698 => 1.4959, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.71% (1.0703 => 1.0886, std.dev.: 0.0051)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -14.85% (6.1320 => 5.2213, std.dev.: 0.2498)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.15% (0.1316 => 0.1314, std.dev.: 0.0036)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 49.16% (2.8867 => 4.3059, std.dev.: 0.0364)
  MultiSource/Benchmarks/FreeBench/neural/neural: 41.53% (0.3171 => 0.4488, std.dev.: 0.0301)
  SingleSource/Benchmarks/Shootout/hash: 24.36% (4.1846 => 5.2041, std.dev.: 0.3151)
  SingleSource/Benchmarks/Shootout-C++/hash: 23.56% (0.6295 => 0.7778, std.dev.: 0.0261)
  MultiSource/Applications/lambda-0_1_3/lambda: 13.66% (7.0762 => 8.0425, std.dev.: 0.0327)
  MultiSource/Applications/siod/siod: 13.44% (3.3761 => 3.8297, std.dev.: 0.0538)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 10.63% (1.0964 => 1.2130, std.dev.: 0.0198)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.32% (5.4910 => 5.9479, std.dev.: 0.0082)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.03% (48.3256 => 52.2038, std.dev.: 0.3459)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.93% (1.2557 => 1.3553, std.dev.: 0.0367)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 7.35% (0.2679 => 0.2876, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.90% (3.2027 => 3.4236, std.dev.: 0.0094)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.17% (14.9584 => 15.8815, std.dev.: 0.1791)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.82% (5.3042 => 5.6128, std.dev.: 0.0452)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.76% (3.4085 => 3.6050, std.dev.: 0.0254)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.76% (3.3877 => 3.5827, std.dev.: 0.0297)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.44% (5.5008 => 5.8003, std.dev.: 0.0558)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.26% (4.3151 => 4.4988, std.dev.: 0.0090)
  SingleSource/Benchmarks/Misc/whetstone: 4.16% (3.4559 => 3.5998, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.72% (3.3384 => 3.4625, std.dev.: 0.0461)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.47% (12.8625 => 13.1796, std.dev.: 0.0529)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.69% (1.4398 => 1.4642, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.15% (4.9040 => 4.9602, std.dev.: 0.0212)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -36.03% (0.2237 => 0.1431, std.dev.: 0.0170)
  MultiSource/Benchmarks/Olden/bisort/bisort: -31.90% (0.1072 => 0.0730, std.dev.: 0.0069)
  MultiSource/Benchmarks/Olden/tsp/tsp: -25.36% (0.1818 => 0.1357, std.dev.: 0.0121)
  MultiSource/Benchmarks/MallocBench/gs/gs: -21.87% (6.0938 => 4.7611, std.dev.: 0.4357)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -20.95% (0.0587 => 0.0464, std.dev.: 0.0032)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -19.10% (0.1518 => 0.1228, std.dev.: 0.0010)
  MultiSource/Applications/hbd/hbd: -17.27% (2.0193 => 1.6705, std.dev.: 0.0111)
  MultiSource/Applications/hexxagon/hexxagon: -15.87% (1.3285 => 1.1177, std.dev.: 0.0056)
  MultiSource/Applications/sgefa/sgefa: -12.54% (0.4809 => 0.4206, std.dev.: 0.0038)
  MultiSource/Applications/ClamAV/clamscan: -12.04% (19.4145 => 17.0766, std.dev.: 0.1105)
  MultiSource/Applications/aha/aha: -11.92% (0.1401 => 0.1234, std.dev.: 0.0064)
  MultiSource/Applications/lambda-0_1_3/lambda: -10.88% (0.9461 => 0.8432, std.dev.: 0.0112)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -10.22% (0.3073 => 0.2759, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -10.04% (1.7797 => 1.6011, std.dev.: 0.0290)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -9.79% (0.3655 => 0.3297, std.dev.: 0.0029)
  MultiSource/Applications/sqlite3/sqlite3: -9.21% (19.1635 => 17.3989, std.dev.: 0.6383)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.81% (0.2498 => 0.2303, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.91% (1.5345 => 1.4285, std.dev.: 0.0055)
  MultiSource/Applications/siod/siod: -6.63% (2.7150 => 2.5350, std.dev.: 0.0376)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.39% (1.5426 => 1.4441, std.dev.: 0.0223)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.76% (1.4339 => 1.3657, std.dev.: 0.0151)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -4.20% (0.7189 => 0.6887, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.20% (1.4333 => 1.3731, std.dev.: 0.0177)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -4.03% (5.2851 => 5.0722, std.dev.: 0.0185)
  MultiSource/Applications/lemon/lemon: -3.78% (1.2976 => 1.2485, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -3.67% (1.5629 => 1.5056, std.dev.: 0.0036)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.61% (15.5498 => 15.1437, std.dev.: 0.0445)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.18% (1.4932 => 1.4607, std.dev.: 0.0057)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -36.49% (1.4194 => 0.9014, std.dev.: 0.0242)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -33.09% (0.0816 => 0.0546, std.dev.: 0.0014)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.00% (2.1022 => 1.4294, std.dev.: 0.0162)
  MultiSource/Applications/JM/ldecod/ldecod: -29.22% (0.0859 => 0.0608, std.dev.: 0.0086)
  MultiSource/Applications/viterbi/viterbi: -27.63% (3.4923 => 2.5274, std.dev.: 0.0898)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.63% (6.9552 => 5.2424, std.dev.: 0.1988)
  SingleSource/Benchmarks/Misc/perlin: -21.43% (4.5989 => 3.6132, std.dev.: 0.0217)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -16.63% (6.2627 => 5.2213, std.dev.: 0.2498)
  SingleSource/Benchmarks/Misc/mandel: -13.99% (1.1996 => 1.0318, std.dev.: 0.0073)
  MultiSource/Applications/sgefa/sgefa: -13.56% (1.4030 => 1.2127, std.dev.: 0.0051)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -12.97% (0.0956 => 0.0832, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout/strcat: -10.23% (0.1593 => 0.1430, std.dev.: 0.0040)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.99% (3.5791 => 3.2214, std.dev.: 0.0822)
  MultiSource/Applications/lua/lua: -8.33% (31.0707 => 28.4833, std.dev.: 0.7337)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.19% (47.2250 => 44.3013, std.dev.: 0.2348)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.28% (1.7207 => 1.6298, std.dev.: 0.0140)
  SingleSource/Regression/C/uint64_to_float: -5.14% (1.5184 => 1.4403, std.dev.: 0.0231)
  SingleSource/Benchmarks/Misc/fbench: -4.33% (4.9602 => 4.7454, std.dev.: 0.0160)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.28% (0.7355 => 0.7040, std.dev.: 0.0043)
  MultiSource/Benchmarks/Olden/health/health: -3.80% (0.3556 => 0.3421, std.dev.: 0.0044)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.66% (2.7049 => 2.6060, std.dev.: 0.0299)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.42% (6.0444 => 5.8379, std.dev.: 0.0028)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -3.26% (0.4783 => 0.4627, std.dev.: 0.0007)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -2.90% (21.6864 => 21.0565, std.dev.: 0.1260)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.82% (5.2218 => 5.0743, std.dev.: 0.0543)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.48% (41.0210 => 40.0041, std.dev.: 0.3114)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.41% (8.6172 => 8.4099, std.dev.: 0.0027)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.88% (34.8438 => 34.1880, std.dev.: 0.0869)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.77% (5.6678 => 5.5676, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.57% (5.0180 => 4.9391, std.dev.: 0.0284)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.34% (4.9231 => 4.8569, std.dev.: 0.0048)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -1.25% (1.1024 => 1.0886, std.dev.: 0.0051)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.64% (0.1378 => 0.1314, std.dev.: 0.0036)

Report Time: 1.56s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130801/a3f75d8e/attachment.html>


More information about the llvm-testresults mailing list