[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Jul 29 22:41:41 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13909?compare_to=13905&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13909, Order: 187402, Start Time: 2013-07-30 03:55:59, End Time: 2013-07-30 05:43:24
      To: 13905, Order: 187398, Start Time: 2013-07-30 01:45:56, End Time: 2013-07-30 03:35:07
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 11 (30 on baseline)
Performance Improvements: 3 (56 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1093 (1021 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.20% (1.3565 => 1.3864, std.dev.: 0.0075)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.04% (1.1898 => 1.2141, std.dev.: 0.0084)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/fp-convert: 16.66% (6.9018 => 8.0514, std.dev.: 0.0081)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 10.85% (0.1907 => 0.2114, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/salsa20: 9.13% (8.2130 => 8.9628, std.dev.: 0.0091)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 7.14% (0.2760 => 0.2957, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/flops-4: 5.92% (1.5393 => 1.6304, std.dev.: 0.0192)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.45% (91.3253 => 96.3067, std.dev.: 1.0141)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 4.67% (0.2720 => 0.2847, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc/flops: 4.38% (9.5040 => 9.9202, std.dev.: 0.0040)
  SingleSource/Benchmarks/Misc/whetstone: 1.05% (3.5833 => 3.6208, std.dev.: 0.0076)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/JM/lencod/lencod: -4.50% (7.4320 => 7.0975, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -3.72% (0.4945 => 0.4761, std.dev.: 0.0009)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.72% (3.3548 => 3.2301, std.dev.: 0.0069)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.33% (0.1376 => 0.1344, std.dev.: 0.0014)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.36% (2.8867 => 4.2826, std.dev.: 0.0168)
  MultiSource/Benchmarks/FreeBench/neural/neural: 36.93% (0.3171 => 0.4342, std.dev.: 0.0404)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 32.84% (0.0341 => 0.0453, std.dev.: 0.0031)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.24% (1.5030 => 1.8974, std.dev.: 0.0195)
  SingleSource/Benchmarks/Shootout/hash: 24.84% (4.1846 => 5.2242, std.dev.: 0.3106)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 17.16% (2.9428 => 3.4478, std.dev.: 0.1191)
  SingleSource/Benchmarks/Shootout-C++/hash: 16.30% (0.6295 => 0.7321, std.dev.: 0.0134)
  MultiSource/Applications/siod/siod: 13.59% (3.3761 => 3.8349, std.dev.: 0.0014)
  MultiSource/Applications/lambda-0_1_3/lambda: 12.39% (7.0762 => 7.9528, std.dev.: 0.0197)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 10.38% (0.2679 => 0.2957, std.dev.: 0.0012)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.24% (0.1678 => 0.1833, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.30% (5.4910 => 5.9469, std.dev.: 0.0505)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.95% (1.2557 => 1.3555, std.dev.: 0.0067)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.91% (48.3256 => 52.1458, std.dev.: 0.0070)
  SingleSource/Benchmarks/McGill/chomp: 7.24% (1.0051 => 1.0779, std.dev.: 0.0159)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.92% (3.2027 => 3.4242, std.dev.: 0.0220)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.81% (3.3877 => 3.5845, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.80% (5.3042 => 5.6121, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.72% (3.4085 => 3.6034, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.46% (5.5008 => 5.8013, std.dev.: 0.0270)
  SingleSource/Benchmarks/Misc/whetstone: 4.77% (3.4559 => 3.6208, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.30% (4.3151 => 4.5005, std.dev.: 0.0671)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.01% (4.8739 => 5.0205, std.dev.: 0.0529)
  MultiSource/Benchmarks/PAQ8p/paq8p: 2.81% (93.6732 => 96.3067, std.dev.: 1.0141)
  MultiSource/Applications/spiff/spiff: 2.57% (2.7609 => 2.8319, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.81% (3.3464 => 3.4069, std.dev.: 0.0166)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.69% (3.5351 => 3.5949, std.dev.: 0.0140)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.68% (1.4398 => 1.4640, std.dev.: 0.0071)
  SingleSource/Benchmarks/Misc/flops: 1.57% (9.7664 => 9.9202, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.04% (3.0680 => 3.0998, std.dev.: 0.0084)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -35.85% (0.2237 => 0.1435, std.dev.: 0.0206)
  MultiSource/Benchmarks/Olden/bisort/bisort: -33.21% (0.1072 => 0.0716, std.dev.: 0.0091)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -21.21% (1.5228 => 1.1998, std.dev.: 0.0154)
  MultiSource/Applications/obsequi/Obsequi: -19.58% (1.4685 => 1.1810, std.dev.: 0.0185)
  MultiSource/Applications/lua/lua: -17.44% (5.3200 => 4.3924, std.dev.: 0.0816)
  MultiSource/Applications/hexxagon/hexxagon: -16.36% (1.3285 => 1.1112, std.dev.: 0.0322)
  MultiSource/Applications/sgefa/sgefa: -14.24% (0.4809 => 0.4124, std.dev.: 0.0035)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -13.19% (1.3985 => 1.2141, std.dev.: 0.0084)
  MultiSource/Applications/ClamAV/clamscan: -12.58% (19.4145 => 16.9717, std.dev.: 0.0671)
  MultiSource/Applications/lambda-0_1_3/lambda: -12.08% (0.9461 => 0.8318, std.dev.: 0.0263)
  MultiSource/Applications/JM/ldecod/ldecod: -12.02% (8.6720 => 7.6295, std.dev.: 0.0293)
  MultiSource/Applications/sqlite3/sqlite3: -9.64% (19.1635 => 17.3165, std.dev.: 0.4332)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -8.31% (1.4514 => 1.3308, std.dev.: 0.0131)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.75% (1.7461 => 1.6107, std.dev.: 0.0018)
  MultiSource/Applications/aha/aha: -7.64% (0.1401 => 0.1294, std.dev.: 0.0016)
  MultiSource/Applications/siod/siod: -7.10% (2.7150 => 2.5221, std.dev.: 0.0157)
  MultiSource/Applications/Burg/burg: -7.05% (1.5733 => 1.4624, std.dev.: 0.0033)
  MultiSource/Applications/JM/lencod/lencod: -6.60% (18.5029 => 17.2820, std.dev.: 0.0564)
  MultiSource/Applications/oggenc/oggenc: -6.58% (6.1121 => 5.7100, std.dev.: 0.0280)
  MultiSource/Applications/minisat/minisat: -5.79% (0.8278 => 0.7799, std.dev.: 0.0140)
  MultiSource/Applications/SPASS/SPASS: -4.70% (17.9111 => 17.0691, std.dev.: 0.0373)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -3.35% (1.3952 => 1.3484, std.dev.: 0.0143)
  MultiSource/Applications/d/make_dparser: -1.68% (3.7722 => 3.7088, std.dev.: 0.0092)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -37.09% (1.4194 => 0.8929, std.dev.: 0.0179)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.12% (2.1022 => 1.4269, std.dev.: 0.0114)
  MultiSource/Benchmarks/MallocBench/gs/gs: -28.43% (0.1189 => 0.0851, std.dev.: 0.0035)
  MultiSource/Applications/viterbi/viterbi: -27.54% (3.4923 => 2.5305, std.dev.: 0.0027)
  MultiSource/Applications/JM/ldecod/ldecod: -24.91% (0.0859 => 0.0645, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.63% (6.9552 => 5.2422, std.dev.: 0.0311)
  MultiSource/Applications/minisat/minisat: -21.50% (8.0162 => 6.2929, std.dev.: 0.5046)
  SingleSource/Benchmarks/Misc/perlin: -21.44% (4.5989 => 3.6130, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -16.54% (6.2627 => 5.2266, std.dev.: 0.2550)
  SingleSource/Benchmarks/Misc/mandel: -14.60% (1.1996 => 1.0245, std.dev.: 0.0278)
  MultiSource/Applications/obsequi/Obsequi: -13.42% (2.6081 => 2.2581, std.dev.: 0.0436)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.90% (0.3557 => 0.3098, std.dev.: 0.0170)
  MultiSource/Applications/sgefa/sgefa: -12.84% (1.4030 => 1.2228, std.dev.: 0.0012)
  MultiSource/Applications/SPASS/SPASS: -12.28% (9.2220 => 8.0892, std.dev.: 0.0071)
  MultiSource/Benchmarks/mafft/pairlocalalign: -11.52% (47.2250 => 41.7854, std.dev.: 1.5917)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.75% (3.5791 => 3.2301, std.dev.: 0.0069)
  MultiSource/Applications/lua/lua: -9.10% (31.0707 => 28.2439, std.dev.: 0.3864)
  SingleSource/Regression/C/uint64_to_float: -6.36% (1.5184 => 1.4219, std.dev.: 0.0314)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.75% (3.8119 => 3.6307, std.dev.: 0.0334)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.27% (0.7355 => 0.7041, std.dev.: 0.0029)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -4.19% (0.4969 => 0.4761, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc/fbench: -4.14% (4.9602 => 4.7549, std.dev.: 0.0086)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.96% (1.7207 => 1.6525, std.dev.: 0.0140)
  MultiSource/Benchmarks/Bullet/bullet: -3.82% (7.2995 => 7.0204, std.dev.: 0.0438)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.38% (21.6864 => 20.9533, std.dev.: 0.2649)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.04% (6.1482 => 5.9616, std.dev.: 0.0044)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -2.90% (1.1024 => 1.0704, std.dev.: 0.0110)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.41% (8.6172 => 8.4097, std.dev.: 0.0375)
  SingleSource/Benchmarks/Misc/oourafft: -2.05% (3.7891 => 3.7113, std.dev.: 0.0050)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.93% (34.8438 => 34.1706, std.dev.: 0.0916)
  SingleSource/Benchmarks/BenchmarkGame/n-body: -1.70% (1.5112 => 1.4855, std.dev.: 0.0094)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.38% (1.3104 => 1.2923, std.dev.: 0.0019)
  MultiSource/Applications/JM/lencod/lencod: -1.15% (7.1799 => 7.0975, std.dev.: 0.0034)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.47% (0.1378 => 0.1344, std.dev.: 0.0014)

Report Time: 0.64s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130730/68d5727d/attachment.html>


More information about the llvm-testresults mailing list