[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Aug 20 11:10:31 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14607?compare_to=14603&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14607, Order: 188808, Start Time: 2013-08-20 16:23:03, End Time: 2013-08-20 18:12:38
      To: 14603, Order: 188797, Start Time: 2013-08-20 14:04:34, End Time: 2013-08-20 15:56:12
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 4 (29 on baseline)
Performance Improvements: 23 (49 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1080 (1029 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 56.04% (5.8004 => 9.0511, std.dev.: 1.0520)
  SingleSource/Benchmarks/Shootout/heapsort: 43.92% (2.8977 => 4.1704, std.dev.: 0.4183)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 30.35% (4.0272 => 5.2494, std.dev.: 0.3555)
  SingleSource/Benchmarks/Shootout/lists: 2.79% (7.1451 => 7.3444, std.dev.: 0.0656)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -28.48% (1.3937 => 0.9968, std.dev.: 0.0134)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -21.74% (0.1095 => 0.0857, std.dev.: 0.0041)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -20.40% (0.2912 => 0.2318, std.dev.: 0.0094)
  MultiSource/Benchmarks/Olden/em3d/em3d: -18.72% (0.2516 => 0.2045, std.dev.: 0.0143)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -16.99% (0.0618 => 0.0513, std.dev.: 0.0031)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -13.22% (0.1346 => 0.1168, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: -10.89% (0.1084 => 0.0966, std.dev.: 0.0013)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -8.91% (0.1593 => 0.1451, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -8.45% (1.7519 => 1.6038, std.dev.: 0.0251)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -7.81% (0.4287 => 0.3952, std.dev.: 0.0060)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -6.88% (1.7874 => 1.6644, std.dev.: 0.0248)
  MultiSource/Benchmarks/Prolangs-C/football/football: -4.86% (1.0802 => 1.0277, std.dev.: 0.0145)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -4.65% (0.7894 => 0.7527, std.dev.: 0.0105)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.30% (0.2444 => 0.2339, std.dev.: 0.0008)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -3.79% (0.7525 => 0.7240, std.dev.: 0.0015)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -3.34% (0.7456 => 0.7207, std.dev.: 0.0088)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -18.82% (2.8805 => 2.3385, std.dev.: 0.1296)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -3.75% (41.5520 => 39.9930, std.dev.: 0.5132)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.84% (2.6746 => 2.5986, std.dev.: 0.0277)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -2.48% (1.4982 => 1.4611, std.dev.: 0.0011)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -2.17% (2.8782 => 2.8156, std.dev.: 0.0169)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -2.17% (1.6381 => 1.6026, std.dev.: 0.0087)
  SingleSource/Benchmarks/McGill/queens: -1.60% (1.6802 => 1.6534, std.dev.: 0.0082)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.38% (0.1304 => 0.1299, std.dev.: 0.0017)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 3.28% (0.7010 => 0.7240, std.dev.: 0.0015)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 67.04% (3.7285 => 6.2280, std.dev.: 0.1322)
  SingleSource/Benchmarks/Shootout/ary3: 55.63% (5.8158 => 9.0511, std.dev.: 1.0520)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.55% (2.8867 => 4.2883, std.dev.: 0.0157)
  SingleSource/Benchmarks/Shootout/heapsort: 43.20% (2.9123 => 4.1704, std.dev.: 0.4183)
  MultiSource/Benchmarks/FreeBench/neural/neural: 34.72% (0.3171 => 0.4272, std.dev.: 0.0104)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 31.31% (3.9978 => 5.2494, std.dev.: 0.3555)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.08% (1.5030 => 1.8800, std.dev.: 0.0116)
  SingleSource/Benchmarks/Shootout/hash: 24.05% (4.1846 => 5.1912, std.dev.: 0.3124)
  SingleSource/Benchmarks/Misc/pi: 21.77% (1.9835 => 2.4153, std.dev.: 0.0492)
  SingleSource/Benchmarks/Shootout-C++/hash: 16.19% (0.6295 => 0.7314, std.dev.: 0.0366)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.90% (7.0762 => 7.8474, std.dev.: 0.0026)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.43% (1.2557 => 1.3616, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.25% (5.4910 => 5.9442, std.dev.: 0.0818)
  MultiSource/Applications/JM/lencod/lencod: 7.05% (7.1799 => 7.6859, std.dev.: 0.0167)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.00% (48.3256 => 51.7071, std.dev.: 0.5037)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.90% (3.2027 => 3.4237, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.75% (3.4085 => 3.6045, std.dev.: 0.0217)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.04% (4.3151 => 4.4895, std.dev.: 0.0514)
  SingleSource/Benchmarks/Misc/whetstone: 3.90% (3.4559 => 3.5908, std.dev.: 0.0129)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.65% (25.0200 => 25.9340, std.dev.: 0.0292)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.48% (6.1245 => 6.3375, std.dev.: 0.0366)
  MultiSource/Applications/spiff/spiff: 3.10% (2.7609 => 2.8466, std.dev.: 0.0295)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.08% (4.8739 => 5.0238, std.dev.: 0.0307)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.77% (12.8625 => 13.2193, std.dev.: 0.0089)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.66% (1.3104 => 1.3452, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.68% (3.3464 => 3.4026, std.dev.: 0.0113)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.48% (1.4398 => 1.4611, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.13% (4.9040 => 4.9596, std.dev.: 0.0071)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/tsp/tsp: -23.10% (0.1818 => 0.1398, std.dev.: 0.0054)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.29% (1.5228 => 1.2139, std.dev.: 0.0052)
  MultiSource/Applications/hbd/hbd: -17.33% (2.0193 => 1.6694, std.dev.: 0.0109)
  MultiSource/Applications/lua/lua: -17.04% (5.3200 => 4.4134, std.dev.: 0.0301)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -16.07% (0.1518 => 0.1274, std.dev.: 0.0006)
  MultiSource/Applications/hexxagon/hexxagon: -15.70% (1.3285 => 1.1199, std.dev.: 0.0068)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -12.71% (1.3985 => 1.2207, std.dev.: 0.0022)
  MultiSource/Applications/lambda-0_1_3/lambda: -11.90% (0.9461 => 0.8335, std.dev.: 0.0149)
  MultiSource/Applications/JM/ldecod/ldecod: -11.74% (8.6720 => 7.6543, std.dev.: 0.2929)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.48% (1.1012 => 0.9968, std.dev.: 0.0134)
  MultiSource/Applications/sqlite3/sqlite3: -9.08% (19.1635 => 17.4241, std.dev.: 0.5992)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -6.37% (0.2498 => 0.2339, std.dev.: 0.0008)
  MultiSource/Applications/JM/lencod/lencod: -5.82% (18.5029 => 17.4252, std.dev.: 0.0607)
  MultiSource/Applications/lemon/lemon: -4.56% (1.2976 => 1.2384, std.dev.: 0.0166)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -3.45% (1.5629 => 1.5090, std.dev.: 0.0158)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -36.52% (1.4194 => 0.9011, std.dev.: 0.0337)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.02% (2.1022 => 1.4291, std.dev.: 0.0055)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.27% (0.0816 => 0.0569, std.dev.: 0.0002)
  MultiSource/Benchmarks/MallocBench/gs/gs: -28.85% (0.1189 => 0.0846, std.dev.: 0.0020)
  MultiSource/Applications/JM/ldecod/ldecod: -27.94% (0.0859 => 0.0619, std.dev.: 0.0018)
  MultiSource/Applications/viterbi/viterbi: -27.53% (3.4923 => 2.5310, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.67% (6.9552 => 5.2395, std.dev.: 0.0685)
  SingleSource/Benchmarks/Misc/perlin: -21.33% (4.5989 => 3.6178, std.dev.: 0.2277)
  SingleSource/Benchmarks/Misc/mandel: -14.80% (1.1996 => 1.0220, std.dev.: 0.0391)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.56% (0.0884 => 0.0773, std.dev.: 0.0023)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.55% (0.5173 => 0.4679, std.dev.: 0.0138)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.67% (3.5791 => 3.3046, std.dev.: 0.0530)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -6.18% (0.4969 => 0.4662, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.93% (3.8119 => 3.6238, std.dev.: 0.0300)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.93% (1.1024 => 1.0481, std.dev.: 0.0100)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.61% (47.2250 => 45.0474, std.dev.: 0.5557)
  SingleSource/Benchmarks/Misc/fbench: -4.50% (4.9602 => 4.7369, std.dev.: 0.0207)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.11% (0.7355 => 0.7053, std.dev.: 0.0051)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.95% (1.1032 => 1.0596, std.dev.: 0.0047)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.93% (2.7049 => 2.5986, std.dev.: 0.0277)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.87% (1.7207 => 1.6541, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.41% (6.0444 => 5.8384, std.dev.: 0.0655)
  MultiSource/Applications/sqlite3/sqlite3: -3.00% (4.3833 => 4.2517, std.dev.: 0.0115)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.97% (6.1482 => 5.9656, std.dev.: 0.0657)
  SingleSource/Regression/C/uint64_to_float: -2.88% (1.5184 => 1.4747, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.83% (5.2218 => 5.0740, std.dev.: 0.0383)
  MultiSource/Applications/sgefa/sgefa: -2.64% (1.4030 => 1.3659, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.45% (8.6172 => 8.4059, std.dev.: 0.0213)
  SingleSource/Benchmarks/Misc/oourafft: -2.24% (3.7891 => 3.7042, std.dev.: 0.0284)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.70% (1.8144 => 1.7836, std.dev.: 0.0018)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.40% (21.6864 => 21.3822, std.dev.: 0.0460)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.36% (4.9231 => 4.8563, std.dev.: 0.0151)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.27% (2.1343 => 2.1072, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -1.26% (4.0075 => 3.9571, std.dev.: 0.0187)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.73% (0.1378 => 0.1299, std.dev.: 0.0017)

Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130820/b4aa6395/attachment.html>


More information about the llvm-testresults mailing list