[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Aug 26 02:51:13 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14794?compare_to=14790&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14794, Order: 189210, Start Time: 2013-08-26 08:06:20, End Time: 2013-08-26 09:53:26
      To: 14790, Order: 189208, Start Time: 2013-08-26 03:15:42, End Time: 2013-08-26 04:57:13
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 10 (32 on baseline)
Performance Improvements: 1 (42 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1096 (1033 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.66% (1.4870 => 1.8834, std.dev.: 0.0178)
  SingleSource/Benchmarks/Misc/pi: 17.83% (2.1316 => 2.5117, std.dev.: 0.0116)
  MultiSource/Benchmarks/Olden/em3d/em3d: 9.57% (4.7128 => 5.1640, std.dev.: 0.0303)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 4.89% (6.2363 => 6.5411, std.dev.: 0.0191)
  SingleSource/Benchmarks/Misc/flops: 4.32% (9.4183 => 9.8251, std.dev.: 0.0189)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 3.95% (0.2711 => 0.2818, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc/fp-convert: 3.19% (7.8209 => 8.0705, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.48% (12.8696 => 13.1885, std.dev.: 0.0154)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.55% (20.6398 => 20.9592, std.dev.: 0.0735)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.23% (1.4218 => 1.4393, std.dev.: 0.0066)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/BitBench/five11/five11: -1.13% (5.6309 => 5.5670, std.dev.: 0.0183)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.70% (0.1293 => 0.1302, std.dev.: 0.0059)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.72% (0.9941 => 1.0410, std.dev.: 0.0112)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.10% (0.6785 => 0.6995, std.dev.: 0.0018)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.81% (0.9407 => 0.9671, std.dev.: 0.0039)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.37% (0.9761 => 0.9992, std.dev.: 0.0068)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.43% (0.7194 => 0.7297, std.dev.: 0.0024)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 75.44% (3.7285 => 6.5411, std.dev.: 0.0191)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.47% (2.8867 => 4.2858, std.dev.: 0.0023)
  MultiSource/Benchmarks/FreeBench/neural/neural: 35.45% (0.3171 => 0.4295, std.dev.: 0.0403)
  SingleSource/Benchmarks/Misc/pi: 26.63% (1.9835 => 2.5117, std.dev.: 0.0116)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.31% (1.5030 => 1.8834, std.dev.: 0.0178)
  SingleSource/Benchmarks/Shootout/hash: 23.32% (4.1846 => 5.1605, std.dev.: 0.1392)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.99% (7.0762 => 7.8541, std.dev.: 0.0123)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.48% (0.1678 => 0.1837, std.dev.: 0.0000)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.34% (5.4910 => 5.9488, std.dev.: 0.0449)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.91% (1.2557 => 1.3550, std.dev.: 0.0169)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.15% (3.4085 => 3.6522, std.dev.: 0.0831)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.93% (3.2027 => 3.4247, std.dev.: 0.0067)
  SingleSource/Benchmarks/Linpack/linpack-pc: 6.76% (48.3256 => 51.5946, std.dev.: 0.2907)
  MultiSource/Benchmarks/FreeBench/mason/mason: 6.36% (0.2799 => 0.2977, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.23% (5.3042 => 5.6347, std.dev.: 0.0646)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.58% (5.5008 => 5.8075, std.dev.: 0.0308)
  MultiSource/Applications/siod/siod: 5.20% (3.3761 => 3.5518, std.dev.: 0.0219)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.26% (4.3151 => 4.4990, std.dev.: 0.0227)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.24% (3.3384 => 3.4801, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.24% (5.1471 => 5.3654, std.dev.: 0.0318)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.39% (6.1245 => 6.3320, std.dev.: 0.0725)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.33% (25.0200 => 25.8530, std.dev.: 0.0936)
  SingleSource/Benchmarks/Shootout-C++/hash2: 3.33% (3.3877 => 3.5004, std.dev.: 0.0282)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.07% (4.8739 => 5.0235, std.dev.: 0.0435)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.79% (1.3104 => 1.3469, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.53% (12.8625 => 13.1885, std.dev.: 0.0154)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.31% (3.5351 => 3.6169, std.dev.: 0.0295)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -32.28% (0.2237 => 0.1515, std.dev.: 0.0259)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -16.73% (0.1518 => 0.1264, std.dev.: 0.0012)
  MultiSource/Applications/hbd/hbd: -16.48% (2.0193 => 1.6866, std.dev.: 0.1022)
  MultiSource/Applications/sgefa/sgefa: -12.10% (0.4809 => 0.4227, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -9.70% (1.7797 => 1.6070, std.dev.: 0.0402)
  MultiSource/Applications/siod/siod: -6.90% (2.7150 => 2.5276, std.dev.: 0.0415)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -4.32% (0.2498 => 0.2390, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -3.78% (0.7189 => 0.6917, std.dev.: 0.0089)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -3.78% (5.3476 => 5.1456, std.dev.: 0.0287)
  MultiSource/Benchmarks/nbench/nbench: -3.20% (1.3677 => 1.3240, std.dev.: 0.0077)
  SingleSource/UnitTests/Vector/constpool: -2.25% (8.8630 => 8.6636, std.dev.: 0.0490)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.19% (1.5376 => 1.5039, std.dev.: 0.0064)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.62% (1.6686 => 1.6416, std.dev.: 0.0096)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -37.30% (1.4194 => 0.8899, std.dev.: 0.1802)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.96% (2.1022 => 1.4303, std.dev.: 0.1417)
  MultiSource/Benchmarks/MallocBench/gs/gs: -29.27% (0.1189 => 0.0841)
  MultiSource/Applications/JM/ldecod/ldecod: -27.82% (0.0859 => 0.0620, std.dev.: 0.0090)
  MultiSource/Applications/viterbi/viterbi: -27.43% (3.4923 => 2.5342, std.dev.: 0.0151)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.54% (6.9552 => 5.2482, std.dev.: 0.0092)
  SingleSource/Benchmarks/Misc/perlin: -21.53% (4.5989 => 3.6089, std.dev.: 0.0265)
  SingleSource/Benchmarks/Misc/mandel: -14.75% (1.1996 => 1.0226, std.dev.: 0.0069)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.90% (0.0884 => 0.0770, std.dev.: 0.0002)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.41% (0.5173 => 0.4686, std.dev.: 0.0173)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.12% (3.5791 => 3.3242, std.dev.: 0.0562)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.99% (1.1024 => 1.0474, std.dev.: 0.0048)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.86% (47.2250 => 44.9298, std.dev.: 0.6575)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -4.85% (0.4969 => 0.4728, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.83% (3.8119 => 3.6278, std.dev.: 0.0133)
  SingleSource/Benchmarks/Misc/fbench: -4.52% (4.9602 => 4.7358, std.dev.: 0.0121)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.80% (0.7806 => 0.7509, std.dev.: 0.0110)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -3.53% (2.7049 => 2.6094, std.dev.: 0.0230)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.37% (6.0444 => 5.8407, std.dev.: 0.0305)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.35% (21.6864 => 20.9592, std.dev.: 0.0735)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.02% (6.1482 => 5.9624, std.dev.: 0.0535)
  MultiSource/Applications/sqlite3/sqlite3: -2.70% (4.3833 => 4.2651, std.dev.: 0.0195)
  MultiSource/Applications/sgefa/sgefa: -2.40% (1.4030 => 1.3693, std.dev.: 0.0022)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.30% (8.6172 => 8.4187, std.dev.: 0.0715)
  SingleSource/Benchmarks/Misc/oourafft: -2.08% (3.7891 => 3.7103, std.dev.: 0.0125)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.97% (34.8438 => 34.1574, std.dev.: 0.2423)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.78% (5.6678 => 5.5670, std.dev.: 0.0183)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.45% (5.8810 => 5.7958, std.dev.: 0.0300)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.31% (4.9231 => 4.8584, std.dev.: 0.0140)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.52% (0.1378 => 0.1302, std.dev.: 0.0059)

Report Time: 0.90s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130826/33979357/attachment.html>


More information about the llvm-testresults mailing list