[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Aug 16 12:56:19 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14485?compare_to=14481&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14485, Order: 188564, Start Time: 2013-08-16 18:05:49, End Time: 2013-08-16 19:58:19
      To: 14481, Order: 188555, Start Time: 2013-08-16 15:45:44, End Time: 2013-08-16 17:38:41
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 34 (59 on baseline)
Performance Improvements: 11 (29 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1062 (1019 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/flops-8: 60.44% (0.0321 => 0.0515, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/lowercase: 37.90% (0.0314 => 0.0433, std.dev.: 0.0039)
  SingleSource/UnitTests/Vector/constpool: 29.49% (9.1025 => 11.7871, std.dev.: 1.0361)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 16.67% (0.2387 => 0.2785, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout-C++/sieve: 13.24% (0.3188 => 0.3610, std.dev.: 0.0098)
  SingleSource/Benchmarks/Shootout-C++/methcall: 10.67% (0.2325 => 0.2573, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 10.38% (0.2332 => 0.2574, std.dev.: 0.0068)
  SingleSource/Benchmarks/Misc-C++/bigfib: 10.33% (0.7509 => 0.8285, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout-C++/lists1: 8.57% (0.3487 => 0.3786, std.dev.: 0.0093)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 1.95% (0.7277 => 0.7419, std.dev.: 0.0052)
  MultiSource/Benchmarks/Prolangs-C/football/football: 1.23% (1.0292 => 1.0419, std.dev.: 0.0040)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 98.19% (5.7910 => 11.4774, std.dev.: 0.1411)
  SingleSource/Benchmarks/Shootout/heapsort: 66.74% (2.8978 => 4.8319, std.dev.: 0.0890)
  SingleSource/Benchmarks/Stanford/Queens: 62.06% (0.0253 => 0.0410, std.dev.: 0.0004)
  SingleSource/Benchmarks/Stanford/Bubblesort: 51.98% (0.0329 => 0.0500, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 41.16% (4.7294 => 6.6760, std.dev.: 0.1351)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 32.67% (3.6604 => 4.8563, std.dev.: 0.1359)
  SingleSource/Benchmarks/Shootout/nestedloop: 29.91% (0.1371 => 0.1781, std.dev.: 0.0132)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.61% (1.4874 => 1.8980, std.dev.: 0.0196)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 22.57% (3.2044 => 3.9275, std.dev.: 0.2065)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 19.26% (29.1851 => 34.8074, std.dev.: 0.5455)
  SingleSource/Benchmarks/Shootout-C++/moments: 17.26% (0.1008 => 0.1182, std.dev.: 0.0046)
  SingleSource/Benchmarks/Shootout-C++/fibo: 16.59% (4.1392 => 4.8260, std.dev.: 0.0139)
  SingleSource/Benchmarks/McGill/chomp: 12.39% (1.0760 => 1.2093, std.dev.: 0.0411)
  SingleSource/Benchmarks/Shootout/hash: 12.26% (5.2359 => 5.8779, std.dev.: 0.0706)
  SingleSource/Benchmarks/Shootout-C++/hash: 9.06% (0.7429 => 0.8102, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/lists1: 8.51% (0.6050 => 0.6565, std.dev.: 0.0067)
  SingleSource/Benchmarks/Shootout-C++/ary3: 7.24% (2.0575 => 2.2064, std.dev.: 0.0376)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 6.66% (3.2226 => 3.4373, std.dev.: 0.0351)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 4.53% (3.1525 => 3.2953, std.dev.: 0.0360)
  SingleSource/Benchmarks/Shootout-C++/random: 4.46% (2.3625 => 2.4679, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.76% (6.2412 => 6.4761, std.dev.: 0.0490)
  SingleSource/Benchmarks/Shootout-C++/sieve: 2.08% (3.4738 => 3.5462, std.dev.: 0.0066)
  SingleSource/Benchmarks/Misc/pi: 1.72% (2.4955 => 2.5383, std.dev.: 0.0084)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -38.86% (0.1315 => 0.0804, std.dev.: 0.0059)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -23.99% (0.1042 => 0.0792, std.dev.: 0.0065)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -13.48% (0.0920 => 0.0796, std.dev.: 0.0046)
  MultiSource/Benchmarks/FreeBench/neural/neural: -6.53% (0.2219 => 0.2074, std.dev.: 0.0018)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/lu/lu: -33.24% (0.0364 => 0.0243, std.dev.: 0.0021)
  MultiSource/Applications/kimwitu++/kc: -19.51% (0.0651 => 0.0524, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -13.81% (46.8762 => 40.4045, std.dev.: 1.3911)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.24% (16.7392 => 14.8571, std.dev.: 0.5820)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -7.05% (0.2269 => 0.2109, std.dev.: 0.0059)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.46% (2.3682 => 2.3099, std.dev.: 0.0116)
  SingleSource/Benchmarks/Shootout/methcall: -1.21% (8.5651 => 8.4616, std.dev.: 0.0324)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.23% (0.1301 => 0.1330, std.dev.: 0.0058)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/flops-8: 51.92% (0.0339 => 0.0515, std.dev.: 0.0026)
  SingleSource/Regression/C/bigstack: 39.06% (0.0466 => 0.0648, std.dev.: 0.0035)
  SingleSource/Benchmarks/Misc/lowercase: 38.78% (0.0312 => 0.0433, std.dev.: 0.0039)
  SingleSource/UnitTests/Vector/constpool: 32.99% (8.8630 => 11.7871, std.dev.: 1.0361)
  MultiSource/Benchmarks/FreeBench/distray/distray: 19.55% (0.1033 => 0.1235, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 16.09% (0.2399 => 0.2785, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout-C++/sieve: 14.68% (0.3148 => 0.3610, std.dev.: 0.0098)
  SingleSource/Benchmarks/Misc-C++/bigfib: 13.74% (0.7284 => 0.8285, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout-C++/methcall: 11.87% (0.2300 => 0.2573, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 11.04% (0.2318 => 0.2574, std.dev.: 0.0068)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 10.97% (0.3592 => 0.3986, std.dev.: 0.0150)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 10.44% (0.4309 => 0.4759, std.dev.: 0.0163)
  SingleSource/Benchmarks/Shootout-C++/lists1: 10.03% (0.3441 => 0.3786, std.dev.: 0.0093)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.63% (4.2444 => 4.6532, std.dev.: 0.1340)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.48% (0.6785 => 0.7021, std.dev.: 0.0039)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 3.13% (0.7194 => 0.7419, std.dev.: 0.0052)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.90% (0.3934 => 0.4048, std.dev.: 0.0033)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.42% (0.9015 => 0.9233, std.dev.: 0.0024)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 2.24% (0.4869 => 0.4978, std.dev.: 0.0013)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 97.35% (5.8158 => 11.4774, std.dev.: 0.1411)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 73.69% (3.7285 => 6.4761, std.dev.: 0.0490)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 67.27% (2.9033 => 4.8563, std.dev.: 0.1359)
  SingleSource/Benchmarks/Shootout/heapsort: 65.91% (2.9123 => 4.8319, std.dev.: 0.0890)
  SingleSource/Benchmarks/Shootout-C++/matrix: 49.35% (2.8867 => 4.3112, std.dev.: 0.0268)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 46.67% (4.5517 => 6.6760, std.dev.: 0.1351)
  SingleSource/Benchmarks/Shootout/hash: 40.47% (4.1846 => 5.8779, std.dev.: 0.0706)
  MultiSource/Benchmarks/FreeBench/neural/neural: 37.24% (0.3171 => 0.4352, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 33.46% (2.9428 => 3.9275, std.dev.: 0.2065)
  SingleSource/Benchmarks/Stanford/Bubblesort: 31.58% (0.0380 => 0.0500, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout/nestedloop: 30.57% (0.1364 => 0.1781, std.dev.: 0.0132)
  SingleSource/Benchmarks/Shootout-C++/hash: 28.71% (0.6295 => 0.8102, std.dev.: 0.0040)
  SingleSource/Benchmarks/Misc/pi: 27.97% (1.9835 => 2.5383, std.dev.: 0.0084)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.28% (1.5030 => 1.8980, std.dev.: 0.0196)
  SingleSource/Benchmarks/McGill/chomp: 20.32% (1.0051 => 1.2093, std.dev.: 0.0411)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 16.75% (29.8131 => 34.8074, std.dev.: 0.5455)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 14.72% (2.9962 => 3.4373, std.dev.: 0.0351)
  SingleSource/Benchmarks/Shootout-C++/moments: 11.72% (0.1058 => 0.1182, std.dev.: 0.0046)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 11.45% (2.9568 => 3.2953, std.dev.: 0.0360)
  MultiSource/Applications/lambda-0_1_3/lambda: 11.09% (7.0762 => 7.8609, std.dev.: 0.0315)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.54% (0.1678 => 0.1838, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/ary3: 9.07% (2.0229 => 2.2064, std.dev.: 0.0376)
  SingleSource/Benchmarks/Shootout-C++/lists1: 8.80% (0.6034 => 0.6565, std.dev.: 0.0067)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.38% (1.2557 => 1.3609, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.37% (5.4910 => 5.9506, std.dev.: 0.1201)
  MultiSource/Benchmarks/Olden/tsp/tsp: 8.25% (1.5339 => 1.6605, std.dev.: 0.0443)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.96% (48.3256 => 52.1712, std.dev.: 0.0531)
  MultiSource/Applications/siod/siod: 7.11% (3.3761 => 3.6160, std.dev.: 0.0194)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.95% (3.2027 => 3.4253, std.dev.: 0.0234)
  MultiSource/Benchmarks/FreeBench/mason/mason: 6.29% (0.2799 => 0.2975, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.74% (3.4085 => 3.6040, std.dev.: 0.0236)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.52% (5.5008 => 5.8047, std.dev.: 0.1149)
  SingleSource/Benchmarks/Shootout-C++/hash2: 4.82% (3.3877 => 3.5511, std.dev.: 0.0189)
  SingleSource/Benchmarks/Misc/whetstone: 4.39% (3.4559 => 3.6077, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.21% (4.3151 => 4.4968, std.dev.: 0.0060)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.63% (6.1245 => 6.3469, std.dev.: 0.0544)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.34% (25.0200 => 25.8562, std.dev.: 0.0469)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 3.25% (12.8625 => 13.2799, std.dev.: 0.0153)
  SingleSource/Benchmarks/Shootout-C++/sieve: 2.59% (3.4566 => 3.5462, std.dev.: 0.0066)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.19% (2.5636 => 2.5942, std.dev.: 0.0031)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -33.26% (0.2237 => 0.1493, std.dev.: 0.0215)
  MultiSource/Benchmarks/Olden/tsp/tsp: -22.88% (0.1818 => 0.1402, std.dev.: 0.0133)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -16.27% (0.1518 => 0.1271, std.dev.: 0.0001)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.08% (0.2498 => 0.2371, std.dev.: 0.0026)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -3.86% (5.3476 => 5.1413, std.dev.: 0.0271)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.24% (1.5376 => 1.5032, std.dev.: 0.0129)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.79% (2.1022 => 1.4339, std.dev.: 0.0198)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -28.55% (0.0816 => 0.0583, std.dev.: 0.0012)
  MultiSource/Applications/viterbi/viterbi: -26.97% (3.4923 => 2.5503, std.dev.: 0.0474)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.59% (6.9552 => 5.2446, std.dev.: 0.0172)
  MultiSource/Applications/JM/ldecod/ldecod: -23.86% (0.0859 => 0.0654, std.dev.: 0.0073)
  SingleSource/Benchmarks/Misc/perlin: -21.18% (4.5989 => 3.6247, std.dev.: 0.0598)
  SingleSource/Benchmarks/Misc/mandel: -13.83% (1.1996 => 1.0337, std.dev.: 0.0381)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.33% (0.0884 => 0.0775, std.dev.: 0.0002)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.54% (0.5173 => 0.4628, std.dev.: 0.0055)
  SingleSource/Benchmarks/Shootout/strcat: -7.91% (0.1593 => 0.1467, std.dev.: 0.0048)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.05% (3.5791 => 3.3266, std.dev.: 0.0935)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.64% (47.2250 => 45.0325, std.dev.: 0.6474)
  SingleSource/Benchmarks/Misc/fbench: -4.49% (4.9602 => 4.7374, std.dev.: 0.0401)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.32% (1.1024 => 1.0548, std.dev.: 0.0062)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.92% (1.1032 => 1.0600, std.dev.: 0.0034)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.41% (1.7207 => 1.6620, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.02% (6.1482 => 5.9623, std.dev.: 0.0290)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -2.95% (0.4783 => 0.4642, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.75% (5.2218 => 5.0784, std.dev.: 0.0451)
  SingleSource/Benchmarks/Misc/oourafft: -2.18% (3.7891 => 3.7064, std.dev.: 0.0305)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.98% (8.6172 => 8.4466, std.dev.: 0.0133)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.82% (34.8438 => 34.2090, std.dev.: 0.1104)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.21% (2.1343 => 2.1085, std.dev.: 0.0074)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.48% (0.1378 => 0.1330, std.dev.: 0.0058)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130816/caf00dc7/attachment.html>


More information about the llvm-testresults mailing list