[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results

Tue Oct 22 15:29:45 PDT 2013

http://llvm.org/perf/db_default/v4/nts/16582?compare_to=16579&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16582, Order: 193189, Start Time: 2013-10-22 20:37:29, End Time: 2013-10-22 22:33:00
      To: 16579, Order: 193170, Start Time: 2013-10-22 18:16:16, End Time: 2013-10-22 20:11:25
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 27 (58 on baseline)
Performance Improvements: 15 (16 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1065 (1033 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/sumarray-dbl: 48.97% (0.0243 => 0.0362, std.dev.: 0.0030)
  SingleSource/Benchmarks/Stanford/Queens: 46.26% (0.0454 => 0.0664, std.dev.: 0.0070)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 9.83% (0.3409 => 0.3744, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 9.66% (1.3347 => 1.4636, std.dev.: 0.0312)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 9.05% (0.3833 => 0.4180, std.dev.: 0.0101)
  SingleSource/Benchmarks/McGill/chomp: 7.76% (0.2268 => 0.2444, std.dev.: 0.0061)
  SingleSource/Benchmarks/Shootout-C++/strcat: 7.33% (0.2059 => 0.2210, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout-C++/matrix: 7.04% (0.2402 => 0.2571, std.dev.: 0.0042)
  SingleSource/Benchmarks/Shootout-C++/moments: 6.85% (0.3826 => 0.4088, std.dev.: 0.0058)
  MultiSource/Applications/minisat/minisat: 5.99% (0.7934 => 0.8409, std.dev.: 0.0125)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.73% (0.2156 => 0.2258, std.dev.: 0.0015)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: 40.28% (0.7174 => 1.0064, std.dev.: 0.0200)
  MultiSource/Applications/minisat/minisat: 40.06% (6.6360 => 9.2946, std.dev.: 0.1426)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 36.02% (0.0322 => 0.0438, std.dev.: 0.0014)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 19.51% (1.3612 => 1.6268, std.dev.: 0.0162)
  MultiSource/Benchmarks/Olden/health/health: 14.37% (0.3430 => 0.3923, std.dev.: 0.0110)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 11.76% (0.4505 => 0.5035, std.dev.: 0.0049)
  MultiSource/Benchmarks/mafft/pairlocalalign: 10.64% (41.2129 => 45.5961, std.dev.: 0.7836)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.03% (4.9733 => 5.4721, std.dev.: 0.0243)
  MultiSource/Benchmarks/Olden/bh/bh: 3.62% (2.4283 => 2.5161, std.dev.: 0.0228)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 3.57% (3.7547 => 3.8887, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.36% (4.3799 => 4.5269, std.dev.: 0.0457)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.17% (4.0056 => 4.1326, std.dev.: 0.0318)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.61% (5.8568 => 6.0097, std.dev.: 0.0194)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.68% (4.4910 => 4.5665, std.dev.: 0.0192)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.48% (4.2195 => 4.2819, std.dev.: 0.0090)
  MultiSource/Benchmarks/NPB-serial/is/is: 1.33% (12.1516 => 12.3138, std.dev.: 0.0511)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -35.59% (0.4198 => 0.2704, std.dev.: 0.0363)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -22.86% (1.2582 => 0.9706, std.dev.: 0.1109)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -22.28% (0.0983 => 0.0764, std.dev.: 0.0024)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: -21.79% (0.0615 => 0.0481, std.dev.: 0.0047)
  MultiSource/Applications/JM/ldecod/ldecod: -16.09% (9.3551 => 7.8495, std.dev.: 0.4823)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -14.33% (0.1082 => 0.0927, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -11.37% (1.5192 => 1.3465, std.dev.: 0.0574)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -8.07% (2.1413 => 1.9684, std.dev.: 0.0365)
  MultiSource/Benchmarks/FreeBench/neural/neural: -6.56% (0.1997 => 0.1866, std.dev.: 0.0028)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/SPASS/SPASS: -15.60% (9.8851 => 8.3429, std.dev.: 0.2379)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -12.56% (0.1027 => 0.0898, std.dev.: 0.0022)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -12.18% (2.4073 => 2.1140, std.dev.: 0.1038)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -9.09% (0.3640 => 0.3309, std.dev.: 0.0022)
  MultiSource/Applications/obsequi/Obsequi: -5.49% (2.7088 => 2.5600, std.dev.: 0.0450)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.02% (6.0076 => 5.9464, std.dev.: 0.0206)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -6.67% (0.1425 => 0.1330, std.dev.: 0.0257)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/sumarray-dbl: 66.82% (0.0217 => 0.0362, std.dev.: 0.0030)
  SingleSource/Benchmarks/Stanford/Queens: 51.60% (0.0438 => 0.0664, std.dev.: 0.0070)
  MultiSource/Benchmarks/NPB-serial/is/is: 49.52% (0.0735 => 0.1099, std.dev.: 0.0124)
  SingleSource/Benchmarks/Shootout/hash: 43.12% (0.0603 => 0.0863, std.dev.: 0.0094)
  MultiSource/Applications/ClamAV/clamscan: 21.62% (16.5398 => 20.1151, std.dev.: 0.8905)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 16.85% (0.3822 => 0.4466, std.dev.: 0.0131)
  MultiSource/Applications/kimwitu++/kc: 14.86% (18.3608 => 21.0885, std.dev.: 0.3143)
  MultiSource/Benchmarks/Bullet/bullet: 14.16% (32.7552 => 37.3929, std.dev.: 0.4849)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 13.57% (0.1098 => 0.1247, std.dev.: 0.0056)
  MultiSource/Applications/minisat/minisat: 13.04% (0.7439 => 0.8409, std.dev.: 0.0125)
  SingleSource/Benchmarks/Shootout-C++/hash: 12.74% (0.3971 => 0.4477, std.dev.: 0.0189)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 11.93% (0.3345 => 0.3744, std.dev.: 0.0104)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.72% (24.6139 => 27.4977, std.dev.: 0.7073)
  SingleSource/Benchmarks/McGill/chomp: 10.99% (0.2202 => 0.2444, std.dev.: 0.0061)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 10.61% (0.2083 => 0.2304, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.59% (1.3235 => 1.4636, std.dev.: 0.0312)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.40% (1.9476 => 2.1502, std.dev.: 0.0381)
  SingleSource/Benchmarks/Shootout-C++/lists1: 9.62% (0.3087 => 0.3384, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/strcat: 9.35% (0.2021 => 0.2210, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 8.94% (0.3837 => 0.4180, std.dev.: 0.0101)
  SingleSource/Benchmarks/Shootout-C++/moments: 8.41% (0.3771 => 0.4088, std.dev.: 0.0058)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.14% (0.7184 => 0.7769, std.dev.: 0.0098)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.05% (0.2956 => 0.3194, std.dev.: 0.0032)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 5.50% (44.2807 => 46.7147, std.dev.: 0.5105)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 102.76% (0.1377 => 0.2792, std.dev.: 0.0376)
  SingleSource/Benchmarks/Shootout-C++/methcall: 62.61% (7.6426 => 12.4279, std.dev.: 0.1414)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 55.74% (3.0111 => 4.6894, std.dev.: 0.1262)
  MultiSource/Benchmarks/Olden/bisort/bisort: 51.41% (0.6647 => 1.0064, std.dev.: 0.0200)
  MultiSource/Applications/minisat/minisat: 48.10% (6.2760 => 9.2946, std.dev.: 0.1426)
  SingleSource/Benchmarks/Shootout/heapsort: 32.49% (3.5900 => 4.7563, std.dev.: 0.2506)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 28.93% (1.1431 => 1.4738, std.dev.: 0.0337)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.06% (1.3008 => 1.6268, std.dev.: 0.0162)
  SingleSource/Benchmarks/Shootout/ary3: 22.54% (4.6972 => 5.7558, std.dev.: 0.1942)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 19.81% (1.4830 => 1.7768, std.dev.: 0.0673)
  MultiSource/Applications/obsequi/Obsequi: 16.98% (2.1884 => 2.5600, std.dev.: 0.0450)
  MultiSource/Benchmarks/Olden/health/health: 15.69% (0.3391 => 0.3923, std.dev.: 0.0110)
  SingleSource/Benchmarks/Shootout/hash: 12.60% (5.2009 => 5.8562, std.dev.: 0.1165)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.71% (4.9428 => 5.4721, std.dev.: 0.0243)
  MultiSource/Applications/spiff/spiff: 7.26% (2.8194 => 3.0242, std.dev.: 0.0738)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 6.83% (3.6401 => 3.8887, std.dev.: 0.0132)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 6.77% (3.9856 => 4.2556, std.dev.: 0.0490)
  SingleSource/UnitTests/Vector/multiplies: 6.65% (0.5561 => 0.5931, std.dev.: 0.0031)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.55% (0.8273 => 0.8815, std.dev.: 0.0196)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.90% (3.1730 => 3.3601, std.dev.: 0.0454)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.83% (96.7834 => 102.4250, std.dev.: 1.8114)
  MultiSource/Benchmarks/Olden/bh/bh: 5.02% (2.3959 => 2.5161, std.dev.: 0.0228)
  MultiSource/Benchmarks/BitBench/five11/five11: 4.42% (5.3716 => 5.6092, std.dev.: 0.0270)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 4.12% (3.9691 => 4.1326, std.dev.: 0.0318)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.05% (5.7757 => 6.0097, std.dev.: 0.0194)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.47% (89.7126 => 92.8226, std.dev.: 0.1179)
  MultiSource/Benchmarks/Olden/power/power: 2.80% (1.2170 => 1.2511, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.73% (5.6951 => 5.8506, std.dev.: 0.0427)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.70% (1.7652 => 1.8128, std.dev.: 0.0093)
  MultiSource/Applications/hexxagon/hexxagon: 2.40% (14.7810 => 15.1354, std.dev.: 0.1011)
  MultiSource/Applications/siod/siod: 1.71% (3.5310 => 3.5913, std.dev.: 0.0161)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.70% (16.7972 => 17.0826, std.dev.: 0.0713)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.20% (3.1569 => 3.1947, std.dev.: 0.0140)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.18% (5.8715 => 5.9410, std.dev.: 0.0207)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -51.68% (0.5226 => 0.2525, std.dev.: 0.0849)
  MultiSource/Applications/sgefa/sgefa: -43.01% (1.5790 => 0.8999, std.dev.: 0.0057)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -30.50% (0.0400 => 0.0278, std.dev.: 0.0033)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.46% (15.9508 => 13.3246, std.dev.: 0.3309)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -12.56% (0.1027 => 0.0898, std.dev.: 0.0022)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.17% (20.8247 => 18.4978, std.dev.: 0.1898)
  SingleSource/Benchmarks/Linpack/linpack-pc: -10.85% (57.2347 => 51.0237, std.dev.: 0.2805)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.27% (3.4956 => 3.1367, std.dev.: 0.0229)
  MultiSource/Benchmarks/Olden/em3d/em3d: -9.58% (5.0288 => 4.5469, std.dev.: 0.0042)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.86% (50.0284 => 45.5961, std.dev.: 0.7836)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.48% (0.3501 => 0.3309, std.dev.: 0.0022)
  SingleSource/Benchmarks/Misc/oourafft: -2.97% (3.7484 => 3.6370, std.dev.: 0.0336)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -2.54% (0.7474 => 0.7284, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.44% (17.1431 => 16.7241, std.dev.: 0.1612)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.77% (4.3592 => 4.2819, std.dev.: 0.0090)
  SingleSource/Benchmarks/Misc/whetstone: -1.06% (3.6303 => 3.5920, std.dev.: 0.0054)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.34% (0.1348 => 0.1330, std.dev.: 0.0257)

Report Time: 1.26s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131022/ed025edd/attachment.html>

[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results