[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Oct 26 00:55:44 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16695?compare_to=16691&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16695, Order: 193461, Start Time: 2013-10-26 06:14:59, End Time: 2013-10-26 07:59:04
      To: 16691, Order: 193459, Start Time: 2013-10-26 04:06:41, End Time: 2013-10-26 05:53:53
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 18 (42 on baseline)
Performance Improvements: 19 (34 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1070 (1031 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 55.83% (1.6752 => 2.6105, std.dev.: 0.0002)
  MultiSource/Benchmarks/Olden/em3d/em3d: 18.36% (4.6044 => 5.4498, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/ReedSolomon: 13.82% (8.6367 => 9.8303, std.dev.: 0.0042)
  SingleSource/Benchmarks/Stanford/Puzzle: 9.91% (0.1685 => 0.1852, std.dev.: 0.0000)
  SingleSource/Benchmarks/McGill/misr: 8.08% (0.3847 => 0.4158)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 7.96% (1.1141 => 1.2028, std.dev.: 0.0009)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.81% (1.3987 => 1.5079, std.dev.: 0.0004)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.63% (1.2586 => 1.3546, std.dev.: 0.0018)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.89% (2.8116 => 3.0052, std.dev.: 0.0234)
  SingleSource/Benchmarks/Stanford/FloatMM: 5.42% (0.6915 => 0.7290, std.dev.: 0.0001)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.20% (3.2912 => 3.4294, std.dev.: 0.0096)
  SingleSource/Benchmarks/Shootout/lists: 3.47% (7.1827 => 7.4319, std.dev.: 0.0386)
  SingleSource/Benchmarks/Misc/fp-convert: 2.07% (7.6834 => 7.8426, std.dev.: 0.0197)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.06% (5.5621 => 5.6767, std.dev.: 0.0176)
  MultiSource/Benchmarks/sim/sim: 2.06% (4.0092 => 4.0918, std.dev.: 0.0319)
  SingleSource/Benchmarks/Misc/oourafft: 1.83% (3.6602 => 3.7272, std.dev.: 0.0012)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.62% (6.7365 => 6.8453, std.dev.: 0.0072)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.36% (1.4457 => 1.4653, std.dev.: 0.0066)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Ptrdist/ft/ft: -6.39% (0.2424 => 0.2269, std.dev.: 0.0015)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -5.61% (1.3716 => 1.2946, std.dev.: 0.0052)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.60% (4.3827 => 4.2249, std.dev.: 0.0332)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -2.63% (2.0255 => 1.9723, std.dev.: 0.0087)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.30% (0.8431 => 0.8237, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.27% (1.3818 => 1.3505, std.dev.: 0.0028)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.18% (0.6480 => 0.6339, std.dev.: 0.0001)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.94% (0.7113 => 0.6975, std.dev.: 0.0040)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.64% (10.2860 => 10.1168, std.dev.: 0.0407)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.46% (0.9029 => 0.8897, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.33% (1.3164 => 1.2989, std.dev.: 0.0014)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.29% (25.5289 => 25.1987, std.dev.: 0.0747)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.20% (2.7881 => 2.7547, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.08% (1.2956 => 1.2816, std.dev.: 0.0033)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: -10.86% (3.3153 => 2.9554, std.dev.: 0.0091)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -10.53% (3.1785 => 2.8438, std.dev.: 0.0804)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -8.41% (4.1294 => 3.7823, std.dev.: 0.1340)
  MultiSource/Benchmarks/Olden/tsp/tsp: -5.81% (1.6391 => 1.5438, std.dev.: 0.0099)
  SingleSource/Benchmarks/McGill/chomp: -1.93% (1.0273 => 1.0075, std.dev.: 0.0059)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.10% (0.1359 => 0.1374, std.dev.: 0.0038)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/08-main/main: 8.75% (0.2870 => 0.3121, std.dev.: 0.0051)
  SingleSource/Benchmarks/Misc/oourafft: 6.23% (0.2294 => 0.2437, std.dev.: 0.0000)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.58% (4.0397 => 4.2249, std.dev.: 0.0332)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.98% (2.6492 => 2.7547, std.dev.: 0.0052)
  SingleSource/UnitTests/Vector/constpool: 3.28% (8.8921 => 9.1834, std.dev.: 0.0388)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.38% (24.6139 => 25.1987, std.dev.: 0.0747)
  SingleSource/Benchmarks/Misc-C++/bigfib: 1.93% (0.6439 => 0.6563, std.dev.: 0.0001)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 1.71% (1.2728 => 1.2946, std.dev.: 0.0052)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.55% (6.0284 => 6.1216, std.dev.: 0.0118)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.27% (1.9476 => 1.9723, std.dev.: 0.0087)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.27% (9.9903 => 10.1168, std.dev.: 0.0407)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.10% (1.2086 => 1.2219, std.dev.: 0.0045)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 60.34% (7.6426 => 12.2544, std.dev.: 0.0750)
  SingleSource/Benchmarks/Misc/pi: 57.51% (1.6574 => 2.6105, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/matrix: 49.40% (2.8554 => 4.2660, std.dev.: 0.0136)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 31.91% (1.1431 => 1.5079, std.dev.: 0.0004)
  SingleSource/Benchmarks/Misc/ReedSolomon: 15.30% (8.5256 => 9.8303, std.dev.: 0.0042)
  SingleSource/Benchmarks/McGill/misr: 10.26% (0.3771 => 0.4158)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 9.22% (1.1013 => 1.2028, std.dev.: 0.0009)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 9.00% (23.4704 => 25.5817, std.dev.: 0.0796)
  MultiSource/Benchmarks/Olden/em3d/em3d: 8.37% (5.0288 => 5.4498, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 8.34% (0.1331 => 0.1442, std.dev.: 0.0004)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.23% (1.2516 => 1.3546, std.dev.: 0.0018)
  MultiSource/Benchmarks/sim/sim: 6.80% (3.8312 => 4.0918, std.dev.: 0.0319)
  SingleSource/UnitTests/Vector/multiplies: 6.60% (0.5561 => 0.5928, std.dev.: 0.0000)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.68% (5.3716 => 5.6767, std.dev.: 0.0176)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.20% (3.1730 => 3.3379, std.dev.: 0.0178)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.86% (0.3836 => 0.3984, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.85% (5.7757 => 5.9982, std.dev.: 0.0014)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.55% (0.2842 => 0.2943, std.dev.: 0.0035)
  SingleSource/Benchmarks/Misc/fp-convert: 3.36% (7.5877 => 7.8426, std.dev.: 0.0197)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.08% (89.7126 => 92.4725, std.dev.: 0.1922)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.84% (4.0181 => 4.1324, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.71% (3.5642 => 3.6609, std.dev.: 0.0293)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.42% (1.8519 => 1.8968, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.40% (5.4925 => 5.6244, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.02% (3.1569 => 3.2206, std.dev.: 0.0001)
  SingleSource/Regression/C/uint64_to_float: 1.98% (1.4528 => 1.4816, std.dev.: 0.0042)
  SingleSource/Benchmarks/Shootout/methcall: 1.57% (8.5434 => 8.6777, std.dev.: 0.0146)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.52% (6.7429 => 6.8453, std.dev.: 0.0072)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.51% (16.7972 => 17.0506, std.dev.: 0.0141)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.04% (6.1088 => 6.1721, std.dev.: 0.0024)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.30% (0.1483 => 0.1182, std.dev.: 0.0000)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -9.71% (0.1195 => 0.1079, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/matrix: -7.35% (0.2571 => 0.2382, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.70% (0.2193 => 0.2090, std.dev.: 0.0009)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.91% (0.7184 => 0.6975, std.dev.: 0.0040)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.36% (0.5226 => 0.2385, std.dev.: 0.0017)
  MultiSource/Applications/sgefa/sgefa: -43.12% (1.5790 => 0.8981, std.dev.: 0.0073)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -38.25% (0.0400 => 0.0247, std.dev.: 0.0003)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.32% (57.2347 => 43.8863, std.dev.: 3.1350)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.45% (15.9508 => 13.0077, std.dev.: 0.4448)
  MultiSource/Benchmarks/FreeBench/mason/mason: -17.98% (0.3304 => 0.2710, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout/heapsort: -17.68% (3.5900 => 2.9554, std.dev.: 0.0091)
  SingleSource/Benchmarks/Shootout-C++/moments: -16.19% (0.1285 => 0.1077, std.dev.: 0.0017)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -14.84% (1.7197 => 1.4645, std.dev.: 0.0744)
  MultiSource/Benchmarks/mafft/pairlocalalign: -13.84% (50.0284 => 43.1023, std.dev.: 0.5841)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.46% (20.8247 => 18.6464, std.dev.: 0.0543)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.85% (3.4956 => 3.1864, std.dev.: 0.0016)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.40% (3.7437 => 3.4294, std.dev.: 0.0096)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -8.34% (1.0695 => 0.9803, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout-C++/ary3: -7.21% (5.0002 => 4.6396, std.dev.: 0.0677)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -6.44% (0.7474 => 0.6993, std.dev.: 0.0087)
  MultiSource/Applications/lambda-0_1_3/lambda: -5.94% (8.1346 => 7.6512, std.dev.: 0.0441)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.41% (30.1838 => 28.5517, std.dev.: 0.0331)
  MultiSource/Applications/lua/lua: -4.40% (29.5202 => 28.2225, std.dev.: 0.2479)
  SingleSource/Benchmarks/Misc/salsa20: -3.73% (7.7964 => 7.5057, std.dev.: 0.0448)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.65% (2.5938 => 2.4991, std.dev.: 0.0242)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.36% (3.7874 => 3.6603, std.dev.: 0.0143)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.25% (2.4471 => 2.3921, std.dev.: 0.0152)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.15% (17.1431 => 16.7748, std.dev.: 0.0177)
  SingleSource/Benchmarks/Misc/flops: -1.81% (9.4433 => 9.2721, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout/hash: -1.66% (5.2009 => 5.1144, std.dev.: 0.0313)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -1.64% (1.4898 => 1.4653, std.dev.: 0.0066)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.26% (3.8582 => 3.8096, std.dev.: 0.0169)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.24% (4.3592 => 4.3052, std.dev.: 0.0044)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.93% (0.1348 => 0.1374, std.dev.: 0.0038)

Report Time: 1.98s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131026/99e5b660/attachment.html>


More information about the llvm-testresults mailing list