[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jul 12 10:23:43 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13347?compare_to=13343&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 13347, Order: 186159, Start Time: 2013-07-12 15:02:59, End Time: 2013-07-12 17:25:06
      To: 13343, Order: 186156, Start Time: 2013-07-12 12:56:05, End Time: 2013-07-12 14:40:28
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 22 (28 on baseline)
Performance Improvements: 1 (19 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1084 (1060 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-10-09-ArrayResolution: 73.71% (0.0175 => 0.0304, std.dev.: 0.0037)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 46.46% (0.1130 => 0.1655, std.dev.: 0.0169)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 43.31% (0.0912 => 0.1307, std.dev.: 0.0144)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 39.72% (0.3472 => 0.4851, std.dev.: 0.0501)
  SingleSource/Benchmarks/Misc/flops-6: 38.37% (0.0331 => 0.0458, std.dev.: 0.0038)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 34.90% (0.0874 => 0.1179, std.dev.: 0.0058)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 28.25% (26.0351 => 33.3902, std.dev.: 1.1894)
  SingleSource/UnitTests/Vector/constpool: 25.56% (8.5825 => 10.7763, std.dev.: 0.6235)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 18.52% (7.5929 => 8.9993, std.dev.: 0.0661)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 16.85% (1.9545 => 2.2838, std.dev.: 0.0994)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.27% (1.1744 => 1.2011, std.dev.: 0.0063)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 87.22% (0.1315 => 0.2462, std.dev.: 0.0254)
  SingleSource/Benchmarks/Shootout/ary3: 59.54% (5.7784 => 9.2186, std.dev.: 0.8501)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.72% (1.4586 => 1.8629, std.dev.: 0.0227)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 24.30% (0.3008 => 0.3739, std.dev.: 0.0238)
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.04% (4.1161 => 4.8173, std.dev.: 0.0239)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.09% (0.4933 => 0.5480, std.dev.: 0.0144)
  SingleSource/Benchmarks/Misc/salsa20: 10.88% (8.1196 => 9.0033, std.dev.: 0.0090)
  MultiSource/Benchmarks/Olden/health/health: 9.26% (0.3325 => 0.3633, std.dev.: 0.0062)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.91% (2.3674 => 2.5311, std.dev.: 0.0529)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 5.92% (1.0552 => 1.1177, std.dev.: 0.0116)
  MultiSource/Benchmarks/sim/sim: 1.12% (3.9758 => 4.0202, std.dev.: 0.0124)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/pi: -20.85% (2.3800 => 1.8837, std.dev.: 0.0899)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.62% (0.1297 => 0.1331, std.dev.: 0.0232)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-10-09-ArrayResolution: 84.24% (0.0165 => 0.0304, std.dev.: 0.0037)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 46.20% (0.1132 => 0.1655, std.dev.: 0.0169)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 42.26% (0.3410 => 0.4851, std.dev.: 0.0501)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 40.54% (0.0930 => 0.1307, std.dev.: 0.0144)
  SingleSource/Benchmarks/Misc/flops-6: 39.63% (0.0328 => 0.0458, std.dev.: 0.0038)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 33.37% (0.0884 => 0.1179, std.dev.: 0.0058)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 28.75% (25.9348 => 33.3902, std.dev.: 1.1894)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.55% (7.7211 => 8.9993, std.dev.: 0.0661)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.94% (1.1782 => 1.2011, std.dev.: 0.0063)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 53.33% (6.0122 => 9.2186, std.dev.: 0.8501)
  MultiSource/Applications/viterbi/viterbi: 37.04% (2.5688 => 3.5204, std.dev.: 0.0217)
  MultiSource/Applications/sgefa/sgefa: 30.17% (1.1695 => 1.5223, std.dev.: 0.0124)
  SingleSource/Benchmarks/Misc/perlin: 27.19% (3.6271 => 4.6132, std.dev.: 0.0406)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.61% (0.9806 => 1.1533, std.dev.: 0.0307)
  SingleSource/Benchmarks/Stanford/Puzzle: 17.25% (0.1455 => 0.1706, std.dev.: 0.0034)
  SingleSource/Benchmarks/Misc/mandel: 17.05% (1.0293 => 1.2048, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.88% (6.1372 => 7.1734, std.dev.: 0.1126)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.86% (0.4988 => 0.5480, std.dev.: 0.0144)
  MultiSource/Benchmarks/Olden/health/health: 8.74% (0.3341 => 0.3633, std.dev.: 0.0062)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.67% (5.2003 => 5.6511, std.dev.: 0.1180)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 8.03% (0.4572 => 0.4939, std.dev.: 0.0048)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 5.73% (1.0571 => 1.1177, std.dev.: 0.0116)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 5.10% (2.8994 => 3.0472, std.dev.: 0.0255)
  SingleSource/Benchmarks/Misc/fbench: 4.88% (4.7508 => 4.9828, std.dev.: 0.0457)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.14% (4.6379 => 4.8298, std.dev.: 0.0689)
  MultiSource/Benchmarks/sim/sim: 3.60% (3.8805 => 4.0202, std.dev.: 0.0124)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.55% (4.3727 => 4.4842, std.dev.: 0.0185)
  SingleSource/Benchmarks/CoyoteBench/almabench: 2.38% (34.3107 => 35.1262, std.dev.: 0.0321)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.24% (1.2911 => 0.7328, std.dev.: 0.0409)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -37.59% (4.4050 => 2.7490, std.dev.: 0.0420)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -23.30% (1.6105 => 1.2353, std.dev.: 0.0094)
  MultiSource/Applications/lambda-0_1_3/lambda: -22.69% (9.1099 => 7.0426, std.dev.: 0.4025)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.64% (4.8986 => 3.8877, std.dev.: 0.0469)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -19.92% (5.7264 => 4.5856, std.dev.: 0.0934)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.96% (6.2328 => 5.0513, std.dev.: 0.0836)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.22% (25.3677 => 21.2529, std.dev.: 0.0927)
  SingleSource/Benchmarks/Misc/salsa20: -12.93% (10.3398 => 9.0033, std.dev.: 0.0090)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -12.29% (0.1945 => 0.1706, std.dev.: 0.0031)
  SingleSource/Regression/C/uint64_to_float: -10.58% (1.6851 => 1.5068, std.dev.: 0.0138)
  MultiSource/Applications/siod/siod: -8.20% (3.7240 => 3.4187, std.dev.: 0.1044)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -7.87% (9.8728 => 9.0957, std.dev.: 0.1210)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.87% (5.3184 => 5.1127, std.dev.: 0.0065)
  SingleSource/Benchmarks/Misc/whetstone: -3.53% (3.5970 => 3.4700, std.dev.: 0.0087)
  MultiSource/Benchmarks/mafft/pairlocalalign: -3.13% (48.3307 => 46.8203, std.dev.: 0.1997)
  SingleSource/Benchmarks/Shootout/sieve: -2.25% (8.0178 => 7.8377, std.dev.: 0.0210)
  MultiSource/Benchmarks/Olden/power/power: -1.37% (1.2558 => 1.2386, std.dev.: 0.0062)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.23% (12.1841 => 12.0340, std.dev.: 0.0430)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -7.63% (0.1441 => 0.1331, std.dev.: 0.0232)

Report Time: 0.78s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130712/653dc8d3/attachment.html>


More information about the llvm-testresults mailing list