[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Oct 10 16:53:38 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16193?compare_to=16189&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16193, Order: 192390, Start Time: 2013-10-10 22:04:06, End Time: 2013-10-10 23:56:41
      To: 16189, Order: 192386, Start Time: 2013-10-10 19:48:24, End Time: 2013-10-10 21:36:45
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 52 (63 on baseline)
Performance Improvements: 4 (14 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1051 (1030 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/flops-4: 51.25% (0.0320 => 0.0484, std.dev.: 0.0018)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 37.69% (0.5763 => 0.7935, std.dev.: 0.0538)
  MultiSource/Benchmarks/MallocBench/gs/gs: 36.85% (4.6431 => 6.3541, std.dev.: 0.3728)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 34.97% (0.0509 => 0.0687, std.dev.: 0.0058)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 33.40% (0.7090 => 0.9458, std.dev.: 0.0298)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 33.02% (0.0851 => 0.1132, std.dev.: 0.0095)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 30.39% (0.9454 => 1.2327, std.dev.: 0.0373)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 25.76% (0.8916 => 1.1213, std.dev.: 0.0804)
  MultiSource/Applications/lua/lua: 21.38% (4.2980 => 5.2170, std.dev.: 0.1671)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 21.35% (0.2796 => 0.3393, std.dev.: 0.0166)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 20.61% (0.6777 => 0.8174, std.dev.: 0.0418)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 15.79% (2.7782 => 3.2170, std.dev.: 0.0239)
  MultiSource/Benchmarks/nbench/nbench: 15.60% (1.2573 => 1.4534, std.dev.: 0.0618)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 14.00% (6.1368 => 6.9957, std.dev.: 0.1194)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 13.47% (0.1760 => 0.1997, std.dev.: 0.0069)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 12.72% (4.1763 => 4.7076, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 10.52% (1.3398 => 1.4807, std.dev.: 0.0213)
  MultiSource/Applications/JM/lencod/lencod: 9.83% (17.1223 => 18.8049, std.dev.: 0.1672)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 8.30% (0.2132 => 0.2309, std.dev.: 0.0018)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 6.47% (0.8347 => 0.8887, std.dev.: 0.0081)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.20% (0.1628 => 0.1729, std.dev.: 0.0035)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 93.16% (0.1375 => 0.2656, std.dev.: 0.0118)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 87.45% (0.7428 => 1.3924, std.dev.: 0.0476)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 50.95% (4.5014 => 6.7950, std.dev.: 0.0714)
  MultiSource/Benchmarks/Olden/bisort/bisort: 50.39% (0.6650 => 1.0001, std.dev.: 0.0131)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 26.46% (1.3018 => 1.6462, std.dev.: 0.0535)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 20.44% (60.3726 => 72.7151, std.dev.: 2.4235)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 19.74% (40.5850 => 48.5956, std.dev.: 1.6772)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 16.07% (0.3180 => 0.3691, std.dev.: 0.0013)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.67% (21.5232 => 24.8963, std.dev.: 0.7364)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.95% (2.1112 => 2.4058, std.dev.: 0.0082)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 13.42% (3.5975 => 4.0804, std.dev.: 0.1124)
  MultiSource/Benchmarks/Olden/tsp/tsp: 11.90% (1.5576 => 1.7429, std.dev.: 0.0364)
  SingleSource/Benchmarks/Shootout-C++/fibo: 11.10% (4.9570 => 5.5073, std.dev.: 0.0472)
  MultiSource/Benchmarks/Olden/health/health: 10.49% (0.3357 => 0.3709, std.dev.: 0.0126)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 10.41% (2.2930 => 2.5317, std.dev.: 0.0089)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.27% (39.9845 => 43.6915, std.dev.: 1.0094)
  MultiSource/Benchmarks/PAQ8p/paq8p: 7.82% (95.6693 => 103.1477, std.dev.: 0.8406)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.40% (0.8416 => 0.9039, std.dev.: 0.0089)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.54% (6.0724 => 6.4693, std.dev.: 0.0443)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 6.38% (2.6580 => 2.8275, std.dev.: 0.0253)
  SingleSource/Benchmarks/McGill/chomp: 5.72% (1.0189 => 1.0772, std.dev.: 0.0103)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 4.62% (3.9840 => 4.1681, std.dev.: 0.0374)
  SingleSource/Benchmarks/Misc/salsa20: 4.31% (7.6025 => 7.9301, std.dev.: 0.1184)
  SingleSource/Benchmarks/Stanford/FloatMM: 3.46% (0.6935 => 0.7175, std.dev.: 0.0053)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.36% (3.5529 => 3.6368, std.dev.: 0.0021)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.28% (5.5180 => 5.6438, std.dev.: 0.0178)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.96% (4.5034 => 4.5916, std.dev.: 0.0191)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.74% (11.9361 => 12.1443, std.dev.: 0.0135)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.71% (6.5835 => 6.6960, std.dev.: 0.0256)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.42% (5.9799 => 6.0649, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.19% (12.3977 => 12.5451, std.dev.: 0.0285)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/pi: -37.31% (2.6107 => 1.6366, std.dev.: 0.2045)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -10.04% (0.4633 => 0.4168, std.dev.: 0.0056)
  MultiSource/Benchmarks/sim/sim: -4.38% (4.0331 => 3.8565, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.06% (5.0154 => 4.9624, std.dev.: 0.0129)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.46% (0.1373 => 0.1353, std.dev.: 0.0020)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/flops-4: 61.87% (0.0299 => 0.0484, std.dev.: 0.0018)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 41.47% (0.5609 => 0.7935, std.dev.: 0.0538)
  MultiSource/Benchmarks/MallocBench/gs/gs: 38.48% (4.5883 => 6.3541, std.dev.: 0.3728)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 36.31% (0.0504 => 0.0687, std.dev.: 0.0058)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 34.40% (0.7037 => 0.9458, std.dev.: 0.0298)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 33.81% (0.9212 => 1.2327, std.dev.: 0.0373)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 33.33% (0.0849 => 0.1132, std.dev.: 0.0095)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 29.38% (0.8667 => 1.1213, std.dev.: 0.0804)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 23.53% (0.6617 => 0.8174, std.dev.: 0.0418)
  MultiSource/Applications/lua/lua: 23.50% (4.2242 => 5.2170, std.dev.: 0.1671)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 21.43% (2.6492 => 3.2170, std.dev.: 0.0239)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: 20.28% (0.2821 => 0.3393, std.dev.: 0.0166)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 16.53% (4.0397 => 4.7076, std.dev.: 0.0036)
  MultiSource/Benchmarks/nbench/nbench: 16.42% (1.2484 => 1.4534, std.dev.: 0.0618)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.05% (6.0284 => 6.9957, std.dev.: 0.1194)
  MultiSource/Applications/siod/siod: 15.10% (2.4480 => 2.8176, std.dev.: 0.0571)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 15.03% (0.1736 => 0.1997, std.dev.: 0.0069)
  MultiSource/Applications/oggenc/oggenc: 14.37% (5.3339 => 6.1004, std.dev.: 0.1679)
  MultiSource/Applications/JM/lencod/lencod: 13.35% (16.5902 => 18.8049, std.dev.: 0.1672)
  MultiSource/Benchmarks/Olden/power/power: 13.23% (0.1398 => 0.1583, std.dev.: 0.0067)
  MultiSource/Applications/viterbi/viterbi: 12.55% (0.1976 => 0.2224, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 11.31% (1.3303 => 1.4807, std.dev.: 0.0213)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.22% (1.0756 => 1.1963, std.dev.: 0.0400)
  SingleSource/Benchmarks/Shootout-C++/sumcol: 9.22% (0.2114 => 0.2309, std.dev.: 0.0018)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 8.27% (0.1597 => 0.1729, std.dev.: 0.0035)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 7.94% (0.8233 => 0.8887, std.dev.: 0.0081)
  MultiSource/Applications/hexxagon/hexxagon: 2.15% (1.0276 => 1.0497, std.dev.: 0.0009)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 92.88% (0.1377 => 0.2656, std.dev.: 0.0118)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 87.91% (0.7410 => 1.3924, std.dev.: 0.0476)
  SingleSource/Benchmarks/Shootout-C++/methcall: 64.15% (7.6426 => 12.5451, std.dev.: 0.0285)
  MultiSource/Benchmarks/Olden/bisort/bisort: 50.46% (0.6647 => 1.0001, std.dev.: 0.0131)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 49.41% (4.5479 => 6.7950, std.dev.: 0.0714)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 33.70% (0.4258 => 0.5693, std.dev.: 0.0534)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 25.25% (1.3143 => 1.6462, std.dev.: 0.0535)
  MultiSource/Applications/SPASS/SPASS: 23.71% (8.2311 => 10.1828, std.dev.: 0.7319)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 19.82% (40.5588 => 48.5956, std.dev.: 1.6772)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 19.77% (60.7119 => 72.7151, std.dev.: 2.4235)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 18.59% (36.8417 => 43.6915, std.dev.: 1.0094)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.68% (21.5217 => 24.8963, std.dev.: 0.7364)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: 14.66% (0.3219 => 0.3691, std.dev.: 0.0013)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.96% (2.1111 => 2.4058, std.dev.: 0.0082)
  MultiSource/Benchmarks/Olden/tsp/tsp: 12.06% (1.5553 => 1.7429, std.dev.: 0.0364)
  SingleSource/Benchmarks/Shootout-C++/fibo: 11.42% (4.9428 => 5.5073, std.dev.: 0.0472)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 9.26% (0.8273 => 0.9039, std.dev.: 0.0089)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 8.35% (2.3365 => 2.5317, std.dev.: 0.0089)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0037)
  MultiSource/Benchmarks/PAQ8p/paq8p: 6.58% (96.7834 => 103.1477, std.dev.: 0.8406)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 6.38% (2.6579 => 2.8275, std.dev.: 0.0253)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.25% (8.1346 => 8.6433, std.dev.: 0.0409)
  SingleSource/Benchmarks/McGill/chomp: 6.01% (1.0161 => 1.0772, std.dev.: 0.0103)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.90% (6.1088 => 6.4693, std.dev.: 0.0443)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.41% (3.9856 => 4.2011, std.dev.: 0.0359)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.07% (5.3716 => 5.6438, std.dev.: 0.0178)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 5.01% (3.9691 => 4.1681, std.dev.: 0.0374)
  MultiSource/Applications/hexxagon/hexxagon: 3.65% (14.7810 => 15.3199, std.dev.: 0.2073)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 3.29% (5.8715 => 6.0649, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.73% (4.4696 => 4.5916, std.dev.: 0.0191)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.92% (3.5683 => 3.6368, std.dev.: 0.0021)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.88% (1.7652 => 1.7983, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.81% (11.9288 => 12.1443, std.dev.: 0.0135)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.71% (1.0477 => 1.0656, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.41% (6.6028 => 6.6960, std.dev.: 0.0256)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.13% (16.7972 => 16.9863, std.dev.: 0.0565)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -51.61% (0.5226 => 0.2529, std.dev.: 0.0465)
  MultiSource/Applications/sgefa/sgefa: -46.83% (1.5790 => 0.8395, std.dev.: 0.0321)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -30.25% (0.0400 => 0.0279, std.dev.: 0.0039)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.32% (57.2347 => 43.8902, std.dev.: 2.9277)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.90% (15.9508 => 12.9362, std.dev.: 0.3292)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.40% (20.8247 => 18.4505, std.dev.: 0.1943)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.39% (3.4956 => 3.1325, std.dev.: 0.0158)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -8.38% (0.4549 => 0.4168, std.dev.: 0.0056)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.32% (50.0284 => 46.3665, std.dev.: 0.2152)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.97% (3.7437 => 3.5949, std.dev.: 0.0223)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.55% (2.5938 => 2.5017, std.dev.: 0.0217)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.80% (17.1431 => 16.6638, std.dev.: 0.1072)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.30% (4.3592 => 4.2590, std.dev.: 0.0060)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.92% (3.7874 => 3.7148, std.dev.: 0.0202)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.37% (0.1348 => 0.1353, std.dev.: 0.0020)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131010/be5f1236/attachment.html>


More information about the llvm-testresults mailing list