[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jun 14 10:32:37 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12387?compare_to=12383&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12387, Order: 183979, Start Time: 2013-06-14 15:43:35, End Time: 2013-06-14 17:33:28
      To: 12383, Order: 183978, Start Time: 2013-06-14 13:33:44, End Time: 2013-06-14 15:17:53
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 46 (48 on baseline)
Performance Improvements: 2 (31 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1059 (1028 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 76.24% (0.0202 => 0.0356, std.dev.: 0.0004)
  SingleSource/Regression/C++/2011-03-28-Bitfield: 68.31% (0.0183 => 0.0308, std.dev.: 0.0006)
  SingleSource/Regression/C++/EH/exception_spec_test: 64.24% (0.0344 => 0.0565, std.dev.: 0.0024)
  SingleSource/UnitTests/printargs: 63.22% (0.0174 => 0.0284, std.dev.: 0.0007)
  SingleSource/UnitTests/2003-08-20-FoldBug: 62.58% (0.0163 => 0.0265, std.dev.: 0.0016)
  SingleSource/Regression/C++/EH/ConditionalExpr: 61.47% (0.0231 => 0.0373, std.dev.: 0.0006)
  SingleSource/UnitTests/2003-08-11-VaListArg: 60.60% (0.0302 => 0.0485, std.dev.: 0.0003)
  SingleSource/Regression/C/casts: 56.23% (0.0409 => 0.0639, std.dev.: 0.0022)
  SingleSource/Regression/C++/EH/ctor_dtor_count: 55.98% (0.0209 => 0.0326, std.dev.: 0.0004)
  SingleSource/UnitTests/2003-07-06-IntOverflow: 53.27% (0.0214 => 0.0328, std.dev.: 0.0010)
  SingleSource/Regression/C++/EH/function_try_block: 53.23% (0.0325 => 0.0498, std.dev.: 0.0025)
  SingleSource/Regression/C++/pointer_method2: 46.30% (0.0257 => 0.0376, std.dev.: 0.0019)
  MultiSource/Applications/hbd/hbd: 29.56% (1.6446 => 2.1307, std.dev.: 0.1341)
  MultiSource/Applications/obsequi/Obsequi: 26.81% (1.1687 => 1.4820, std.dev.: 0.0527)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 24.29% (1.1842 => 1.4718, std.dev.: 0.0586)
  SingleSource/UnitTests/Vector/constpool: 19.66% (8.8997 => 10.6494, std.dev.: 0.6284)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 19.55% (9.9022 => 11.8385, std.dev.: 0.6397)
  SingleSource/Benchmarks/Shootout-C++/ary3: 17.10% (0.2853 => 0.3341, std.dev.: 0.0106)
  MultiSource/Applications/hexxagon/hexxagon: 14.06% (1.1145 => 1.2712, std.dev.: 0.0324)
  MultiSource/Applications/sqlite3/sqlite3: 10.65% (16.6312 => 18.4016, std.dev.: 0.0599)
  MultiSource/Applications/sgefa/sgefa: 8.54% (0.4156 => 0.4511, std.dev.: 0.0036)
  MultiSource/Applications/d/make_dparser: 7.75% (3.6966 => 3.9830, std.dev.: 0.0731)
  MultiSource/Applications/siod/siod: 7.47% (2.4983 => 2.6849, std.dev.: 0.0435)
  MultiSource/Applications/SPASS/SPASS: 7.24% (16.8810 => 18.1026, std.dev.: 0.3443)
  MultiSource/Applications/lemon/lemon: 6.96% (1.2237 => 1.3089, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 5.63% (0.3553 => 0.3753, std.dev.: 0.0050)
  SingleSource/Benchmarks/Shootout-C++/moments: 3.72% (0.4089 => 0.4241, std.dev.: 0.0045)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Towers: 89.22% (0.0204 => 0.0386, std.dev.: 0.0028)
  SingleSource/Benchmarks/Stanford/Quicksort: 62.95% (0.0224 => 0.0365, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout/ary3: 54.04% (5.7752 => 8.8961, std.dev.: 0.9203)
  SingleSource/Benchmarks/Shootout/heapsort: 51.55% (2.8894 => 4.3789, std.dev.: 0.1608)
  MultiSource/Applications/lemon/lemon: 47.43% (0.8532 => 1.2579, std.dev.: 0.0568)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 47.08% (0.0240 => 0.0353, std.dev.: 0.0020)
  MultiSource/Applications/minisat/minisat: 28.04% (6.2961 => 8.0614, std.dev.: 0.1163)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 26.12% (3.9562 => 4.9897, std.dev.: 0.1601)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 7.81% (0.4292 => 0.4627, std.dev.: 0.0100)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.12% (15.4461 => 16.5459, std.dev.: 0.2652)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.76% (21.2254 => 22.4476, std.dev.: 0.2971)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 5.12% (0.2596 => 0.2729, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.91% (37.1696 => 38.9962, std.dev.: 0.6338)
  MultiSource/Applications/lua/lua: 4.43% (28.2835 => 29.5369, std.dev.: 0.0667)
  MultiSource/Applications/sqlite3/sqlite3: 3.13% (4.3353 => 4.4712, std.dev.: 0.0099)
  MultiSource/Applications/JM/lencod/lencod: 2.38% (6.8569 => 7.0204, std.dev.: 0.0259)
  SingleSource/Benchmarks/Shootout-C++/lists: 1.49% (16.4432 => 16.6881, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc/flops-6: 1.37% (2.4256 => 2.4589, std.dev.: 0.0100)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.04% (5.8571 => 5.9178, std.dev.: 0.0076)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -6.57% (7.2706 => 6.7932, std.dev.: 0.1057)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -2.06% (1.6565 => 1.6224, std.dev.: 0.0130)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 13.33% (0.1448 => 0.1641, std.dev.: 0.0141)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/2011-03-28-Bitfield: 74.01% (0.0177 => 0.0308, std.dev.: 0.0006)
  SingleSource/UnitTests/printargs: 60.45% (0.0177 => 0.0284, std.dev.: 0.0007)
  SingleSource/Regression/C++/EH/ConditionalExpr: 60.09% (0.0233 => 0.0373, std.dev.: 0.0006)
  SingleSource/Regression/C/casts: 59.35% (0.0401 => 0.0639, std.dev.: 0.0022)
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 57.52% (0.0226 => 0.0356, std.dev.: 0.0004)
  SingleSource/Regression/C++/EH/ctor_dtor_count: 51.63% (0.0215 => 0.0326, std.dev.: 0.0004)
  SingleSource/UnitTests/2003-08-11-VaListArg: 51.56% (0.0320 => 0.0485, std.dev.: 0.0003)
  SingleSource/Regression/C++/EH/exception_spec_test: 51.07% (0.0374 => 0.0565, std.dev.: 0.0024)
  SingleSource/Regression/C++/pointer_method2: 49.21% (0.0252 => 0.0376, std.dev.: 0.0019)
  SingleSource/Regression/C++/EH/function_try_block: 49.10% (0.0334 => 0.0498, std.dev.: 0.0025)
  MultiSource/Applications/hbd/hbd: 30.03% (1.6386 => 2.1307, std.dev.: 0.1341)
  MultiSource/Applications/obsequi/Obsequi: 26.31% (1.1733 => 1.4820, std.dev.: 0.0527)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 22.59% (1.2006 => 1.4718, std.dev.: 0.0586)
  SingleSource/Benchmarks/Shootout-C++/ary3: 19.36% (0.2799 => 0.3341, std.dev.: 0.0106)
  MultiSource/Applications/hexxagon/hexxagon: 17.77% (1.0794 => 1.2712, std.dev.: 0.0324)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: 16.52% (10.1602 => 11.8385, std.dev.: 0.6397)
  MultiSource/Applications/sgefa/sgefa: 9.09% (0.4135 => 0.4511, std.dev.: 0.0036)
  MultiSource/Applications/sqlite3/sqlite3: 8.42% (16.9719 => 18.4016, std.dev.: 0.0599)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.72% (0.2721 => 0.2931, std.dev.: 0.0053)
  MultiSource/Applications/siod/siod: 7.64% (2.4944 => 2.6849, std.dev.: 0.0435)
  MultiSource/Applications/d/make_dparser: 6.70% (3.7330 => 3.9830, std.dev.: 0.0731)
  SingleSource/Benchmarks/Shootout-C++/moments: 5.87% (0.4006 => 0.4241, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.76% (0.3617 => 0.3753, std.dev.: 0.0050)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Towers: 93.97% (0.0199 => 0.0386, std.dev.: 0.0028)
  SingleSource/Benchmarks/Stanford/Quicksort: 60.79% (0.0227 => 0.0365, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout/ary3: 47.97% (6.0122 => 8.8961, std.dev.: 0.9203)
  SingleSource/Benchmarks/Shootout/heapsort: 46.02% (2.9988 => 4.3789, std.dev.: 0.1608)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 45.27% (0.0243 => 0.0353, std.dev.: 0.0020)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 22.22% (0.0459 => 0.0561, std.dev.: 0.0007)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 19.46% (4.1768 => 4.9897, std.dev.: 0.1601)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.37% (6.1372 => 7.2034, std.dev.: 0.1019)
  MultiSource/Applications/sgefa/sgefa: 17.26% (1.1695 => 1.3713, std.dev.: 0.0071)
  MultiSource/Applications/minisat/minisat: 9.38% (7.3703 => 8.0614, std.dev.: 0.1163)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.07% (5.2003 => 5.6200, std.dev.: 0.0273)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.20% (3.1853 => 3.3829, std.dev.: 0.0419)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.77% (4.6639 => 4.8866, std.dev.: 0.0306)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.68% (3.2201 => 3.3707, std.dev.: 0.0325)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.64% (1.0571 => 1.1061, std.dev.: 0.0077)
  MultiSource/Applications/lua/lua: 4.56% (28.2496 => 29.5369, std.dev.: 0.0667)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.47% (21.4874 => 22.4476, std.dev.: 0.2971)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.07% (1.2224 => 1.2722, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.83% (5.9362 => 6.1638, std.dev.: 0.0240)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.61% (5.2788 => 5.4692, std.dev.: 0.0556)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 3.56% (3.6122 => 3.7407, std.dev.: 0.0415)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.00% (5.5010 => 5.6662, std.dev.: 0.0324)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.04% (3.9713 => 4.0523, std.dev.: 0.0206)
  MultiSource/Applications/siod/siod: 1.95% (3.7240 => 3.7966, std.dev.: 0.0275)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.25% (11.4990 => 11.6433, std.dev.: 0.0056)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -14.07% (0.0803 => 0.0690, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc/whetstone: -11.30% (0.1097 => 0.0973, std.dev.: 0.0025)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -8.82% (0.2006 => 0.1829, std.dev.: 0.0003)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -5.75% (0.1861 => 0.1754, std.dev.: 0.0006)
  MultiSource/Benchmarks/Olden/em3d/em3d: -5.10% (0.2117 => 0.2009, std.dev.: 0.0024)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.31% (1.2911 => 0.7319, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.52% (4.4050 => 3.2366, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.77% (6.2328 => 5.0629, std.dev.: 0.0115)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.57% (25.3677 => 21.1636, std.dev.: 0.0973)
  SingleSource/Benchmarks/Misc/salsa20: -16.07% (10.3398 => 8.6787, std.dev.: 0.1636)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.04% (48.3307 => 43.4784, std.dev.: 0.2027)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.29% (1.6679 => 1.5129, std.dev.: 0.0316)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -7.64% (0.2973 => 0.2746, std.dev.: 0.0068)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.04% (3.5327 => 3.2841, std.dev.: 0.0573)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.83% (5.5889 => 5.2071, std.dev.: 0.0137)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.68% (0.1945 => 0.1815, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.40% (9.8728 => 9.2406, std.dev.: 0.0474)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -6.07% (3.2030 => 3.0086, std.dev.: 0.0257)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.57% (4.5717 => 4.3169, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.70% (5.3184 => 5.0686, std.dev.: 0.0417)
  MultiSource/Benchmarks/Bullet/bullet: -4.04% (7.1938 => 6.9030, std.dev.: 0.1041)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -3.96% (2.4808 => 2.3826, std.dev.: 0.0256)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.67% (9.1099 => 8.7758, std.dev.: 0.0231)
  MultiSource/Applications/sqlite3/sqlite3: -3.55% (4.6358 => 4.4712, std.dev.: 0.0099)
  SingleSource/Benchmarks/Misc/flops: -3.54% (10.2170 => 9.8552, std.dev.: 0.0218)
  MultiSource/Applications/hexxagon/hexxagon: -3.45% (15.4979 => 14.9633, std.dev.: 0.0182)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.81% (3.8665 => 3.7579, std.dev.: 0.0090)
  SingleSource/Benchmarks/Shootout/sieve: -2.77% (8.0178 => 7.7955, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.18% (4.5094 => 4.4111, std.dev.: 0.0381)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -1.28% (1.1291 => 1.1146, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.15% (9.6556 => 9.5449, std.dev.: 0.0315)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 13.88% (0.1441 => 0.1641, std.dev.: 0.0141)

Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130614/6bc2f4ef/attachment.html>


More information about the llvm-testresults mailing list