[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Oct 18 02:35:57 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16434?compare_to=16430&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16434, Order: 192953, Start Time: 2013-10-18 07:47:41, End Time: 2013-10-18 09:39:08
      To: 16430, Order: 192946, Start Time: 2013-10-18 05:32:05, End Time: 2013-10-18 07:20:06
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 39 (59 on baseline)
Performance Improvements: 2 (15 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1066 (1033 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/2003-05-14-initialize-string: 147.89% (0.0071 => 0.0176, std.dev.: 0.0017)
  SingleSource/UnitTests/2002-05-02-CastTest2: 72.82% (0.0206 => 0.0356, std.dev.: 0.0013)
  SingleSource/UnitTests/2003-05-31-CastToBool: 69.52% (0.0269 => 0.0456, std.dev.: 0.0032)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 69.15% (0.0765 => 0.1294, std.dev.: 0.0047)
  SingleSource/UnitTests/2003-10-13-SwitchTest: 63.74% (0.0171 => 0.0280, std.dev.: 0.0011)
  SingleSource/Regression/C/sumarray: 61.69% (0.0308 => 0.0498, std.dev.: 0.0035)
  SingleSource/UnitTests/AtomicOps: 61.64% (0.0232 => 0.0375, std.dev.: 0.0003)
  SingleSource/UnitTests/2002-05-03-NotTest: 60.49% (0.0205 => 0.0329, std.dev.: 0.0021)
  SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 59.56% (0.0183 => 0.0292, std.dev.: 0.0010)
  SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 57.92% (0.0240 => 0.0379, std.dev.: 0.0021)
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 53.70% (0.0216 => 0.0332, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc/flops-6: 53.05% (0.0311 => 0.0476, std.dev.: 0.0053)
  SingleSource/Regression/C/PR640: 50.00% (0.0262 => 0.0393, std.dev.: 0.0013)
  SingleSource/UnitTests/2003-05-07-VarArgs: 44.85% (0.0330 => 0.0478, std.dev.: 0.0011)
  SingleSource/UnitTests/2003-07-09-SignedArgs: 44.19% (0.0301 => 0.0434, std.dev.: 0.0042)
  SingleSource/Benchmarks/Misc/richards_benchmark: 14.05% (0.0797 => 0.0909, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 7.41% (0.2104 => 0.2260, std.dev.: 0.0024)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 7.21% (0.1636 => 0.1754, std.dev.: 0.0014)
  MultiSource/Applications/kimwitu++/kc: 6.02% (18.9057 => 20.0440, std.dev.: 0.4093)
  MultiSource/Applications/hexxagon/hexxagon: 3.02% (1.0379 => 1.0692, std.dev.: 0.0010)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.57% (0.8260 => 0.8390, std.dev.: 0.0009)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 32.12% (4.6192 => 6.1031, std.dev.: 0.2674)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 20.42% (3.4491 => 4.1534, std.dev.: 0.0609)
  SingleSource/Benchmarks/Shootout/ary3: 16.80% (4.6860 => 5.4733, std.dev.: 0.2019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 12.77% (21.5410 => 24.2910, std.dev.: 0.7447)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.59% (0.4149 => 0.4630, std.dev.: 0.0168)
  SingleSource/Benchmarks/Shootout/hash: 10.56% (5.1670 => 5.7124, std.dev.: 0.0495)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.54% (45.1801 => 49.0403, std.dev.: 1.0461)
  MultiSource/Applications/JM/lencod/lencod: 8.45% (7.5902 => 8.2312, std.dev.: 0.1755)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.69% (1.2351 => 1.3177, std.dev.: 0.0092)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.57% (6.0828 => 6.4216, std.dev.: 0.0210)
  SingleSource/Benchmarks/Shootout-C++/lists1: 3.71% (0.5693 => 0.5904, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.69% (4.4995 => 4.6205, std.dev.: 0.0069)
  MultiSource/Applications/lua/lua: 2.64% (28.5941 => 29.3483, std.dev.: 0.0856)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.29% (5.1351 => 5.2528, std.dev.: 0.0400)
  SingleSource/Benchmarks/Shootout/methcall: 1.68% (8.5420 => 8.6858, std.dev.: 0.0217)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.64% (11.8794 => 12.0743, std.dev.: 0.0336)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.60% (1.6526 => 1.6790, std.dev.: 0.0072)
  SingleSource/Benchmarks/Misc/mandel: 1.15% (1.0579 => 1.0701, std.dev.: 0.0009)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.42% (3.5866 => 3.5357, std.dev.: 0.0163)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.28% (1.3786 => 1.3610, std.dev.: 0.0039)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 3.52% (0.1305 => 0.1351, std.dev.: 0.0097)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-05-02-CastTest3: 94.55% (0.0110 => 0.0214, std.dev.: 0.0005)
  SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 85.99% (0.0157 => 0.0292, std.dev.: 0.0010)
  SingleSource/UnitTests/AtomicOps: 81.16% (0.0207 => 0.0375, std.dev.: 0.0003)
  SingleSource/UnitTests/printargs: 78.79% (0.0165 => 0.0295, std.dev.: 0.0011)
  SingleSource/UnitTests/2003-10-13-SwitchTest: 77.22% (0.0158 => 0.0280, std.dev.: 0.0011)
  SingleSource/UnitTests/2003-05-07-VarArgs: 75.74% (0.0272 => 0.0478, std.dev.: 0.0011)
  SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 75.46% (0.0216 => 0.0379, std.dev.: 0.0021)
  SingleSource/UnitTests/2002-10-12-StructureArgs: 75.46% (0.0163 => 0.0286, std.dev.: 0.0018)
  SingleSource/Regression/C/PR640: 72.37% (0.0228 => 0.0393, std.dev.: 0.0013)
  SingleSource/UnitTests/2002-12-13-MishaTest: 72.22% (0.0198 => 0.0341, std.dev.: 0.0015)
  SingleSource/UnitTests/2003-05-31-CastToBool: 71.43% (0.0266 => 0.0456, std.dev.: 0.0032)
  SingleSource/UnitTests/2002-05-02-CastTest2: 69.52% (0.0210 => 0.0356, std.dev.: 0.0013)
  SingleSource/UnitTests/2002-05-03-NotTest: 68.72% (0.0195 => 0.0329, std.dev.: 0.0021)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 68.05% (0.0770 => 0.1294, std.dev.: 0.0047)
  SingleSource/UnitTests/2004-06-20-StaticBitfieldInit: 66.46% (0.0158 => 0.0263, std.dev.: 0.0008)
  SingleSource/Regression/C/PR491: 65.81% (0.0155 => 0.0257, std.dev.: 0.0017)
  SingleSource/UnitTests/2003-10-29-ScalarReplBug: 64.60% (0.0161 => 0.0265, std.dev.: 0.0026)
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 64.36% (0.0202 => 0.0332, std.dev.: 0.0025)
  SingleSource/Regression/C/sumarray: 63.82% (0.0304 => 0.0498, std.dev.: 0.0035)
  SingleSource/Regression/C++/EH/throw_rethrow_test: 57.79% (0.0263 => 0.0415, std.dev.: 0.0056)
  SingleSource/UnitTests/2003-07-09-SignedArgs: 55.56% (0.0279 => 0.0434, std.dev.: 0.0042)
  SingleSource/Benchmarks/Misc/flops-6: 51.11% (0.0315 => 0.0476, std.dev.: 0.0053)
  SingleSource/Benchmarks/Misc/richards_benchmark: 17.75% (0.0772 => 0.0909, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/fbench: 15.04% (0.0705 => 0.0811, std.dev.: 0.0025)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 9.83% (0.1597 => 0.1754, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc-C++/bigfib: 9.26% (0.6439 => 0.7035, std.dev.: 0.0229)
  MultiSource/Applications/kimwitu++/kc: 9.17% (18.3608 => 20.0440, std.dev.: 0.4093)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 6.45% (0.2123 => 0.2260, std.dev.: 0.0024)
  MultiSource/Applications/JM/lencod/lencod: 5.05% (16.5902 => 17.4286, std.dev.: 0.1898)
  MultiSource/Applications/lambda-0_1_3/lambda: 4.69% (0.8014 => 0.8390, std.dev.: 0.0009)
  MultiSource/Applications/hexxagon/hexxagon: 4.05% (1.0276 => 1.0692, std.dev.: 0.0010)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.05% (1.5333 => 1.5801, std.dev.: 0.0179)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.45% (1.3365 => 1.3692, std.dev.: 0.0110)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ackermann: 678.95% (0.0019 => 0.0148, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout-C++/methcall: 64.03% (7.6426 => 12.5361, std.dev.: 0.0421)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 34.20% (4.5479 => 6.1031, std.dev.: 0.2674)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 20.76% (1.1431 => 1.3804, std.dev.: 0.0536)
  SingleSource/Benchmarks/Shootout/ary3: 16.52% (4.6972 => 5.4733, std.dev.: 0.2019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 12.87% (21.5217 => 24.2910, std.dev.: 0.7447)
  SingleSource/Benchmarks/Shootout/hash: 9.83% (5.2009 => 5.7124, std.dev.: 0.0495)
  SingleSource/UnitTests/Vector/multiplies: 6.67% (0.5561 => 0.5932, std.dev.: 0.0030)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 6.63% (0.1871 => 0.1995, std.dev.: 0.0006)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.51% (3.1730 => 3.3797, std.dev.: 0.0231)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.12% (6.1088 => 6.4216, std.dev.: 0.0210)
  MultiSource/Benchmarks/sim/sim: 4.88% (3.8312 => 4.0183, std.dev.: 0.0262)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.49% (2.5368 => 2.6253, std.dev.: 0.0336)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.38% (4.4696 => 4.6205, std.dev.: 0.0069)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.13% (89.7126 => 92.5224, std.dev.: 0.1379)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.96% (4.0596 => 4.1799, std.dev.: 0.0403)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.79% (1.7652 => 1.8144, std.dev.: 0.0111)
  MultiSource/Applications/sqlite3/sqlite3: 2.48% (4.2733 => 4.3794, std.dev.: 0.0353)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.07% (3.1569 => 3.2224, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout/methcall: 1.67% (8.5434 => 8.6858, std.dev.: 0.0217)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.40% (3.5683 => 3.6184, std.dev.: 0.0108)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.38% (16.7972 => 17.0297, std.dev.: 0.0334)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.22% (11.9288 => 12.0743, std.dev.: 0.0336)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.22% (5.0196 => 5.0806, std.dev.: 0.0115)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.15% (8.1346 => 8.2285, std.dev.: 0.0287)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 1.11% (3.9856 => 4.0297, std.dev.: 0.0094)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -17.19% (0.1483 => 0.1228, std.dev.: 0.0058)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.57% (0.5226 => 0.2374, std.dev.: 0.0118)
  MultiSource/Applications/sgefa/sgefa: -43.86% (1.5790 => 0.8865, std.dev.: 0.0127)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -31.00% (0.0400 => 0.0276, std.dev.: 0.0046)
  MultiSource/Benchmarks/Olden/em3d/em3d: -28.84% (5.0288 => 3.5784, std.dev.: 0.0811)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.83% (15.9508 => 12.9474, std.dev.: 0.4412)
  MultiSource/Benchmarks/mafft/pairlocalalign: -18.32% (50.0284 => 40.8647, std.dev.: 2.3962)
  SingleSource/Benchmarks/Linpack/linpack-pc: -14.32% (57.2347 => 49.0403, std.dev.: 1.0461)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.56% (20.8247 => 18.4177, std.dev.: 0.1700)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.98% (4.3592 => 4.1859, std.dev.: 0.0518)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.98% (3.7874 => 3.6747, std.dev.: 0.0111)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.66% (2.5938 => 2.5247, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.57% (17.1431 => 16.7025, std.dev.: 0.0825)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.45% (2.4471 => 2.3871, std.dev.: 0.0157)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.11% (1.3763 => 1.3610, std.dev.: 0.0039)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.22% (0.1348 => 0.1351, std.dev.: 0.0097)

Report Time: 0.77s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131018/58a0053f/attachment.html>


More information about the llvm-testresults mailing list