[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jun 4 11:31:17 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12045?compare_to=12042&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12045, Order: 183234, Start Time: 2013-06-04 16:44:25, End Time: 2013-06-04 18:31:58
      To: 12042, Order: 183223, Start Time: 2013-06-04 14:33:04, End Time: 2013-06-04 16:21:51
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 12 (28 on baseline)
Performance Improvements: 26 (28 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1069 (1051 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.41% (1.6108 => 1.7140, std.dev.: 0.0267)
  SingleSource/Benchmarks/Shootout-C++/fibo: 6.00% (0.2001 => 0.2121, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 4.89% (1.6656 => 1.7470, std.dev.: 0.0184)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 4.86% (1.6160 => 1.6945, std.dev.: 0.0139)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.00% (1.5293 => 1.5904, std.dev.: 0.0139)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/salsa20: 10.47% (8.0732 => 8.9182, std.dev.: 0.0366)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 10.25% (4.0411 => 4.4552, std.dev.: 0.1249)
  SingleSource/Benchmarks/Misc/flops-4: 6.10% (1.5334 => 1.6270, std.dev.: 0.0304)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.50% (4.6112 => 4.7264, std.dev.: 0.0326)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.43% (3.3380 => 3.3857, std.dev.: 0.0123)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.12% (4.4269 => 4.4766, std.dev.: 0.0083)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.01% (6.1646 => 6.2267, std.dev.: 0.0083)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C++/EH/ConditionalExpr: -39.95% (0.0383 => 0.0230, std.dev.: 0.0006)
  SingleSource/Regression/C++/EH/exception_spec_test: -38.83% (0.0564 => 0.0345, std.dev.: 0.0008)
  SingleSource/Regression/C++/pointer_method2: -37.95% (0.0419 => 0.0260, std.dev.: 0.0003)
  SingleSource/Regression/C/sumarray: -36.41% (0.0585 => 0.0372, std.dev.: 0.0008)
  SingleSource/Regression/C++/EH/throw_rethrow_test: -36.21% (0.0417 => 0.0266, std.dev.: 0.0048)
  SingleSource/UnitTests/2002-05-02-CastTest2: -34.16% (0.0322 => 0.0212, std.dev.: 0.0007)
  SingleSource/Regression/C++/global_ctor: -31.80% (0.0327 => 0.0223, std.dev.: 0.0005)
  SingleSource/Regression/C/matrixTranspose: -28.04% (0.0378 => 0.0272, std.dev.: 0.0004)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -24.63% (1.2880 => 0.9708, std.dev.: 0.1072)
  SingleSource/Regression/C++/ofstream_ctor: -21.50% (0.2916 => 0.2289, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc/ffbench: -20.08% (0.0991 => 0.0792, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -14.03% (0.0877 => 0.0754, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -11.50% (0.0913 => 0.0808, std.dev.: 0.0010)
  SingleSource/Benchmarks/McGill/chomp: -9.87% (0.2036 => 0.1835, std.dev.: 0.0029)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -8.33% (53.3317 => 48.8889, std.dev.: 1.3993)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -4.54% (0.4276 => 0.4082, std.dev.: 0.0055)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: -20.41% (2.1275 => 1.6932, std.dev.: 0.0661)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -18.04% (0.3260 => 0.2672, std.dev.: 0.0178)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -14.99% (0.0687 => 0.0584, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -7.53% (0.1886 => 0.1744, std.dev.: 0.0008)
  SingleSource/Benchmarks/McGill/chomp: -6.01% (1.0757 => 1.0111, std.dev.: 0.0183)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.74% (7.0655 => 6.8009, std.dev.: 0.0864)
  SingleSource/Benchmarks/Dhrystone/fldry: -2.65% (0.6801 => 0.6621, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.41% (8.5849 => 8.3778, std.dev.: 0.0104)
  SingleSource/Regression/C/uint64_to_float: -2.19% (1.7331 => 1.6951, std.dev.: 0.0035)
  SingleSource/Benchmarks/Misc/mandel: -1.37% (1.0460 => 1.0317, std.dev.: 0.0040)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.05% (0.1460 => 0.1430, std.dev.: 0.0335)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.40% (1.5959 => 1.7140, std.dev.: 0.0267)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 6.03% (1.4999 => 1.5904, std.dev.: 0.0139)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.01% (1.5984 => 1.6945, std.dev.: 0.0139)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 5.78% (1.7006 => 1.7989, std.dev.: 0.0202)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.76% (1.4131 => 1.4945, std.dev.: 0.0210)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 5.48% (1.6563 => 1.7470, std.dev.: 0.0184)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 5.25% (1.4165 => 1.4909, std.dev.: 0.0101)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: 4.55% (0.3429 => 0.3585, std.dev.: 0.0053)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.58% (1.8435 => 1.9095, std.dev.: 0.0181)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 52.86% (6.0122 => 9.1905, std.dev.: 0.7225)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 27.29% (3.5000 => 4.4552, std.dev.: 0.1249)
  SingleSource/Benchmarks/Stanford/Puzzle: 21.24% (0.1455 => 0.1764, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 19.23% (6.1372 => 7.3172, std.dev.: 0.2579)
  MultiSource/Applications/sgefa/sgefa: 17.82% (1.1695 => 1.3779, std.dev.: 0.0192)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.90% (5.2003 => 5.5592, std.dev.: 0.0479)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.29% (3.1853 => 3.3857, std.dev.: 0.0123)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.60% (4.6639 => 4.9253, std.dev.: 0.0986)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.14% (3.2201 => 3.3856, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.89% (5.9362 => 6.2267, std.dev.: 0.0083)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.74% (5.2788 => 5.5291, std.dev.: 0.0804)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.33% (1.0571 => 1.1029, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.02% (5.5010 => 5.6670, std.dev.: 0.0209)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.89% (4.5935 => 4.7264, std.dev.: 0.0326)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.38% (4.3727 => 4.4766, std.dev.: 0.0083)
  SingleSource/Benchmarks/Shootout/methcall: 2.30% (8.3425 => 8.5341, std.dev.: 0.0570)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.92% (5.6582 => 5.7670, std.dev.: 0.0145)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.73% (3.9713 => 4.0400, std.dev.: 0.0179)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.09% (1.6980 => 1.7165, std.dev.: 0.0040)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -34.41% (0.1113 => 0.0730, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -17.68% (0.0803 => 0.0661, std.dev.: 0.0020)
  MultiSource/Applications/aha/aha: -7.18% (0.1407 => 0.1306, std.dev.: 0.0012)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -6.23% (0.2006 => 0.1881, std.dev.: 0.0006)
  MultiSource/Applications/Burg/burg: -5.69% (1.5375 => 1.4500, std.dev.: 0.0120)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.47% (1.2911 => 0.7299, std.dev.: 0.0280)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.51% (4.4050 => 3.2372, std.dev.: 0.1342)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.98% (6.2328 => 5.0496, std.dev.: 0.0243)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.05% (25.3677 => 21.2973, std.dev.: 0.2983)
  SingleSource/Benchmarks/Misc/salsa20: -13.75% (10.3398 => 8.9182, std.dev.: 0.0366)
  MultiSource/Benchmarks/mafft/pairlocalalign: -9.79% (48.3307 => 43.5975, std.dev.: 0.0787)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.41% (1.6679 => 1.5109, std.dev.: 0.0588)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.63% (3.5327 => 3.2278, std.dev.: 0.0505)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.54% (5.5889 => 5.2232, std.dev.: 0.0172)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.50% (0.4445 => 0.4156, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.27% (4.5717 => 4.2851, std.dev.: 0.0292)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.88% (9.8728 => 9.2922, std.dev.: 0.0158)
  SingleSource/Benchmarks/Shootout-C++/hash: -5.31% (0.7941 => 0.7519, std.dev.: 0.0136)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.76% (5.3184 => 5.0655, std.dev.: 0.0319)
  MultiSource/Applications/hexxagon/hexxagon: -4.04% (15.4979 => 14.8716, std.dev.: 0.0727)
  SingleSource/Benchmarks/Linpack/linpack-pc: -3.69% (51.8429 => 49.9305, std.dev.: 0.6044)
  SingleSource/Benchmarks/Misc/flops: -3.64% (10.2170 => 9.8453, std.dev.: 0.0259)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.86% (3.8665 => 3.7561, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.79% (5.3276 => 5.1790, std.dev.: 0.0531)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.20% (2.8537 => 2.7908, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.02% (4.2167 => 4.1315, std.dev.: 0.0054)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.72% (8.5243 => 8.3778, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.10% (9.6556 => 9.5493, std.dev.: 0.0332)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.76% (0.1441 => 0.1430, std.dev.: 0.0335)

Report Time: 1.07s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130604/d7e560b6/attachment.html>


More information about the llvm-testresults mailing list