[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Jul 1 03:39:07 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12949?compare_to=12946&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12949, Order: 185312, Start Time: 2013-07-01 08:50:13, End Time: 2013-07-01 10:40:18
      To: 12946, Order: 185304, Start Time: 2013-07-01 06:41:21, End Time: 2013-07-01 08:27:24
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 39 (50 on baseline)
Performance Improvements: 2 (46 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1066 (1011 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/pointer_method2: 68.77% (0.0253 => 0.0427, std.dev.: 0.0002)
  SingleSource/UnitTests/2003-05-14-AtExit: 57.69% (0.0208 => 0.0328, std.dev.: 0.0006)
  SingleSource/UnitTests/2002-05-02-CastTest: 55.06% (0.0267 => 0.0414, std.dev.: 0.0013)
  SingleSource/Regression/C++/EH/exception_spec_test: 54.52% (0.0343 => 0.0530, std.dev.: 0.0019)
  SingleSource/Regression/C++/fixups: 48.57% (0.0245 => 0.0364, std.dev.: 0.0019)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 32.05% (0.9387 => 1.2396, std.dev.: 0.1121)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.19% (1.9207 => 2.0780, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 6.87% (1.6312 => 1.7432, std.dev.: 0.0423)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.38% (1.4321 => 1.5234, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/matrix: 5.72% (0.2570 => 0.2717, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 5.67% (1.4581 => 1.5408, std.dev.: 0.0308)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.17% (1.4731 => 1.5493, std.dev.: 0.0135)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.01% (0.6308 => 0.6624, std.dev.: 0.0040)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.84% (0.9681 => 1.0150, std.dev.: 0.0168)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.76% (1.6148 => 1.6917, std.dev.: 0.0089)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.04% (1.5770 => 1.5934, std.dev.: 0.0055)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 56.90% (5.7973 => 9.0961, std.dev.: 0.8632)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 42.26% (2.9276 => 4.1647, std.dev.: 0.2120)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.46% (1.4635 => 1.8654, std.dev.: 0.0200)
  SingleSource/Benchmarks/Shootout-C++/ary: 25.08% (0.0630 => 0.0788, std.dev.: 0.0016)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 17.18% (2.5543 => 2.9931, std.dev.: 0.0247)
  SingleSource/Benchmarks/Shootout-C++/fibo: 16.28% (4.1422 => 4.8167, std.dev.: 0.1355)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 14.49% (3.6236 => 4.1486, std.dev.: 0.1337)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.70% (2.1084 => 2.3973, std.dev.: 0.0099)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.43% (15.0839 => 16.9588, std.dev.: 0.3073)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 10.80% (29.3328 => 32.4995, std.dev.: 0.6597)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.21% (0.3322 => 0.3628, std.dev.: 0.0063)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 8.65% (0.4647 => 0.5049, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 8.34% (4.7027 => 5.0947, std.dev.: 0.0228)
  SingleSource/Benchmarks/Misc/salsa20: 6.39% (8.4547 => 8.9949, std.dev.: 0.0302)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.92% (5.8966 => 6.1869, std.dev.: 0.0166)
  SingleSource/Benchmarks/Shootout-C++/lists1: 4.45% (0.6246 => 0.6524, std.dev.: 0.0015)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 2.94% (2.4947 => 2.5681, std.dev.: 0.0182)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.36% (2.5339 => 2.5936, std.dev.: 0.0092)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.20% (4.0052 => 4.0933, std.dev.: 0.0288)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.77% (6.2380 => 6.3487, std.dev.: 0.0394)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.61% (2.7334 => 2.7775, std.dev.: 0.0163)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.21% (11.4133 => 11.5514, std.dev.: 0.0458)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.18% (2.5502 => 2.5803, std.dev.: 0.0114)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/pi: -5.30% (2.1288 => 2.0159, std.dev.: 0.0325)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -3.61% (0.4018 => 0.3873, std.dev.: 0.0046)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.45% (0.1340 => 0.1346, std.dev.: 0.0096)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/pointer_method2: 69.44% (0.0252 => 0.0427, std.dev.: 0.0002)
  SingleSource/UnitTests/2003-05-14-AtExit: 56.94% (0.0209 => 0.0328, std.dev.: 0.0006)
  SingleSource/UnitTests/2002-05-02-CastTest: 42.27% (0.0291 => 0.0414, std.dev.: 0.0013)
  SingleSource/Regression/C++/EH/exception_spec_test: 41.71% (0.0374 => 0.0530, std.dev.: 0.0019)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 8.92% (1.9079 => 2.0780, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.22% (1.4238 => 1.5408, std.dev.: 0.0308)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 8.19% (1.4081 => 1.5234, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/matrix: 8.12% (0.2513 => 0.2717, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 7.57% (1.5727 => 1.6917, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 7.45% (1.5959 => 1.7148, std.dev.: 0.0265)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.11% (1.6275 => 1.7432, std.dev.: 0.0423)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.96% (1.4485 => 1.5493, std.dev.: 0.0135)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 5.92% (0.6254 => 0.6624, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/ary: 5.86% (0.2747 => 0.2908, std.dev.: 0.0024)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.74% (0.9599 => 1.0150, std.dev.: 0.0168)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 4.74% (0.7791 => 0.8160, std.dev.: 0.0118)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 4.70% (0.3425 => 0.3586, std.dev.: 0.0056)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 51.29% (6.0122 => 9.0961, std.dev.: 0.8632)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.27% (0.0275 => 0.0383, std.dev.: 0.0022)
  MultiSource/Applications/viterbi/viterbi: 36.48% (2.5688 => 3.5058, std.dev.: 0.0283)
  MultiSource/Applications/sgefa/sgefa: 30.25% (1.1695 => 1.5233, std.dev.: 0.0097)
  SingleSource/Benchmarks/Misc/perlin: 27.17% (3.6271 => 4.6125, std.dev.: 0.0093)
  SingleSource/Benchmarks/Shootout-C++/ary: 24.49% (0.0633 => 0.0788, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 18.99% (3.5000 => 4.1647, std.dev.: 0.2120)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.68% (6.1372 => 7.2222, std.dev.: 0.0891)
  SingleSource/Benchmarks/Misc/mandel: 16.60% (1.0293 => 1.2002, std.dev.: 0.0031)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.28% (0.9806 => 1.1402, std.dev.: 0.0255)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 16.01% (2.5800 => 2.9931, std.dev.: 0.0247)
  SingleSource/Benchmarks/Misc/pi: 10.05% (1.8318 => 2.0159, std.dev.: 0.0325)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 8.81% (0.4640 => 0.5049, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.26% (5.2003 => 5.6296, std.dev.: 0.0178)
  MultiSource/Benchmarks/PAQ8p/paq8p: 7.45% (94.2966 => 101.3170, std.dev.: 1.2934)
  SingleSource/Benchmarks/Shootout-C++/lists1: 7.00% (0.6097 => 0.6524, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.26% (3.1853 => 3.3847, std.dev.: 0.0564)
  MultiSource/Applications/lua/lua: 5.96% (28.2496 => 29.9326, std.dev.: 0.6265)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.88% (3.2201 => 3.4094, std.dev.: 0.0135)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.81% (4.6639 => 4.8883, std.dev.: 0.0348)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.48% (2.8994 => 3.0293, std.dev.: 0.0276)
  SingleSource/Benchmarks/Misc/fbench: 4.45% (4.7508 => 4.9621, std.dev.: 0.0198)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.22% (5.9362 => 6.1869, std.dev.: 0.0166)
  MultiSource/Benchmarks/sim/sim: 3.58% (3.8805 => 4.0195, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.54% (4.6379 => 4.8022, std.dev.: 0.0035)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.07% (3.9713 => 4.0933, std.dev.: 0.0288)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.99% (5.5010 => 5.6654, std.dev.: 0.0215)
  SingleSource/Benchmarks/Misc/ffbench: 2.64% (1.3696 => 1.4057, std.dev.: 0.0092)
  SingleSource/Benchmarks/CoyoteBench/almabench: 2.42% (34.3107 => 35.1412, std.dev.: 0.0262)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 2.37% (2.5087 => 2.5681, std.dev.: 0.0182)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.08% (2.5408 => 2.5936, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.81% (5.6582 => 5.7607, std.dev.: 0.0306)
  SingleSource/Benchmarks/Shootout/methcall: 1.57% (8.3425 => 8.4737, std.dev.: 0.0464)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/viterbi/viterbi: -23.65% (0.2431 => 0.1856, std.dev.: 0.0073)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.12% (1.6793 => 1.5934, std.dev.: 0.0055)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.45% (1.2911 => 0.7301, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -37.44% (4.4050 => 2.7556, std.dev.: 0.0141)
  SingleSource/Benchmarks/Shootout/hash: -20.70% (5.3656 => 4.2547, std.dev.: 0.2233)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -19.86% (4.8986 => 3.9257, std.dev.: 0.0246)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -19.84% (5.7264 => 4.5905, std.dev.: 0.0646)
  MultiSource/Benchmarks/Olden/bisort/bisort: -19.25% (0.8606 => 0.6949, std.dev.: 0.0322)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.26% (6.2328 => 5.0947, std.dev.: 0.0228)
  MultiSource/Applications/lambda-0_1_3/lambda: -17.98% (9.1099 => 7.4722, std.dev.: 0.0829)
  SingleSource/Benchmarks/Shootout-C++/hash: -17.11% (0.7941 => 0.6582, std.dev.: 0.0348)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.73% (25.3677 => 21.3765, std.dev.: 0.4528)
  MultiSource/Benchmarks/mafft/pairlocalalign: -13.31% (48.3307 => 41.8965, std.dev.: 0.0705)
  MultiSource/Benchmarks/Olden/tsp/tsp: -13.07% (1.6613 => 1.4442, std.dev.: 0.0085)
  SingleSource/Benchmarks/Misc/salsa20: -13.01% (10.3398 => 8.9949, std.dev.: 0.0302)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -9.22% (3.2030 => 2.9076, std.dev.: 0.1084)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -8.78% (2.4808 => 2.2631, std.dev.: 0.0635)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.32% (9.8728 => 9.0509, std.dev.: 0.0195)
  MultiSource/Applications/siod/siod: -8.14% (3.7240 => 3.4209, std.dev.: 0.0169)
  MultiSource/Applications/sqlite3/sqlite3: -7.97% (4.6358 => 4.2662, std.dev.: 0.0735)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.06% (4.5717 => 4.2489, std.dev.: 0.0131)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -5.76% (5.5889 => 5.2671, std.dev.: 0.0197)
  SingleSource/Benchmarks/Shootout-C++/hash2: -5.71% (3.5939 => 3.3887, std.dev.: 0.0540)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -5.40% (1.6535 => 1.5642, std.dev.: 0.0133)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -5.33% (1.4783 => 1.3995, std.dev.: 0.0291)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -5.31% (1.3084 => 1.2389, std.dev.: 0.0235)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.07% (5.3276 => 5.1107, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.06% (5.3184 => 5.1025, std.dev.: 0.0572)
  SingleSource/Benchmarks/Misc/flops: -3.76% (10.2170 => 9.8329, std.dev.: 0.0153)
  MultiSource/Applications/spiff/spiff: -3.67% (2.8536 => 2.7488, std.dev.: 0.0319)
  MultiSource/Applications/hexxagon/hexxagon: -3.56% (15.4979 => 14.9456, std.dev.: 0.0669)
  SingleSource/Benchmarks/Misc/whetstone: -3.49% (3.5970 => 3.4716, std.dev.: 0.0075)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -3.27% (4.5935 => 4.4435, std.dev.: 0.0502)
  SingleSource/Benchmarks/Shootout/sieve: -2.79% (8.0178 => 7.7940, std.dev.: 0.0165)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.74% (3.8665 => 3.7606, std.dev.: 0.0135)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -2.71% (1.6440 => 1.5995, std.dev.: 0.0034)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.67% (2.8537 => 2.7775, std.dev.: 0.0163)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.24% (3.6122 => 3.5312, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.84% (4.5094 => 4.4264, std.dev.: 0.0075)
  MultiSource/Benchmarks/Olden/power/power: -1.82% (1.2558 => 1.2330, std.dev.: 0.0028)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.69% (4.9946 => 4.9101, std.dev.: 0.0187)
  SingleSource/Benchmarks/Shootout/lists: -1.60% (7.2961 => 7.1790, std.dev.: 0.0384)
  MultiSource/Applications/SIBsim4/SIBsim4: -1.48% (3.5327 => 3.4804, std.dev.: 0.0191)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.36% (1.1791 => 1.1631, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.06% (9.6556 => 9.5533, std.dev.: 0.0206)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -1.05% (1.6105 => 1.5936, std.dev.: 0.0065)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -6.59% (0.1441 => 0.1346, std.dev.: 0.0096)

Report Time: 0.95s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130701/443d76f3/attachment.html>


More information about the llvm-testresults mailing list