[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Sep 28 11:18:34 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15763?compare_to=15760&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15763, Order: 191615, Start Time: 2013-09-28 16:35:47, End Time: 2013-09-28 18:21:25
      To: 15760, Order: 191612, Start Time: 2013-09-28 14:28:53, End Time: 2013-09-28 16:14:46
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 31 (42 on baseline)
Performance Improvements: 4 (20 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1072 (1045 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/aha/aha: 18.40% (0.1288 => 0.1525, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.71% (1.4288 => 1.4532, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.58% (1.3206 => 1.3414, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.52% (1.4549 => 1.4770, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.51% (1.2573 => 1.2763, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.46% (1.2480 => 1.2662, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.40% (1.2711 => 1.2889, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.30% (1.3029 => 1.3198, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.13% (1.2460 => 1.2601, std.dev.: 0.0029)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 38.94% (0.1420 => 0.1973, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout/sieve: 18.36% (7.1011 => 8.4050, std.dev.: 0.0425)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 12.88% (6.5458 => 7.3889, std.dev.: 0.0164)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 6.81% (0.4524 => 0.4832, std.dev.: 0.0111)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.74% (3.6172 => 3.8609, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 5.34% (0.3766 => 0.3967, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.73% (3.5862 => 3.7198, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.98% (5.2786 => 5.4361, std.dev.: 0.0010)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.94% (2.3944 => 2.4647, std.dev.: 0.0225)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.76% (5.1073 => 5.2481, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.37% (4.4269 => 4.5316, std.dev.: 0.0125)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.32% (1.5888 => 1.6256, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.25% (11.7893 => 12.0542, std.dev.: 0.0215)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.14% (5.5068 => 5.6246, std.dev.: 0.0002)
  SingleSource/Regression/C/uint64_to_float: 1.99% (1.4526 => 1.4815, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.91% (3.1600 => 3.2204, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.88% (4.0552 => 4.1313, std.dev.: 0.0185)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 1.59% (3.9521 => 4.0151, std.dev.: 0.0080)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.40% (18.5263 => 18.7853, std.dev.: 0.0210)
  SingleSource/Benchmarks/Shootout/fib2: 1.31% (3.5990 => 3.6463, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.26% (5.9354 => 6.0104, std.dev.: 0.0038)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.16% (23.3988 => 23.6697, std.dev.: 0.0591)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -10.28% (24.1865 => 21.7010, std.dev.: 0.6029)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.09% (4.3308 => 4.2405, std.dev.: 0.0345)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -1.93% (9.3747 => 9.1935, std.dev.: 0.0658)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.38% (2.5428 => 2.5078, std.dev.: 0.0136)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.31% (0.1385 => 0.1353, std.dev.: 0.0258)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/aha/aha: 19.23% (0.1279 => 0.1525, std.dev.: 0.0048)
  SingleSource/UnitTests/Vector/constpool: 4.45% (8.8921 => 9.2877, std.dev.: 0.1303)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.63% (1.3365 => 1.3716, std.dev.: 0.0129)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.00% (9.9903 => 10.1897, std.dev.: 0.0643)
  MultiSource/Benchmarks/Bullet/bullet: 1.98% (32.7552 => 33.4047, std.dev.: 0.0523)
  MultiSource/Benchmarks/nbench/nbench: 1.75% (1.2484 => 1.2703, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.68% (1.2932 => 1.3149, std.dev.: 0.0032)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.67% (24.6139 => 25.0238, std.dev.: 0.1269)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.59% (1.4304 => 1.4532, std.dev.: 0.0011)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 1.56% (44.2807 => 44.9699, std.dev.: 0.0543)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.53% (1.2695 => 1.2889, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.32% (1.2007 => 1.2165, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.22% (1.2948 => 1.3106, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.17% (1.4599 => 1.4770, std.dev.: 0.0007)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.15% (2.5666 => 2.5961, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.12% (1.2639 => 1.2780, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.11% (1.2152 => 1.2287, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.06% (1.3249 => 1.3389, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.05% (1.2630 => 1.2763, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.01% (1.3042 => 1.3174, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.00% (1.3278 => 1.3411, std.dev.: 0.0038)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 65.44% (7.6426 => 12.6440, std.dev.: 0.0092)
  SingleSource/Benchmarks/Shootout/sieve: 16.33% (7.2254 => 8.4050, std.dev.: 0.0425)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.69% (6.4425 => 7.3889, std.dev.: 0.0164)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.60% (3.5550 => 3.8609, std.dev.: 0.0020)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.42% (8.1346 => 8.6566, std.dev.: 0.0810)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.45% (0.1871 => 0.1973, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.37% (3.5642 => 3.7198, std.dev.: 0.0014)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.42% (0.3836 => 0.3967, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.82% (4.0181 => 4.1313, std.dev.: 0.0185)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.45% (11.7654 => 12.0542, std.dev.: 0.0215)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.41% (5.4925 => 5.6246, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.01% (3.1569 => 3.2204, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.98% (1.5940 => 1.6256, std.dev.: 0.0072)
  SingleSource/Regression/C/uint64_to_float: 1.98% (1.4528 => 1.4815, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.93% (5.3022 => 5.4046, std.dev.: 0.0003)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.61% (1.7652 => 1.7937, std.dev.: 0.0102)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.60% (16.7972 => 17.0664, std.dev.: 0.0296)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.46% (1.6707 => 1.6951, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout/fib2: 1.38% (3.5966 => 3.6463, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.14% (6.6028 => 6.6780, std.dev.: 0.0108)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.90% (0.1483 => 0.1173, std.dev.: 0.0004)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -9.21% (0.1195 => 0.1085, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -2.62% (1.2499 => 1.2172, std.dev.: 0.0090)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.40% (0.5226 => 0.2383, std.dev.: 0.0099)
  MultiSource/Applications/sgefa/sgefa: -46.75% (1.5790 => 0.8408, std.dev.: 0.0324)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -25.00% (0.0400 => 0.0300, std.dev.: 0.0003)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.77% (57.2347 => 43.6312, std.dev.: 2.2037)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.83% (15.9508 => 13.1067, std.dev.: 0.2576)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -14.71% (1.7197 => 1.4668, std.dev.: 0.0322)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.10% (3.4956 => 3.1427, std.dev.: 0.0361)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -9.79% (20.8247 => 18.7853, std.dev.: 0.0210)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.31% (50.0284 => 46.3697, std.dev.: 0.3710)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -6.55% (4.1004 => 3.8319, std.dev.: 0.0971)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.73% (30.1838 => 28.4534, std.dev.: 0.0567)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.03% (0.3501 => 0.3325, std.dev.: 0.0033)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.32% (2.5938 => 2.5078, std.dev.: 0.0136)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -2.80% (9.4586 => 9.1935, std.dev.: 0.0658)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.72% (4.3592 => 4.2405, std.dev.: 0.0345)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.74% (17.1431 => 16.8455, std.dev.: 0.0026)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.22% (89.7126 => 88.6212, std.dev.: 0.0561)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.37% (0.1348 => 0.1353, std.dev.: 0.0258)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130928/22596fb3/attachment.html>


More information about the llvm-testresults mailing list