[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Aug 4 04:30:33 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14070?compare_to=14067&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14070, Order: 187702, Start Time: 2013-08-04 09:40:46, End Time: 2013-08-04 11:32:22
      To: 14067, Order: 187701, Start Time: 2013-08-04 03:37:44, End Time: 2013-08-04 05:18:46
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 30 (40 on baseline)
Performance Improvements: 1 (39 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1074 (1026 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/recursive: 53.72% (0.0296 => 0.0455, std.dev.: 0.0040)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 40.89% (0.0560 => 0.0789, std.dev.: 0.0060)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 24.27% (0.0412 => 0.0512, std.dev.: 0.0000)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.82% (6.5045 => 7.5985, std.dev.: 0.0258)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 14.99% (0.2321 => 0.2669, std.dev.: 0.0054)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 14.72% (2.6654 => 3.0577, std.dev.: 0.0811)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 14.39% (1.9508 => 2.2316, std.dev.: 0.0718)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.05% (4.2690 => 4.8261, std.dev.: 0.1038)
  MultiSource/Applications/JM/lencod/lencod: 12.82% (17.4051 => 19.6364, std.dev.: 0.1035)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 10.26% (0.9878 => 1.0891, std.dev.: 0.0389)
  MultiSource/Applications/SIBsim4/SIBsim4: 7.95% (1.6391 => 1.7694, std.dev.: 0.0311)
  SingleSource/UnitTests/2006-12-11-LoadConstants: 7.78% (0.1517 => 0.1635, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout-C++/ary3: 4.12% (0.2939 => 0.3060, std.dev.: 0.0017)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.90% (0.6109 => 0.6286, std.dev.: 0.0036)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 68.38% (2.9254 => 4.9259, std.dev.: 0.1479)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 54.04% (4.4789 => 6.8993, std.dev.: 0.0722)
  MultiSource/Applications/SPASS/SPASS: 27.97% (8.1416 => 10.4187, std.dev.: 0.2416)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 23.26% (36.9234 => 45.5116, std.dev.: 2.7257)
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.10% (4.1323 => 4.8391, std.dev.: 0.0052)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.56% (21.4608 => 24.7993, std.dev.: 0.8684)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 12.11% (2.9530 => 3.3105, std.dev.: 0.1351)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 9.93% (2.3163 => 2.5463, std.dev.: 0.0480)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.38% (0.3315 => 0.3626, std.dev.: 0.0032)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 7.46% (2.4100 => 2.5899, std.dev.: 0.0507)
  MultiSource/Benchmarks/mafft/pairlocalalign: 7.15% (41.8567 => 44.8486, std.dev.: 0.1611)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 4.62% (6.2293 => 6.5171, std.dev.: 0.0349)
  SingleSource/Benchmarks/Misc/salsa20: 3.15% (8.7202 => 8.9945, std.dev.: 0.0382)
  SingleSource/Regression/C/uint64_to_float: 2.67% (1.4382 => 1.4766, std.dev.: 0.0026)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.81% (3.5814 => 3.6461, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.03% (3.7336 => 3.7719, std.dev.: 0.0012)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/pi: -18.32% (2.3996 => 1.9599, std.dev.: 0.0580)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: -2.32% (0.1338 => 0.1307, std.dev.: 0.0101)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.13% (0.2679 => 0.2736, std.dev.: 0.0036)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 14.17% (0.0247 => 0.0282, std.dev.: 0.0008)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.74% (0.2813 => 0.2736, std.dev.: 0.0036)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -18.26% (0.0345 => 0.0282, std.dev.: 0.0008)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/recursive: 50.66% (0.0302 => 0.0455, std.dev.: 0.0040)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 37.22% (0.0575 => 0.0789, std.dev.: 0.0060)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.94% (6.4979 => 7.5985, std.dev.: 0.0258)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 15.87% (2.6390 => 3.0577, std.dev.: 0.0811)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 15.53% (1.9317 => 2.2316, std.dev.: 0.0718)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 15.14% (0.2318 => 0.2669, std.dev.: 0.0054)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.71% (4.2444 => 4.8261, std.dev.: 0.1038)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 11.58% (0.9761 => 1.0891, std.dev.: 0.0389)
  SingleSource/UnitTests/2006-12-11-LoadConstants: 8.78% (0.1503 => 0.1635, std.dev.: 0.0036)
  MultiSource/Applications/JM/lencod/lencod: 6.13% (18.5029 => 19.6364, std.dev.: 0.1035)
  SingleSource/Benchmarks/Shootout-C++/ary3: 5.37% (0.2904 => 0.3060, std.dev.: 0.0017)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 74.79% (3.7285 => 6.5171, std.dev.: 0.0349)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 69.67% (2.9033 => 4.9259, std.dev.: 0.1479)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 51.58% (4.5517 => 6.8993, std.dev.: 0.0722)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.51% (2.8867 => 4.2870, std.dev.: 0.0125)
  MultiSource/Benchmarks/FreeBench/neural/neural: 39.99% (0.3171 => 0.4439, std.dev.: 0.0339)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 23.37% (36.8900 => 45.5116, std.dev.: 2.7257)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.04% (21.5567 => 24.7993, std.dev.: 0.8684)
  MultiSource/Applications/siod/siod: 13.91% (3.3761 => 3.8457, std.dev.: 0.0596)
  MultiSource/Applications/SPASS/SPASS: 12.98% (9.2220 => 10.4187, std.dev.: 0.2416)
  MultiSource/Applications/lambda-0_1_3/lambda: 12.88% (7.0762 => 7.9877, std.dev.: 0.0496)
  MultiSource/Applications/JM/lencod/lencod: 11.09% (7.1799 => 7.9762, std.dev.: 0.0880)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.43% (5.4910 => 5.9540, std.dev.: 0.0250)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 8.39% (2.3894 => 2.5899, std.dev.: 0.0507)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.37% (1.2557 => 1.3608, std.dev.: 0.0352)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.15% (48.3256 => 52.2648, std.dev.: 0.3410)
  SingleSource/Benchmarks/Shootout-C++/hash2: 7.63% (3.3877 => 3.6461, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.91% (3.2027 => 3.4240, std.dev.: 0.0808)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.00% (5.3042 => 5.6224, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.96% (5.5008 => 5.8288, std.dev.: 0.1047)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.88% (3.4085 => 3.6090, std.dev.: 0.0330)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.26% (5.1471 => 5.3662, std.dev.: 0.0733)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.83% (3.3384 => 3.4661, std.dev.: 0.0420)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.93% (4.8739 => 5.0168, std.dev.: 0.0047)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.18% (3.5351 => 3.6123, std.dev.: 0.0231)
  SingleSource/Benchmarks/Shootout-C++/sieve: 1.83% (3.4566 => 3.5197, std.dev.: 0.0219)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.81% (3.3464 => 3.4070, std.dev.: 0.0100)
  SingleSource/Benchmarks/Misc/flops: 1.69% (9.7664 => 9.9311, std.dev.: 0.0169)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.60% (1.4398 => 1.4629, std.dev.: 0.0006)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.59% (1.5957 => 1.6210, std.dev.: 0.0088)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -17.33% (0.1518 => 0.1255, std.dev.: 0.0017)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.35% (0.7091 => 0.6286, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -10.23% (1.7797 => 1.5976, std.dev.: 0.0156)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -8.41% (1.1012 => 1.0086, std.dev.: 0.0132)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.25% (0.2498 => 0.2317, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -6.94% (1.4514 => 1.3507, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.88% (1.5426 => 1.4365, std.dev.: 0.0203)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -6.67% (1.5345 => 1.4321, std.dev.: 0.0151)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.43% (1.4794 => 1.3843, std.dev.: 0.0193)
  MultiSource/Benchmarks/PAQ8p/paq8p: -6.06% (2.6853 => 2.5226, std.dev.: 0.0295)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.89% (1.5239 => 1.4342, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.74% (1.4333 => 1.3511, std.dev.: 0.0245)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -5.49% (1.5437 => 1.4590, std.dev.: 0.0160)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.18% (1.4853 => 1.4084, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.76% (1.4506 => 1.3815, std.dev.: 0.0154)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.78% (1.5357 => 1.4930, std.dev.: 0.0154)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.59% (1.5416 => 1.5017, std.dev.: 0.0090)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.69% (2.1022 => 1.4361, std.dev.: 0.0356)
  MultiSource/Benchmarks/MallocBench/gs/gs: -28.68% (0.1189 => 0.0848, std.dev.: 0.0018)
  MultiSource/Applications/viterbi/viterbi: -26.92% (3.4923 => 2.5520, std.dev.: 0.0173)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.68% (6.9552 => 5.2390, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc/perlin: -21.26% (4.5989 => 3.6214, std.dev.: 0.0338)
  MultiSource/Applications/sgefa/sgefa: -12.92% (1.4030 => 1.2217, std.dev.: 0.0080)
  SingleSource/Benchmarks/Misc/mandel: -11.11% (1.1996 => 1.0663, std.dev.: 0.0454)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.48% (0.5173 => 0.4631, std.dev.: 0.0177)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.95% (3.5791 => 3.2589, std.dev.: 0.0590)
  MultiSource/Applications/lua/lua: -6.38% (31.0707 => 29.0869, std.dev.: 0.4972)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.03% (47.2250 => 44.8486, std.dev.: 0.1611)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.91% (3.8119 => 3.6249, std.dev.: 0.0201)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -4.40% (21.6864 => 20.7323, std.dev.: 0.3203)
  SingleSource/Benchmarks/Misc/fbench: -4.19% (4.9602 => 4.7523, std.dev.: 0.0188)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.44% (0.7355 => 0.7102, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.03% (6.1482 => 5.9620, std.dev.: 0.0265)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.98% (5.2218 => 5.0663, std.dev.: 0.0103)
  SingleSource/Regression/C/uint64_to_float: -2.75% (1.5184 => 1.4766, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.30% (8.6172 => 8.4186, std.dev.: 0.0200)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.77% (34.8438 => 34.2279, std.dev.: 0.0759)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.46% (2.1343 => 2.1032, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.45% (5.8810 => 5.7957, std.dev.: 0.0286)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.15% (0.1378 => 0.1307, std.dev.: 0.0101)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130804/27d215c8/attachment.html>


More information about the llvm-testresults mailing list