[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Sep 27 13:29:37 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15737?compare_to=15733&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15737, Order: 191537, Start Time: 2013-09-27 18:39:03, End Time: 2013-09-27 20:32:28
      To: 15733, Order: 191526, Start Time: 2013-09-27 16:24:53, End Time: 2013-09-27 18:15:27
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 26 (52 on baseline)
Performance Improvements: 10 (15 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1071 (1040 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 60.97% (0.0392 => 0.0631, std.dev.: 0.0057)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 24.13% (0.6038 => 0.7495, std.dev.: 0.0457)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 15.16% (1.2745 => 1.4677, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 8.20% (1.2825 => 1.3877, std.dev.: 0.0393)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 7.65% (0.1385 => 0.1491, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.97% (1.2594 => 1.3472, std.dev.: 0.0256)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 4.78% (1.4440 => 1.5130, std.dev.: 0.0243)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.79% (1.3793 => 1.4316, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.04% (1.2885 => 1.3277, std.dev.: 0.0057)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.03% (1.4827 => 1.8834, std.dev.: 0.0137)
  SingleSource/Benchmarks/Shootout-C++/moments: 16.22% (0.1110 => 0.1290, std.dev.: 0.0068)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 7.52% (2.5182 => 2.7076, std.dev.: 0.0072)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.06% (1.2527 => 1.3286, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.43% (4.1208 => 4.3446, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.05% (5.9185 => 6.2171, std.dev.: 0.0899)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.25% (6.8538 => 7.1451, std.dev.: 0.0209)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.07% (13.2401 => 13.7788, std.dev.: 0.0233)
  SingleSource/Regression/C/uint64_to_float: 3.96% (1.4283 => 1.4848, std.dev.: 0.0048)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.76% (39.7312 => 41.2260, std.dev.: 0.1822)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 3.76% (2.9362 => 3.0465, std.dev.: 0.0390)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 3.17% (2.3164 => 2.3898, std.dev.: 0.0146)
  SingleSource/Benchmarks/Stanford/FloatMM: 2.47% (0.7119 => 0.7295, std.dev.: 0.0001)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.45% (2.4831 => 2.5439, std.dev.: 0.0151)
  SingleSource/Benchmarks/Misc/fp-convert: 2.22% (7.5498 => 7.7177, std.dev.: 0.0170)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.79% (11.9296 => 12.1436, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.53% (5.9103 => 6.0010, std.dev.: 0.0300)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc/pi: -41.27% (0.0361 => 0.0212, std.dev.: 0.0016)
  SingleSource/Benchmarks/Misc/lowercase: -32.33% (0.0365 => 0.0247, std.dev.: 0.0012)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -19.12% (1.4992 => 1.2125, std.dev.: 0.1029)
  SingleSource/Benchmarks/Stanford/Oscar: -16.80% (0.0845 => 0.0703, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -12.39% (1.4463 => 1.2671, std.dev.: 0.0442)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -10.82% (1.4649 => 1.3064, std.dev.: 0.0562)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: -3.39% (0.3508 => 0.3389, std.dev.: 0.0045)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/himenobmtxpa: -3.88% (4.2146 => 4.0512, std.dev.: 0.0548)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -3.81% (2.2074 => 2.1233, std.dev.: 0.0003)
  SingleSource/Benchmarks/Misc/perlin: -1.83% (3.6778 => 3.6105, std.dev.: 0.0136)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.14% (0.1371 => 0.1328, std.dev.: 0.0098)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 71.47% (0.0368 => 0.0631, std.dev.: 0.0057)
  MultiSource/Applications/spiff/spiff: 50.45% (0.8911 => 1.3407, std.dev.: 0.0796)
  MultiSource/Applications/Burg/burg: 36.30% (1.3994 => 1.9074, std.dev.: 0.0998)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 33.42% (0.2229 => 0.2974, std.dev.: 0.0173)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 31.38% (0.5705 => 0.7495, std.dev.: 0.0457)
  MultiSource/Applications/JM/lencod/lencod: 21.91% (16.5902 => 20.2255, std.dev.: 0.3417)
  MultiSource/Applications/siod/siod: 21.36% (2.4480 => 2.9709, std.dev.: 0.0522)
  MultiSource/Applications/d/make_dparser: 18.11% (3.4962 => 4.1293, std.dev.: 0.2191)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 16.92% (1.2553 => 1.4677, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 12.73% (1.2250 => 1.3809, std.dev.: 0.0581)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 12.21% (1.3499 => 1.5147, std.dev.: 0.0324)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 12.11% (1.3249 => 1.4854, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 12.09% (1.3498 => 1.5130, std.dev.: 0.0243)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 11.85% (0.1333 => 0.1491, std.dev.: 0.0009)
  MultiSource/Applications/kimwitu++/kc: 11.30% (18.3608 => 20.4361, std.dev.: 0.5615)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.86% (1.2152 => 1.3472, std.dev.: 0.0256)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.48% (1.2523 => 1.3836, std.dev.: 0.0346)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.37% (1.2201 => 1.3466, std.dev.: 0.0093)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 10.24% (44.2807 => 48.8129, std.dev.: 0.8047)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.13% (1.2639 => 1.3919, std.dev.: 0.0347)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 9.98% (0.1012 => 0.1113, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.94% (1.2622 => 1.3877, std.dev.: 0.0393)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 9.61% (1.2494 => 1.3695, std.dev.: 0.0455)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 9.60% (1.2630 => 1.3842, std.dev.: 0.0380)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.09% (1.3123 => 1.4316, std.dev.: 0.0102)
  MultiSource/Benchmarks/Bullet/bullet: 8.16% (32.7552 => 35.4292, std.dev.: 0.8796)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.71% (1.3068 => 1.4075, std.dev.: 0.0379)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 5.83% (1.4746 => 1.5606, std.dev.: 0.0323)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.45% (0.4624 => 0.4876, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.87% (1.2660 => 1.3277, std.dev.: 0.0057)
  MultiSource/Benchmarks/Prolangs-C/football/football: 3.46% (0.9828 => 1.0168, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 3.23% (0.8802 => 0.9086, std.dev.: 0.0090)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.84% (7.6426 => 12.5220, std.dev.: 0.0757)
  SingleSource/Benchmarks/Misc/pi: 31.77% (1.6574 => 2.1839, std.dev.: 0.2015)
  MultiSource/Applications/minisat/minisat: 29.67% (6.2760 => 8.1380, std.dev.: 0.5988)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.00% (1.4830 => 1.8834, std.dev.: 0.0137)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.28% (6.5990 => 7.1451, std.dev.: 0.0209)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 6.73% (2.5368 => 2.7076, std.dev.: 0.0072)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0027)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.15% (1.2516 => 1.3286, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.94% (4.1011 => 4.3446, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.27% (5.9061 => 6.2171, std.dev.: 0.0899)
  SingleSource/Benchmarks/McGill/misr: 5.09% (0.3771 => 0.3963, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.90% (5.7757 => 6.0010, std.dev.: 0.0300)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 3.72% (2.9372 => 3.0465, std.dev.: 0.0390)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.19% (39.9519 => 41.2260, std.dev.: 0.1822)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 2.28% (2.3365 => 2.3898, std.dev.: 0.0146)
  SingleSource/Regression/C/uint64_to_float: 2.20% (1.4528 => 1.4848, std.dev.: 0.0048)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.08% (2.4920 => 2.5439, std.dev.: 0.0151)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.80% (11.9288 => 12.1436, std.dev.: 0.0082)
  SingleSource/Benchmarks/Misc/fp-convert: 1.71% (7.5877 => 7.7177, std.dev.: 0.0170)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.29% (8.8798 => 8.9940, std.dev.: 0.0413)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.84% (0.1483 => 0.1174, std.dev.: 0.0069)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.25% (0.5226 => 0.2391, std.dev.: 0.0183)
  MultiSource/Applications/sgefa/sgefa: -46.80% (1.5790 => 0.8400, std.dev.: 0.0279)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.57% (57.2347 => 43.7459, std.dev.: 3.5757)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -13.62% (15.9508 => 13.7788, std.dev.: 0.0233)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -12.09% (20.8247 => 18.3071, std.dev.: 0.1985)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.33% (3.4956 => 3.1345, std.dev.: 0.0393)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.35% (50.0284 => 46.3532, std.dev.: 0.1701)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -4.74% (0.6563 => 0.6252, std.dev.: 0.0100)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.90% (3.7437 => 3.5976, std.dev.: 0.0540)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.76% (2.5938 => 2.5221, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.56% (17.1431 => 16.7047, std.dev.: 0.1198)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.74% (2.4471 => 2.4046, std.dev.: 0.0078)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.19% (89.7126 => 88.6459, std.dev.: 0.0965)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.11% (2.1472 => 2.1233, std.dev.: 0.0003)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.48% (0.1348 => 0.1328, std.dev.: 0.0098)

Report Time: 0.67s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130927/932d63e2/attachment.html>


More information about the llvm-testresults mailing list