[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 28 21:26:29 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16788?compare_to=16782&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16788, Order: 193576, Start Time: 2013-10-29 02:33:02, End Time: 2013-10-29 04:29:54
      To: 16782, Order: 193543, Start Time: 2013-10-28 22:25:32, End Time: 2013-10-29 00:26:39
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 14 (25 on baseline)
Performance Improvements: 45 (15 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1048 (1067 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 12.94% (1.3729 => 1.5506, std.dev.: 0.0289)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.02% (0.6427 => 0.7071, std.dev.: 0.0062)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.92% (0.5199 => 0.5715, std.dev.: 0.0079)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.91% (3.0125 => 3.2507, std.dev.: 0.0747)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/flops: 23.49% (7.8002 => 9.6322, std.dev.: 0.1006)
  MultiSource/Benchmarks/PAQ8p/paq8p: 9.05% (98.3614 => 107.2592, std.dev.: 2.7361)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 6.17% (3.9826 => 4.2285, std.dev.: 0.0524)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 4.50% (0.4670 => 0.4880, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 3.96% (6.4000 => 6.6534, std.dev.: 0.0596)
  SingleSource/Benchmarks/Shootout-C++/matrix: 2.69% (4.1843 => 4.2967, std.dev.: 0.0050)
  MultiSource/Applications/viterbi/viterbi: 2.09% (2.6390 => 2.6942, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.68% (4.9379 => 5.0211, std.dev.: 0.0248)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.48% (5.4982 => 5.5795, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.04% (5.8100 => 5.8705, std.dev.: 0.0228)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C/globalrefs: -48.02% (0.0404 => 0.0210, std.dev.: 0.0010)
  SingleSource/Regression/C/uint64_to_float: -46.95% (0.0788 => 0.0418, std.dev.: 0.0017)
  SingleSource/Benchmarks/Dhrystone/dry: -44.99% (0.1067 => 0.0587, std.dev.: 0.0037)
  SingleSource/UnitTests/Vector/divides: -44.51% (0.0364 => 0.0202, std.dev.: 0.0010)
  SingleSource/Regression/C/2003-05-21-BitfieldHandling: -43.48% (0.0276 => 0.0156, std.dev.: 0.0014)
  SingleSource/Regression/C/badidx: -42.43% (0.0436 => 0.0251, std.dev.: 0.0020)
  SingleSource/Regression/C/2003-05-23-TransparentUnion: -40.55% (0.0291 => 0.0173, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc/pi: -39.56% (0.0407 => 0.0246, std.dev.: 0.0053)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -36.35% (0.9339 => 0.5944, std.dev.: 0.0830)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -32.53% (0.7898 => 0.5329, std.dev.: 0.0304)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -32.38% (0.1791 => 0.1211, std.dev.: 0.0054)
  MultiSource/Applications/Burg/burg: -27.32% (1.9721 => 1.4333, std.dev.: 0.0566)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -26.99% (0.1467 => 0.1071, std.dev.: 0.0054)
  SingleSource/UnitTests/Vector/Altivec/alti_sdot: -22.52% (0.2131 => 0.1651, std.dev.: 0.0101)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -21.44% (0.0975 => 0.0766, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -18.12% (1.5951 => 1.3060, std.dev.: 0.0614)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -16.89% (1.5836 => 1.3162, std.dev.: 0.0299)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -16.53% (1.7304 => 1.4444, std.dev.: 0.0349)
  SingleSource/Benchmarks/Dhrystone/fldry: -15.95% (0.0702 => 0.0590, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -14.59% (0.0925 => 0.0790, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -14.51% (1.6239 => 1.3883, std.dev.: 0.0064)
  SingleSource/Regression/C/bigstack: -13.84% (0.0737 => 0.0635, std.dev.: 0.0031)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -12.39% (0.1904 => 0.1668, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -11.90% (1.4653 => 1.2909, std.dev.: 0.0208)
  SingleSource/UnitTests/Vector/Altivec/casts: -11.39% (0.1335 => 0.1183, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: -11.15% (0.1624 => 0.1443, std.dev.: 0.0046)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -10.36% (0.1206 => 0.1081, std.dev.: 0.0035)
  MultiSource/Applications/sgefa/sgefa: -10.16% (0.4388 => 0.3942, std.dev.: 0.0148)
  SingleSource/UnitTests/Vector/Altivec/test1: -9.39% (0.1363 => 0.1235, std.dev.: 0.0025)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.67% (1.6647 => 1.5370, std.dev.: 0.0209)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.54% (0.2334 => 0.2158, std.dev.: 0.0068)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -6.15% (0.3821 => 0.3586, std.dev.: 0.0080)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.11% (5.1712 => 4.9585, std.dev.: 0.0532)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: -58.04% (0.0367 => 0.0154, std.dev.: 0.0039)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -23.72% (0.4380 => 0.3341, std.dev.: 0.0312)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -17.73% (0.3192 => 0.2626, std.dev.: 0.0190)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -8.57% (4.4456 => 4.0648, std.dev.: 0.0512)
  SingleSource/Benchmarks/Dhrystone/dry: -7.90% (0.5288 => 0.4870, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.70% (4.3499 => 4.1021, std.dev.: 0.0490)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -4.34% (5.1429 => 4.9198, std.dev.: 0.0238)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -2.73% (5.0313 => 4.8941, std.dev.: 0.0519)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -2.21% (0.7326 => 0.7164, std.dev.: 0.0010)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.96% (1.6333 => 1.6013, std.dev.: 0.0038)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.79% (9.0643 => 8.9021, std.dev.: 0.0484)
  SingleSource/Benchmarks/SmallPT/smallpt: -1.31% (17.1512 => 16.9268, std.dev.: 0.0506)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.60% (0.1343 => 0.1351, std.dev.: 0.0144)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 27.68% (0.0383 => 0.0489, std.dev.: 0.0024)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 22.74% (4.0397 => 4.9585, std.dev.: 0.0532)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 22.70% (2.6492 => 3.2507, std.dev.: 0.0747)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 14.74% (1.3514 => 1.5506, std.dev.: 0.0289)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 13.26% (0.5046 => 0.5715, std.dev.: 0.0079)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 12.29% (0.6297 => 0.7071, std.dev.: 0.0062)
  SingleSource/Benchmarks/Shootout-C++/hash2: 7.69% (0.4369 => 0.4705, std.dev.: 0.0123)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.85% (1.3498 => 1.3883, std.dev.: 0.0064)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 60.34% (7.6426 => 12.2544, std.dev.: 0.0928)
  SingleSource/Benchmarks/Shootout-C++/matrix: 50.48% (2.8554 => 4.2967, std.dev.: 0.0050)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 22.06% (1.1431 => 1.3953, std.dev.: 0.0460)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 19.60% (60.7119 => 72.6123, std.dev.: 2.5165)
  MultiSource/Applications/SPASS/SPASS: 13.59% (8.2311 => 9.3500, std.dev.: 0.3173)
  MultiSource/Benchmarks/PAQ8p/paq8p: 10.82% (96.7834 => 107.2592, std.dev.: 2.7361)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.92% (6.1088 => 6.6534, std.dev.: 0.0596)
  SingleSource/UnitTests/Vector/multiplies: 6.60% (0.5561 => 0.5928, std.dev.: 0.0080)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 6.54% (3.9691 => 4.2285, std.dev.: 0.0524)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.41% (3.1730 => 3.3763, std.dev.: 0.0136)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.75% (1.2516 => 1.3110, std.dev.: 0.0213)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.36% (89.7126 => 92.7252, std.dev.: 0.3233)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.78% (1.7652 => 1.8143, std.dev.: 0.0031)
  SingleSource/Regression/C/uint64_to_float: 2.06% (1.4528 => 1.4828, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.64% (5.7757 => 5.8705, std.dev.: 0.0228)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.58% (5.4925 => 5.5795, std.dev.: 0.0186)
  SingleSource/Benchmarks/Shootout/methcall: 1.19% (8.5434 => 8.6450, std.dev.: 0.0361)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.23% (0.1483 => 0.1183, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/matrix: -6.77% (0.2571 => 0.2397, std.dev.: 0.0005)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -52.07% (0.5226 => 0.2505, std.dev.: 0.0585)
  MultiSource/Applications/sgefa/sgefa: -42.80% (1.5790 => 0.9032, std.dev.: 0.0047)
  SingleSource/Benchmarks/Linpack/linpack-pc: -21.97% (57.2347 => 44.6575, std.dev.: 3.9848)
  MultiSource/Applications/SIBsim4/SIBsim4: -12.85% (3.7437 => 3.2627, std.dev.: 0.1071)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.02% (20.8247 => 18.5296, std.dev.: 0.1223)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.51% (3.4956 => 3.1281, std.dev.: 0.0133)
  MultiSource/Benchmarks/mafft/pairlocalalign: -9.42% (50.0284 => 45.3171, std.dev.: 0.4168)
  MultiSource/Applications/lambda-0_1_3/lambda: -4.76% (8.1346 => 7.7475, std.dev.: 0.1444)
  SingleSource/Benchmarks/Shootout-C++/ary3: -3.98% (5.0002 => 4.8013, std.dev.: 0.0734)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.11% (3.7874 => 3.6697, std.dev.: 0.0044)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.48% (2.4471 => 2.3863, std.dev.: 0.0180)
  SingleSource/Benchmarks/Misc/oourafft: -2.36% (3.7484 => 3.6599, std.dev.: 0.0314)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.11% (4.3592 => 4.2673, std.dev.: 0.0176)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.22% (0.1348 => 0.1351, std.dev.: 0.0144)

Report Time: 0.76s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131028/f7566149/attachment.html>


More information about the llvm-testresults mailing list