[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jul 31 16:48:26 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13970?compare_to=13966&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13970, Order: 187531, Start Time: 2013-07-31 21:56:25, End Time: 2013-07-31 23:50:11
      To: 13966, Order: 187509, Start Time: 2013-07-31 19:45:04, End Time: 2013-07-31 21:31:47
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 33 (49 on baseline)
Performance Improvements: 4 (32 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1070 (1026 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Stanford/RealMM: 28.85% (0.0364 => 0.0469, std.dev.: 0.0024)
  MultiSource/Benchmarks/Bullet/bullet: 18.18% (35.8701 => 42.3927, std.dev.: 1.5458)
  MultiSource/Benchmarks/mafft/pairlocalalign: 17.54% (10.7847 => 12.6768, std.dev.: 0.3610)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 13.91% (0.3888 => 0.4429, std.dev.: 0.0032)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 13.78% (26.0934 => 29.6882, std.dev.: 0.2200)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 13.42% (6.5330 => 7.4100, std.dev.: 0.0221)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 13.03% (1.9668 => 2.2231, std.dev.: 0.0797)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.62% (0.6471 => 0.7223, std.dev.: 0.0040)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 11.14% (0.2173 => 0.2415, std.dev.: 0.0047)
  MultiSource/Benchmarks/PAQ8p/paq8p: 10.56% (2.5454 => 2.8141, std.dev.: 0.0624)
  SingleSource/Benchmarks/Misc-C++/bigfib: 10.46% (0.7331 => 0.8098, std.dev.: 0.0243)
  SingleSource/Benchmarks/Shootout-C++/fibo: 9.36% (0.2105 => 0.2302, std.dev.: 0.0061)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.31% (0.8067 => 0.8737, std.dev.: 0.0017)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.44% (0.5351 => 0.5749, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 7.23% (1.4513 => 1.5563, std.dev.: 0.0384)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 60.77% (5.8173 => 9.3525, std.dev.: 0.5202)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 19.30% (29.2008 => 34.8376, std.dev.: 1.4483)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 19.29% (9.4124 => 11.2277, std.dev.: 0.1132)
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.45% (4.1184 => 4.8371, std.dev.: 0.0822)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 14.89% (60.8882 => 69.9538, std.dev.: 2.1850)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.30% (40.7110 => 46.1252, std.dev.: 0.6984)
  SingleSource/Benchmarks/Shootout-C++/ary3: 12.91% (2.0313 => 2.2935, std.dev.: 0.0744)
  MultiSource/Benchmarks/PAQ8p/paq8p: 9.94% (90.9225 => 99.9591, std.dev.: 0.5189)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 7.92% (2.7096 => 2.9243, std.dev.: 0.0174)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.67% (0.4995 => 0.5278, std.dev.: 0.0030)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 5.43% (0.2762 => 0.2912, std.dev.: 0.0041)
  MultiSource/Benchmarks/mafft/pairlocalalign: 5.43% (42.6863 => 45.0042, std.dev.: 0.0986)
  SingleSource/Benchmarks/Misc-C++/bigfib: 5.29% (0.3329 => 0.3505, std.dev.: 0.0045)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 4.10% (2.4047 => 2.5032, std.dev.: 0.0363)
  SingleSource/Benchmarks/Misc/salsa20: 3.11% (8.6978 => 8.9685, std.dev.: 0.0202)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.46% (5.7990 => 5.9414, std.dev.: 0.0311)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.07% (20.9496 => 21.3826, std.dev.: 0.0917)
  SingleSource/Regression/C/uint64_to_float: 1.73% (1.4555 => 1.4807, std.dev.: 0.0043)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/nestedloop: -12.65% (0.1573 => 0.1374, std.dev.: 0.0055)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -6.18% (16.9835 => 15.9332, std.dev.: 0.2206)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -3.56% (1.2352 => 1.1912, std.dev.: 0.0028)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.85% (2.6050 => 2.5567, std.dev.: 0.0094)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.52% (0.1338 => 0.1345, std.dev.: 0.0080)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/mafft/pairlocalalign: 16.79% (10.8541 => 12.6768, std.dev.: 0.3610)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 15.09% (1.9317 => 2.2231, std.dev.: 0.0797)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 14.04% (6.4979 => 7.4100, std.dev.: 0.0221)
  SingleSource/Benchmarks/Shootout-C++/reversefile: 13.86% (0.3890 => 0.4429, std.dev.: 0.0032)
  MultiSource/Benchmarks/Bullet/bullet: 13.09% (37.4863 => 42.3927, std.dev.: 1.5458)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 11.47% (0.6480 => 0.7223, std.dev.: 0.0040)
  SingleSource/Benchmarks/Misc-C++/bigfib: 11.18% (0.7284 => 0.8098, std.dev.: 0.0243)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.64% (0.5292 => 0.5749, std.dev.: 0.0051)
  SingleSource/Benchmarks/Misc-C++/stepanov_v1p2: 8.49% (0.2226 => 0.2415, std.dev.: 0.0047)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 8.02% (0.8088 => 0.8737, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout-C++/lists: 7.77% (0.2857 => 0.3079, std.dev.: 0.0072)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.57% (0.2140 => 0.2302, std.dev.: 0.0061)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 7.40% (27.6418 => 29.6882, std.dev.: 0.2200)
  SingleSource/Benchmarks/Shootout-C++/sieve: 5.65% (0.3148 => 0.3326, std.dev.: 0.0061)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 60.81% (5.8158 => 9.3525, std.dev.: 0.5202)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.92% (2.8867 => 4.2989, std.dev.: 0.0561)
  MultiSource/Benchmarks/FreeBench/neural/neural: 37.59% (0.3171 => 0.4363, std.dev.: 0.0074)
  SingleSource/Benchmarks/Shootout/hash: 29.66% (4.1846 => 5.4258, std.dev.: 0.2701)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 22.90% (9.1355 => 11.2277, std.dev.: 0.1132)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 20.72% (0.0526 => 0.0635, std.dev.: 0.0040)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 16.85% (29.8131 => 34.8376, std.dev.: 1.4483)
  SingleSource/Benchmarks/Shootout-C++/hash: 16.12% (0.6295 => 0.7310, std.dev.: 0.0346)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 15.92% (60.3477 => 69.9538, std.dev.: 2.1850)
  MultiSource/Applications/siod/siod: 14.05% (3.3761 => 3.8505, std.dev.: 0.0175)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 13.88% (40.5028 => 46.1252, std.dev.: 0.6984)
  SingleSource/Benchmarks/Shootout-C++/ary3: 13.38% (2.0229 => 2.2935, std.dev.: 0.0744)
  MultiSource/Applications/lambda-0_1_3/lambda: 12.93% (7.0762 => 7.9915, std.dev.: 0.0266)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: 8.70% (0.2679 => 0.2912, std.dev.: 0.0041)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.39% (1.2557 => 1.3610, std.dev.: 0.0277)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.36% (5.4910 => 5.9500, std.dev.: 0.0445)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.06% (48.3256 => 52.2201, std.dev.: 0.0590)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 8.01% (5.5008 => 5.9414, std.dev.: 0.0311)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.16% (3.4085 => 3.6527, std.dev.: 0.0240)
  MultiSource/Benchmarks/PAQ8p/paq8p: 6.71% (93.6732 => 99.9591, std.dev.: 0.5189)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.52% (14.9584 => 15.9332, std.dev.: 0.2206)
  SingleSource/Benchmarks/Shootout-C++/hash2: 5.80% (3.3877 => 3.5841, std.dev.: 0.0439)
  SingleSource/Benchmarks/Misc-C++/bigfib: 5.07% (0.3336 => 0.3505, std.dev.: 0.0045)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 4.76% (2.3894 => 2.5032, std.dev.: 0.0363)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 4.63% (1.4327 => 1.4990, std.dev.: 0.0170)
  SingleSource/Benchmarks/Misc/whetstone: 4.52% (3.4559 => 3.6121, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.51% (4.3151 => 4.5098, std.dev.: 0.0061)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 4.25% (2.8052 => 2.9243, std.dev.: 0.0174)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.55% (0.5097 => 0.5278, std.dev.: 0.0030)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 3.29% (3.5351 => 3.6514, std.dev.: 0.0142)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.22% (4.8739 => 5.0306, std.dev.: 0.0272)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.27% (12.8625 => 13.1541, std.dev.: 0.0799)
  SingleSource/Benchmarks/Misc/flops: 1.84% (9.7664 => 9.9465, std.dev.: 0.0097)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.15% (1.4398 => 1.4563, std.dev.: 0.0064)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 1.01% (1.4813 => 1.4962, std.dev.: 0.0033)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/hexxagon/hexxagon: -16.05% (1.3285 => 1.1153, std.dev.: 0.0233)
  MultiSource/Applications/sgefa/sgefa: -12.25% (0.4809 => 0.4220, std.dev.: 0.0096)
  MultiSource/Applications/ClamAV/clamscan: -11.78% (19.4145 => 17.1276, std.dev.: 0.8110)
  MultiSource/Applications/sqlite3/sqlite3: -9.23% (19.1635 => 17.3955, std.dev.: 0.4369)
  MultiSource/Applications/siod/siod: -5.49% (2.7150 => 2.5660, std.dev.: 0.0567)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.41% (0.2385 => 0.2256, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.61% (1.4783 => 1.4101, std.dev.: 0.0228)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -36.77% (1.4194 => 0.8975, std.dev.: 0.1947)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.81% (2.1022 => 1.4334, std.dev.: 0.0022)
  MultiSource/Applications/viterbi/viterbi: -27.47% (3.4923 => 2.5329, std.dev.: 0.0089)
  MultiSource/Applications/JM/ldecod/ldecod: -26.08% (0.0859 => 0.0635, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.65% (6.9552 => 5.2405, std.dev.: 0.0383)
  SingleSource/Benchmarks/Misc/perlin: -21.32% (4.5989 => 3.6186, std.dev.: 0.0086)
  SingleSource/Benchmarks/Misc/mandel: -13.73% (1.1996 => 1.0349, std.dev.: 0.0106)
  MultiSource/Applications/sgefa/sgefa: -13.59% (1.4030 => 1.2123, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -10.56% (6.2627 => 5.6013, std.dev.: 0.2212)
  MultiSource/Applications/SIBsim4/SIBsim4: -10.27% (3.5791 => 3.2115, std.dev.: 0.0970)
  MultiSource/Applications/lua/lua: -8.66% (31.0707 => 28.3790, std.dev.: 0.9085)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.02% (1.7207 => 1.6343, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.76% (3.8119 => 3.6306, std.dev.: 0.0294)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.70% (47.2250 => 45.0042, std.dev.: 0.0986)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -4.59% (0.4969 => 0.4741, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc/fbench: -4.33% (4.9602 => 4.7455, std.dev.: 0.0477)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.93% (0.7355 => 0.7066, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.24% (5.2218 => 5.0525, std.dev.: 0.0385)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.20% (6.0444 => 5.8512, std.dev.: 0.0571)
  SingleSource/Regression/C/uint64_to_float: -2.48% (1.5184 => 1.4807, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.38% (8.6172 => 8.4122, std.dev.: 0.0227)
  SingleSource/Benchmarks/Misc/oourafft: -1.95% (3.7891 => 3.7152, std.dev.: 0.0053)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.75% (34.8438 => 34.2344, std.dev.: 0.0239)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.40% (21.6864 => 21.3826, std.dev.: 0.0917)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -1.17% (1.6737 => 1.6541, std.dev.: 0.0005)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.39% (0.1378 => 0.1345, std.dev.: 0.0080)

Report Time: 0.69s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130731/f8df802a/attachment.html>


More information about the llvm-testresults mailing list