[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jun 18 01:51:42 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12495?compare_to=12491&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12495, Order: 184173, Start Time: 2013-06-18 07:02:43, End Time: 2013-06-18 08:52:36
      To: 12491, Order: 184168, Start Time: 2013-06-18 04:49:12, End Time: 2013-06-18 06:38:48
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 30 (48 on baseline)
Performance Improvements: 7 (33 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1070 (1026 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/random: 48.47% (0.0359 => 0.0533, std.dev.: 0.0055)
  SingleSource/Benchmarks/Shootout/heapsort: 48.28% (0.0464 => 0.0688, std.dev.: 0.0035)
  SingleSource/Benchmarks/Misc/flops-1: 47.44% (0.0312 => 0.0460, std.dev.: 0.0030)
  SingleSource/Benchmarks/Misc/lowercase: 45.66% (0.0311 => 0.0453, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc/flops-8: 43.33% (0.0330 => 0.0473, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout-C++/lists1: 11.64% (0.3377 => 0.3770, std.dev.: 0.0089)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 11.31% (0.1123 => 0.1250, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 9.32% (1.6369 => 1.7894, std.dev.: 0.0420)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.42% (6.3887 => 6.9264, std.dev.: 0.0174)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.16% (1.5808 => 1.6940, std.dev.: 0.0262)
  SingleSource/Benchmarks/Misc-C++/bigfib: 6.78% (0.7141 => 0.7625, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 5.64% (0.9657 => 1.0202, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 3.33% (1.4842 => 1.5336, std.dev.: 0.0153)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 71.90% (5.7923 => 9.9570, std.dev.: 0.4802)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 48.18% (3.0841 => 4.5700, std.dev.: 0.0492)
  SingleSource/Benchmarks/Shootout/heapsort: 42.15% (2.8779 => 4.0908, std.dev.: 0.2944)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 26.73% (4.5746 => 5.7975, std.dev.: 0.1461)
  SingleSource/Benchmarks/Misc/salsa20: 11.84% (8.0492 => 9.0020, std.dev.: 0.0205)
  SingleSource/Benchmarks/Shootout-C++/fibo: 11.24% (4.3463 => 4.8348, std.dev.: 0.0439)
  SingleSource/Benchmarks/Misc/lowercase: 9.32% (0.7756 => 0.8479, std.dev.: 0.0185)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.49% (46.3938 => 50.3338, std.dev.: 0.4817)
  SingleSource/Benchmarks/McGill/chomp: 7.16% (1.0218 => 1.0950, std.dev.: 0.0179)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 5.72% (31.7541 => 33.5691, std.dev.: 0.4261)
  SingleSource/Benchmarks/Misc/fp-convert: 5.03% (7.7003 => 8.0874, std.dev.: 0.0553)
  SingleSource/Benchmarks/Shootout/hash: 4.49% (5.2647 => 5.5009, std.dev.: 0.0746)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.26% (1.0503 => 1.0950, std.dev.: 0.0166)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.15% (40.2847 => 41.5552, std.dev.: 0.4701)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.07% (21.5744 => 22.0216, std.dev.: 0.1570)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.86% (4.6881 => 4.7752, std.dev.: 0.0141)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.74% (4.0594 => 4.1299, std.dev.: 0.0110)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/nbench/nbench: -5.70% (1.3563 => 1.2790, std.dev.: 0.0131)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -4.90% (1.6880 => 1.6053, std.dev.: 0.0088)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -3.73% (4.8279 => 4.6479, std.dev.: 0.0401)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: -26.12% (1.7154 => 1.2673, std.dev.: 0.1679)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -6.44% (0.3896 => 0.3645, std.dev.: 0.0039)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -2.66% (1.3416 => 1.3059, std.dev.: 0.0055)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.09% (12.1539 => 12.0213, std.dev.: 0.0259)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 6.00% (0.1383 => 0.1466, std.dev.: 0.0263)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/random: 59.10% (0.0335 => 0.0533, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc/flops-1: 47.44% (0.0312 => 0.0460, std.dev.: 0.0030)
  SingleSource/Benchmarks/Misc/flops-8: 45.54% (0.0325 => 0.0473, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout/heapsort: 43.04% (0.0481 => 0.0688, std.dev.: 0.0035)
  SingleSource/Benchmarks/Misc/lowercase: 31.69% (0.0344 => 0.0453, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/lists1: 14.59% (0.3290 => 0.3770, std.dev.: 0.0089)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 13.12% (0.2393 => 0.2707, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 11.95% (1.5984 => 1.7894, std.dev.: 0.0420)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 10.42% (0.1132 => 0.1250, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.51% (1.5612 => 1.6940, std.dev.: 0.0262)
  SingleSource/Benchmarks/Misc-C++/bigfib: 8.02% (0.7059 => 0.7625, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 7.84% (1.6299 => 1.7577, std.dev.: 0.0387)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.10% (1.6275 => 1.7430, std.dev.: 0.0421)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.28% (0.9599 => 1.0202, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/sieve: 6.19% (0.3088 => 0.3279, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.88% (1.4485 => 1.5336, std.dev.: 0.0153)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 5.79% (0.2175 => 0.2301, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.74% (1.3833 => 1.4489, std.dev.: 0.0229)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.57% (6.6236 => 6.9264, std.dev.: 0.0174)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 65.61% (6.0122 => 9.9570, std.dev.: 0.4802)
  MultiSource/Applications/sgefa/sgefa: 38.09% (1.1695 => 1.6150, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout/heapsort: 36.41% (2.9988 => 4.0908, std.dev.: 0.2944)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 30.57% (3.5000 => 4.5700, std.dev.: 0.0492)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.81% (4.6452 => 5.7975, std.dev.: 0.1461)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 21.45% (16.4665 => 19.9979, std.dev.: 1.1361)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.64% (6.1372 => 7.1584, std.dev.: 0.1108)
  SingleSource/Benchmarks/Misc/pi: 10.26% (1.8318 => 2.0198, std.dev.: 0.0314)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 9.70% (10.2418 => 11.2351, std.dev.: 0.2920)
  SingleSource/Benchmarks/Misc/lowercase: 9.46% (0.7746 => 0.8479, std.dev.: 0.0185)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.58% (5.2003 => 5.6463, std.dev.: 0.0073)
  SingleSource/Benchmarks/McGill/chomp: 7.73% (1.0164 => 1.0950, std.dev.: 0.0179)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.52% (3.1853 => 3.4249, std.dev.: 0.0209)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 6.08% (4.6639 => 4.9474, std.dev.: 0.0021)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.58% (94.2966 => 99.5611, std.dev.: 1.1912)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.61% (2.9004 => 3.0340, std.dev.: 0.0182)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.12% (5.5010 => 5.7279, std.dev.: 0.0313)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.99% (3.9713 => 4.1299, std.dev.: 0.0110)
  SingleSource/Benchmarks/Misc/ffbench: 3.99% (1.3696 => 1.4242, std.dev.: 0.0182)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.92% (5.9362 => 6.1687, std.dev.: 0.0579)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.86% (1.2224 => 1.2696, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.77% (5.2788 => 5.4780, std.dev.: 0.0278)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 3.42% (32.4581 => 33.5691, std.dev.: 0.4261)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.49% (21.4874 => 22.0216, std.dev.: 0.1570)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.41% (4.3727 => 4.4780, std.dev.: 0.0230)
  SingleSource/Benchmarks/Shootout/methcall: 1.90% (8.3425 => 8.5012, std.dev.: 0.0370)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.70% (5.6582 => 5.7542, std.dev.: 0.0341)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.55% (1.7925 => 1.8202, std.dev.: 0.0105)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.21% (11.4990 => 11.6381, std.dev.: 0.0082)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.99% (1.5932 => 1.4341, std.dev.: 0.0609)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.90% (5.1587 => 4.6479, std.dev.: 0.0401)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -5.83% (0.1886 => 0.1776, std.dev.: 0.0039)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.35% (1.2911 => 0.7314, std.dev.: 0.0048)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -27.23% (0.0393 => 0.0286, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.61% (4.4050 => 3.2329, std.dev.: 0.0483)
  MultiSource/Benchmarks/FreeBench/neural/neural: -24.96% (0.3513 => 0.2636, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -23.39% (6.2328 => 4.7752, std.dev.: 0.0141)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.93% (25.3677 => 21.3258, std.dev.: 0.0182)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -13.89% (11.6227 => 10.0078, std.dev.: 0.0081)
  SingleSource/Benchmarks/Misc/salsa20: -12.94% (10.3398 => 9.0020, std.dev.: 0.0205)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -9.85% (7.0179 => 6.3268, std.dev.: 0.0086)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.43% (1.6679 => 1.5107, std.dev.: 0.0241)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -9.12% (0.2973 => 0.2702, std.dev.: 0.0033)
  MultiSource/Applications/siod/siod: -9.08% (3.7240 => 3.3858, std.dev.: 0.0268)
  MultiSource/Applications/lambda-0_1_3/lambda: -8.79% (9.1099 => 8.3094, std.dev.: 0.0639)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -7.59% (0.1542 => 0.1425, std.dev.: 0.0024)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.18% (48.3307 => 44.8612, std.dev.: 0.5173)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.23% (9.8728 => 9.2579, std.dev.: 0.0150)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.01% (5.5889 => 5.2532, std.dev.: 0.1039)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.94% (4.5717 => 4.3002, std.dev.: 0.0417)
  MultiSource/Applications/sqlite3/sqlite3: -5.01% (4.6358 => 4.4035, std.dev.: 0.0878)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.36% (5.3184 => 5.0867, std.dev.: 0.0177)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.12% (5.3276 => 5.1080, std.dev.: 0.0053)
  SingleSource/Benchmarks/Misc/flops: -3.85% (10.2170 => 9.8240, std.dev.: 0.0145)
  SingleSource/Benchmarks/Linpack/linpack-pc: -2.91% (51.8429 => 50.3338, std.dev.: 0.4817)
  SingleSource/Benchmarks/Shootout/sieve: -2.86% (8.0178 => 7.7886, std.dev.: 0.0238)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.68% (4.5094 => 4.4337, std.dev.: 0.0287)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.41% (2.8573 => 2.8170, std.dev.: 0.0120)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.34% (8.5243 => 8.4101, std.dev.: 0.0263)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.34% (12.1841 => 12.0213, std.dev.: 0.0259)
  MultiSource/Applications/hexxagon/hexxagon: -1.22% (15.4979 => 15.3093, std.dev.: 0.0546)
  MultiSource/Benchmarks/sim/sim: -1.08% (3.8805 => 3.8385, std.dev.: 0.0045)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.73% (0.1441 => 0.1466, std.dev.: 0.0263)

Report Time: 0.71s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130618/5bde4b83/attachment.html>


More information about the llvm-testresults mailing list