[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 28 17:23:15 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16782?compare_to=16778&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16782, Order: 193543, Start Time: 2013-10-28 22:25:32, End Time: 2013-10-29 00:26:39
      To: 16778, Order: 193532, Start Time: 2013-10-28 19:57:01, End Time: 2013-10-28 21:54:26
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 45 (57 on baseline)
Performance Improvements: 11 (18 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1051 (1032 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/pi: 97.57% (0.0206 => 0.0407, std.dev.: 0.0026)
  SingleSource/UnitTests/Vector/divides: 93.62% (0.0188 => 0.0364, std.dev.: 0.0009)
  SingleSource/Regression/C/globalrefs: 92.38% (0.0210 => 0.0404, std.dev.: 0.0031)
  SingleSource/Regression/C/2003-05-21-UnionTest: 90.32% (0.0155 => 0.0295, std.dev.: 0.0021)
  SingleSource/Regression/C/uint64_to_float: 89.88% (0.0415 => 0.0788, std.dev.: 0.0034)
  SingleSource/Benchmarks/Dhrystone/dry: 88.85% (0.0565 => 0.1067, std.dev.: 0.0046)
  SingleSource/UnitTests/Vector/constpool: 84.56% (9.0057 => 16.6211, std.dev.: 1.3241)
  SingleSource/Regression/C/2003-05-23-TransparentUnion: 84.18% (0.0158 => 0.0291, std.dev.: 0.0013)
  SingleSource/Regression/C/2003-05-21-BitfieldHandling: 64.29% (0.0168 => 0.0276, std.dev.: 0.0030)
  SingleSource/Regression/C/badidx: 63.30% (0.0267 => 0.0436, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc/lowercase: 62.04% (0.0245 => 0.0397, std.dev.: 0.0057)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 51.51% (0.6164 => 0.9339, std.dev.: 0.0502)
  SingleSource/UnitTests/2002-08-19-CodegenBug: 51.49% (0.0202 => 0.0306, std.dev.: 0.0034)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 48.99% (0.5301 => 0.7898, std.dev.: 0.0969)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 37.56% (1.1015 => 1.5152, std.dev.: 0.1288)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 34.37% (0.1449 => 0.1947, std.dev.: 0.0174)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 34.22% (0.1093 => 0.1467, std.dev.: 0.0145)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 30.00% (0.2093 => 0.2721, std.dev.: 0.0187)
  SingleSource/Benchmarks/Misc/flops: 26.23% (0.1136 => 0.1434, std.dev.: 0.0109)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 22.53% (4.2202 => 5.1712, std.dev.: 0.2306)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 17.83% (1.3537 => 1.5951, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 17.18% (1.3858 => 1.6239, std.dev.: 0.0566)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 15.75% (0.1403 => 0.1624, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 14.88% (1.3785 => 1.5836, std.dev.: 0.0428)
  MultiSource/Applications/JM/ldecod/ldecod: 11.07% (7.9248 => 8.8023, std.dev.: 0.2607)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 10.37% (1.3903 => 1.5345, std.dev.: 0.0308)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 133.76% (0.0157 => 0.0367, std.dev.: 0.0040)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 48.75% (4.5455 => 6.7614, std.dev.: 0.5053)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 31.99% (28.6608 => 37.8294, std.dev.: 1.3860)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 30.94% (0.3345 => 0.4380, std.dev.: 0.0353)
  SingleSource/Benchmarks/Linpack/linpack-pc: 15.96% (44.1802 => 51.2319, std.dev.: 1.1359)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 8.64% (2.9485 => 3.2033, std.dev.: 0.0696)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.37% (4.9758 => 5.3424, std.dev.: 0.0503)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 7.06% (3.6450 => 3.9025, std.dev.: 0.0945)
  SingleSource/Regression/C/uint64_to_float: 6.30% (1.3972 => 1.4852, std.dev.: 0.0194)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 4.66% (4.8073 => 5.0313, std.dev.: 0.0488)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.56% (4.0938 => 4.2396, std.dev.: 0.0480)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.69% (3.6259 => 3.7234, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.25% (3.5949 => 3.6757, std.dev.: 0.0183)
  SingleSource/Benchmarks/Misc/flops-7: 2.11% (1.7125 => 1.7487, std.dev.: 0.0056)
  MultiSource/Applications/siod/siod: 2.06% (3.5319 => 3.6046, std.dev.: 0.0067)
  MultiSource/Applications/aha/aha: 1.92% (3.5625 => 3.6308, std.dev.: 0.0169)
  SingleSource/Benchmarks/CoyoteBench/almabench: 1.63% (35.1031 => 35.6753, std.dev.: 0.2127)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.54% (1.0697 => 1.0862, std.dev.: 0.0017)
  MultiSource/Benchmarks/NPB-serial/is/is: 1.35% (12.1722 => 12.3364, std.dev.: 0.0485)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/obsequi/Obsequi: -27.06% (1.6248 => 1.1851, std.dev.: 0.0774)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -26.19% (2.0154 => 1.4875, std.dev.: 0.1649)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -25.26% (0.9341 => 0.6981, std.dev.: 0.0610)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -20.26% (0.4920 => 0.3923, std.dev.: 0.0354)
  MultiSource/Benchmarks/Prolangs-C/football/football: -19.01% (1.2280 => 0.9945, std.dev.: 0.0810)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -18.70% (0.1166 => 0.0948, std.dev.: 0.0007)
  MultiSource/Applications/obsequi/Obsequi: -14.10% (2.7431 => 2.3564, std.dev.: 0.0484)
  MultiSource/Applications/spiff/spiff: -4.76% (2.9693 => 2.8281, std.dev.: 0.0273)
  MultiSource/Applications/JM/lencod/lencod: -3.85% (7.9534 => 7.6468, std.dev.: 0.1151)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.71% (3.6881 => 3.5880, std.dev.: 0.0192)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.96% (6.7581 => 6.6256, std.dev.: 0.0148)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.74% (0.1320 => 0.1343, std.dev.: 0.0213)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/pi: 99.51% (0.0204 => 0.0407, std.dev.: 0.0026)
  SingleSource/Regression/C/globalrefs: 96.12% (0.0206 => 0.0404, std.dev.: 0.0031)
  SingleSource/Regression/C/uint64_to_float: 92.20% (0.0410 => 0.0788, std.dev.: 0.0034)
  SingleSource/UnitTests/Vector/divides: 87.63% (0.0194 => 0.0364, std.dev.: 0.0009)
  SingleSource/UnitTests/Vector/constpool: 86.92% (8.8921 => 16.6211, std.dev.: 1.3241)
  SingleSource/Regression/C/2003-05-21-UnionTest: 86.71% (0.0158 => 0.0295, std.dev.: 0.0021)
  SingleSource/Benchmarks/Dhrystone/dry: 86.54% (0.0572 => 0.1067, std.dev.: 0.0046)
  SingleSource/Regression/C/2003-05-23-TransparentUnion: 75.30% (0.0166 => 0.0291, std.dev.: 0.0013)
  SingleSource/Regression/C/2003-05-21-BitfieldHandling: 69.33% (0.0163 => 0.0276, std.dev.: 0.0030)
  SingleSource/Regression/C/badidx: 65.78% (0.0263 => 0.0436, std.dev.: 0.0038)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 63.70% (0.5705 => 0.9339, std.dev.: 0.0502)
  SingleSource/Benchmarks/Misc/lowercase: 63.37% (0.0243 => 0.0397, std.dev.: 0.0057)
  SingleSource/UnitTests/2002-08-19-CodegenBug: 52.24% (0.0201 => 0.0306, std.dev.: 0.0034)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 50.70% (0.5241 => 0.7898, std.dev.: 0.0969)
  MultiSource/Applications/Burg/burg: 40.92% (1.3994 => 1.9721, std.dev.: 0.1360)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 38.87% (0.1402 => 0.1947, std.dev.: 0.0174)
  SingleSource/Benchmarks/Misc/flops: 38.68% (0.1034 => 0.1434, std.dev.: 0.0109)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 38.56% (1.0935 => 1.5152, std.dev.: 0.1288)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 34.46% (0.1091 => 0.1467, std.dev.: 0.0145)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 28.01% (4.0397 => 5.1712, std.dev.: 0.2306)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 24.08% (0.2193 => 0.2721, std.dev.: 0.0187)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 22.88% (1.2981 => 1.5951, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 21.48% (1.3036 => 1.5836, std.dev.: 0.0428)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 20.31% (1.3498 => 1.6239, std.dev.: 0.0566)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 19.36% (1.3365 => 1.5953, std.dev.: 0.0832)
  MultiSource/Applications/JM/ldecod/ldecod: 18.91% (7.4026 => 8.8023, std.dev.: 0.2607)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 17.09% (0.1387 => 0.1624, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 16.93% (1.3123 => 1.5345, std.dev.: 0.0308)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 9.17% (1.3303 => 1.4523, std.dev.: 0.0451)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 60.68% (7.6426 => 12.2799, std.dev.: 0.0909)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 48.67% (4.5479 => 6.7614, std.dev.: 0.5053)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 48.58% (0.0247 => 0.0367, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/matrix: 46.54% (2.8554 => 4.1843, std.dev.: 0.0552)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 26.52% (0.3462 => 0.4380, std.dev.: 0.0353)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 25.33% (30.1838 => 37.8294, std.dev.: 1.3860)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 24.46% (1.1431 => 1.4227, std.dev.: 0.0420)
  SingleSource/Benchmarks/McGill/misr: 9.60% (0.3771 => 0.4133, std.dev.: 0.0051)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 9.06% (2.9372 => 3.2033, std.dev.: 0.0696)
  SingleSource/Benchmarks/Shootout-C++/fibo: 8.08% (4.9428 => 5.3424, std.dev.: 0.0503)
  MultiSource/Applications/obsequi/Obsequi: 7.68% (2.1884 => 2.3564, std.dev.: 0.0484)
  SingleSource/UnitTests/Vector/multiplies: 7.44% (0.5561 => 0.5975, std.dev.: 0.0023)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 7.41% (3.9856 => 4.2808, std.dev.: 0.1115)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: 7.21% (3.6401 => 3.9025, std.dev.: 0.0945)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.33% (1.2516 => 1.3183, std.dev.: 0.0182)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.77% (6.1088 => 6.4000, std.dev.: 0.0855)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.47% (3.5642 => 3.7234, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 4.43% (4.0596 => 4.2396, std.dev.: 0.0480)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.85% (89.7126 => 93.1700, std.dev.: 0.3068)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.67% (1.0477 => 1.0862, std.dev.: 0.0017)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.70% (1.7652 => 1.8128, std.dev.: 0.0122)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.63% (4.9022 => 5.0313, std.dev.: 0.0488)
  MultiSource/Benchmarks/Olden/power/power: 2.42% (1.2170 => 1.2465, std.dev.: 0.0006)
  SingleSource/Benchmarks/SmallPT/smallpt: 2.11% (16.7972 => 17.1512, std.dev.: 0.0499)
  MultiSource/Applications/siod/siod: 2.08% (3.5310 => 3.6046, std.dev.: 0.0067)
  SingleSource/Benchmarks/Misc/flops-7: 1.72% (1.7191 => 1.7487, std.dev.: 0.0056)
  MultiSource/Applications/aha/aha: 1.61% (3.5731 => 3.6308, std.dev.: 0.0169)
  MultiSource/Benchmarks/NPB-serial/is/is: 1.03% (12.2111 => 12.3364, std.dev.: 0.0485)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.48% (0.5226 => 0.2379, std.dev.: 0.0235)
  MultiSource/Applications/sgefa/sgefa: -42.58% (1.5790 => 0.9067, std.dev.: 0.0084)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -31.75% (0.0400 => 0.0273, std.dev.: 0.0044)
  MultiSource/Benchmarks/FreeBench/mason/mason: -17.95% (0.3304 => 0.2711, std.dev.: 0.0049)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -11.36% (15.9508 => 14.1394, std.dev.: 0.5381)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.18% (20.8247 => 18.4965, std.dev.: 0.1201)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.92% (50.0284 => 44.5650, std.dev.: 0.5188)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.72% (3.4956 => 3.1207, std.dev.: 0.0285)
  SingleSource/Benchmarks/Linpack/linpack-pc: -10.49% (57.2347 => 51.2319, std.dev.: 1.1359)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.65% (3.7437 => 3.3826, std.dev.: 0.0458)
  SingleSource/Benchmarks/Shootout/sieve: -6.80% (7.2254 => 6.7339, std.dev.: 0.0412)
  MultiSource/Applications/JM/lencod/lencod: -6.50% (8.1785 => 7.6468, std.dev.: 0.1151)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -4.52% (3.0561 => 2.9180, std.dev.: 0.0326)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.32% (3.7874 => 3.6615, std.dev.: 0.0153)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.75% (2.4471 => 2.3799, std.dev.: 0.0241)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.91% (17.1431 => 16.8152, std.dev.: 0.0442)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.84% (4.3592 => 4.2791, std.dev.: 0.0100)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.65% (1.8519 => 1.8214, std.dev.: 0.0092)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.37% (0.1348 => 0.1343, std.dev.: 0.0213)

Report Time: 0.81s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131028/2c90abc1/attachment.html>


More information about the llvm-testresults mailing list