[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Dec 16 03:32:16 PST 2013


http://llvm.org/perf/db_default/v4/nts/18476?compare_to=18473&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18476, Order: 197369, Start Time: 2013-12-16 09:55:04, End Time: 2013-12-16 11:36:36
      To: 18473, Order: 197366, Start Time: 2013-12-16 07:48:29, End Time: 2013-12-16 09:32:45
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 29 (33 on baseline)
Performance Improvements: 15 (43 on baseline)
Unchanged Tests: 1066 (1034 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/SciMark2-C/scimark2: 4.25% (0.3600 => 0.3753, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.49% (1.2416 => 1.2601, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.33% (1.2610 => 1.2778, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.32% (1.3208 => 1.3382, std.dev.: 0.0042)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 38.81% (2.8943 => 4.0175, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 37.68% (0.1441 => 0.1984, std.dev.: 0.0148)
  SingleSource/Benchmarks/Misc/pi: 27.83% (1.9393 => 2.4791, std.dev.: 0.0606)
  SingleSource/Benchmarks/Shootout/matrix: 16.18% (1.8120 => 2.1051, std.dev.: 0.0034)
  SingleSource/Benchmarks/Misc/ReedSolomon: 14.97% (8.5037 => 9.7766, std.dev.: 0.0119)
  MultiSource/Benchmarks/nbench/nbench: 11.27% (20.2256 => 22.5054, std.dev.: 0.7790)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 6.11% (14.2194 => 15.0888, std.dev.: 0.2698)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 5.48% (1.4011 => 1.4779, std.dev.: 0.0142)
  SingleSource/Benchmarks/Stanford/FloatMM: 5.27% (0.6926 => 0.7291, std.dev.: 0.0000)
  SingleSource/Benchmarks/McGill/misr: 4.99% (0.3871 => 0.4064, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 4.42% (0.3711 => 0.3875, std.dev.: 0.0050)
  SingleSource/Benchmarks/Shootout/lists: 4.37% (7.1126 => 7.4234, std.dev.: 0.0444)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 4.24% (1.1253 => 1.1730, std.dev.: 0.0118)
  SingleSource/Benchmarks/Misc/fp-convert: 4.20% (7.5258 => 7.8417, std.dev.: 0.0311)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 4.15% (0.4799 => 0.4998, std.dev.: 0.0016)
  MultiSource/Applications/sqlite3/sqlite3: 2.51% (4.1073 => 4.2105, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/hash: 2.24% (0.7265 => 0.7428, std.dev.: 0.0015)
  MultiSource/Applications/viterbi/viterbi: 2.14% (2.6339 => 2.6902, std.dev.: 0.0206)
  SingleSource/Benchmarks/Misc/oourafft: 2.06% (3.6466 => 3.7219, std.dev.: 0.0026)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.86% (2.3652 => 2.4091, std.dev.: 0.0070)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.81% (3.6004 => 3.6657, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.65% (3.1597 => 3.2118, std.dev.: 0.0044)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.52% (8.7874 => 8.9211, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.49% (5.9005 => 5.9884, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.12% (4.9366 => 4.9917, std.dev.: 0.0050)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2006-12-11-LoadConstants: -7.76% (0.1534 => 0.1415, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -6.96% (0.2241 => 0.2085, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout-C++/matrix: -5.61% (0.2514 => 0.2373, std.dev.: 0.0007)
  MultiSource/Benchmarks/Bullet/bullet: -1.06% (33.3433 => 32.9910, std.dev.: 0.0175)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ary3: -11.81% (5.1412 => 4.5340, std.dev.: 0.1341)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -9.84% (4.1700 => 3.7597, std.dev.: 0.1176)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -8.19% (1.5831 => 1.4534, std.dev.: 0.0427)
  SingleSource/Benchmarks/Shootout/heapsort: -7.96% (3.1441 => 2.8937, std.dev.: 0.0303)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -7.39% (4.9203 => 4.5567, std.dev.: 0.0150)
  SingleSource/Benchmarks/Misc/salsa20: -7.38% (8.0791 => 7.4827, std.dev.: 0.2221)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -2.04% (2.3661 => 2.3178, std.dev.: 0.0014)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.69% (3.6476 => 3.5861, std.dev.: 0.0204)
  SingleSource/Benchmarks/McGill/chomp: -1.12% (1.0252 => 1.0137, std.dev.: 0.0029)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.04% (28.9064 => 28.6054, std.dev.: 0.0207)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.02% (3.9959 => 3.9550, std.dev.: 0.0155)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 40.03% (15.7419 => 22.0439, std.dev.: 0.6256)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 29.39% (0.3859 => 0.4993, std.dev.: 0.0111)
  MultiSource/Applications/lemon/lemon: 8.85% (1.2200 => 1.3280, std.dev.: 0.0139)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.67% (25.9661 => 27.1781, std.dev.: 0.1360)
  SingleSource/Benchmarks/Misc-C++/bigfib: 3.21% (0.6412 => 0.6618, std.dev.: 0.0022)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 48.58% (1.6685 => 2.4791, std.dev.: 0.0606)
  SingleSource/Benchmarks/Shootout-C++/matrix: 40.44% (2.8607 => 4.0175, std.dev.: 0.0037)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 17.26% (5.9583 => 6.9866, std.dev.: 0.1269)
  SingleSource/Benchmarks/Shootout/matrix: 17.21% (1.7960 => 2.1051, std.dev.: 0.0034)
  SingleSource/Benchmarks/Misc/ReedSolomon: 15.01% (8.5010 => 9.7766, std.dev.: 0.0119)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.18% (3.3810 => 3.6576, std.dev.: 0.0038)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 6.80% (1.3838 => 1.4779, std.dev.: 0.0142)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 6.45% (1.1019 => 1.1730, std.dev.: 0.0118)
  SingleSource/Benchmarks/Shootout/lists: 6.15% (6.9930 => 7.4234, std.dev.: 0.0444)
  SingleSource/Benchmarks/Misc/fp-convert: 6.12% (7.3892 => 7.8417, std.dev.: 0.0311)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.75% (0.6261 => 0.6621, std.dev.: 0.0022)
  SingleSource/Benchmarks/Stanford/FloatMM: 5.07% (0.6939 => 0.7291, std.dev.: 0.0000)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.86% (0.5112 => 0.5258, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.52% (6.5291 => 6.6938, std.dev.: 0.0244)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.50% (0.4526 => 0.4639, std.dev.: 0.0039)
  MultiSource/Applications/viterbi/viterbi: 2.03% (2.6366 => 2.6902, std.dev.: 0.0206)
  SingleSource/Benchmarks/Misc/oourafft: 1.97% (3.6501 => 3.7219, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.89% (5.9126 => 6.0246, std.dev.: 0.0405)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.84% (2.4894 => 2.5353, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.81% (3.1547 => 3.2118, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.61% (5.8933 => 5.9884, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.55% (11.7894 => 11.9724, std.dev.: 0.0700)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.45% (3.1455 => 3.1912, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.30% (5.5032 => 5.5745, std.dev.: 0.0232)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.29% (8.8073 => 8.9211, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.16% (3.5451 => 3.5864, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.12% (4.9365 => 4.9917, std.dev.: 0.0050)
  SingleSource/Benchmarks/Shootout/ary3: 1.10% (4.5977 => 4.6483, std.dev.: 0.0116)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.89% (0.0688 => 0.0503, std.dev.: 0.0027)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: -18.33% (0.0562 => 0.0459, std.dev.: 0.0029)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -16.87% (0.1938 => 0.1611, std.dev.: 0.0098)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.11% (0.1088 => 0.0978, std.dev.: 0.0002)
  MultiSource/Benchmarks/Bullet/bullet: -9.93% (36.6274 => 32.9910, std.dev.: 0.0175)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.80% (0.1523 => 0.1389, std.dev.: 0.0012)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -8.32% (0.3247 => 0.2977, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.59% (5.8749 => 5.4292, std.dev.: 0.0801)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -7.50% (1.5034 => 1.3906, std.dev.: 0.0202)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -7.12% (0.2824 => 0.2623, std.dev.: 0.0008)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.83% (0.6882 => 0.6412, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.57% (1.3676 => 1.2778, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.75% (1.3505 => 1.2729, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.60% (1.4277 => 1.3477, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.54% (1.3819 => 1.3053, std.dev.: 0.0127)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -5.26% (1.2914 => 1.2235, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.25% (1.3127 => 1.2438, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.18% (1.4113 => 1.3382, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.13% (1.4125 => 1.3401, std.dev.: 0.0269)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.82% (0.3714 => 0.3535, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.57% (1.5305 => 1.4606, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.40% (1.2824 => 1.2260, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -4.23% (1.3157 => 1.2601, std.dev.: 0.0007)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.10% (15.4053 => 14.7730, std.dev.: 0.1007)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.06% (1.2724 => 1.2208, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -4.03% (1.3264 => 1.2729, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.87% (1.2544 => 1.2059, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.65% (1.3702 => 1.3202, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -3.37% (1.3024 => 1.2585, std.dev.: 0.0054)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -3.35% (1.1767 => 1.1373, std.dev.: 0.0117)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.50% (4.7807 => 4.6610, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.35% (1.3510 => 1.3193, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.99% (1.3068 => 1.2808, std.dev.: 0.0043)
  SingleSource/UnitTests/Vector/constpool: -1.81% (9.2178 => 9.0506, std.dev.: 0.0221)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: -8.71% (1.4335 => 1.3087, std.dev.: 0.0073)
  MultiSource/Benchmarks/Bullet/bullet: -6.26% (7.4226 => 6.9577, std.dev.: 0.0229)
  MultiSource/Benchmarks/PAQ8p/paq8p: -3.15% (99.3511 => 96.2244, std.dev.: 0.5810)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.85% (6.0535 => 5.8811, std.dev.: 0.0025)
  MultiSource/Applications/sqlite3/sqlite3: -2.03% (4.2978 => 4.2105, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.97% (3.6583 => 3.5861, std.dev.: 0.0204)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -1.96% (5.1947 => 5.0928, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -1.22% (2.9945 => 2.9580, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.07% (4.1462 => 4.1018, std.dev.: 0.0020)

Report Time: 0.91s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131216/11eb6bd6/attachment.html>


More information about the llvm-testresults mailing list