[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Dec 8 12:13:40 PST 2013


http://llvm.org/perf/db_default/v4/nts/18157?compare_to=18151&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18157, Order: 196727, Start Time: 2013-12-08 18:34:23, End Time: 2013-12-08 20:17:52
      To: 18151, Order: 196724, Start Time: 2013-12-08 16:26:12, End Time: 2013-12-08 18:10:36
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 24 (32 on baseline)
Performance Improvements: 18 (44 on baseline)
Unchanged Tests: 1068 (1034 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 6.24% (0.2099 => 0.2230, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/wc: 5.65% (0.2246 => 0.2373, std.dev.: 0.0026)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/lpbench: 30.00% (3.6716 => 4.7732, std.dev.: 0.2502)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 23.15% (1.4583 => 1.7959, std.dev.: 0.1096)
  SingleSource/Benchmarks/Shootout/ary3: 16.56% (4.7530 => 5.5401, std.dev.: 0.2706)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 12.42% (28.5270 => 32.0691, std.dev.: 0.5661)
  SingleSource/Benchmarks/Stanford/Puzzle: 9.76% (0.1629 => 0.1788, std.dev.: 0.0029)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.38% (1.0581 => 1.1362, std.dev.: 0.0001)
  MultiSource/Benchmarks/PAQ8p/paq8p: 6.63% (95.1736 => 101.4825, std.dev.: 0.7657)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.61% (0.4358 => 0.4646, std.dev.: 0.0007)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 6.01% (1.4223 => 1.5078, std.dev.: 0.0003)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 5.94% (1.9774 => 2.0948, std.dev.: 0.0006)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 5.92% (0.3599 => 0.3812, std.dev.: 0.0004)
  MultiSource/Benchmarks/sim/sim: 5.86% (3.8030 => 4.0260, std.dev.: 0.0064)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 5.61% (0.4941 => 0.5218, std.dev.: 0.0001)
  MultiSource/Applications/spiff/spiff: 5.17% (2.8127 => 2.9581, std.dev.: 0.0238)
  MultiSource/Applications/aha/aha: 5.01% (3.5625 => 3.7410, std.dev.: 0.0202)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.93% (1.8028 => 1.8916, std.dev.: 0.0030)
  SingleSource/Benchmarks/McGill/misr: 4.87% (0.3816 => 0.4002, std.dev.: 0.0067)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.72% (0.6964 => 0.7293, std.dev.: 0.0015)
  MultiSource/Applications/hexxagon/hexxagon: 3.77% (15.0347 => 15.6014, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.90% (6.5058 => 6.6944, std.dev.: 0.0237)
  MultiSource/Applications/sgefa/sgefa: 2.76% (0.8950 => 0.9197, std.dev.: 0.0010)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.98% (1.7210 => 1.7551, std.dev.: 0.0053)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -38.21% (0.1081 => 0.0668, std.dev.: 0.0074)
  SingleSource/Benchmarks/Stanford/Perm: -26.44% (0.0469 => 0.0345, std.dev.: 0.0038)
  MultiSource/Benchmarks/McCat/18-imp/imp: -4.50% (0.4108 => 0.3923, std.dev.: 0.0028)
  MultiSource/Applications/Burg/burg: -3.95% (1.4664 => 1.4085, std.dev.: 0.0150)
  MultiSource/Applications/oggenc/oggenc: -2.48% (5.5546 => 5.4170, std.dev.: 0.0320)
  MultiSource/Benchmarks/McCat/05-eks/eks: -2.23% (0.5334 => 0.5215, std.dev.: 0.0011)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -1.54% (4.9289 => 4.8529, std.dev.: 0.0171)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.33% (1.9163 => 1.8909, std.dev.: 0.0082)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.30% (1.4146 => 1.3962, std.dev.: 0.0070)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: -22.37% (3.7013 => 2.8733, std.dev.: 0.0460)
  SingleSource/Benchmarks/Shootout/matrix: -14.72% (2.1111 => 1.8004, std.dev.: 0.0394)
  SingleSource/Benchmarks/Shootout/sieve: -14.42% (7.8564 => 6.7236, std.dev.: 0.0084)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -7.49% (0.1909 => 0.1766, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc/ReedSolomon: -4.74% (8.9315 => 8.5084, std.dev.: 0.0082)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -3.64% (0.4966 => 0.4785, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.41% (5.9970 => 5.7924, std.dev.: 0.0673)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -2.57% (4.9528 => 4.8255, std.dev.: 0.0441)
  MultiSource/Applications/minisat/minisat: -1.12% (6.4047 => 6.3328, std.dev.: 0.0193)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 9.69% (0.2033 => 0.2230, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout-C++/wc: 6.08% (0.2237 => 0.2373, std.dev.: 0.0026)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.53% (4.2717 => 4.5078, std.dev.: 0.0883)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: 22.04% (1.4716 => 1.7959, std.dev.: 0.1096)
  SingleSource/Benchmarks/Shootout/ary3: 20.50% (4.5977 => 5.5401, std.dev.: 0.2706)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 17.66% (4.0567 => 4.7732, std.dev.: 0.2502)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.85% (2.1020 => 2.3721, std.dev.: 0.0087)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 11.88% (28.6638 => 32.0691, std.dev.: 0.5661)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.04% (1.0232 => 1.1362, std.dev.: 0.0001)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.96% (1.3838 => 1.5078, std.dev.: 0.0003)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.10% (1.1019 => 1.1911, std.dev.: 0.0243)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.98% (3.5771 => 3.8625, std.dev.: 0.0038)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 7.87% (0.3534 => 0.3812, std.dev.: 0.0004)
  SingleSource/Benchmarks/Stanford/Puzzle: 7.19% (0.1668 => 0.1788, std.dev.: 0.0029)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 6.18% (1.9729 => 2.0948, std.dev.: 0.0006)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.46% (1.2278 => 1.2948, std.dev.: 0.0181)
  MultiSource/Applications/sgefa/sgefa: 5.17% (0.8745 => 0.9197, std.dev.: 0.0010)
  MultiSource/Applications/spiff/spiff: 5.16% (2.8130 => 2.9581, std.dev.: 0.0238)
  SingleSource/Benchmarks/Stanford/FloatMM: 5.10% (0.6939 => 0.7293, std.dev.: 0.0015)
  MultiSource/Applications/aha/aha: 4.95% (3.5645 => 3.7410, std.dev.: 0.0202)
  MultiSource/Applications/siod/siod: 4.54% (3.4258 => 3.5813, std.dev.: 0.0220)
  MultiSource/Applications/hexxagon/hexxagon: 4.02% (14.9989 => 15.6014, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.17% (5.9126 => 6.1003, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.83% (5.0601 => 5.2031, std.dev.: 0.0433)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.75% (1.8409 => 1.8916, std.dev.: 0.0030)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 2.65% (0.4526 => 0.4646, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.53% (6.5291 => 6.6944, std.dev.: 0.0237)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.49% (5.9456 => 6.0935, std.dev.: 0.0075)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 2.26% (1.2463 => 1.2745, std.dev.: 0.0055)
  MultiSource/Benchmarks/PAQ8p/paq8p: 2.15% (99.3511 => 101.4825, std.dev.: 0.7657)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.12% (11.7894 => 12.0388, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.15% (3.5451 => 3.5860, std.dev.: 0.0017)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.31% (0.0688 => 0.0507, std.dev.: 0.0004)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -14.29% (0.1938 => 0.1661, std.dev.: 0.0012)
  MultiSource/Benchmarks/Bullet/bullet: -9.99% (36.6274 => 32.9665, std.dev.: 1.3977)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -8.17% (1.3676 => 1.2559, std.dev.: 0.0320)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -7.87% (0.2540 => 0.2340, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.85% (0.3402 => 0.3135, std.dev.: 0.0021)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.29% (0.1523 => 0.1412, std.dev.: 0.0020)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.74% (1.5034 => 1.4020, std.dev.: 0.0058)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.62% (0.2810 => 0.2624, std.dev.: 0.0031)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.60% (0.6882 => 0.6428, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.42% (2.0207 => 1.8909, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.30% (1.3819 => 1.2949, std.dev.: 0.0170)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.84% (0.2758 => 0.2597, std.dev.: 0.0013)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.70% (1.0197 => 0.9616, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.31% (1.4113 => 1.3364, std.dev.: 0.0251)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.12% (1.3146 => 1.2473, std.dev.: 0.0108)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -4.51% (5.0823 => 4.8529, std.dev.: 0.0171)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.51% (1.2824 => 1.2246, std.dev.: 0.0214)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.51% (1.2914 => 1.2332, std.dev.: 0.0142)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.36% (1.1409 => 1.0911, std.dev.: 0.0004)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.12% (15.4053 => 14.7705, std.dev.: 0.0261)
  MultiSource/Applications/obsequi/Obsequi: -3.81% (1.1905 => 1.1451, std.dev.: 0.0031)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -3.37% (1.4449 => 1.3962, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.13% (1.3608 => 1.3182, std.dev.: 0.0124)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.82% (7.5124 => 7.3002, std.dev.: 0.0220)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.79% (0.5879 => 0.5715, std.dev.: 0.0054)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -2.75% (5.0556 => 4.9168, std.dev.: 0.0188)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.56% (1.4074 => 1.3714, std.dev.: 0.0110)
  MultiSource/Benchmarks/nbench/nbench: -2.44% (1.2647 => 1.2339, std.dev.: 0.0057)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -2.40% (1.3256 => 1.2938, std.dev.: 0.0071)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.26% (4.7807 => 4.6725, std.dev.: 0.0197)
  MultiSource/Benchmarks/McCat/05-eks/eks: -2.01% (0.5322 => 0.5215, std.dev.: 0.0011)
  MultiSource/Applications/JM/ldecod/ldecod: -1.79% (7.6560 => 7.5188, std.dev.: 0.0477)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.59% (5.5433 => 5.4549, std.dev.: 0.0298)
  MultiSource/Applications/kimwitu++/kc: -1.47% (18.6861 => 18.4116, std.dev.: 0.0346)
  MultiSource/Benchmarks/Prolangs-C/football/football: -1.43% (0.9915 => 0.9773, std.dev.: 0.0030)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.31% (1.6656 => 1.6438, std.dev.: 0.0013)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.40% (2.8850 => 2.3829, std.dev.: 0.0946)
  MultiSource/Benchmarks/nbench/nbench: -15.55% (23.4696 => 19.8209, std.dev.: 1.1949)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -12.84% (1.4335 => 1.2494, std.dev.: 0.0240)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.19% (2.5559 => 2.3976, std.dev.: 0.0414)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -4.05% (0.4987 => 0.4785, std.dev.: 0.0018)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -3.66% (0.4400 => 0.4239, std.dev.: 0.0002)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.92% (40.4190 => 39.2391, std.dev.: 0.1293)

Report Time: 0.89s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131208/a371a6d4/attachment.html>


More information about the llvm-testresults mailing list