[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Jan 9 16:30:01 PST 2014


http://llvm.org/perf/db_default/v4/nts/20143?compare_to=20133&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 20143, Order: 198893, Start Time: 2014-01-09 22:43:41, End Time: 2014-01-10 00:34:46
      To: 20133, Order: 198879, Start Time: 2014-01-09 20:12:07, End Time: 2014-01-09 22:10:51
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 26 (41 on baseline)
Performance Improvements: 29 (5 on baseline)
Unchanged Tests: 1055 (1064 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 55.61% (0.0989 => 0.1539, std.dev.: 0.0070)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 41.52% (0.0395 => 0.0559, std.dev.: 0.0047)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 40.56% (0.0710 => 0.0998, std.dev.: 0.0052)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 27.44% (0.2784 => 0.3548, std.dev.: 0.0211)
  SingleSource/Benchmarks/Misc/perlin: 26.09% (0.0594 => 0.0749, std.dev.: 0.0053)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 25.15% (1.4233 => 1.7813, std.dev.: 0.0451)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 17.10% (0.7104 => 0.8319, std.dev.: 0.0411)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 14.61% (5.2400 => 6.0055, std.dev.: 0.2742)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 11.75% (4.8067 => 5.3714, std.dev.: 0.0892)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 11.56% (1.4864 => 1.6583, std.dev.: 0.0334)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 10.63% (2.1106 => 2.3349, std.dev.: 0.0342)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 6.17% (2.7964 => 2.9689, std.dev.: 0.0205)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 4.16% (46.5235 => 48.4610, std.dev.: 0.3341)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.35% (4.3498 => 4.4520, std.dev.: 0.0345)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.15% (1.4808 => 1.8828, std.dev.: 0.0425)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 20.11% (2.4318 => 2.9209, std.dev.: 0.0582)
  SingleSource/Benchmarks/Shootout/ary3: 19.67% (5.2572 => 6.2911, std.dev.: 0.3146)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 17.38% (0.3573 => 0.4194, std.dev.: 0.0183)
  MultiSource/Applications/SPASS/SPASS: 16.21% (8.4453 => 9.8140, std.dev.: 0.1352)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 8.77% (37.5750 => 40.8708, std.dev.: 0.6943)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 5.32% (2.6739 => 2.8161, std.dev.: 0.0361)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.44% (21.4953 => 22.4498, std.dev.: 0.0817)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 3.22% (5.1429 => 5.3084, std.dev.: 0.0405)
  MultiSource/Applications/sqlite3/sqlite3: 2.03% (4.2049 => 4.2901, std.dev.: 0.0224)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.47% (5.9917 => 6.0800, std.dev.: 0.0172)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.33% (3.1725 => 3.2146, std.dev.: 0.0037)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout/nestedloop: -40.93% (0.0540 => 0.0319, std.dev.: 0.0003)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -37.47% (0.0870 => 0.0544, std.dev.: 0.0112)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: -34.91% (0.5351 => 0.3483, std.dev.: 0.0322)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -25.80% (0.1562 => 0.1159, std.dev.: 0.0032)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -25.00% (0.1284 => 0.0963, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -23.43% (1.6772 => 1.2843, std.dev.: 0.1239)
  MultiSource/Applications/minisat/minisat: -23.26% (1.0113 => 0.7761, std.dev.: 0.0641)
  MultiSource/Benchmarks/McCat/18-imp/imp: -18.34% (0.4870 => 0.3977, std.dev.: 0.0050)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -15.26% (0.2051 => 0.1738, std.dev.: 0.0078)
  MultiSource/Benchmarks/McCat/09-vor/vor: -14.99% (0.4342 => 0.3691, std.dev.: 0.0114)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -14.96% (0.1083 => 0.0921, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout-C++/hash2: -14.91% (0.5042 => 0.4290, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -10.57% (1.4229 => 1.2725, std.dev.: 0.0508)
  MultiSource/Benchmarks/Olden/bh/bh: -7.63% (0.3631 => 0.3354, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.07% (1.4161 => 1.3301, std.dev.: 0.0221)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.98% (1.4191 => 1.3342, std.dev.: 0.0227)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -4.75% (0.2442 => 0.2326, std.dev.: 0.0018)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -2.73% (1.2068 => 1.1739, std.dev.: 0.0081)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: -16.28% (1.6179 => 1.3545, std.dev.: 0.0364)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -10.51% (1.4440 => 1.2923, std.dev.: 0.0126)
  MultiSource/Benchmarks/McCat/18-imp/imp: -10.24% (0.1143 => 0.1026, std.dev.: 0.0040)
  SingleSource/Benchmarks/McGill/misr: -8.18% (0.4167 => 0.3826, std.dev.: 0.0125)
  SingleSource/Benchmarks/Shootout/hash: -5.76% (5.5040 => 5.1871, std.dev.: 0.0140)
  SingleSource/Benchmarks/Shootout-C++/lists1: -5.28% (0.6118 => 0.5795, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.54% (3.7022 => 3.5713, std.dev.: 0.0259)
  MultiSource/Benchmarks/sim/sim: -3.46% (3.9630 => 3.8257, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.09% (5.6614 => 5.5433, std.dev.: 0.0453)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -2.00% (1.2886 => 1.2628, std.dev.: 0.0071)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.83% (3.6757 => 3.6086, std.dev.: 0.0225)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: 61.49% (0.0953 => 0.1539, std.dev.: 0.0070)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 51.67% (0.0658 => 0.0998, std.dev.: 0.0052)
  MultiSource/Applications/sqlite3/sqlite3: 45.19% (15.7419 => 22.8549, std.dev.: 0.5221)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: 40.45% (0.0398 => 0.0559, std.dev.: 0.0047)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 26.26% (0.2810 => 0.3548, std.dev.: 0.0211)
  SingleSource/Benchmarks/Misc/perlin: 24.42% (0.0602 => 0.0749, std.dev.: 0.0053)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 23.28% (1.4449 => 1.7813, std.dev.: 0.0451)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 22.90% (0.6769 => 0.8319, std.dev.: 0.0411)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 20.08% (5.0556 => 6.0708, std.dev.: 0.3044)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 18.17% (5.0823 => 6.0055, std.dev.: 0.2742)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 15.55% (2.0207 => 2.3349, std.dev.: 0.0342)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: 15.50% (1.7054 => 1.9697, std.dev.: 0.0815)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 13.36% (1.4629 => 1.6583, std.dev.: 0.0334)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 12.36% (4.7807 => 5.3714, std.dev.: 0.0892)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 7.89% (44.9186 => 48.4610, std.dev.: 0.3341)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.68% (2.7572 => 2.9689, std.dev.: 0.0205)
  MultiSource/Applications/oggenc/oggenc: 7.12% (5.4968 => 5.8884, std.dev.: 0.1307)
  MultiSource/Applications/SIBsim4/SIBsim4: 5.32% (1.5198 => 1.6006, std.dev.: 0.0259)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 4.95% (0.5134 => 0.5388, std.dev.: 0.0059)
  SingleSource/Benchmarks/Misc-C++/bigfib: 4.29% (0.6412 => 0.6687, std.dev.: 0.0093)
  MultiSource/Benchmarks/McCat/08-main/main: 4.26% (0.3007 => 0.3135, std.dev.: 0.0032)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.22% (4.2717 => 4.4520, std.dev.: 0.0345)
  MultiSource/Applications/lua/lua: 1.92% (4.2737 => 4.3559, std.dev.: 0.0190)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 36.83% (4.5977 => 6.2911, std.dev.: 0.3146)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.26% (1.4795 => 1.8828, std.dev.: 0.0425)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 24.90% (0.3358 => 0.4194, std.dev.: 0.0183)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.55% (5.9583 => 6.9443, std.dev.: 0.1668)
  MultiSource/Applications/SPASS/SPASS: 14.97% (8.5363 => 9.8140, std.dev.: 0.1352)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 14.28% (2.5559 => 2.9209, std.dev.: 0.0582)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.63% (35.9684 => 40.8708, std.dev.: 0.6943)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 12.38% (28.6638 => 32.2137, std.dev.: 0.8318)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 12.38% (82.2592 => 92.4393, std.dev.: 0.1033)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 9.38% (0.3346 => 0.3660, std.dev.: 0.0049)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 5.64% (2.6658 => 2.8161, std.dev.: 0.0361)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.25% (1.2278 => 1.2923, std.dev.: 0.0126)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.44% (0.6261 => 0.6539, std.dev.: 0.0079)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.95% (21.5962 => 22.4498, std.dev.: 0.0817)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.78% (4.0012 => 4.1523, std.dev.: 0.0540)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.83% (5.9126 => 6.0800, std.dev.: 0.0172)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.54% (11.7894 => 12.0889, std.dev.: 0.0256)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.90% (3.1547 => 3.2146, std.dev.: 0.0037)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -7.73% (0.3247 => 0.2996, std.dev.: 0.0051)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -14.53% (15.5356 => 13.2777, std.dev.: 0.7395)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.27% (50.9650 => 48.2815, std.dev.: 0.0784)
  MultiSource/Benchmarks/sim/sim: -4.68% (4.0134 => 3.8257, std.dev.: 0.0056)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.24% (6.0535 => 5.9178, std.dev.: 0.0491)

Report Time: 0.77s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140109/79b72125/attachment.html>


More information about the llvm-testresults mailing list