[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Dec 13 09:13:44 PST 2013


http://llvm.org/perf/db_default/v4/nts/18375?compare_to=18370&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18375, Order: 197229, Start Time: 2013-12-13 15:29:00, End Time: 2013-12-13 17:17:58
      To: 18370, Order: 197224, Start Time: 2013-12-13 13:20:21, End Time: 2013-12-13 15:04:44
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 29 (35 on baseline)
Performance Improvements: 4 (8 on baseline)
Unchanged Tests: 1077 (1067 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Stanford/Perm: 79.52% (0.0332 => 0.0596, std.dev.: 0.0028)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 57.41% (0.0864 => 0.1360, std.dev.: 0.0036)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 54.03% (0.0546 => 0.0841, std.dev.: 0.0059)
  SingleSource/Benchmarks/Stanford/IntMM: 51.24% (0.0445 => 0.0673, std.dev.: 0.0068)
  SingleSource/Benchmarks/Stanford/Quicksort: 43.40% (0.0394 => 0.0565, std.dev.: 0.0063)
  SingleSource/Benchmarks/Stanford/Queens: 41.81% (0.0452 => 0.0641, std.dev.: 0.0032)
  SingleSource/Benchmarks/Linpack/linpack-pc: 35.99% (0.3109 => 0.4228, std.dev.: 0.0382)
  MultiSource/Applications/hbd/hbd: 25.88% (1.5484 => 1.9492, std.dev.: 0.0327)
  MultiSource/Applications/lua/lua: 14.53% (4.2608 => 4.8798, std.dev.: 0.1196)
  SingleSource/Benchmarks/Shootout-C++/strcat: 10.05% (0.2049 => 0.2255, std.dev.: 0.0066)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 8.19% (5.4298 => 5.8744, std.dev.: 0.1142)
  MultiSource/Applications/sqlite3/sqlite3: 7.73% (22.1376 => 23.8490, std.dev.: 0.3413)
  SingleSource/Benchmarks/Shootout-C++/methcall: 6.05% (0.2033 => 0.2156, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc-C++/bigfib: 3.96% (0.6615 => 0.6877, std.dev.: 0.0081)
  MultiSource/Applications/oggenc/oggenc: 3.52% (5.6543 => 5.8536, std.dev.: 0.0645)
  MultiSource/Applications/lemon/lemon: 2.77% (1.3699 => 1.4079, std.dev.: 0.0141)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 2.61% (1.3167 => 1.3511, std.dev.: 0.0057)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 31.18% (4.6399 => 6.0867, std.dev.: 0.0923)
  MultiSource/Applications/minisat/minisat: 29.32% (6.3715 => 8.2399, std.dev.: 0.3388)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 25.91% (3.6968 => 4.6546, std.dev.: 0.1661)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 10.51% (2.8818 => 3.1846, std.dev.: 0.0848)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.70% (14.6207 => 16.0390, std.dev.: 0.4383)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 7.30% (0.8305 => 0.8911, std.dev.: 0.0167)
  SingleSource/Benchmarks/Shootout-C++/fibo: 6.82% (5.0395 => 5.3834, std.dev.: 0.0044)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.44% (4.0079 => 4.2261, std.dev.: 0.0508)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.03% (1.8097 => 1.9007, std.dev.: 0.0206)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 4.60% (2.6716 => 2.7944, std.dev.: 0.0048)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.11% (40.5618 => 42.2292, std.dev.: 0.4076)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.56% (5.8897 => 5.9816, std.dev.: 0.0215)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -29.12% (0.2002 => 0.1419, std.dev.: 0.0226)
  SingleSource/Benchmarks/Shootout-C++/matrix: -3.56% (3.0029 => 2.8960, std.dev.: 0.0361)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.67% (5.6605 => 5.5093, std.dev.: 0.0586)
  MultiSource/Applications/lambda-0_1_3/lambda: -2.23% (8.0132 => 7.8342, std.dev.: 0.0465)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Stanford/Perm: 70.29% (0.0350 => 0.0596, std.dev.: 0.0028)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 54.72% (0.0879 => 0.1360, std.dev.: 0.0036)
  SingleSource/Benchmarks/Stanford/IntMM: 54.00% (0.0437 => 0.0673, std.dev.: 0.0068)
  MultiSource/Applications/sqlite3/sqlite3: 51.50% (15.7419 => 23.8490, std.dev.: 0.3413)
  SingleSource/Benchmarks/Stanford/Queens: 44.37% (0.0444 => 0.0641, std.dev.: 0.0032)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: 42.06% (0.0592 => 0.0841, std.dev.: 0.0059)
  SingleSource/Benchmarks/Linpack/linpack-pc: 35.99% (0.3109 => 0.4228, std.dev.: 0.0382)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 27.57% (0.3859 => 0.4923, std.dev.: 0.0102)
  MultiSource/Applications/hbd/hbd: 24.58% (1.5646 => 1.9492, std.dev.: 0.0327)
  MultiSource/Applications/lemon/lemon: 15.40% (1.2200 => 1.4079, std.dev.: 0.0141)
  MultiSource/Applications/lua/lua: 14.18% (4.2737 => 4.8798, std.dev.: 0.1196)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 10.48% (0.1145 => 0.1265, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/strcat: 9.57% (0.2058 => 0.2255, std.dev.: 0.0066)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.20% (25.9661 => 28.3557, std.dev.: 0.4652)
  SingleSource/Benchmarks/Misc-C++/bigfib: 7.25% (0.6412 => 0.6877, std.dev.: 0.0081)
  MultiSource/Applications/oggenc/oggenc: 6.49% (5.4968 => 5.8536, std.dev.: 0.0645)
  SingleSource/Benchmarks/Shootout-C++/methcall: 6.05% (0.2033 => 0.2156, std.dev.: 0.0032)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.80% (0.6322 => 0.6499, std.dev.: 0.0036)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 1.92% (1.3256 => 1.3511, std.dev.: 0.0057)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 32.99% (4.5769 => 6.0867, std.dev.: 0.0923)
  MultiSource/Applications/minisat/minisat: 28.99% (6.3881 => 8.2399, std.dev.: 0.3388)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 19.71% (3.8883 => 4.6546, std.dev.: 0.1661)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.16% (5.9583 => 6.9212, std.dev.: 0.2991)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 10.04% (2.8940 => 3.1846, std.dev.: 0.0848)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.46% (3.3810 => 3.6670, std.dev.: 0.0298)
  SingleSource/Benchmarks/Shootout-C++/fibo: 6.98% (5.0320 => 5.3834, std.dev.: 0.0044)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.62% (4.0012 => 4.2261, std.dev.: 0.0508)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 4.82% (2.6658 => 2.7944, std.dev.: 0.0048)
  MultiSource/Applications/siod/siod: 4.76% (3.4258 => 3.5890, std.dev.: 0.0094)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.13% (40.5530 => 42.2292, std.dev.: 0.4076)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.25% (1.8409 => 1.9007, std.dev.: 0.0206)
  SingleSource/Benchmarks/Misc/fp-convert: 1.72% (7.3892 => 7.5164, std.dev.: 0.0422)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.72% (11.7894 => 11.9923, std.dev.: 0.0638)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 1.52% (4.0593 => 4.1209, std.dev.: 0.0215)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.50% (5.8933 => 5.9816, std.dev.: 0.0215)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -27.03% (0.0688 => 0.0502, std.dev.: 0.0059)
  MultiSource/Benchmarks/Bullet/bullet: -6.76% (36.6274 => 34.1524, std.dev.: 0.8232)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.57% (1.3676 => 1.2777, std.dev.: 0.0311)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.13% (0.2824 => 0.2651, std.dev.: 0.0056)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.06% (1.1409 => 1.0946, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.80% (1.2724 => 1.2240, std.dev.: 0.0183)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: -11.27% (1.4335 => 1.2719, std.dev.: 0.0319)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.58% (7.9597 => 7.8342, std.dev.: 0.0465)

Report Time: 2.25s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131213/62feb23e/attachment.html>


More information about the llvm-testresults mailing list