[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Jan 9 08:43:45 PST 2014


http://llvm.org/perf/db_default/v4/nts/20116?compare_to=20105&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 20116, Order: 198871, Start Time: 2014-01-09 15:03:16, End Time: 2014-01-09 16:48:34
      To: 20105, Order: 198862, Start Time: 2014-01-09 12:38:09, End Time: 2014-01-09 14:34:56
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 13 (27 on baseline)
Performance Improvements: 63 (20 on baseline)
Unchanged Tests: 1034 (1063 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.90% (1.2632 => 1.2872, std.dev.: 0.0046)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 37.96% (0.1428 => 0.1970, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/flops: 19.22% (7.7719 => 9.2660, std.dev.: 0.1719)
  MultiSource/Benchmarks/nbench/nbench: 8.78% (20.7504 => 22.5731, std.dev.: 0.5735)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 7.60% (0.3528 => 0.3796, std.dev.: 0.0008)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.06% (1.2597 => 1.3234, std.dev.: 0.0104)
  MultiSource/Benchmarks/sim/sim: 4.97% (3.8381 => 4.0288, std.dev.: 0.0057)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.82% (0.4396 => 0.4564, std.dev.: 0.0036)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.76% (1.9649 => 2.0387, std.dev.: 0.0267)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.64% (0.6299 => 0.6528, std.dev.: 0.0006)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.35% (5.4241 => 5.6056, std.dev.: 0.0301)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.24% (5.3635 => 5.4301, std.dev.: 0.0051)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.16% (23.3943 => 23.6646, std.dev.: 0.0841)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: -43.69% (0.1197 => 0.0674, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -43.49% (0.1359 => 0.0768, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/flops-6: -33.89% (0.0478 => 0.0316, std.dev.: 0.0016)
  SingleSource/Benchmarks/Misc/fp-convert: -33.33% (0.0450 => 0.0300, std.dev.: 0.0012)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -32.67% (0.3358 => 0.2261, std.dev.: 0.0156)
  SingleSource/Benchmarks/Misc/flops-4: -30.72% (0.0459 => 0.0318, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -30.28% (0.1189 => 0.0829, std.dev.: 0.0019)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -28.16% (0.1346 => 0.0967, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -27.67% (0.0983 => 0.0711, std.dev.: 0.0012)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -27.23% (0.1142 => 0.0831, std.dev.: 0.0012)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -23.97% (0.2194 => 0.1668, std.dev.: 0.0028)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -22.71% (0.1123 => 0.0868, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/richards_benchmark: -21.76% (0.1034 => 0.0809, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/ffbench: -21.72% (0.0990 => 0.0775, std.dev.: 0.0015)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: -17.24% (0.1601 => 0.1325, std.dev.: 0.0031)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -16.47% (1.0929 => 0.9129, std.dev.: 0.0146)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -16.29% (1.6668 => 1.3953, std.dev.: 0.0891)
  MultiSource/Benchmarks/McCat/08-main/main: -16.12% (0.3778 => 0.3169, std.dev.: 0.0005)
  SingleSource/Benchmarks/Misc/oourafft: -15.57% (0.2992 => 0.2526, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -15.03% (0.3473 => 0.2951, std.dev.: 0.0066)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -13.47% (0.0898 => 0.0777, std.dev.: 0.0026)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -12.07% (0.1856 => 0.1632, std.dev.: 0.0016)
  MultiSource/Benchmarks/nbench/nbench: -10.65% (1.4030 => 1.2536, std.dev.: 0.0295)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -9.39% (2.0995 => 1.9024, std.dev.: 0.0228)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -9.06% (0.1159 => 0.1054, std.dev.: 0.0004)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -9.02% (3.0124 => 2.7406, std.dev.: 0.0509)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -8.01% (5.9729 => 5.4946, std.dev.: 0.0253)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -7.43% (0.3471 => 0.3213, std.dev.: 0.0010)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.51% (15.7980 => 14.7698, std.dev.: 0.1110)
  MultiSource/Benchmarks/Olden/health/health: -6.49% (0.1648 => 0.1541, std.dev.: 0.0020)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -6.33% (0.4044 => 0.3788, std.dev.: 0.0064)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -5.66% (0.7187 => 0.6780, std.dev.: 0.0121)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.96% (0.5503 => 0.5230, std.dev.: 0.0028)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -4.73% (0.7174 => 0.6835, std.dev.: 0.0038)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -4.26% (0.9196 => 0.8804, std.dev.: 0.0066)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -4.24% (2.0753 => 1.9873, std.dev.: 0.0230)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: -4.13% (0.3538 => 0.3392, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -3.93% (1.2927 => 1.2419, std.dev.: 0.0152)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -3.63% (0.6747 => 0.6502, std.dev.: 0.0078)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -3.62% (0.7551 => 0.7278, std.dev.: 0.0080)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -3.24% (1.5285 => 1.4790, std.dev.: 0.0037)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.24% (1.7534 => 1.7142, std.dev.: 0.0150)
  SingleSource/Benchmarks/Misc-C++/bigfib: -2.04% (0.6823 => 0.6684, std.dev.: 0.0033)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -30.77% (0.2197 => 0.1521, std.dev.: 0.0007)
  MultiSource/Applications/kimwitu++/kc: -18.97% (0.0622 => 0.0504, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout/ary3: -18.48% (5.7247 => 4.6670, std.dev.: 0.1674)
  SingleSource/Benchmarks/Shootout/sieve: -16.79% (8.1401 => 6.7735, std.dev.: 0.2035)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -16.60% (1.5616 => 1.3023, std.dev.: 0.0116)
  SingleSource/Benchmarks/Shootout-C++/ary3: -15.57% (5.3311 => 4.5008, std.dev.: 0.2681)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -14.89% (42.0300 => 35.7733, std.dev.: 1.1747)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -9.31% (1.4386 => 1.3046, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc/ffbench: -7.93% (1.5213 => 1.4006, std.dev.: 0.0082)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -7.23% (4.2543 => 3.9468, std.dev.: 0.0225)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -6.48% (2.8580 => 2.6727, std.dev.: 0.0261)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -4.03% (42.5741 => 40.8573, std.dev.: 0.2425)
  SingleSource/Benchmarks/Misc/fbench: -3.31% (5.0956 => 4.9270, std.dev.: 0.0222)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -2.78% (22.1840 => 21.5675, std.dev.: 0.2085)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.58% (4.1841 => 4.0761, std.dev.: 0.0176)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -2.53% (4.0756 => 3.9725, std.dev.: 0.0167)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.92% (5.0078 => 4.9116, std.dev.: 0.0032)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.41% (4.5096 => 4.4462, std.dev.: 0.0088)
  MultiSource/Benchmarks/Olden/tsp/tsp: -1.37% (1.5632 => 1.5418, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc/flops-4: -1.14% (1.7499 => 1.7300, std.dev.: 0.0012)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 41.13% (15.7419 => 22.2158, std.dev.: 0.8999)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 28.56% (0.3859 => 0.4961, std.dev.: 0.0018)
  MultiSource/Applications/lemon/lemon: 10.21% (1.2200 => 1.3446, std.dev.: 0.0372)
  MultiSource/Benchmarks/McCat/08-main/main: 5.39% (0.3007 => 0.3169, std.dev.: 0.0005)
  SingleSource/Benchmarks/Misc-C++/bigfib: 4.24% (0.6412 => 0.6684, std.dev.: 0.0033)
  MultiSource/Benchmarks/McCat/09-vor/vor: 3.34% (0.3596 => 0.3716, std.dev.: 0.0043)
  MultiSource/Benchmarks/Prolangs-C/football/football: 2.41% (0.9915 => 1.0154, std.dev.: 0.0026)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 1.23% (1.4994 => 1.5179, std.dev.: 0.0062)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 1.10% (1.4629 => 1.4790, std.dev.: 0.0037)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.91% (5.9583 => 6.9661, std.dev.: 0.1141)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 12.24% (82.2592 => 92.3240, std.dev.: 0.4043)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.36% (3.3810 => 3.6635, std.dev.: 0.0424)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 7.41% (0.3534 => 0.3796, std.dev.: 0.0008)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.26% (1.2278 => 1.3046, std.dev.: 0.0041)
  MultiSource/Applications/lua/lua: 6.05% (29.1357 => 30.8974, std.dev.: 0.4416)
  MultiSource/Applications/siod/siod: 5.52% (3.4258 => 3.6149, std.dev.: 0.0156)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.40% (1.2556 => 1.3234, std.dev.: 0.0104)
  SingleSource/Benchmarks/Stanford/FloatMM: 5.09% (0.6939 => 0.7292, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout/lists: 4.35% (6.9930 => 7.2970, std.dev.: 0.0999)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.26% (0.6261 => 0.6528, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.46% (5.2486 => 5.4301, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.27% (5.9126 => 6.0468, std.dev.: 0.0346)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.20% (11.7894 => 12.0483, std.dev.: 0.0436)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.06% (1.5797 => 1.6123, std.dev.: 0.0073)
  MultiSource/Benchmarks/BitBench/five11/five11: 1.93% (5.4994 => 5.6056, std.dev.: 0.0301)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.36% (1.4366 => 1.4562, std.dev.: 0.0061)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.14% (23.3972 => 23.6646, std.dev.: 0.0841)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.31% (0.0688 => 0.0507, std.dev.: 0.0052)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -12.38% (0.1938 => 0.1698, std.dev.: 0.0067)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -10.02% (0.3402 => 0.3061, std.dev.: 0.0099)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.34% (0.6882 => 0.6377, std.dev.: 0.0059)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -6.96% (0.1523 => 0.1417, std.dev.: 0.0024)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.65% (0.1774 => 0.1656, std.dev.: 0.0023)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -6.22% (0.3247 => 0.3045, std.dev.: 0.0045)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.95% (0.2824 => 0.2656, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.85% (2.0207 => 1.9024, std.dev.: 0.0228)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.27% (1.3676 => 1.2955, std.dev.: 0.0217)
  MultiSource/Benchmarks/McCat/05-eks/eks: -4.60% (0.5322 => 0.5077, std.dev.: 0.0093)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.13% (15.4053 => 14.7698, std.dev.: 0.1110)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -3.83% (1.2914 => 1.2419, std.dev.: 0.0152)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -2.23% (1.2785 => 1.2500, std.dev.: 0.0056)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -27.91% (0.0369 => 0.0266, std.dev.: 0.0005)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.15% (15.5356 => 13.1815, std.dev.: 0.1359)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.01% (0.1035 => 0.0890, std.dev.: 0.0032)
  MultiSource/Benchmarks/mafft/pairlocalalign: -11.57% (50.9650 => 45.0676, std.dev.: 1.2848)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -9.15% (1.4335 => 1.3023, std.dev.: 0.0116)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -4.01% (6.0535 => 5.8110, std.dev.: 0.0452)

Report Time: 0.81s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140109/83b031c1/attachment.html>


More information about the llvm-testresults mailing list