[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 21 19:31:26 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16553?compare_to=16549&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16553, Order: 193134, Start Time: 2013-10-22 00:47:29, End Time: 2013-10-22 02:34:42
      To: 16549, Order: 193120, Start Time: 2013-10-21 22:26:49, End Time: 2013-10-22 00:21:32
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 16 (26 on baseline)
Performance Improvements: 42 (20 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1049 (1061 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 32.72% (0.1467 => 0.1947, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 15.61% (6.3910 => 7.3888, std.dev.: 0.0533)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.86% (1.2555 => 1.3542, std.dev.: 0.0015)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 5.80% (1.0083 => 1.0668, std.dev.: 0.0005)
  MultiSource/Benchmarks/sim/sim: 5.28% (3.8567 => 4.0602, std.dev.: 0.0039)
  MultiSource/Applications/aha/aha: 5.11% (3.5821 => 3.7651, std.dev.: 0.0079)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 3.79% (1.1164 => 1.1587, std.dev.: 0.0008)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 3.20% (2.3608 => 2.4363, std.dev.: 0.0217)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 3.03% (1.8247 => 1.8799, std.dev.: 0.0111)
  SingleSource/Benchmarks/Shootout-C++/ary3: 2.77% (4.9154 => 5.0518, std.dev.: 0.0449)
  SingleSource/Benchmarks/Misc/fp-convert: 2.58% (7.4193 => 7.6106, std.dev.: 0.0476)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.25% (3.1495 => 3.2204, std.dev.: 0.0140)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.03% (0.6414 => 0.6544, std.dev.: 0.0028)
  MultiSource/Applications/sgefa/sgefa: 1.67% (0.8997 => 0.9147, std.dev.: 0.0023)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.65% (20.9460 => 21.2923, std.dev.: 0.0880)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.15% (3.6103 => 3.6518, std.dev.: 0.0107)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -32.94% (0.1193 => 0.0800, std.dev.: 0.0070)
  MultiSource/Benchmarks/McCat/08-main/main: -28.40% (0.4380 => 0.3136, std.dev.: 0.0162)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: -27.25% (0.0712 => 0.0518, std.dev.: 0.0002)
  MultiSource/Benchmarks/Olden/tsp/tsp: -25.30% (0.1850 => 0.1382, std.dev.: 0.0027)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -24.47% (0.1046 => 0.0790, std.dev.: 0.0032)
  MultiSource/Applications/obsequi/Obsequi: -23.68% (1.5261 => 1.1647, std.dev.: 0.0078)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -23.42% (0.1409 => 0.1079, std.dev.: 0.0025)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -21.22% (1.8081 => 1.4245, std.dev.: 0.0148)
  MultiSource/Benchmarks/Olden/bisort/bisort: -20.34% (0.0890 => 0.0709, std.dev.: 0.0020)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -20.02% (0.3326 => 0.2660, std.dev.: 0.0257)
  MultiSource/Benchmarks/mediabench/adpcm/rawcaudio/rawcaudio: -19.75% (0.0714 => 0.0573, std.dev.: 0.0009)
  MultiSource/Benchmarks/Olden/mst/mst: -19.17% (0.1664 => 0.1345, std.dev.: 0.0100)
  MultiSource/Benchmarks/McCat/15-trie/trie: -17.60% (0.0733 => 0.0604, std.dev.: 0.0040)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -17.15% (0.2921 => 0.2420, std.dev.: 0.0027)
  MultiSource/Applications/sgefa/sgefa: -16.45% (0.4729 => 0.3951, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -15.32% (1.6083 => 1.3619, std.dev.: 0.0877)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -14.44% (1.4945 => 1.2787, std.dev.: 0.0598)
  MultiSource/Applications/Burg/burg: -14.33% (1.6739 => 1.4340, std.dev.: 0.0174)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -13.89% (0.1973 => 0.1699, std.dev.: 0.0021)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -13.31% (0.1893 => 0.1641, std.dev.: 0.0011)
  MultiSource/Applications/aha/aha: -11.39% (0.1475 => 0.1307, std.dev.: 0.0013)
  MultiSource/Benchmarks/Olden/power/power: -10.74% (0.1573 => 0.1404, std.dev.: 0.0049)
  MultiSource/Applications/kimwitu++/kc: -9.05% (20.8505 => 18.9638, std.dev.: 0.0744)
  MultiSource/Applications/siod/siod: -8.26% (2.7668 => 2.5383, std.dev.: 0.0177)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -5.29% (0.3004 => 0.2845, std.dev.: 0.0029)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.52% (0.9660 => 0.9320, std.dev.: 0.0069)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.56% (1.7006 => 1.6741, std.dev.: 0.0036)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.49% (1.1106 => 1.0941, std.dev.: 0.0041)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -52.59% (0.2871 => 0.1361, std.dev.: 0.0562)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -31.60% (1.0941 => 0.7484, std.dev.: 0.0208)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -27.33% (1.7988 => 1.3072, std.dev.: 0.0312)
  MultiSource/Applications/obsequi/Obsequi: -17.74% (2.6886 => 2.2116, std.dev.: 0.0701)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -17.08% (1.5571 => 1.2911, std.dev.: 0.0926)
  MultiSource/Benchmarks/McCat/18-imp/imp: -16.90% (0.1213 => 0.1008, std.dev.: 0.0010)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -16.72% (0.0688 => 0.0573, std.dev.: 0.0008)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -13.47% (0.0995 => 0.0861, std.dev.: 0.0038)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -9.09% (39.7751 => 36.1581, std.dev.: 0.8832)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -6.06% (1.5959 => 1.4992, std.dev.: 0.0005)
  MultiSource/Benchmarks/FreeBench/neural/neural: -5.68% (0.2466 => 0.2326, std.dev.: 0.0032)
  MultiSource/Applications/lua/lua: -5.43% (29.9780 => 28.3513, std.dev.: 0.3251)
  MultiSource/Benchmarks/Olden/tsp/tsp: -4.08% (1.6091 => 1.5435, std.dev.: 0.0142)
  MultiSource/Benchmarks/llubenchmark/llu: -3.08% (2.0394 => 1.9765, std.dev.: 0.0147)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.17% (0.1365 => 0.1349, std.dev.: 0.0189)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/siod/siod: 3.69% (2.4480 => 2.5383, std.dev.: 0.0177)
  MultiSource/Applications/lambda-0_1_3/lambda: 3.46% (0.8014 => 0.8291, std.dev.: 0.0040)
  MultiSource/Applications/kimwitu++/kc: 3.28% (18.3608 => 18.9638, std.dev.: 0.0744)
  SingleSource/Benchmarks/Misc-C++/bigfib: 3.15% (0.6439 => 0.6642, std.dev.: 0.0028)
  MultiSource/Applications/sgefa/sgefa: 2.68% (0.3848 => 0.3951, std.dev.: 0.0027)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.72% (1.0756 => 1.0941, std.dev.: 0.0041)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 1.68% (1.6465 => 1.6741, std.dev.: 0.0036)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.02% (7.6426 => 12.4588, std.dev.: 0.0604)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 20.70% (1.1431 => 1.3797, std.dev.: 0.0611)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.69% (6.4425 => 7.3888, std.dev.: 0.0533)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 8.20% (1.2516 => 1.3542, std.dev.: 0.0015)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0003)
  MultiSource/Benchmarks/sim/sim: 5.98% (3.8312 => 4.0602, std.dev.: 0.0039)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.54% (2.3084 => 2.4363, std.dev.: 0.0217)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.50% (3.1730 => 3.3476, std.dev.: 0.0042)
  MultiSource/Applications/aha/aha: 5.37% (3.5731 => 3.7651, std.dev.: 0.0079)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.21% (1.1013 => 1.1587, std.dev.: 0.0008)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.68% (2.5368 => 2.6301, std.dev.: 0.0257)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.09% (89.7126 => 92.4810, std.dev.: 0.4222)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.59% (1.7652 => 1.8110, std.dev.: 0.0113)
  MultiSource/Benchmarks/Olden/power/power: 2.39% (1.2170 => 1.2461, std.dev.: 0.0016)
  MultiSource/Applications/siod/siod: 2.23% (3.5310 => 3.6097, std.dev.: 0.0162)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.01% (3.1569 => 3.2204, std.dev.: 0.0140)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.74% (16.7972 => 17.0902, std.dev.: 0.0766)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.58% (2.4920 => 2.5314, std.dev.: 0.0027)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.18% (8.1346 => 8.2306, std.dev.: 0.0200)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.38% (0.1483 => 0.1166, std.dev.: 0.0056)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -55.49% (0.5226 => 0.2326, std.dev.: 0.0032)
  MultiSource/Applications/sgefa/sgefa: -42.07% (1.5790 => 0.9147, std.dev.: 0.0023)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -31.75% (0.0400 => 0.0273)
  SingleSource/Benchmarks/Linpack/linpack-pc: -24.24% (57.2347 => 43.3587, std.dev.: 3.5777)
  MultiSource/Benchmarks/mafft/pairlocalalign: -18.48% (50.0284 => 40.7840, std.dev.: 1.8540)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.78% (15.9508 => 13.1141, std.dev.: 0.2814)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.77% (20.8247 => 18.5827, std.dev.: 0.0686)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.51% (3.4956 => 3.1282, std.dev.: 0.0291)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.93% (0.3304 => 0.2976, std.dev.: 0.0002)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.76% (2.5938 => 2.4703, std.dev.: 0.0256)
  MultiSource/Applications/lua/lua: -3.96% (29.5202 => 28.3513, std.dev.: 0.3251)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.21% (3.7437 => 3.6236, std.dev.: 0.0223)
  SingleSource/Benchmarks/Misc/oourafft: -2.93% (3.7484 => 3.6387, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.83% (17.1431 => 16.6584, std.dev.: 0.0789)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.82% (2.4471 => 2.3780, std.dev.: 0.0220)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.72% (4.3592 => 4.2408, std.dev.: 0.0452)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.64% (4.9459 => 4.8650, std.dev.: 0.0108)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.46% (1.5170 => 1.4949, std.dev.: 0.0082)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.07% (21.5217 => 21.2923, std.dev.: 0.0880)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.07% (0.1348 => 0.1349, std.dev.: 0.0189)

Report Time: 0.76s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131021/a37328ab/attachment.html>


More information about the llvm-testresults mailing list