[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Aug 24 02:46:11 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14735?compare_to=14731&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14735, Order: 189164, Start Time: 2013-08-24 08:02:16, End Time: 2013-08-24 09:48:22
      To: 14731, Order: 189162, Start Time: 2013-08-24 03:16:29, End Time: 2013-08-24 04:58:02
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 8 (33 on baseline)
Performance Improvements: 9 (86 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1090 (988 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/nbench/nbench: 10.20% (20.6533 => 22.7608, std.dev.: 0.7305)
  MultiSource/Benchmarks/Olden/em3d/em3d: 7.57% (4.7192 => 5.0764, std.dev.: 0.0439)
  SingleSource/Benchmarks/Misc/lowercase: 6.25% (0.7787 => 0.8274, std.dev.: 0.0150)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 5.92% (5.0128 => 5.3097, std.dev.: 0.0448)
  SingleSource/Benchmarks/Shootout/lists: 4.00% (7.1524 => 7.4385, std.dev.: 0.0309)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.69% (2.5901 => 2.6597, std.dev.: 0.0182)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.63% (1.5843 => 1.6102, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.01% (13.0439 => 13.1761, std.dev.: 0.0422)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.81% (0.9219 => 0.8960, std.dev.: 0.0090)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.12% (0.5997 => 0.5870, std.dev.: 0.0036)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.98% (1.1586 => 1.1357, std.dev.: 0.0072)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.67% (1.6915 => 1.6632, std.dev.: 0.0085)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.56% (0.7235 => 0.7122, std.dev.: 0.0038)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -1.56% (1.2060 => 1.1872, std.dev.: 0.0027)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -1.55% (0.7113 => 0.7003, std.dev.: 0.0005)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -1.17% (5.2038 => 5.1430, std.dev.: 0.0130)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.70% (46.3953 => 45.1434, std.dev.: 0.4593)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.01% (0.1289 => 0.1302, std.dev.: 0.0010)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/distray/distray: 16.75% (0.1033 => 0.1206, std.dev.: 0.0025)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 4.46% (0.9941 => 1.0384, std.dev.: 0.0136)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.21% (0.6785 => 0.7003, std.dev.: 0.0005)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.60% (0.7010 => 0.7122, std.dev.: 0.0038)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 73.49% (3.7285 => 6.4684, std.dev.: 0.0601)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.55% (2.8867 => 4.2881, std.dev.: 0.0376)
  MultiSource/Benchmarks/FreeBench/neural/neural: 38.10% (0.3171 => 0.4379, std.dev.: 0.0365)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 24.64% (1.5030 => 1.8734, std.dev.: 0.0154)
  SingleSource/Benchmarks/Shootout/hash: 23.05% (4.1846 => 5.1490, std.dev.: 0.2396)
  SingleSource/Benchmarks/Shootout-C++/hash: 16.04% (0.6295 => 0.7305, std.dev.: 0.0041)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.83% (7.0762 => 7.8423, std.dev.: 0.0122)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.24% (0.1678 => 0.1833, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.31% (5.4910 => 5.9473, std.dev.: 0.0496)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.91% (1.2557 => 1.3550, std.dev.: 0.0028)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.86% (48.3256 => 52.1255, std.dev.: 0.4395)
  MultiSource/Applications/JM/lencod/lencod: 7.09% (7.1799 => 7.6889, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.89% (3.2027 => 3.4234, std.dev.: 0.0063)
  SingleSource/Benchmarks/McGill/chomp: 6.44% (1.0051 => 1.0698, std.dev.: 0.0118)
  MultiSource/Benchmarks/FreeBench/mason/mason: 6.29% (0.2799 => 0.2975, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.00% (5.3042 => 5.6223, std.dev.: 0.0263)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.70% (5.5008 => 5.8146, std.dev.: 0.1120)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.56% (3.4085 => 3.5979, std.dev.: 0.0662)
  SingleSource/Benchmarks/Misc/lowercase: 5.41% (0.7849 => 0.8274, std.dev.: 0.0150)
  MultiSource/Benchmarks/Olden/tsp/tsp: 4.63% (1.5339 => 1.6049, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout-C++/hash2: 4.44% (3.3877 => 3.5380, std.dev.: 0.0398)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.27% (4.3151 => 4.4992, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.25% (5.1471 => 5.3656, std.dev.: 0.0723)
  SingleSource/Benchmarks/Misc/whetstone: 3.69% (3.4559 => 3.5833, std.dev.: 0.0161)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.24% (25.0200 => 25.8301, std.dev.: 0.0823)
  MultiSource/Applications/spiff/spiff: 3.08% (2.7609 => 2.8458, std.dev.: 0.0259)
  SingleSource/Benchmarks/Shootout/lists: 2.86% (7.2315 => 7.4385, std.dev.: 0.0309)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.44% (12.8625 => 13.1761, std.dev.: 0.0422)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.62% (1.4398 => 1.4631, std.dev.: 0.0003)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -33.93% (0.2237 => 0.1478, std.dev.: 0.0017)
  MultiSource/Benchmarks/Olden/bisort/bisort: -31.90% (0.1072 => 0.0730, std.dev.: 0.0003)
  MultiSource/Benchmarks/Olden/tsp/tsp: -24.86% (0.1818 => 0.1366, std.dev.: 0.0014)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -23.56% (0.0675 => 0.0516, std.dev.: 0.0007)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -21.99% (0.1114 => 0.0869, std.dev.: 0.0022)
  MultiSource/Benchmarks/MallocBench/gs/gs: -21.72% (6.0938 => 4.7704, std.dev.: 0.0255)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.32% (1.5228 => 1.2133, std.dev.: 0.0058)
  MultiSource/Benchmarks/Olden/health/health: -20.02% (0.1993 => 0.1594, std.dev.: 0.0009)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -18.48% (0.3576 => 0.2915, std.dev.: 0.0028)
  MultiSource/Applications/obsequi/Obsequi: -17.75% (1.4685 => 1.2079, std.dev.: 0.0038)
  MultiSource/Applications/hbd/hbd: -16.89% (2.0193 => 1.6783, std.dev.: 0.0070)
  MultiSource/Applications/lua/lua: -16.62% (5.3200 => 4.4358, std.dev.: 0.0098)
  MultiSource/Applications/hexxagon/hexxagon: -15.96% (1.3285 => 1.1165, std.dev.: 0.0068)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -13.32% (1.3985 => 1.2122, std.dev.: 0.0090)
  MultiSource/Benchmarks/Olden/em3d/em3d: -12.46% (0.2367 => 0.2072, std.dev.: 0.0068)
  MultiSource/Applications/lambda-0_1_3/lambda: -11.21% (0.9461 => 0.8400, std.dev.: 0.0022)
  MultiSource/Applications/ClamAV/clamscan: -10.87% (19.4145 => 17.3043, std.dev.: 0.0319)
  MultiSource/Applications/JM/ldecod/ldecod: -10.84% (8.6720 => 7.7320, std.dev.: 0.0349)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.53% (0.1870 => 0.1673, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -9.85% (0.3655 => 0.3295, std.dev.: 0.0075)
  MultiSource/Applications/sqlite3/sqlite3: -9.11% (19.1635 => 17.4183, std.dev.: 0.0527)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -8.43% (0.3073 => 0.2814, std.dev.: 0.0017)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -8.17% (0.1947 => 0.1788, std.dev.: 0.0011)
  MultiSource/Applications/kimwitu++/kc: -7.08% (21.0770 => 19.5840, std.dev.: 0.0158)
  MultiSource/Applications/oggenc/oggenc: -5.99% (6.1121 => 5.7458, std.dev.: 0.0737)
  MultiSource/Benchmarks/Olden/bh/bh: -5.61% (0.3603 => 0.3401, std.dev.: 0.0047)
  MultiSource/Applications/JM/lencod/lencod: -5.53% (18.5029 => 17.4801, std.dev.: 0.0560)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.27% (1.7461 => 1.6541, std.dev.: 0.0028)
  MultiSource/Applications/minisat/minisat: -5.19% (0.8278 => 0.7848, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.02% (1.4853 => 1.4108, std.dev.: 0.0088)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.00% (6.1631 => 5.8550, std.dev.: 0.0217)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -4.89% (0.2432 => 0.2313, std.dev.: 0.0028)
  MultiSource/Applications/lemon/lemon: -4.22% (1.2976 => 1.2428, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -3.83% (1.4947 => 1.4374, std.dev.: 0.0075)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -3.83% (5.3476 => 5.1430, std.dev.: 0.0130)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.39% (1.5479 => 1.4955, std.dev.: 0.0113)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -2.97% (5.2851 => 5.1282, std.dev.: 0.0433)
  MultiSource/Benchmarks/nbench/nbench: -2.60% (1.3677 => 1.3322, std.dev.: 0.0039)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -2.59% (1.3780 => 1.3423, std.dev.: 0.0025)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -2.24% (1.6686 => 1.6312, std.dev.: 0.0137)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.24% (1.5376 => 1.5032, std.dev.: 0.0078)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -37.58% (0.2134 => 0.1332, std.dev.: 0.0082)
  MultiSource/Applications/lemon/lemon: -36.74% (1.4194 => 0.8979, std.dev.: 0.0094)
  SingleSource/Benchmarks/Stanford/Towers: -36.56% (0.0279 => 0.0177, std.dev.: 0.0017)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -34.20% (0.0345 => 0.0227, std.dev.: 0.0029)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.39% (2.1022 => 1.4212, std.dev.: 0.0065)
  MultiSource/Benchmarks/MallocBench/gs/gs: -31.71% (0.1189 => 0.0812, std.dev.: 0.0018)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -30.58% (1.0962 => 0.7610, std.dev.: 0.0470)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -30.02% (0.0816 => 0.0571, std.dev.: 0.0004)
  MultiSource/Benchmarks/Olden/bisort/bisort: -29.46% (0.9545 => 0.6733, std.dev.: 0.0099)
  MultiSource/Applications/viterbi/viterbi: -27.39% (3.4923 => 2.5357, std.dev.: 0.0065)
  MultiSource/Applications/JM/ldecod/ldecod: -25.15% (0.0859 => 0.0643, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.60% (6.9552 => 5.2443, std.dev.: 0.0213)
  MultiSource/Applications/minisat/minisat: -22.45% (8.0162 => 6.2165, std.dev.: 0.3059)
  SingleSource/Benchmarks/Misc/perlin: -21.35% (4.5989 => 3.6170, std.dev.: 0.1174)
  MultiSource/Applications/obsequi/Obsequi: -18.73% (2.6081 => 2.1195, std.dev.: 0.0039)
  SingleSource/Benchmarks/Misc/mandel: -14.06% (1.1996 => 1.0309, std.dev.: 0.0138)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.44% (0.0884 => 0.0774, std.dev.: 0.0001)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.37% (0.3557 => 0.3117, std.dev.: 0.0025)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.49% (0.5173 => 0.4682, std.dev.: 0.0019)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.07% (3.5791 => 3.2904, std.dev.: 0.0045)
  MultiSource/Benchmarks/Olden/health/health: -6.97% (0.3556 => 0.3308, std.dev.: 0.0061)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.53% (1.3148 => 1.2290, std.dev.: 0.0309)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.86% (1.7207 => 1.6198, std.dev.: 0.0176)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -5.55% (0.4969 => 0.4693, std.dev.: 0.0094)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -5.25% (0.3773 => 0.3575, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.92% (3.8119 => 3.6245, std.dev.: 0.0073)
  SingleSource/Benchmarks/Misc/fbench: -4.81% (4.9602 => 4.7217, std.dev.: 0.0168)
  MultiSource/Applications/lua/lua: -4.76% (31.0707 => 29.5916, std.dev.: 0.0372)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.41% (47.2250 => 45.1434, std.dev.: 0.4593)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.40% (0.3479 => 0.3326, std.dev.: 0.0013)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.20% (1.1024 => 1.0561, std.dev.: 0.0054)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -3.98% (0.7355 => 0.7062, std.dev.: 0.0086)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.36% (21.6864 => 20.9582, std.dev.: 0.2698)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -3.12% (0.4783 => 0.4634, std.dev.: 0.0029)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.09% (0.7806 => 0.7565, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.03% (6.1482 => 5.9621, std.dev.: 0.0592)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.00% (5.2218 => 5.0649, std.dev.: 0.0384)
  MultiSource/Benchmarks/Olden/bh/bh: -2.99% (2.4879 => 2.4136, std.dev.: 0.0019)
  MultiSource/Applications/sqlite3/sqlite3: -2.95% (4.3833 => 4.2542, std.dev.: 0.0263)
  MultiSource/Applications/sgefa/sgefa: -2.57% (1.4030 => 1.3670, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/oourafft: -2.11% (3.7891 => 3.7090, std.dev.: 0.0213)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.00% (34.8438 => 34.1455, std.dev.: 0.0723)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.44% (2.9568 => 2.9143, std.dev.: 0.0107)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.22% (2.1343 => 2.1082, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -1.21% (4.0075 => 3.9590, std.dev.: 0.0175)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.52% (0.1378 => 0.1302, std.dev.: 0.0010)

Report Time: 0.69s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130824/71620e9a/attachment.html>


More information about the llvm-testresults mailing list