[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Aug 19 00:16:38 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14553?compare_to=14551&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14553, Order: 188653, Start Time: 2013-08-19 05:35:32, End Time: 2013-08-19 07:18:41
      To: 14551, Order: 188647, Start Time: 2013-08-19 03:18:52, End Time: 2013-08-19 05:08:47
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 1 (34 on baseline)
Performance Improvements: 17 (100 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1089 (973 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 3.98% (2.4223 => 2.5186, std.dev.: 0.0049)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.45% (0.0916 => 0.0802, std.dev.: 0.0036)
  SingleSource/UnitTests/Vector/constpool: -8.76% (9.4031 => 8.5791, std.dev.: 0.2564)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -3.29% (0.7639 => 0.7388, std.dev.: 0.0055)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -2.01% (1.5865 => 1.5546, std.dev.: 0.0062)
  MultiSource/Applications/siod/siod: -1.32% (2.5764 => 2.5423, std.dev.: 0.0014)
  MultiSource/Applications/oggenc/oggenc: -1.17% (5.8605 => 5.7920, std.dev.: 0.0069)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -24.24% (0.1770 => 0.1341, std.dev.: 0.0008)
  MultiSource/Benchmarks/llubenchmark/llu: -17.22% (2.4210 => 2.0041, std.dev.: 0.0141)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -7.16% (31.3613 => 29.1161, std.dev.: 0.6162)
  MultiSource/Benchmarks/FreeBench/distray/distray: -4.27% (0.2363 => 0.2262, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.62% (61.9820 => 59.7390, std.dev.: 0.5298)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -3.40% (0.3269 => 0.3158, std.dev.: 0.0016)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -1.94% (4.5445 => 4.4564, std.dev.: 0.0183)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.80% (0.6445 => 0.6329, std.dev.: 0.0039)
  MultiSource/Benchmarks/sim/sim: -1.54% (3.9302 => 3.8698, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/lowercase: -1.53% (0.7802 => 0.7683, std.dev.: 0.0025)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.43% (4.7348 => 4.6671, std.dev.: 0.0219)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.93% (0.1289 => 0.1301, std.dev.: 0.0019)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/bigstack: 39.27% (0.0466 => 0.0649, std.dev.: 0.0022)
  MultiSource/Benchmarks/FreeBench/distray/distray: 16.75% (0.1033 => 0.1206, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc/oourafft: 4.51% (0.2284 => 0.2387, std.dev.: 0.0010)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 3.40% (0.6785 => 0.7016, std.dev.: 0.0050)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 2.99% (0.3546 => 0.3652, std.dev.: 0.0004)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.75% (0.9941 => 1.0214, std.dev.: 0.0062)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.42% (0.9407 => 0.9635, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.98% (0.7010 => 0.7149, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.55% (0.9761 => 0.9912, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.02% (6.4979 => 6.5644, std.dev.: 0.0137)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 67.18% (3.7285 => 6.2332, std.dev.: 0.1490)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.56% (2.8867 => 4.2884, std.dev.: 0.0371)
  SingleSource/Benchmarks/Misc/pi: 26.98% (1.9835 => 2.5186, std.dev.: 0.0049)
  SingleSource/Benchmarks/Shootout/hash: 22.50% (4.1846 => 5.1261, std.dev.: 0.0933)
  SingleSource/Benchmarks/Shootout-C++/hash: 15.66% (0.6295 => 0.7281, std.dev.: 0.0186)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.94% (7.0762 => 7.8504, std.dev.: 0.0800)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.59% (0.1678 => 0.1839, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.31% (5.4910 => 5.9475, std.dev.: 0.0703)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.08% (1.2557 => 1.3572, std.dev.: 0.0015)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.92% (48.3256 => 52.1552, std.dev.: 0.3589)
  SingleSource/Benchmarks/McGill/chomp: 7.05% (1.0051 => 1.0760, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.92% (3.2027 => 3.4242, std.dev.: 0.0555)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.98% (5.3042 => 5.6216, std.dev.: 0.0928)
  MultiSource/Benchmarks/FreeBench/mason/mason: 5.47% (0.2799 => 0.2952, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.43% (5.5008 => 5.7995, std.dev.: 0.0535)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.26% (5.1471 => 5.3663, std.dev.: 0.0198)
  MultiSource/Benchmarks/Olden/tsp/tsp: 4.17% (1.5339 => 1.5978, std.dev.: 0.0090)
  SingleSource/Benchmarks/Misc/whetstone: 3.92% (3.4559 => 3.5912, std.dev.: 0.0066)
  MultiSource/Applications/siod/siod: 3.72% (3.3761 => 3.5016, std.dev.: 0.0137)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.27% (25.0200 => 25.8380, std.dev.: 0.0190)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.86% (3.3877 => 3.4846, std.dev.: 0.0240)
  SingleSource/Benchmarks/Misc/ffbench: 2.26% (1.3679 => 1.3988, std.dev.: 0.0091)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 1.20% (1.4398 => 1.4571, std.dev.: 0.0054)
  SingleSource/Benchmarks/Misc-C++/Large/ray: 1.02% (4.9089 => 4.9592, std.dev.: 0.0098)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -34.56% (0.2237 => 0.1464, std.dev.: 0.0024)
  MultiSource/Benchmarks/Olden/bisort/bisort: -30.69% (0.1072 => 0.0743, std.dev.: 0.0012)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -28.01% (0.1114 => 0.0802, std.dev.: 0.0036)
  MultiSource/Benchmarks/Olden/tsp/tsp: -24.86% (0.1818 => 0.1366, std.dev.: 0.0032)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -23.56% (0.0675 => 0.0516, std.dev.: 0.0012)
  MultiSource/Benchmarks/MallocBench/gs/gs: -21.80% (6.0938 => 4.7656, std.dev.: 0.0062)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.56% (1.5228 => 1.2097, std.dev.: 0.0124)
  MultiSource/Benchmarks/Olden/health/health: -19.82% (0.1993 => 0.1598, std.dev.: 0.0013)
  MultiSource/Applications/obsequi/Obsequi: -19.21% (1.4685 => 1.1864, std.dev.: 0.0092)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -18.99% (0.3576 => 0.2897, std.dev.: 0.0011)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -17.98% (0.1518 => 0.1245, std.dev.: 0.0017)
  MultiSource/Applications/lua/lua: -17.47% (5.3200 => 4.3906, std.dev.: 0.0290)
  MultiSource/Applications/hbd/hbd: -17.19% (2.0193 => 1.6721, std.dev.: 0.0141)
  MultiSource/Applications/hexxagon/hexxagon: -15.94% (1.3285 => 1.1168, std.dev.: 0.0101)
  MultiSource/Benchmarks/Olden/em3d/em3d: -15.25% (0.2367 => 0.2006, std.dev.: 0.0019)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -13.56% (1.3985 => 1.2089, std.dev.: 0.0159)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -13.07% (0.0773 => 0.0672, std.dev.: 0.0008)
  MultiSource/Applications/sgefa/sgefa: -11.98% (0.4809 => 0.4233, std.dev.: 0.0010)
  MultiSource/Applications/JM/ldecod/ldecod: -11.95% (8.6720 => 7.6360, std.dev.: 0.0229)
  MultiSource/Applications/lambda-0_1_3/lambda: -11.89% (0.9461 => 0.8336, std.dev.: 0.0089)
  MultiSource/Applications/ClamAV/clamscan: -11.09% (19.4145 => 17.2608, std.dev.: 0.0453)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -9.79% (0.3655 => 0.3297, std.dev.: 0.0040)
  MultiSource/Applications/sqlite3/sqlite3: -9.38% (19.1635 => 17.3668, std.dev.: 0.0899)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -9.29% (1.1012 => 0.9989, std.dev.: 0.0068)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -8.85% (0.1141 => 0.1040, std.dev.: 0.0005)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -7.86% (0.1947 => 0.1794, std.dev.: 0.0018)
  MultiSource/Applications/aha/aha: -7.42% (0.1401 => 0.1297, std.dev.: 0.0018)
  MultiSource/Applications/kimwitu++/kc: -7.00% (21.0770 => 19.6021, std.dev.: 0.0324)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.85% (1.7461 => 1.6265, std.dev.: 0.0098)
  MultiSource/Applications/siod/siod: -6.36% (2.7150 => 2.5423, std.dev.: 0.0014)
  MultiSource/Applications/JM/lencod/lencod: -6.04% (18.5029 => 17.3851, std.dev.: 0.0583)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.78% (6.1631 => 5.8066, std.dev.: 0.0229)
  MultiSource/Benchmarks/Olden/bh/bh: -5.44% (0.3603 => 0.3407, std.dev.: 0.0049)
  MultiSource/Applications/minisat/minisat: -5.33% (0.8278 => 0.7837, std.dev.: 0.0057)
  MultiSource/Applications/oggenc/oggenc: -5.24% (6.1121 => 5.7920, std.dev.: 0.0069)
  MultiSource/Applications/Burg/burg: -5.17% (1.5733 => 1.4920, std.dev.: 0.0095)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -4.51% (5.3476 => 5.1066, std.dev.: 0.0145)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -4.15% (0.2432 => 0.2331, std.dev.: 0.0007)
  MultiSource/Applications/lemon/lemon: -4.14% (1.2976 => 1.2439, std.dev.: 0.0102)
  MultiSource/Applications/SPASS/SPASS: -3.82% (17.9111 => 17.2270, std.dev.: 0.0595)
  MultiSource/Benchmarks/nbench/nbench: -3.66% (1.3677 => 1.3177, std.dev.: 0.0042)
  MultiSource/Benchmarks/Bullet/bullet: -3.39% (37.4863 => 36.2139, std.dev.: 0.2994)
  MultiSource/Benchmarks/McCat/18-imp/imp: -3.32% (0.4153 => 0.4015, std.dev.: 0.0009)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -2.98% (1.3780 => 1.3370, std.dev.: 0.0023)
  MultiSource/Benchmarks/McCat/09-vor/vor: -2.92% (0.3670 => 0.3563, std.dev.: 0.0028)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.74% (1.5376 => 1.4955, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.62% (0.7189 => 0.7001, std.dev.: 0.0034)
  MultiSource/Applications/spiff/spiff: -2.24% (0.9578 => 0.9363, std.dev.: 0.0082)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.22% (10.3031 => 10.0747, std.dev.: 0.0074)
  MultiSource/Benchmarks/McCat/05-eks/eks: -2.15% (0.5634 => 0.5513, std.dev.: 0.0018)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.70% (0.7487 => 0.7360, std.dev.: 0.0047)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.16% (1.6686 => 1.6492, std.dev.: 0.0050)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -45.21% (0.0292 => 0.0160, std.dev.: 0.0045)
  MultiSource/Applications/lemon/lemon: -39.19% (1.4194 => 0.8631, std.dev.: 0.0206)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -39.09% (0.0816 => 0.0497, std.dev.: 0.0038)
  MultiSource/Benchmarks/Olden/mst/mst: -37.16% (0.2134 => 0.1341, std.dev.: 0.0008)
  MultiSource/Benchmarks/MallocBench/gs/gs: -33.14% (0.1189 => 0.0795, std.dev.: 0.0017)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.44% (2.1022 => 1.4202, std.dev.: 0.0031)
  MultiSource/Benchmarks/Olden/bisort/bisort: -29.45% (0.9545 => 0.6734, std.dev.: 0.0106)
  MultiSource/Applications/viterbi/viterbi: -27.16% (3.4923 => 2.5439, std.dev.: 0.0224)
  MultiSource/Applications/JM/ldecod/ldecod: -25.26% (0.0859 => 0.0642, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.69% (6.9552 => 5.2380, std.dev.: 0.3075)
  MultiSource/Applications/minisat/minisat: -22.43% (8.0162 => 6.2185, std.dev.: 0.0506)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -21.67% (1.0962 => 0.8587, std.dev.: 0.0018)
  SingleSource/Benchmarks/Misc/perlin: -21.44% (4.5989 => 3.6131, std.dev.: 0.0018)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -19.46% (0.0884 => 0.0712, std.dev.: 0.0029)
  MultiSource/Applications/obsequi/Obsequi: -18.84% (2.6081 => 2.1168, std.dev.: 0.0658)
  SingleSource/Benchmarks/Misc/mandel: -14.16% (1.1996 => 1.0297, std.dev.: 0.0157)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.48% (0.3557 => 0.3113, std.dev.: 0.0083)
  MultiSource/Applications/SPASS/SPASS: -10.40% (9.2220 => 8.2632, std.dev.: 0.0848)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -9.38% (0.5173 => 0.4688, std.dev.: 0.0098)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -7.85% (0.1542 => 0.1421, std.dev.: 0.0039)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -6.99% (0.2047 => 0.1904, std.dev.: 0.0006)
  MultiSource/Benchmarks/Olden/health/health: -6.97% (0.3556 => 0.3308, std.dev.: 0.0047)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.24% (1.3148 => 1.2327, std.dev.: 0.0251)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -5.22% (0.3773 => 0.3576, std.dev.: 0.0041)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.13% (1.7207 => 1.6325, std.dev.: 0.0139)
  MultiSource/Applications/lua/lua: -4.78% (31.0707 => 29.5870, std.dev.: 0.0506)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -4.63% (0.2854 => 0.2722, std.dev.: 0.0030)
  SingleSource/Benchmarks/Misc/fbench: -4.61% (4.9602 => 4.7317, std.dev.: 0.0167)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.42% (1.1024 => 1.0537, std.dev.: 0.0013)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.38% (1.1032 => 1.0549, std.dev.: 0.0022)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.34% (0.7355 => 0.7036, std.dev.: 0.0033)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.23% (0.3479 => 0.3332, std.dev.: 0.0009)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.18% (2.7049 => 2.5917, std.dev.: 0.0325)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.98% (2.8052 => 2.6935, std.dev.: 0.0288)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.72% (21.6864 => 20.8799, std.dev.: 0.2436)
  MultiSource/Benchmarks/Olden/bh/bh: -3.14% (2.4879 => 2.4097, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.04% (6.1482 => 5.9612, std.dev.: 0.0254)
  SingleSource/Benchmarks/Stanford/FloatMM: -2.93% (0.7806 => 0.7577, std.dev.: 0.0040)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.61% (1.0964 => 1.0678, std.dev.: 0.0044)
  MultiSource/Applications/sgefa/sgefa: -2.35% (1.4030 => 1.3700, std.dev.: 0.0008)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.33% (0.6480 => 0.6329, std.dev.: 0.0039)
  SingleSource/Benchmarks/Misc/lowercase: -2.11% (0.7849 => 0.7683, std.dev.: 0.0025)
  SingleSource/Benchmarks/Misc/oourafft: -2.08% (3.7891 => 3.7104, std.dev.: 0.0229)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.01% (34.8438 => 34.1426, std.dev.: 0.0464)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.68% (1.2012 => 1.1810, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/lists: -1.53% (16.5294 => 16.2762, std.dev.: 0.0695)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: -1.45% (4.7360 => 4.6671, std.dev.: 0.0219)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.38% (2.9568 => 2.9159, std.dev.: 0.0127)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.59% (0.1378 => 0.1301, std.dev.: 0.0019)

Report Time: 0.87s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130819/ff56891a/attachment.html>


More information about the llvm-testresults mailing list