[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results
llvm-testresults at cs.uiuc.edu
llvm-testresults at cs.uiuc.edu
Mon May 27 18:40:37 PDT 2013
http://llvm.org/perf/db_default/v4/nts/11785?compare_to=11779&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13
Comparing:
Run: 11785, Order: 182747, Start Time: 2013-05-28 00:00:23, End Time: 2013-05-28 01:41:09
To: 11779, Order: 182741, Start Time: 2013-05-27 18:08:04, End Time: 2013-05-27 19:48:46
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16
===============
Tests Summary
===============
Performance Regressions: 16 (11 on baseline)
Performance Improvements: 5 (122 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1086 (974 on baseline)
Total Tests: 1108
===========================
Run-Over-Run Changes Detail
===========================
Performance Regressions - Compile Time
--------------------------------------
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.75% (0.9192 => 0.9353, std.dev.: 0.0062)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.48% (1.1628 => 1.1800, std.dev.: 0.0049)
Performance Regressions - Execution Time
----------------------------------------
MultiSource/Applications/ALAC/decode/alacconvert-decode: 88.03% (0.0117 => 0.0220, std.dev.: 0.0000)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 21.10% (0.0474 => 0.0574)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 13.61% (0.1866 => 0.2120, std.dev.: 0.0003)
SingleSource/Benchmarks/Misc/salsa20: 12.86% (7.9656 => 8.9898, std.dev.: 0.0060)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 8.04% (0.3023 => 0.3266, std.dev.: 0.0002)
SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 5.31% (2.3223 => 2.4457, std.dev.: 0.0200)
MultiSource/Benchmarks/Olden/em3d/em3d: 4.04% (4.9679 => 5.1685, std.dev.: 0.0027)
MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.32% (2.6030 => 2.6895, std.dev.: 0.0252)
SingleSource/Benchmarks/Misc/flops: 3.30% (9.5383 => 9.8534, std.dev.: 0.0008)
SingleSource/Benchmarks/Misc/fp-convert: 2.84% (7.8389 => 8.0618, std.dev.: 0.0105)
SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.24% (1.0453 => 1.0687, std.dev.: 0.0049)
SingleSource/Benchmarks/McGill/queens: 2.20% (1.6398 => 1.6759, std.dev.: 0.0018)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.79% (5.6892 => 5.7910, std.dev.: 0.0080)
MultiSource/Applications/siod/siod: 1.01% (3.7157 => 3.7534, std.dev.: 0.0138)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -2.32% (0.6851 => 0.6692, std.dev.: 0.0016)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.18% (25.7241 => 25.4217, std.dev.: 0.0293)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -1.13% (0.8827 => 0.8727, std.dev.: 0.0032)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.10% (5.6325 => 5.5708, std.dev.: 0.0151)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.05% (1.9311 => 1.9108, std.dev.: 0.0027)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: 1.05% (0.1424 => 0.1439, std.dev.: 0.0023)
================================
Run-Over-Baseline Changes Detail
================================
Performance Regressions - Execution Time
----------------------------------------
SingleSource/Benchmarks/Misc/pi: 31.26% (1.8318 => 2.4045, std.dev.: 0.0692)
MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 25.05% (0.0459 => 0.0574)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: 12.77% (0.1880 => 0.2120, std.dev.: 0.0003)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 10.60% (0.9806 => 1.0845, std.dev.: 0.0044)
MultiSource/Benchmarks/Ptrdist/anagram/anagram: 4.93% (1.2224 => 1.2827, std.dev.: 0.0099)
MultiSource/Applications/lua/lua: 3.20% (28.2496 => 29.1541, std.dev.: 0.0257)
SingleSource/Benchmarks/Shootout/methcall: 2.89% (8.3425 => 8.5836, std.dev.: 0.0142)
SingleSource/Benchmarks/McGill/queens: 1.71% (1.6478 => 1.6759, std.dev.: 0.0018)
SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.61% (3.9713 => 4.0351, std.dev.: 0.0206)
MultiSource/Benchmarks/SciMark2-C/scimark2: 1.23% (88.2998 => 89.3815, std.dev.: 0.0269)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.13% (5.7264 => 5.7910, std.dev.: 0.0080)
Performance Improvements - Compile Time
---------------------------------------
MultiSource/Applications/viterbi/viterbi: -25.42% (0.2431 => 0.1813, std.dev.: 0.0018)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -18.56% (0.0803 => 0.0654, std.dev.: 0.0006)
SingleSource/Benchmarks/Misc/whetstone: -17.14% (0.1097 => 0.0909, std.dev.: 0.0009)
MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -14.67% (0.1322 => 0.1128, std.dev.: 0.0031)
SingleSource/UnitTests/Vector/constpool: -14.66% (10.3086 => 8.7977, std.dev.: 0.1705)
MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.22% (0.7918 => 0.6792, std.dev.: 0.0057)
MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.03% (0.1151 => 0.1001, std.dev.: 0.0010)
MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -12.33% (0.1646 => 0.1443, std.dev.: 0.0008)
MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -11.72% (0.1075 => 0.0949, std.dev.: 0.0007)
MultiSource/Applications/JM/lencod/lencod: -11.48% (18.9387 => 16.7648, std.dev.: 0.0726)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.06% (1.5932 => 1.4170, std.dev.: 0.0064)
SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.82% (0.2006 => 0.1789, std.dev.: 0.0010)
MultiSource/Applications/aha/aha: -10.38% (0.1407 => 0.1261, std.dev.: 0.0012)
MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -10.19% (5.1587 => 4.6332, std.dev.: 0.0137)
MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.96% (0.8025 => 0.7226, std.dev.: 0.0045)
MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -9.60% (0.1886 => 0.1705, std.dev.: 0.0027)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -9.32% (1.0314 => 0.9353, std.dev.: 0.0062)
MultiSource/Benchmarks/Prolangs-C/bison/mybison: -9.23% (1.7804 => 1.6161, std.dev.: 0.0064)
MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -8.87% (5.4314 => 4.9496, std.dev.: 0.0188)
MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.36% (0.1674 => 0.1534, std.dev.: 0.0030)
MultiSource/Applications/Burg/burg: -7.92% (1.5375 => 1.4157, std.dev.: 0.0050)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.53% (15.9860 => 14.7826, std.dev.: 0.0393)
MultiSource/Benchmarks/McCat/18-imp/imp: -7.48% (0.4199 => 0.3885, std.dev.: 0.0044)
MultiSource/Applications/lemon/lemon: -6.90% (1.3155 => 1.2247, std.dev.: 0.0005)
MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.90% (0.7381 => 0.6872, std.dev.: 0.0062)
MultiSource/Applications/oggenc/oggenc: -6.85% (5.9886 => 5.5783, std.dev.: 0.0313)
MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.51% (2.0439 => 1.9108, std.dev.: 0.0027)
MultiSource/Benchmarks/Olden/em3d/em3d: -6.24% (0.2117 => 0.1985, std.dev.: 0.0012)
MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.17% (0.2416 => 0.2267, std.dev.: 0.0038)
MultiSource/Benchmarks/McCat/09-vor/vor: -6.15% (0.3723 => 0.3494, std.dev.: 0.0042)
MultiSource/Applications/SIBsim4/SIBsim4: -6.12% (1.6793 => 1.5765, std.dev.: 0.0075)
MultiSource/Benchmarks/7zip/7zip-benchmark: -6.03% (51.0211 => 47.9434, std.dev.: 0.1418)
MultiSource/Benchmarks/Ptrdist/ks/ks: -5.83% (0.1853 => 0.1745, std.dev.: 0.0015)
MultiSource/Applications/kimwitu++/kc: -5.79% (20.1855 => 19.0158, std.dev.: 0.0313)
MultiSource/Applications/lambda-0_1_3/lambda: -5.41% (0.8649 => 0.8181, std.dev.: 0.0043)
SingleSource/Benchmarks/Shootout-C++/strcat: -5.20% (0.2309 => 0.2189, std.dev.: 0.0010)
MultiSource/Applications/SPASS/SPASS: -5.08% (17.6379 => 16.7427, std.dev.: 0.0346)
MultiSource/Benchmarks/McCat/05-eks/eks: -5.00% (0.5698 => 0.5413, std.dev.: 0.0025)
SingleSource/Benchmarks/Shootout-C++/objinst: -4.96% (0.2397 => 0.2278, std.dev.: 0.0019)
SingleSource/Benchmarks/Shootout-C++/ackermann: -4.74% (0.2151 => 0.2049, std.dev.: 0.0016)
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.69% (0.2753 => 0.2624, std.dev.: 0.0013)
MultiSource/Benchmarks/Ptrdist/bc/bc: -4.58% (1.3686 => 1.3059, std.dev.: 0.0036)
MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.49% (0.3853 => 0.3680, std.dev.: 0.0001)
SingleSource/UnitTests/Vectorizer/gcc-loops: -4.49% (0.5748 => 0.5490, std.dev.: 0.0029)
MultiSource/Benchmarks/Prolangs-C/compiler/compiler: -4.12% (0.4030 => 0.3864, std.dev.: 0.0028)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.00% (7.7211 => 7.4120, std.dev.: 0.0159)
SingleSource/Benchmarks/Linpack/linpack-pc: -3.98% (0.2738 => 0.2629, std.dev.: 0.0013)
MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -3.77% (10.1602 => 9.7769, std.dev.: 0.0437)
MultiSource/Applications/ALAC/decode/alacconvert-decode: -3.58% (1.1954 => 1.1526, std.dev.: 0.0122)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -3.58% (0.2961 => 0.2855, std.dev.: 0.0005)
SingleSource/Benchmarks/Shootout-C++/ary2: -3.56% (0.2951 => 0.2846, std.dev.: 0.0015)
SingleSource/Benchmarks/Shootout-C++/hash: -3.45% (0.4554 => 0.4397, std.dev.: 0.0014)
MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: -3.44% (0.4861 => 0.4694, std.dev.: 0.0010)
MultiSource/Applications/ClamAV/clamscan: -3.36% (17.3229 => 16.7412, std.dev.: 0.0625)
MultiSource/Applications/ALAC/encode/alacconvert-encode: -3.16% (1.2006 => 1.1627, std.dev.: 0.0128)
MultiSource/Benchmarks/Olden/bh/bh: -3.15% (0.3429 => 0.3321, std.dev.: 0.0023)
MultiSource/Benchmarks/Prolangs-C/football/football: -3.07% (1.0292 => 0.9976, std.dev.: 0.0065)
MultiSource/Benchmarks/FreeBench/pifft/pifft: -2.89% (0.9957 => 0.9669, std.dev.: 0.0005)
SingleSource/Benchmarks/Shootout-C++/spellcheck: -2.70% (0.4293 => 0.4177, std.dev.: 0.0011)
MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.70% (0.8969 => 0.8727, std.dev.: 0.0032)
MultiSource/Benchmarks/mafft/pairlocalalign: -2.65% (10.7257 => 10.4410, std.dev.: 0.0552)
MultiSource/Benchmarks/MallocBench/gs/gs: -2.52% (4.7091 => 4.5903, std.dev.: 0.0344)
MultiSource/Applications/sqlite3/sqlite3: -2.35% (16.9719 => 16.5733, std.dev.: 0.0784)
MultiSource/Applications/d/make_dparser: -2.05% (3.7330 => 3.6565, std.dev.: 0.0143)
MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.98% (25.9348 => 25.4217, std.dev.: 0.0293)
MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.98% (0.7334 => 0.7189, std.dev.: 0.0011)
MultiSource/Applications/minisat/minisat: -1.76% (0.7844 => 0.7706, std.dev.: 0.0007)
MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.66% (1.1193 => 1.1007, std.dev.: 0.0069)
MultiSource/Applications/spiff/spiff: -1.43% (0.9365 => 0.9231, std.dev.: 0.0037)
MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.43% (1.8435 => 1.8172, std.dev.: 0.0099)
MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.27% (5.6424 => 5.5708, std.dev.: 0.0151)
MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.23% (1.7006 => 1.6796, std.dev.: 0.0055)
MultiSource/Benchmarks/nbench/nbench: -1.18% (1.2926 => 1.2774, std.dev.: 0.0024)
MultiSource/Benchmarks/mediabench/gsm/toast/toast: -1.13% (1.4253 => 1.4092, std.dev.: 0.0012)
MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.06% (1.4771 => 1.4614, std.dev.: 0.0004)
MultiSource/Applications/lua/lua: -1.00% (4.3359 => 4.2925, std.dev.: 0.0149)
Performance Improvements - Execution Time
-----------------------------------------
SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.40% (1.2911 => 0.7308, std.dev.: 0.0035)
MultiSource/Benchmarks/Olden/mst/mst: -36.49% (0.2099 => 0.1333, std.dev.: 0.0002)
MultiSource/Applications/lemon/lemon: -31.61% (1.3499 => 0.9232, std.dev.: 0.0085)
MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.66% (4.4050 => 3.2308, std.dev.: 0.0038)
MultiSource/Benchmarks/Olden/bisort/bisort: -21.59% (0.8606 => 0.6748, std.dev.: 0.0004)
MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.33% (6.2328 => 5.0283, std.dev.: 0.0175)
SingleSource/UnitTests/Vectorizer/gcc-loops: -16.30% (25.3677 => 21.2326, std.dev.: 0.2109)
SingleSource/Benchmarks/Shootout-C++/heapsort: -16.15% (3.5000 => 2.9349, std.dev.: 0.0076)
MultiSource/Benchmarks/Ptrdist/ft/ft: -15.92% (1.0251 => 0.8619, std.dev.: 0.0120)
MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -15.43% (0.0920 => 0.0778, std.dev.: 0.0043)
MultiSource/Applications/minisat/minisat: -15.27% (7.3703 => 6.2452, std.dev.: 0.0119)
SingleSource/Benchmarks/Misc/salsa20: -13.06% (10.3398 => 8.9898, std.dev.: 0.0060)
MultiSource/Applications/SIBsim4/SIBsim4: -12.27% (3.5327 => 3.0992, std.dev.: 0.0556)
MultiSource/Benchmarks/7zip/7zip-benchmark: -11.32% (10.2418 => 9.0823, std.dev.: 0.1583)
MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -10.64% (0.3702 => 0.3308, std.dev.: 0.0129)
SingleSource/Benchmarks/Shootout-C++/hash: -9.14% (0.7941 => 0.7215, std.dev.: 0.0278)
MultiSource/Applications/SPASS/SPASS: -8.42% (8.8720 => 8.1252, std.dev.: 0.0488)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.27% (3.2030 => 2.9701, std.dev.: 0.0287)
MultiSource/Benchmarks/nbench/nbench: -7.08% (22.3004 => 20.7224, std.dev.: 0.5672)
MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.84% (0.1945 => 0.1812, std.dev.: 0.0010)
MultiSource/Benchmarks/Fhourstones/fhourstones: -6.64% (1.3530 => 1.2632, std.dev.: 0.0332)
MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.34% (0.2777 => 0.2601, std.dev.: 0.0036)
MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.61% (4.5717 => 4.3152, std.dev.: 0.0001)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -5.36% (39.1740 => 37.0730, std.dev.: 0.3772)
MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -5.11% (2.5366 => 2.4071, std.dev.: 0.0152)
MultiSource/Benchmarks/FreeBench/distray/distray: -4.80% (0.2332 => 0.2220, std.dev.: 0.0040)
SingleSource/Benchmarks/Shootout/ary3: -3.96% (6.0122 => 5.7739, std.dev.: 0.0207)
MultiSource/Benchmarks/BitBench/five11/five11: -3.79% (5.7342 => 5.5169, std.dev.: 0.0834)
MultiSource/Applications/sqlite3/sqlite3: -3.74% (4.6358 => 4.4624, std.dev.: 0.0600)
SingleSource/Benchmarks/Misc/flops: -3.56% (10.2170 => 9.8534, std.dev.: 0.0008)
MultiSource/Benchmarks/Olden/tsp/tsp: -3.53% (1.6613 => 1.6027, std.dev.: 0.0017)
SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.43% (2.8537 => 2.7557, std.dev.: 0.0147)
SingleSource/Benchmarks/Misc/flops-7: -3.37% (1.7987 => 1.7381, std.dev.: 0.0095)
SingleSource/Benchmarks/Shootout/heapsort: -3.09% (2.9988 => 2.9061, std.dev.: 0.0051)
SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -3.01% (62.4345 => 60.5543, std.dev.: 0.2450)
MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -2.75% (1.6679 => 1.6220, std.dev.: 0.0097)
MultiSource/Benchmarks/Bullet/bullet: -2.58% (7.1938 => 7.0083, std.dev.: 0.0351)
MultiSource/Benchmarks/llubenchmark/llu: -2.19% (2.0425 => 1.9977, std.dev.: 0.0029)
SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.86% (4.6452 => 4.5586, std.dev.: 0.0139)
MultiSource/Benchmarks/Ptrdist/bc/bc: -1.66% (1.1291 => 1.1104, std.dev.: 0.0004)
MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.53% (2.5408 => 2.5019, std.dev.: 0.0031)
MultiSource/Benchmarks/NPB-serial/is/is: -1.36% (12.1841 => 12.0180, std.dev.: 0.0603)
SingleSource/Benchmarks/Misc/ReedSolomon: -1.21% (8.5243 => 8.4215, std.dev.: 0.0034)
MultiSource/Benchmarks/Olden/bh/bh: -1.08% (2.4435 => 2.4172, std.dev.: 0.0031)
MultiSource/Benchmarks/Ptrdist/ks/ks: -1.04% (1.6105 => 1.5937, std.dev.: 0.0035)
MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: -1.01% (1.7925 => 1.7744, std.dev.: 0.0052)
Existing Failures - Execution Time
----------------------------------
MultiSource/Applications/ClamAV/clamscan
MultiSource/Applications/ClamAV/clamscan: -0.14% (0.1441 => 0.1439, std.dev.: 0.0023)
Report Time: 0.64s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130527/4bda25cc/attachment.html>
More information about the llvm-testresults
mailing list