[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jul 24 23:59:09 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13737?compare_to=13733&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13737, Order: 187103, Start Time: 2013-07-25 05:17:14, End Time: 2013-07-25 07:00:46
      To: 13733, Order: 187097, Start Time: 2013-07-25 03:09:30, End Time: 2013-07-25 04:56:40
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 5 (4 on baseline)
Performance Improvements: 20 (88 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1082 (1015 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/obsequi/Obsequi: 7.42% (2.2455 => 2.4121, std.dev.: 0.0012)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 3.08% (2.3538 => 2.4262, std.dev.: 0.0265)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 2.57% (2.5434 => 2.6087, std.dev.: 0.0132)
  SingleSource/Benchmarks/Stanford/FloatMM: 1.61% (0.7999 => 0.8128, std.dev.: 0.0036)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.59% (39.6875 => 40.3195, std.dev.: 0.2230)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -3.69% (0.2977 => 0.2867, std.dev.: 0.0039)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.89% (0.9603 => 0.9325, std.dev.: 0.0070)
  MultiSource/Applications/hbd/hbd: -2.83% (1.6836 => 1.6359, std.dev.: 0.0091)
  MultiSource/Benchmarks/McCat/18-imp/imp: -2.48% (0.4076 => 0.3975, std.dev.: 0.0006)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -2.26% (1.5506 => 1.5156, std.dev.: 0.0053)
  MultiSource/Benchmarks/MallocBench/gs/gs: -2.17% (4.7876 => 4.6835, std.dev.: 0.0113)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.04% (1.1969 => 1.1725, std.dev.: 0.0088)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -1.77% (10.2047 => 10.0236, std.dev.: 0.0075)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.65% (5.8393 => 5.7430, std.dev.: 0.0111)
  MultiSource/Applications/JM/ldecod/ldecod: -1.51% (7.7115 => 7.5949, std.dev.: 0.0258)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -1.47% (0.7029 => 0.6926, std.dev.: 0.0019)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -1.31% (1.1405 => 1.1256, std.dev.: 0.0048)
  MultiSource/Applications/lemon/lemon: -1.20% (1.2463 => 1.2314, std.dev.: 0.0057)
  MultiSource/Applications/oggenc/oggenc: -1.13% (5.7551 => 5.6902, std.dev.: 0.0159)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -11.54% (2.3854 => 2.1101, std.dev.: 0.0004)
  MultiSource/Applications/spiff/spiff: -3.91% (2.8576 => 2.7459, std.dev.: 0.0209)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: -3.83% (41.7829 => 40.1831, std.dev.: 0.4580)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.20% (37.9299 => 36.7172, std.dev.: 0.3987)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.03% (4.2335 => 4.1474, std.dev.: 0.0141)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -1.76% (1.2857 => 1.2631, std.dev.: 0.0031)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.14% (0.1312 => 0.1327, std.dev.: 0.0002)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 24.92% (1.5030 => 1.8775, std.dev.: 0.0072)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.13% (0.7806 => 0.8128, std.dev.: 0.0036)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 3.36% (2.5240 => 2.6087, std.dev.: 0.0132)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 3.04% (1.4327 => 1.4762, std.dev.: 0.0042)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -37.59% (0.2237 => 0.1396, std.dev.: 0.0026)
  MultiSource/Benchmarks/Olden/bisort/bisort: -32.93% (0.1072 => 0.0719, std.dev.: 0.0003)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: -29.38% (0.0439 => 0.0310, std.dev.: 0.0028)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -26.21% (0.1114 => 0.0822, std.dev.: 0.0018)
  MultiSource/Benchmarks/Olden/tsp/tsp: -25.80% (0.1818 => 0.1349, std.dev.: 0.0015)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -24.00% (0.0675 => 0.0513, std.dev.: 0.0007)
  MultiSource/Benchmarks/MallocBench/gs/gs: -23.14% (6.0938 => 4.6835, std.dev.: 0.0113)
  MultiSource/Benchmarks/Olden/health/health: -21.63% (0.1993 => 0.1562, std.dev.: 0.0012)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -21.57% (1.5228 => 1.1944, std.dev.: 0.0074)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -19.49% (0.3576 => 0.2879, std.dev.: 0.0019)
  MultiSource/Applications/obsequi/Obsequi: -19.26% (1.4685 => 1.1857, std.dev.: 0.0096)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -19.24% (0.1518 => 0.1226, std.dev.: 0.0026)
  MultiSource/Applications/hbd/hbd: -18.99% (2.0193 => 1.6359, std.dev.: 0.0091)
  MultiSource/Applications/lua/lua: -18.22% (5.3200 => 4.3509, std.dev.: 0.0216)
  MultiSource/Applications/hexxagon/hexxagon: -16.24% (1.3285 => 1.1128, std.dev.: 0.0081)
  MultiSource/Benchmarks/Olden/em3d/em3d: -15.12% (0.2367 => 0.2009, std.dev.: 0.0015)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -14.97% (1.3985 => 1.1892, std.dev.: 0.0065)
  MultiSource/Applications/sgefa/sgefa: -13.77% (0.4809 => 0.4147, std.dev.: 0.0044)
  MultiSource/Applications/ClamAV/clamscan: -12.71% (19.4145 => 16.9475, std.dev.: 0.0588)
  MultiSource/Applications/lambda-0_1_3/lambda: -12.63% (0.9461 => 0.8266, std.dev.: 0.0012)
  MultiSource/Applications/JM/ldecod/ldecod: -12.42% (8.6720 => 7.5949, std.dev.: 0.0258)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -11.98% (0.1870 => 0.1646, std.dev.: 0.0005)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -11.27% (0.3655 => 0.3243, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -10.31% (1.7797 => 1.5963, std.dev.: 0.0628)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -10.23% (1.1012 => 0.9885, std.dev.: 0.0109)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -9.64% (0.1141 => 0.1031, std.dev.: 0.0015)
  MultiSource/Applications/sqlite3/sqlite3: -9.61% (19.1635 => 17.3220, std.dev.: 0.1056)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -9.30% (0.1947 => 0.1766, std.dev.: 0.0032)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -9.05% (0.3073 => 0.2795, std.dev.: 0.0011)
  MultiSource/Applications/aha/aha: -8.71% (0.1401 => 0.1279, std.dev.: 0.0011)
  MultiSource/Applications/kimwitu++/kc: -8.08% (21.0770 => 19.3743, std.dev.: 0.0810)
  MultiSource/Benchmarks/Olden/mst/mst: -7.91% (0.1454 => 0.1339, std.dev.: 0.0020)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.64% (1.7461 => 1.6127, std.dev.: 0.0106)
  MultiSource/Applications/Burg/burg: -7.51% (1.5733 => 1.4552, std.dev.: 0.0022)
  MultiSource/Applications/siod/siod: -7.11% (2.7150 => 2.5220, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -7.08% (1.5144 => 1.4072, std.dev.: 0.0374)
  MultiSource/Benchmarks/Olden/bh/bh: -7.08% (0.3603 => 0.3348, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -7.01% (1.5345 => 1.4269, std.dev.: 0.0407)
  MultiSource/Applications/JM/lencod/lencod: -6.96% (18.5029 => 17.2143, std.dev.: 0.0602)
  MultiSource/Applications/oggenc/oggenc: -6.90% (6.1121 => 5.6902, std.dev.: 0.0159)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.82% (6.1631 => 5.7430, std.dev.: 0.0111)
  MultiSource/Applications/minisat/minisat: -6.68% (0.8278 => 0.7725, std.dev.: 0.0075)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -6.66% (0.2432 => 0.2270, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -6.03% (1.4794 => 1.3902, std.dev.: 0.0276)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -5.38% (5.3476 => 5.0600, std.dev.: 0.0382)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -5.19% (1.5376 => 1.4578, std.dev.: 0.0035)
  MultiSource/Applications/lemon/lemon: -5.10% (1.2976 => 1.2314, std.dev.: 0.0057)
  MultiSource/Applications/SPASS/SPASS: -4.79% (17.9111 => 17.0538, std.dev.: 0.0863)
  MultiSource/Benchmarks/nbench/nbench: -4.59% (1.3677 => 1.3049, std.dev.: 0.0050)
  MultiSource/Benchmarks/McCat/18-imp/imp: -4.29% (0.4153 => 0.3975, std.dev.: 0.0006)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -4.19% (1.3780 => 1.3203, std.dev.: 0.0061)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -4.17% (5.2851 => 5.0647, std.dev.: 0.0050)
  MultiSource/Benchmarks/McCat/09-vor/vor: -3.65% (0.3670 => 0.3536, std.dev.: 0.0044)
  MultiSource/Benchmarks/McCat/05-eks/eks: -3.25% (0.5634 => 0.5451, std.dev.: 0.0042)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -3.03% (1.6686 => 1.6180, std.dev.: 0.0183)
  MultiSource/Benchmarks/Prolangs-C/TimberWolfMC/timberwolfmc: -2.71% (10.3031 => 10.0236, std.dev.: 0.0075)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -2.58% (0.7487 => 0.7294, std.dev.: 0.0020)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: -2.50% (1.5544 => 1.5156, std.dev.: 0.0053)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -2.43% (15.5498 => 15.1714, std.dev.: 0.1242)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -1.91% (0.7189 => 0.7052, std.dev.: 0.0048)
  MultiSource/Applications/treecc/treecc: -1.82% (2.3651 => 2.3220, std.dev.: 0.0157)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.16% (0.9941 => 0.9826, std.dev.: 0.0007)
  MultiSource/Applications/d/make_dparser: -1.09% (3.7722 => 3.7312, std.dev.: 0.0035)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -38.00% (0.2134 => 0.1323, std.dev.: 0.0004)
  MultiSource/Applications/lemon/lemon: -37.61% (1.4194 => 0.8856, std.dev.: 0.0150)
  MultiSource/Benchmarks/MallocBench/gs/gs: -31.62% (0.1189 => 0.0813, std.dev.: 0.0012)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -29.77% (1.0962 => 0.7699, std.dev.: 0.0512)
  MultiSource/Benchmarks/Olden/bisort/bisort: -29.57% (0.9545 => 0.6723, std.dev.: 0.0105)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -28.55% (0.0816 => 0.0583, std.dev.: 0.0019)
  MultiSource/Applications/JM/ldecod/ldecod: -25.96% (0.0859 => 0.0636, std.dev.: 0.0004)
  MultiSource/Applications/minisat/minisat: -23.24% (8.0162 => 6.1535, std.dev.: 0.0109)
  MultiSource/Applications/SPASS/SPASS: -12.60% (9.2220 => 8.0604, std.dev.: 0.2469)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -11.47% (2.6992 => 2.3896, std.dev.: 0.0361)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -9.95% (0.3557 => 0.3203, std.dev.: 0.0016)
  MultiSource/Applications/obsequi/Obsequi: -7.52% (2.6081 => 2.4121, std.dev.: 0.0012)
  MultiSource/Benchmarks/Olden/tsp/tsp: -6.75% (1.5339 => 1.4304, std.dev.: 0.0145)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -5.80% (1.3148 => 1.2386, std.dev.: 0.0023)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.13% (3.5791 => 3.3954, std.dev.: 0.0543)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -5.05% (0.5173 => 0.4912, std.dev.: 0.0012)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -4.74% (0.2849 => 0.2714, std.dev.: 0.0046)
  MultiSource/Benchmarks/Olden/health/health: -3.85% (0.3556 => 0.3419, std.dev.: 0.0009)
  MultiSource/Benchmarks/Olden/bh/bh: -3.24% (2.4879 => 2.4074, std.dev.: 0.0170)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -3.13% (0.3479 => 0.3370, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.93% (2.8052 => 2.7229, std.dev.: 0.0200)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.71% (41.0210 => 40.3195, std.dev.: 0.2230)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.41% (2.9962 => 2.9539, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -1.40% (4.2062 => 4.1474, std.dev.: 0.0141)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -1.36% (1.2558 => 1.2387, std.dev.: 0.0065)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.70% (0.1378 => 0.1327, std.dev.: 0.0002)

Report Time: 0.63s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130725/1aeece3f/attachment.html>


More information about the llvm-testresults mailing list