[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri May 24 23:24:36 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11733?compare_to=11729&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 11733, Order: 182708, Start Time: 2013-05-25 04:42:09, End Time: 2013-05-25 06:25:05
      To: 11729, Order: 182700, Start Time: 2013-05-25 02:29:36, End Time: 2013-05-25 04:19:41
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 6 (7 on baseline)
Performance Improvements: 69 (63 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1032 (1037 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.23% (1.4747 => 1.8762, std.dev.: 0.0030)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.53% (0.9792 => 1.0921, std.dev.: 0.0226)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 6.91% (0.3298 => 0.3526, std.dev.: 0.0047)
  MultiSource/Applications/lua/lua: 6.12% (27.9564 => 29.6675, std.dev.: 0.3729)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.47% (5.1874 => 5.3155, std.dev.: 0.0150)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 1.36% (88.2582 => 89.4622, std.dev.: 0.0376)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2002-10-09-ArrayResolution: -46.43% (0.0308 => 0.0165, std.dev.: 0.0003)
  SingleSource/UnitTests/2002-12-13-MishaTest: -42.03% (0.0345 => 0.0200, std.dev.: 0.0001)
  SingleSource/UnitTests/vla: -41.97% (0.0772 => 0.0448, std.dev.: 0.0007)
  SingleSource/Regression/C++/EH/throw_rethrow_test: -41.11% (0.0433 => 0.0255, std.dev.: 0.0006)
  SingleSource/Benchmarks/Dhrystone/dry: -36.23% (0.0944 => 0.0602, std.dev.: 0.0004)
  SingleSource/Benchmarks/Dhrystone/fldry: -32.56% (0.0860 => 0.0580, std.dev.: 0.0009)
  SingleSource/UnitTests/2003-05-31-CastToBool: -32.45% (0.0376 => 0.0254, std.dev.: 0.0003)
  SingleSource/Regression/C/uint64_to_float: -29.77% (0.0598 => 0.0420, std.dev.: 0.0006)
  SingleSource/Regression/C/DuffsDevice: -29.30% (0.0372 => 0.0263, std.dev.: 0.0004)
  SingleSource/Regression/C++/EH/function_try_block: -26.25% (0.0419 => 0.0309, std.dev.: 0.0008)
  SingleSource/Regression/C/sumarray: -23.84% (0.0474 => 0.0361, std.dev.: 0.0005)
  SingleSource/Regression/C/sumarraymalloc: -23.36% (0.0565 => 0.0433, std.dev.: 0.0004)
  MultiSource/Applications/sqlite3/sqlite3: -9.32% (18.4179 => 16.7016, std.dev.: 0.3847)
  MultiSource/Applications/viterbi/viterbi: -9.30% (0.1979 => 0.1795, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -8.74% (0.2311 => 0.2109, std.dev.: 0.0048)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -7.85% (52.3766 => 48.2653, std.dev.: 0.1063)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -6.94% (1.8064 => 1.6810, std.dev.: 0.0046)
  SingleSource/Benchmarks/Shootout-C++/hash: -6.58% (0.4698 => 0.4389, std.dev.: 0.0114)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.08% (1.6813 => 1.5790, std.dev.: 0.0129)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.90% (0.2407 => 0.2265, std.dev.: 0.0002)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -5.86% (27.1183 => 25.5286, std.dev.: 0.0120)
  MultiSource/Benchmarks/Prolangs-C++/employ/employ: -5.63% (0.3675 => 0.3468, std.dev.: 0.0003)
  SingleSource/Regression/C++/ofstream_ctor: -5.59% (0.2432 => 0.2296, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -5.29% (1.7142 => 1.6235, std.dev.: 0.0063)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -5.10% (0.2158 => 0.2048, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.91% (1.6909 => 1.6079, std.dev.: 0.0015)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -4.76% (0.4261 => 0.4058, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -4.73% (1.6566 => 1.5782, std.dev.: 0.0063)
  MultiSource/Benchmarks/Bullet/bullet: -4.54% (36.8224 => 35.1523, std.dev.: 0.0669)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -4.13% (1.6634 => 1.5947, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.12% (1.7782 => 1.7050, std.dev.: 0.0058)
  SingleSource/UnitTests/Vector/constpool: -3.99% (9.3325 => 8.9603, std.dev.: 0.1273)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.73% (0.5713 => 0.5500, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.47% (1.6176 => 1.5615, std.dev.: 0.0048)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -3.37% (0.3054 => 0.2951, std.dev.: 0.0007)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.92% (0.6995 => 0.6791, std.dev.: 0.0042)
  MultiSource/Benchmarks/PAQ8p/paq8p: -2.58% (2.5709 => 2.5046, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.47% (1.6188 => 1.5788, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.21% (1.7428 => 1.7042, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -1.99% (1.6870 => 1.6534, std.dev.: 0.0120)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -1.89% (1.9560 => 1.9190, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.80% (1.4525 => 1.4263, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.74% (1.7126 => 1.6828, std.dev.: 0.0017)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -1.74% (1.6353 => 1.6069, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -1.46% (1.5625 => 1.5397, std.dev.: 0.0010)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.44% (10.6250 => 10.4720, std.dev.: 0.0249)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -1.44% (1.4445 => 1.4237, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.13% (1.5998 => 1.5817, std.dev.: 0.0044)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: -29.76% (2.1471 => 1.5081, std.dev.: 0.0116)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -19.49% (4.8446 => 3.9003, std.dev.: 0.0667)
  MultiSource/Applications/SIBsim4/SIBsim4: -14.38% (3.6228 => 3.1017, std.dev.: 0.0508)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -11.17% (0.0985 => 0.0875, std.dev.: 0.0041)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.67% (32.6445 => 29.4894, std.dev.: 0.1312)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.74% (48.6995 => 44.4428, std.dev.: 1.1189)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: -7.91% (0.1428 => 0.1315, std.dev.: 0.0036)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -7.63% (9.9444 => 9.1853, std.dev.: 0.1629)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -6.55% (3.4162 => 3.1923, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout-C++/hash: -5.34% (0.7626 => 0.7219, std.dev.: 0.0094)
  MultiSource/Benchmarks/Bullet/bullet: -3.93% (7.2539 => 6.9686, std.dev.: 0.0514)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -3.27% (3.0709 => 2.9704, std.dev.: 0.0236)
  SingleSource/Benchmarks/Misc/flops: -3.23% (10.1819 => 9.8535, std.dev.: 0.0261)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.19% (0.6530 => 0.6322, std.dev.: 0.0040)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -2.53% (4.1802 => 4.0745, std.dev.: 0.0353)
  MultiSource/Applications/JM/lencod/lencod: -2.25% (6.9674 => 6.8103, std.dev.: 0.0562)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -2.18% (1.7400 => 1.7020, std.dev.: 0.0072)
  SingleSource/Benchmarks/Shootout/matrix: -2.08% (1.7727 => 1.7358, std.dev.: 0.0099)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.43% (12.0078 => 11.8361, std.dev.: 0.0081)
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.39% (92.9463 => 91.6565, std.dev.: 0.3263)
  SingleSource/Benchmarks/Misc/fbench: -1.30% (4.7985 => 4.7363, std.dev.: 0.0131)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.55% (0.1464 => 0.1412, std.dev.: 0.0013)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/city/city: 1.31% (1.5862 => 1.6069, std.dev.: 0.0012)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.37% (0.9806 => 1.0921, std.dev.: 0.0226)
  MultiSource/Applications/lua/lua: 5.02% (28.2496 => 29.6675, std.dev.: 0.3729)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.60% (3.9713 => 4.0745, std.dev.: 0.0353)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 2.04% (1.6679 => 1.7020, std.dev.: 0.0072)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 1.32% (88.2998 => 89.4622, std.dev.: 0.0376)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.17% (11.4990 => 11.6330, std.dev.: 0.0079)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/viterbi/viterbi: -26.16% (0.2431 => 0.1795, std.dev.: 0.0022)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -16.81% (0.0803 => 0.0668, std.dev.: 0.0007)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -15.51% (0.1322 => 0.1117, std.dev.: 0.0033)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.21% (0.1151 => 0.0999, std.dev.: 0.0014)
  SingleSource/UnitTests/Vector/constpool: -13.08% (10.3086 => 8.9603, std.dev.: 0.1273)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -12.28% (0.1075 => 0.0943, std.dev.: 0.0010)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.66% (0.1646 => 0.1454, std.dev.: 0.0015)
  MultiSource/Applications/JM/lencod/lencod: -11.17% (18.9387 => 16.8239, std.dev.: 0.3728)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.72% (0.2006 => 0.1791, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.64% (1.5932 => 1.4237, std.dev.: 0.0049)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.70% (5.1587 => 4.6582, std.dev.: 0.1939)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -8.93% (5.4314 => 4.9462, std.dev.: 0.0402)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.99% (0.7381 => 0.6791, std.dev.: 0.0042)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -7.48% (0.1886 => 0.1745, std.dev.: 0.0035)
  MultiSource/Applications/aha/aha: -7.18% (0.1407 => 0.1306, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.11% (2.0439 => 1.9190, std.dev.: 0.0022)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.97% (1.6793 => 1.5790, std.dev.: 0.0129)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -5.67% (0.2416 => 0.2279, std.dev.: 0.0027)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -5.40% (51.0211 => 48.2653, std.dev.: 0.1063)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -4.91% (0.3853 => 0.3664, std.dev.: 0.0017)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -4.31% (0.5748 => 0.5500, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -4.20% (0.3378 => 0.3236, std.dev.: 0.0040)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.37% (10.7257 => 10.4720, std.dev.: 0.0249)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.60% (1.8435 => 1.8140, std.dev.: 0.0028)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.57% (25.9348 => 25.5286, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.31% (1.6804 => 1.6584, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.15% (1.7006 => 1.6810, std.dev.: 0.0046)
  MultiSource/Benchmarks/Bullet/bullet: -1.06% (35.5296 => 35.1523, std.dev.: 0.0669)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.40% (1.2911 => 0.7308, std.dev.: 0.0392)
  MultiSource/Benchmarks/Olden/mst/mst: -36.64% (0.2099 => 0.1330, std.dev.: 0.0223)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -27.53% (4.4050 => 3.1923, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -25.27% (6.2328 => 4.6575, std.dev.: 0.1843)
  SingleSource/Benchmarks/Misc/salsa20: -24.25% (10.3398 => 7.8325, std.dev.: 0.5477)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -17.55% (1.8291 => 1.5081, std.dev.: 0.0116)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.11% (25.3677 => 21.2808, std.dev.: 0.1745)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -14.58% (1.0251 => 0.8756, std.dev.: 0.0324)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: -13.11% (0.1007 => 0.0875, std.dev.: 0.0041)
  MultiSource/Applications/SIBsim4/SIBsim4: -12.20% (3.5327 => 3.1017, std.dev.: 0.0508)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -10.32% (10.2418 => 9.1853, std.dev.: 0.1629)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -9.15% (32.4581 => 29.4894, std.dev.: 0.1312)
  SingleSource/Benchmarks/Shootout-C++/hash: -9.09% (0.7941 => 0.7219, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -9.06% (4.5717 => 4.1576, std.dev.: 0.0272)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.04% (48.3307 => 44.4428, std.dev.: 1.1189)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.26% (3.2030 => 2.9704, std.dev.: 0.0236)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.89% (0.1945 => 0.1811, std.dev.: 0.0042)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -6.62% (4.1768 => 3.9003, std.dev.: 0.0667)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.16% (0.2777 => 0.2606, std.dev.: 0.0020)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.75% (0.3702 => 0.3526, std.dev.: 0.0047)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -4.17% (2.5366 => 2.4307, std.dev.: 0.0203)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -3.79% (2.4808 => 2.3868, std.dev.: 0.0280)
  MultiSource/Applications/sqlite3/sqlite3: -3.63% (4.6358 => 4.4673, std.dev.: 0.0516)
  SingleSource/Benchmarks/Misc/flops: -3.56% (10.2170 => 9.8535, std.dev.: 0.0261)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -3.45% (0.6548 => 0.6322, std.dev.: 0.0040)
  MultiSource/Benchmarks/Olden/tsp/tsp: -3.31% (1.6613 => 1.6063, std.dev.: 0.0099)
  MultiSource/Applications/JM/lencod/lencod: -3.20% (7.0353 => 6.8103, std.dev.: 0.0562)
  MultiSource/Benchmarks/Bullet/bullet: -3.13% (7.1938 => 6.9686, std.dev.: 0.0514)
  MultiSource/Benchmarks/NPB-serial/is/is: -2.86% (12.1841 => 11.8361, std.dev.: 0.0081)
  MultiSource/Benchmarks/PAQ8p/paq8p: -2.80% (94.2966 => 91.6565, std.dev.: 0.3263)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -1.61% (1.1291 => 1.1109, std.dev.: 0.0016)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.35% (2.8573 => 2.8187, std.dev.: 0.0007)
  MultiSource/Applications/viterbi/viterbi: -1.29% (2.5688 => 2.5357, std.dev.: 0.0099)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.20% (1.8989 => 1.8762, std.dev.: 0.0030)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.15% (8.5243 => 8.4264, std.dev.: 0.0270)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.01% (0.1441 => 0.1412, std.dev.: 0.0013)

Report Time: 0.64s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130525/ef10b7cc/attachment.html>


More information about the llvm-testresults mailing list