[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri May 31 22:29:54 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11941?compare_to=11937&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 11941, Order: 183065, Start Time: 2013-06-01 03:48:12, End Time: 2013-06-01 05:30:31
      To: 11937, Order: 183059, Start Time: 2013-06-01 00:07:30, End Time: 2013-06-01 01:56:42
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 12 (11 on baseline)
Performance Improvements: 52 (67 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1043 (1029 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 4.28% (0.2782 => 0.2901, std.dev.: 0.0012)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 14.20% (3.6253 => 4.1400, std.dev.: 0.0010)
  SingleSource/Benchmarks/Stanford/Puzzle: 7.53% (0.1739 => 0.1870, std.dev.: 0.0002)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 5.26% (15.7780 => 16.6085, std.dev.: 0.1302)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.92% (0.4777 => 0.5012, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.83% (7.0495 => 7.3898, std.dev.: 0.0677)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 4.63% (0.3718 => 0.3890, std.dev.: 0.0065)
  SingleSource/Benchmarks/McGill/misr: 4.46% (0.3813 => 0.3983, std.dev.: 0.0000)
  SingleSource/Benchmarks/Stanford/FloatMM: 2.49% (0.7857 => 0.8053, std.dev.: 0.0036)
  SingleSource/Benchmarks/McGill/queens: 1.73% (1.6426 => 1.6710, std.dev.: 0.0071)
  SingleSource/Benchmarks/McGill/chomp: 1.52% (1.0040 => 1.0193, std.dev.: 0.0058)
  SingleSource/Benchmarks/Shootout/methcall: 1.09% (8.4971 => 8.5894, std.dev.: 0.0023)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -38.64% (0.1149 => 0.0705, std.dev.: 0.0004)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -9.94% (0.8708 => 0.7842, std.dev.: 0.0303)
  MultiSource/Applications/sgefa/sgefa: -8.28% (0.4518 => 0.4144, std.dev.: 0.0099)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.57% (0.2746 => 0.2593, std.dev.: 0.0042)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -4.42% (48.3431 => 46.2080, std.dev.: 0.1259)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -3.56% (1.4392 => 1.3879, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.13% (1.4209 => 1.3764, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -2.92% (1.4287 => 1.3870, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -2.71% (1.4555 => 1.4160, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -2.63% (1.4309 => 1.3933, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.50% (1.4665 => 1.4299, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.46% (1.5173 => 1.4799, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.42% (1.4616 => 1.4262, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -2.41% (1.4633 => 1.4281, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.36% (1.5521 => 1.5154, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -2.36% (1.4903 => 1.4552, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.29% (1.6211 => 1.5839, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.24% (1.5429 => 1.5084, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: -2.23% (1.6198 => 1.5837, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.22% (1.6403 => 1.6039, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -2.18% (1.4694 => 1.4374, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.14% (1.6771 => 1.6412, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -2.13% (1.6510 => 1.6159, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.10% (1.6929 => 1.6574, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -2.07% (1.6506 => 1.6164, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.03% (1.7217 => 1.6868, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.99% (1.6210 => 1.5888, std.dev.: 0.0111)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -1.97% (0.9905 => 0.9710, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.95% (1.8569 => 1.8206, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.92% (1.7246 => 1.6915, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.89% (1.6019 => 1.5717, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.85% (1.7030 => 1.6715, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.85% (1.7447 => 1.7125, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.79% (1.6628 => 1.6330, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.74% (1.6979 => 1.6684, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.68% (1.6535 => 1.6257, std.dev.: 0.0019)
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.63% (2.5256 => 2.4844, std.dev.: 0.0013)
  MultiSource/Benchmarks/Bullet/bullet: -1.10% (35.6942 => 35.3029, std.dev.: 0.0602)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -15.15% (0.9713 => 0.8241, std.dev.: 0.0346)
  SingleSource/Benchmarks/Shootout/heapsort: -12.40% (3.3183 => 2.9067, std.dev.: 0.0830)
  MultiSource/Benchmarks/nbench/nbench: -9.39% (22.6173 => 20.4926, std.dev.: 0.7093)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -8.41% (3.2686 => 2.9937, std.dev.: 0.0859)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -8.37% (1.7222 => 1.5780, std.dev.: 0.0361)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -7.61% (6.4948 => 6.0007, std.dev.: 0.1899)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -6.57% (3.4227 => 3.1978, std.dev.: 0.0736)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.47% (3.4294 => 3.2074, std.dev.: 0.0369)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -5.74% (4.2185 => 3.9765, std.dev.: 0.0380)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -3.02% (4.1054 => 3.9814, std.dev.: 0.0212)
  MultiSource/Benchmarks/PAQ8p/paq8p: -2.35% (94.3435 => 92.1282, std.dev.: 0.4621)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.75% (4.0952 => 4.0236, std.dev.: 0.0258)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.64% (5.0406 => 4.9579, std.dev.: 0.0204)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -1.10% (29.9501 => 29.6203, std.dev.: 0.0544)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 3.39% (0.1417 => 0.1465, std.dev.: 0.0005)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.62% (0.2721 => 0.2901, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.16% (1.6070 => 1.6257, std.dev.: 0.0019)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Puzzle: 28.52% (0.1455 => 0.1870, std.dev.: 0.0002)
  MultiSource/Applications/sgefa/sgefa: 18.27% (1.1695 => 1.3832, std.dev.: 0.0402)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.30% (7.0179 => 7.3898, std.dev.: 0.0677)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.33% (2.5366 => 2.6210, std.dev.: 0.0281)
  SingleSource/Benchmarks/Shootout/methcall: 2.96% (8.3425 => 8.5894, std.dev.: 0.0023)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.25% (4.3727 => 4.4712, std.dev.: 0.0172)
  SingleSource/Benchmarks/Stanford/FloatMM: 2.14% (0.7884 => 0.8053, std.dev.: 0.0036)
  SingleSource/Benchmarks/McGill/queens: 1.41% (1.6478 => 1.6710, std.dev.: 0.0071)
  SingleSource/Benchmarks/Misc/oourafft: 1.07% (3.7315 => 3.7714, std.dev.: 0.0092)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -36.66% (0.1113 => 0.0705, std.dev.: 0.0004)
  MultiSource/Applications/viterbi/viterbi: -25.71% (0.2431 => 0.1806, std.dev.: 0.0220)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -16.94% (0.0803 => 0.0667, std.dev.: 0.0003)
  SingleSource/Benchmarks/Misc/whetstone: -16.59% (0.1097 => 0.0915, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -16.34% (0.1646 => 0.1377, std.dev.: 0.0035)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -12.65% (0.1075 => 0.0939, std.dev.: 0.0006)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.51% (0.1151 => 0.1007, std.dev.: 0.0007)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -12.18% (0.1322 => 0.1161, std.dev.: 0.0026)
  SingleSource/UnitTests/Vector/constpool: -11.42% (10.3086 => 9.1311, std.dev.: 0.1063)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.62% (0.2006 => 0.1793, std.dev.: 0.0017)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -9.43% (51.0211 => 46.2080, std.dev.: 0.1259)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -8.48% (5.4314 => 4.9706, std.dev.: 0.0233)
  MultiSource/Applications/aha/aha: -8.46% (0.1407 => 0.1288, std.dev.: 0.0039)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -7.74% (0.1563 => 0.1442, std.dev.: 0.0004)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.66% (0.2416 => 0.2231, std.dev.: 0.0027)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.41% (0.7381 => 0.6834, std.dev.: 0.0052)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -7.21% (0.1886 => 0.1750, std.dev.: 0.0005)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.99% (15.9860 => 14.8691, std.dev.: 0.1833)
  MultiSource/Applications/Burg/burg: -6.89% (1.5375 => 1.4315, std.dev.: 0.0344)
  MultiSource/Applications/lemon/lemon: -6.74% (1.3155 => 1.2269, std.dev.: 0.0106)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.93% (2.0439 => 1.9227, std.dev.: 0.0068)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.81% (0.2753 => 0.2593, std.dev.: 0.0042)
  SingleSource/Benchmarks/Shootout-C++/strcat: -5.11% (0.2309 => 0.2191, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout-C++/ary2: -4.17% (0.2951 => 0.2828, std.dev.: 0.0030)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -4.09% (0.5748 => 0.5513, std.dev.: 0.0034)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -3.95% (0.2961 => 0.2844, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/hash: -3.38% (0.4554 => 0.4400, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: -3.28% (0.4293 => 0.4152, std.dev.: 0.0051)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -3.28% (7.7211 => 7.4678, std.dev.: 0.0176)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: -2.82% (0.3617 => 0.3515, std.dev.: 0.0036)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -2.55% (0.9964 => 0.9710, std.dev.: 0.0057)
  MultiSource/Benchmarks/mafft/pairlocalalign: -1.81% (10.7257 => 10.5321, std.dev.: 0.0407)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -1.54% (25.9348 => 25.5357, std.dev.: 0.1333)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.24% (1.8435 => 1.8206, std.dev.: 0.0011)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.37% (1.2911 => 0.7312, std.dev.: 0.0017)
  MultiSource/Applications/lemon/lemon: -38.95% (1.3499 => 0.8241, std.dev.: 0.0346)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.62% (4.4050 => 3.2324, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -20.01% (6.2328 => 4.9855, std.dev.: 0.0267)
  MultiSource/Benchmarks/mafft/pairlocalalign: -16.45% (48.3307 => 40.3791, std.dev.: 1.2988)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.68% (25.3677 => 21.3911, std.dev.: 0.0404)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -13.91% (0.0920 => 0.0792, std.dev.: 0.0028)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -13.73% (1.8291 => 1.5780, std.dev.: 0.0361)
  SingleSource/Benchmarks/Misc/salsa20: -13.07% (10.3398 => 8.9879, std.dev.: 0.0274)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -11.06% (10.2418 => 9.1086, std.dev.: 0.1731)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -10.32% (0.3702 => 0.3320, std.dev.: 0.0145)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.21% (3.5327 => 3.2074, std.dev.: 0.0369)
  SingleSource/Benchmarks/Shootout-C++/hash: -9.19% (0.7941 => 0.7211, std.dev.: 0.0268)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -8.95% (3.5120 => 3.1978, std.dev.: 0.0736)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.74% (32.4581 => 29.6203, std.dev.: 0.0544)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.79% (0.1945 => 0.1813, std.dev.: 0.0009)
  MultiSource/Applications/sqlite3/sqlite3: -5.79% (4.6358 => 4.3673, std.dev.: 0.0587)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.61% (4.5717 => 4.3153, std.dev.: 0.0013)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -4.68% (4.1768 => 3.9814, std.dev.: 0.0212)
  MultiSource/Benchmarks/Bullet/bullet: -4.41% (7.1938 => 6.8769, std.dev.: 0.0514)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.97% (9.1099 => 8.7483, std.dev.: 0.0329)
  SingleSource/Benchmarks/Misc/flops: -3.56% (10.2170 => 9.8531, std.dev.: 0.0207)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.19% (2.8537 => 2.7626, std.dev.: 0.0101)
  MultiSource/Benchmarks/BitBench/five11/five11: -3.06% (5.7342 => 5.5589, std.dev.: 0.0343)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -2.73% (1.6679 => 1.6223, std.dev.: 0.0007)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.65% (3.8665 => 3.7642, std.dev.: 0.0378)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.50% (0.6548 => 0.6384, std.dev.: 0.0036)
  MultiSource/Benchmarks/PAQ8p/paq8p: -2.30% (94.2966 => 92.1282, std.dev.: 0.4621)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.82% (4.2167 => 4.1400, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.69% (8.5243 => 8.3799, std.dev.: 0.0485)
  MultiSource/Applications/viterbi/viterbi: -1.37% (2.5688 => 2.5336, std.dev.: 0.0118)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.37% (2.8573 => 2.8182, std.dev.: 0.0010)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.32% (12.1841 => 12.0237, std.dev.: 0.0309)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.67% (0.1441 => 0.1465, std.dev.: 0.0005)

Report Time: 0.63s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130601/55ffda4b/attachment.html>


More information about the llvm-testresults mailing list