[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jun 12 13:40:52 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12318?compare_to=12315&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12318, Order: 183849, Start Time: 2013-06-12 18:53:25, End Time: 2013-06-12 20:41:42
      To: 12315, Order: 183842, Start Time: 2013-06-12 16:42:28, End Time: 2013-06-12 18:31:55
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 19 (43 on baseline)
Performance Improvements: 6 (34 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1082 (1030 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 42.58% (0.2816 => 0.4015, std.dev.: 0.0293)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 13.51% (7.9399 => 9.0124, std.dev.: 0.2485)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 11.44% (48.0816 => 53.5826, std.dev.: 1.5127)
  MultiSource/Benchmarks/nbench/nbench: 10.74% (1.2889 => 1.4273, std.dev.: 0.0228)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 4.97% (1.4054 => 1.4752, std.dev.: 0.0202)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.92% (1.6297 => 1.7098, std.dev.: 0.0237)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.83% (1.5239 => 1.5975, std.dev.: 0.0200)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.03% (1.5526 => 1.6152, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.61% (1.4987 => 1.5528, std.dev.: 0.0086)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.23% (0.5775 => 0.5904, std.dev.: 0.0041)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.00% (0.1265 => 0.1518, std.dev.: 0.0032)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.16% (2.1110 => 2.4099, std.dev.: 0.0177)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 10.51% (9.6780 => 10.6955, std.dev.: 0.0156)
  SingleSource/Benchmarks/Linpack/linpack-pc: 4.88% (48.8826 => 51.2689, std.dev.: 0.3175)
  MultiSource/Benchmarks/Bullet/bullet: 3.44% (6.9373 => 7.1758, std.dev.: 0.0922)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 3.23% (2.4741 => 2.5541, std.dev.: 0.0111)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 1.73% (1.8631 => 1.8954, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.01% (11.5355 => 11.6519, std.dev.: 0.0124)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.00% (40.6057 => 41.0132, std.dev.: 0.0809)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -20.85% (0.0638 => 0.0505, std.dev.: 0.0014)
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: -19.72% (0.0634 => 0.0509, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.87% (1.7978 => 1.7103, std.dev.: 0.0130)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.42% (1.7433 => 1.6837, std.dev.: 0.0197)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.10% (1.7978 => 1.7420, std.dev.: 0.0061)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.33% (2.8587 => 2.8206, std.dev.: 0.0116)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.30% (0.1484 => 0.1435, std.dev.: 0.0022)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 46.85% (0.2734 => 0.4015, std.dev.: 0.0293)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 41.56% (0.9964 => 1.4105, std.dev.: 0.0386)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 35.68% (0.1617 => 0.2194, std.dev.: 0.0209)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.72% (7.7211 => 9.0124, std.dev.: 0.2485)
  MultiSource/Benchmarks/nbench/nbench: 10.42% (1.2926 => 1.4273, std.dev.: 0.0228)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 8.66% (1.5735 => 1.7098, std.dev.: 0.0237)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 8.13% (1.5959 => 1.7257, std.dev.: 0.0385)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.69% (1.4999 => 1.6152, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 6.65% (1.3832 => 1.4752, std.dev.: 0.0202)
  SingleSource/Benchmarks/Shootout-C++/hello: 6.62% (0.1934 => 0.2062, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.56% (1.4991 => 1.5975, std.dev.: 0.0200)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.06% (0.2721 => 0.2886, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.93% (1.4771 => 1.5647, std.dev.: 0.0278)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 5.22% (1.4757 => 1.5528, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.93% (1.5612 => 1.6381, std.dev.: 0.0206)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.40% (1.6299 => 1.6853, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.98% (1.4202 => 1.4625, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.86% (1.7102 => 1.7420, std.dev.: 0.0061)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 29.52% (0.1172 => 0.1518, std.dev.: 0.0032)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 24.34% (2.5366 => 3.1540, std.dev.: 0.0531)
  SingleSource/Benchmarks/Stanford/Puzzle: 18.90% (0.1455 => 0.1730, std.dev.: 0.0104)
  MultiSource/Applications/sgefa/sgefa: 18.31% (1.1695 => 1.3836, std.dev.: 0.0419)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 17.32% (6.1372 => 7.2002, std.dev.: 0.0031)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 11.95% (2.5800 => 2.8884, std.dev.: 0.0663)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.06% (5.2003 => 5.6195, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.21% (3.1853 => 3.3830, std.dev.: 0.0633)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.71% (1.2224 => 1.2922, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.02% (3.2201 => 3.3817, std.dev.: 0.0365)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.76% (0.8276 => 0.8670, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.71% (4.6639 => 4.8835, std.dev.: 0.0139)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 4.43% (10.2418 => 10.6955, std.dev.: 0.0156)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.71% (5.2788 => 5.4746, std.dev.: 0.0337)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.08% (5.5010 => 5.6705, std.dev.: 0.0072)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.73% (39.9248 => 41.0132, std.dev.: 0.0809)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.37% (3.9713 => 4.0654, std.dev.: 0.0061)
  MultiSource/Applications/siod/siod: 2.04% (3.7240 => 3.7999, std.dev.: 0.0085)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.96% (4.3727 => 4.4586, std.dev.: 0.0127)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.83% (5.6582 => 5.7618, std.dev.: 0.0203)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 1.81% (2.5087 => 2.5541, std.dev.: 0.0111)
  SingleSource/Benchmarks/Shootout/methcall: 1.64% (8.3425 => 8.4792, std.dev.: 0.0467)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.33% (11.4990 => 11.6519, std.dev.: 0.0124)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.24% (4.8986 => 4.9593, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/oourafft: 1.02% (3.7315 => 3.7696, std.dev.: 0.0055)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -31.90% (0.1113 => 0.0758, std.dev.: 0.0003)
  MultiSource/Applications/viterbi/viterbi: -26.12% (0.2431 => 0.1796, std.dev.: 0.0198)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -16.19% (0.0803 => 0.0673, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc/whetstone: -14.31% (0.1097 => 0.0940, std.dev.: 0.0007)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -9.78% (0.8025 => 0.7240, std.dev.: 0.0136)
  MultiSource/Applications/lemon/lemon: -7.12% (1.3155 => 1.2218, std.dev.: 0.0347)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.40% (1.6793 => 1.5718, std.dev.: 0.0332)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -6.10% (0.1886 => 0.1771, std.dev.: 0.0020)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.45% (1.2911 => 0.7301, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.41% (4.4050 => 3.2418, std.dev.: 0.0181)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.09% (6.2328 => 5.0428, std.dev.: 0.0560)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.87% (25.3677 => 21.3427, std.dev.: 0.0609)
  SingleSource/Benchmarks/Misc/salsa20: -13.02% (10.3398 => 8.9939, std.dev.: 0.0096)
  MultiSource/Benchmarks/nbench/nbench: -12.19% (22.3004 => 19.5809, std.dev.: 1.0010)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.15% (48.3307 => 43.4266, std.dev.: 0.2576)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.20% (1.6679 => 1.5144, std.dev.: 0.0214)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.81% (3.5327 => 3.2214, std.dev.: 0.0168)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.64% (5.5889 => 5.2179, std.dev.: 0.0107)
  MultiSource/Applications/sqlite3/sqlite3: -6.37% (4.6358 => 4.3405, std.dev.: 0.1060)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.25% (9.8728 => 9.2554, std.dev.: 0.0232)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.09% (4.5717 => 4.3389, std.dev.: 0.0340)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.70% (5.3184 => 5.0686, std.dev.: 0.0081)
  MultiSource/Applications/hexxagon/hexxagon: -4.08% (15.4979 => 14.8656, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.05% (5.3276 => 5.1119, std.dev.: 0.0379)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.93% (9.1099 => 8.7520, std.dev.: 0.0251)
  SingleSource/Benchmarks/Misc/flops: -3.53% (10.2170 => 9.8566, std.dev.: 0.0186)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.52% (0.9806 => 0.9461, std.dev.: 0.0082)
  SingleSource/Benchmarks/Shootout/sieve: -2.97% (8.0178 => 7.7795, std.dev.: 0.0049)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.84% (3.8665 => 3.7567, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.17% (4.5094 => 4.4116, std.dev.: 0.0025)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.10% (5.7342 => 5.6140, std.dev.: 0.0131)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.73% (8.5243 => 8.3765, std.dev.: 0.0277)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.28% (2.8573 => 2.8206, std.dev.: 0.0116)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.18% (12.1841 => 12.0408, std.dev.: 0.0472)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.42% (0.1441 => 0.1435, std.dev.: 0.0022)

Report Time: 1.30s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130612/7e9a1da6/attachment.html>


More information about the llvm-testresults mailing list