[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jun 25 06:23:45 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12738?compare_to=12735&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12738, Order: 184830, Start Time: 2013-06-25 11:40:26, End Time: 2013-06-25 13:24:49
      To: 12735, Order: 184827, Start Time: 2013-06-25 07:43:13, End Time: 2013-06-25 09:24:19
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 8 (17 on baseline)
Performance Improvements: 1 (71 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1098 (1019 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/fibo: 16.68% (4.1314 => 4.8205, std.dev.: 0.0061)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 3.78% (0.3495 => 0.3627, std.dev.: 0.0044)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.55% (20.8140 => 21.5523, std.dev.: 0.2815)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.31% (3.8955 => 4.0245, std.dev.: 0.0021)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.72% (2.6370 => 2.7086, std.dev.: 0.0252)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.27% (1.4656 => 1.4989, std.dev.: 0.0021)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 1.94% (2.7134 => 2.7661, std.dev.: 0.0173)
  SingleSource/Benchmarks/Shootout/heapsort: 1.09% (2.8698 => 2.9011, std.dev.: 0.0096)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.22% (5.4768 => 5.2455, std.dev.: 0.0653)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.11% (0.1324 => 0.1352, std.dev.: 0.0032)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/sgefa/sgefa: 33.31% (1.1695 => 1.5591, std.dev.: 0.0264)
  SingleSource/Benchmarks/Misc/pi: 29.20% (1.8318 => 2.3667, std.dev.: 0.0238)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 28.98% (16.4665 => 21.2386, std.dev.: 0.3459)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.90% (6.1372 => 7.1745, std.dev.: 0.3919)
  SingleSource/Benchmarks/Stanford/Puzzle: 14.85% (0.1455 => 0.1671, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.82% (5.2003 => 5.6069, std.dev.: 0.0326)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.86% (3.2201 => 3.3766, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.64% (4.6639 => 4.8802, std.dev.: 0.0262)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.37% (2.8994 => 3.0261, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.15% (2.9004 => 3.0207, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.63% (5.2788 => 5.4703, std.dev.: 0.0301)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.92% (5.5010 => 5.6618, std.dev.: 0.0440)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.15% (3.9713 => 4.0567, std.dev.: 0.0083)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.11% (4.6379 => 4.7358, std.dev.: 0.0292)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.06% (4.3727 => 4.4629, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.02% (5.6582 => 5.7723, std.dev.: 0.0150)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.39% (1.4783 => 1.4989, std.dev.: 0.0021)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/viterbi/viterbi: -25.50% (0.2431 => 0.1811, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -17.19% (0.0803 => 0.0665, std.dev.: 0.0003)
  SingleSource/Benchmarks/Misc/whetstone: -16.23% (0.1097 => 0.0919, std.dev.: 0.0006)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.08% (0.1151 => 0.1012, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -11.91% (0.1075 => 0.0947, std.dev.: 0.0046)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.48% (0.1646 => 0.1457, std.dev.: 0.0014)
  MultiSource/Applications/JM/lencod/lencod: -11.29% (18.9387 => 16.7998, std.dev.: 0.1388)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -10.22% (0.2006 => 0.1801, std.dev.: 0.0012)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -9.56% (1.5932 => 1.4409, std.dev.: 0.0133)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -9.12% (51.0211 => 46.3688, std.dev.: 1.4853)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -8.86% (5.4314 => 4.9501, std.dev.: 0.0779)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -7.79% (0.1886 => 0.1739, std.dev.: 0.0028)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -7.55% (0.1563 => 0.1445, std.dev.: 0.0008)
  MultiSource/Applications/Burg/burg: -7.09% (1.5375 => 1.4285, std.dev.: 0.0179)
  MultiSource/Applications/lemon/lemon: -6.63% (1.3155 => 1.2283, std.dev.: 0.0163)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.50% (0.7381 => 0.6901, std.dev.: 0.0033)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.35% (2.0439 => 1.9142, std.dev.: 0.0470)
  MultiSource/Applications/oggenc/oggenc: -6.31% (5.9886 => 5.6105, std.dev.: 0.0281)
  MultiSource/Applications/lambda-0_1_3/lambda: -5.01% (0.8649 => 0.8216, std.dev.: 0.0108)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.64% (6.6236 => 6.3162, std.dev.: 0.0046)
  MultiSource/Applications/SPASS/SPASS: -4.60% (17.6379 => 16.8257, std.dev.: 0.0576)
  SingleSource/Benchmarks/Linpack/linpack-pc: -4.09% (0.2738 => 0.2626, std.dev.: 0.0016)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.30% (0.3853 => 0.3726, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout-C++/hash: -2.53% (0.4554 => 0.4439, std.dev.: 0.0027)
  MultiSource/Applications/d/make_dparser: -1.61% (3.7330 => 3.6729, std.dev.: 0.0145)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.41% (1.2911 => 0.7306, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -35.20% (4.4050 => 2.8545, std.dev.: 0.1252)
  MultiSource/Applications/lemon/lemon: -30.79% (1.3499 => 0.9343, std.dev.: 0.0854)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -23.18% (6.2328 => 4.7881, std.dev.: 0.0216)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -20.50% (5.7264 => 4.5523, std.dev.: 0.1887)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.47% (4.8986 => 3.8961, std.dev.: 0.0028)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -19.67% (1.8291 => 1.4693, std.dev.: 0.0742)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -16.06% (3.5000 => 2.9380, std.dev.: 0.0023)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.66% (25.3677 => 21.3947, std.dev.: 0.0580)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -14.10% (11.6227 => 9.9837, std.dev.: 0.0593)
  SingleSource/Benchmarks/Misc/salsa20: -13.11% (10.3398 => 8.9842, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -12.88% (7.0179 => 6.1137, std.dev.: 0.0841)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.92% (1.6679 => 1.5025, std.dev.: 0.0428)
  SingleSource/Benchmarks/Shootout-C++/hash: -9.32% (0.7941 => 0.7201, std.dev.: 0.0273)
  MultiSource/Applications/siod/siod: -9.20% (3.7240 => 3.3815, std.dev.: 0.0179)
  MultiSource/Applications/SPASS/SPASS: -9.18% (8.8720 => 8.0578, std.dev.: 0.0402)
  MultiSource/Applications/lambda-0_1_3/lambda: -8.92% (9.1099 => 8.2974, std.dev.: 0.0561)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -8.83% (4.5717 => 4.1680, std.dev.: 0.0289)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -7.46% (3.2030 => 2.9641, std.dev.: 0.0309)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.73% (5.5889 => 5.2129, std.dev.: 0.0398)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.72% (48.3307 => 45.0825, std.dev.: 0.7254)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -6.04% (39.1740 => 36.8071, std.dev.: 0.3390)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.83% (5.3184 => 5.0617, std.dev.: 0.0170)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.56% (4.2167 => 4.0245, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -4.28% (5.4801 => 5.2455, std.dev.: 0.0653)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.23% (5.3276 => 5.1025, std.dev.: 0.0868)
  SingleSource/Benchmarks/Misc/flops: -4.11% (10.2170 => 9.7972, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout/ary3: -3.94% (6.0122 => 5.7753, std.dev.: 0.0078)
  MultiSource/Applications/sqlite3/sqlite3: -3.82% (4.6358 => 4.4585, std.dev.: 0.0235)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -3.47% (4.1768 => 4.0317, std.dev.: 0.0093)
  SingleSource/Benchmarks/Misc/flops-7: -3.39% (1.7987 => 1.7377, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout/heapsort: -3.26% (2.9988 => 2.9011, std.dev.: 0.0096)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -3.10% (3.8665 => 3.7466, std.dev.: 0.0079)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -3.07% (2.8537 => 2.7661, std.dev.: 0.0173)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.89% (5.7342 => 5.5687, std.dev.: 0.0127)
  SingleSource/Benchmarks/McGill/misr: -2.83% (0.3890 => 0.3780, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.77% (6.3757 => 6.1989, std.dev.: 0.0206)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -2.70% (62.4345 => 60.7461, std.dev.: 0.3650)
  SingleSource/Benchmarks/Shootout/hash: -2.32% (5.3656 => 5.2412, std.dev.: 0.0242)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.22% (4.5094 => 4.4091, std.dev.: 0.0269)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.97% (4.6452 => 4.5535, std.dev.: 0.0138)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.97% (8.5243 => 8.3565, std.dev.: 0.0095)
  SingleSource/Benchmarks/McGill/chomp: -1.61% (1.0164 => 1.0000, std.dev.: 0.0063)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.35% (12.1841 => 12.0202, std.dev.: 0.0090)
  SingleSource/Benchmarks/Polybench/medley/floyd-warshall/floyd-warshall: -1.15% (3.0234 => 2.9886, std.dev.: 0.0100)
  MultiSource/Benchmarks/sim/sim: -1.07% (3.8805 => 3.8391, std.dev.: 0.0044)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -6.18% (0.1441 => 0.1352, std.dev.: 0.0032)

Report Time: 0.73s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130625/ead238b5/attachment.html>


More information about the llvm-testresults mailing list