[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Jun 3 17:06:27 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12017?compare_to=12014&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12017, Order: 183155, Start Time: 2013-06-03 22:22:41, End Time: 2013-06-04 00:07:06
      To: 12014, Order: 183148, Start Time: 2013-06-03 20:14:27, End Time: 2013-06-03 22:01:41
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 6 (8 on baseline)
Performance Improvements: 32 (49 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1069 (1050 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/fp-convert: 15.54% (6.9780 => 8.0625, std.dev.: 0.0133)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 6.12% (4.0570 => 4.3051, std.dev.: 0.0128)
  SingleSource/Benchmarks/Misc/flops-4: 5.30% (1.5438 => 1.6256, std.dev.: 0.0038)
  SingleSource/Benchmarks/Misc/lowercase: 4.81% (0.7963 => 0.8346, std.dev.: 0.0039)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.47% (3.2241 => 3.3036, std.dev.: 0.0196)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.23% (5.5071 => 5.5747, std.dev.: 0.0191)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2002-08-02-CastTest: -46.21% (0.0264 => 0.0142, std.dev.: 0.0028)
  SingleSource/Regression/C++/2003-05-14-array-init: -42.40% (0.0250 => 0.0144, std.dev.: 0.0035)
  SingleSource/UnitTests/byval-alignment: -41.61% (0.0310 => 0.0181, std.dev.: 0.0017)
  SingleSource/Benchmarks/McGill/exptree: -33.80% (0.1485 => 0.0983, std.dev.: 0.0105)
  SingleSource/Regression/C++/EH/ConditionalExpr: -33.14% (0.0347 => 0.0232, std.dev.: 0.0012)
  SingleSource/Benchmarks/Stanford/IntMM: -30.89% (0.0641 => 0.0443, std.dev.: 0.0044)
  SingleSource/UnitTests/2003-05-31-CastToBool: -28.69% (0.0373 => 0.0266, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/hello: -23.50% (0.2536 => 0.1940, std.dev.: 0.0169)
  MultiSource/Applications/Burg/burg: -21.53% (1.8272 => 1.4338, std.dev.: 0.1187)
  SingleSource/Benchmarks/Shootout/objinst: -17.51% (0.0594 => 0.0490, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -13.64% (0.0880 => 0.0760, std.dev.: 0.0005)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: -13.30% (0.3932 => 0.3409, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -11.72% (0.2500 => 0.2207, std.dev.: 0.0089)
  SingleSource/Benchmarks/Shootout-C++/wc: -9.56% (0.2585 => 0.2338, std.dev.: 0.0073)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -8.81% (0.3416 => 0.3115, std.dev.: 0.0045)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: -8.23% (0.7703 => 0.7069, std.dev.: 0.0103)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -7.01% (0.6151 => 0.5720, std.dev.: 0.0089)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: -5.77% (0.3729 => 0.3514, std.dev.: 0.0081)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -1.62% (0.9667 => 0.9510, std.dev.: 0.0054)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Stanford/Towers: -39.27% (0.0354 => 0.0215, std.dev.: 0.0030)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -14.05% (5.3245 => 4.5765, std.dev.: 0.0408)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -10.65% (0.1324 => 0.1183, std.dev.: 0.0015)
  SingleSource/Benchmarks/Stanford/Puzzle: -8.85% (0.1898 => 0.1730, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/mandel: -4.04% (1.0657 => 1.0226, std.dev.: 0.0047)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.25% (22.1436 => 21.4238, std.dev.: 0.1672)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: -2.92% (1.5253 => 1.4807, std.dev.: 0.0075)
  SingleSource/Benchmarks/Misc/flops-3: -2.76% (2.1090 => 2.0507, std.dev.: 0.0145)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.30% (3.7020 => 3.6168, std.dev.: 0.0307)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.28% (1.4945 => 1.4604, std.dev.: 0.0131)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -1.92% (1.0730 => 1.0524, std.dev.: 0.0055)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.14% (4.0912 => 4.0446, std.dev.: 0.0087)
  SingleSource/Benchmarks/Misc/flops-6: -1.12% (2.4567 => 2.4293, std.dev.: 0.0033)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.61% (0.1464 => 0.1473, std.dev.: 0.0274)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Puzzle: 18.90% (0.1455 => 0.1730, std.dev.: 0.0027)
  MultiSource/Applications/sgefa/sgefa: 18.07% (1.1695 => 1.3808, std.dev.: 0.0030)
  SingleSource/Benchmarks/Misc/lowercase: 7.75% (0.7746 => 0.8346, std.dev.: 0.0039)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.40% (4.3727 => 4.4775, std.dev.: 0.0037)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 1.85% (3.9713 => 4.0446, std.dev.: 0.0087)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 1.69% (4.2334 => 4.3051, std.dev.: 0.0128)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.40% (6.1372 => 6.2232, std.dev.: 0.0084)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.21% (11.4990 => 11.6383, std.dev.: 0.0102)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -38.01% (0.1113 => 0.0690, std.dev.: 0.0027)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -15.82% (0.0803 => 0.0676, std.dev.: 0.0021)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -14.88% (0.1075 => 0.0915, std.dev.: 0.0017)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -12.95% (0.1151 => 0.1002, std.dev.: 0.0007)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -11.65% (0.1322 => 0.1168, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -11.24% (0.1646 => 0.1461, std.dev.: 0.0005)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -10.93% (1.5932 => 1.4190, std.dev.: 0.0071)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -10.92% (0.1886 => 0.1680, std.dev.: 0.0029)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -10.29% (51.0211 => 45.7701, std.dev.: 1.5306)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.90% (5.1587 => 4.6479, std.dev.: 0.1647)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -8.38% (0.1563 => 0.1432, std.dev.: 0.0010)
  MultiSource/Applications/aha/aha: -7.68% (0.1407 => 0.1299, std.dev.: 0.0027)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.04% (0.2416 => 0.2246, std.dev.: 0.0035)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -7.04% (15.9860 => 14.8612, std.dev.: 0.1467)
  MultiSource/Applications/lemon/lemon: -6.99% (1.3155 => 1.2235, std.dev.: 0.0191)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.50% (0.7381 => 0.6901, std.dev.: 0.0039)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.58% (2.0439 => 1.9299, std.dev.: 0.0098)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.44% (6.6236 => 6.2632, std.dev.: 0.1153)
  SingleSource/Benchmarks/Shootout-C++/strcat: -5.07% (0.2309 => 0.2192, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/ary2: -4.10% (0.2951 => 0.2830, std.dev.: 0.0038)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.40% (0.3378 => 0.3263, std.dev.: 0.0029)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.46% (1.2911 => 0.7300, std.dev.: 0.0027)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -36.63% (0.0273 => 0.0173, std.dev.: 0.0035)
  MultiSource/Applications/lemon/lemon: -28.91% (1.3499 => 0.9597, std.dev.: 0.0946)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.50% (4.4050 => 3.2377, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.95% (6.2328 => 5.0515, std.dev.: 0.0179)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.20% (25.3677 => 21.2575, std.dev.: 0.0730)
  SingleSource/Benchmarks/Misc/salsa20: -13.15% (10.3398 => 8.9802, std.dev.: 0.0147)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -10.56% (0.3702 => 0.3311, std.dev.: 0.0145)
  MultiSource/Benchmarks/mafft/pairlocalalign: -9.96% (48.3307 => 43.5164, std.dev.: 0.0390)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -8.81% (32.4581 => 29.5985, std.dev.: 1.0731)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -6.84% (2.4808 => 2.3110, std.dev.: 0.0608)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.49% (3.5327 => 3.3036, std.dev.: 0.0196)
  MultiSource/Benchmarks/FreeBench/neural/neural: -6.21% (0.3513 => 0.3295, std.dev.: 0.0071)
  MultiSource/Applications/sqlite3/sqlite3: -6.09% (4.6358 => 4.3533, std.dev.: 0.0283)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.60% (4.5717 => 4.3157, std.dev.: 0.0109)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.50% (0.1945 => 0.1838, std.dev.: 0.0005)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.03% (0.2777 => 0.2665, std.dev.: 0.0024)
  MultiSource/Applications/hexxagon/hexxagon: -4.02% (15.4979 => 14.8743, std.dev.: 0.0204)
  MultiSource/Applications/lambda-0_1_3/lambda: -3.91% (9.1099 => 8.7535, std.dev.: 0.0371)
  SingleSource/Benchmarks/Misc/flops: -3.57% (10.2170 => 9.8525, std.dev.: 0.0069)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.97% (2.8537 => 2.7689, std.dev.: 0.0217)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.89% (5.7342 => 5.5685, std.dev.: 0.0398)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -2.78% (1.6679 => 1.6216, std.dev.: 0.0078)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.74% (3.8665 => 3.7605, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.95% (4.2167 => 4.1345, std.dev.: 0.0044)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.80% (8.5243 => 8.3705, std.dev.: 0.0118)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.32% (12.1841 => 12.0227, std.dev.: 0.0039)
  MultiSource/Applications/aha/aha: -1.12% (3.6251 => 3.5844, std.dev.: 0.0069)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.22% (0.1441 => 0.1473, std.dev.: 0.0274)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130603/b4f94141/attachment.html>


More information about the llvm-testresults mailing list