[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed May 29 01:13:15 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11830?compare_to=11827&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 11830, Order: 182823, Start Time: 2013-05-29 06:28:52, End Time: 2013-05-29 08:13:48
      To: 11827, Order: 182820, Start Time: 2013-05-29 04:21:38, End Time: 2013-05-29 06:08:56
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 5 (4 on baseline)
Performance Improvements: 32 (40 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1070 (1063 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 4.85% (6.8845 => 7.2185, std.dev.: 0.0320)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.97% (1.0556 => 1.0975, std.dev.: 0.0060)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 3.00% (1.4491 => 1.4926, std.dev.: 0.0093)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 2.98% (0.4501 => 0.4635, std.dev.: 0.0024)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.56% (2.5173 => 2.5565, std.dev.: 0.0063)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C++/short_circuit_dtor: -42.99% (0.0335 => 0.0191, std.dev.: 0.0001)
  SingleSource/Regression/C++/2003-05-14-array-init: -42.12% (0.0273 => 0.0158, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/sumarray: -41.21% (0.0347 => 0.0204, std.dev.: 0.0008)
  SingleSource/UnitTests/FloatPrecision: -40.43% (0.0277 => 0.0165, std.dev.: 0.0005)
  SingleSource/UnitTests/2003-10-29-ScalarReplBug: -39.70% (0.0267 => 0.0161, std.dev.: 0.0003)
  SingleSource/Regression/C++/EH/inlined_cleanup: -38.59% (0.0298 => 0.0183, std.dev.: 0.0000)
  SingleSource/UnitTests/2002-05-03-NotTest: -38.49% (0.0317 => 0.0195, std.dev.: 0.0016)
  SingleSource/UnitTests/2002-08-19-CodegenBug: -38.27% (0.0324 => 0.0200, std.dev.: 0.0002)
  SingleSource/UnitTests/2006-02-04-DivRem: -37.76% (0.0294 => 0.0183, std.dev.: 0.0001)
  SingleSource/UnitTests/2003-05-31-CastToBool: -36.99% (0.0419 => 0.0264, std.dev.: 0.0013)
  SingleSource/UnitTests/Vector/sumarray-dbl: -36.87% (0.0358 => 0.0226, std.dev.: 0.0008)
  SingleSource/Regression/C++/fixups: -36.82% (0.0402 => 0.0254, std.dev.: 0.0002)
  SingleSource/UnitTests/SignlessTypes/ccc: -36.74% (0.0411 => 0.0260, std.dev.: 0.0002)
  SingleSource/UnitTests/2003-07-10-SignConversions: -36.07% (0.0280 => 0.0179, std.dev.: 0.0002)
  SingleSource/UnitTests/SignlessTypes/shr: -34.93% (0.0521 => 0.0339, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/divides: -34.88% (0.0301 => 0.0196, std.dev.: 0.0003)
  SingleSource/UnitTests/2005-07-17-INT-To-FP: -32.54% (0.0335 => 0.0226, std.dev.: 0.0001)
  SingleSource/UnitTests/2003-08-11-VaListArg: -30.50% (0.0436 => 0.0303, std.dev.: 0.0005)
  SingleSource/Regression/C++/EH/exception_spec_test: -23.25% (0.0443 => 0.0340, std.dev.: 0.0003)
  SingleSource/Benchmarks/Stanford/IntMM: -18.94% (0.0549 => 0.0445, std.dev.: 0.0004)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -18.13% (0.6773 => 0.5545, std.dev.: 0.0032)
  SingleSource/Benchmarks/McGill/exptree: -16.62% (0.1173 => 0.0978, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/perlin: -14.65% (0.0703 => 0.0600, std.dev.: 0.0009)
  SingleSource/Benchmarks/Stanford/Puzzle: -11.23% (0.1416 => 0.1257, std.dev.: 0.0042)
  SingleSource/Benchmarks/Shootout-C++/ary2: -8.80% (0.3102 => 0.2829, std.dev.: 0.0063)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -7.12% (0.1573 => 0.1461, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/methcall: -6.70% (0.2358 => 0.2200, std.dev.: 0.0042)
  SingleSource/Regression/C++/ofstream_ctor: -6.47% (0.2457 => 0.2298, std.dev.: 0.0017)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/ackermann: -13.50% (3.5648 => 3.0834, std.dev.: 0.1749)
  MultiSource/Benchmarks/nbench/nbench: -7.44% (22.3284 => 20.6672, std.dev.: 0.1138)
  SingleSource/Benchmarks/McGill/chomp: -4.83% (1.0496 => 0.9989, std.dev.: 0.0079)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: -4.57% (1.5436 => 1.4730, std.dev.: 0.0050)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.36% (0.1403 => 0.1398, std.dev.: 0.0012)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/lua/lua: 4.62% (28.2496 => 29.5540, std.dev.: 0.4958)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.82% (1.0571 => 1.0975, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.86% (7.0179 => 7.2185, std.dev.: 0.0320)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 1.30% (88.2998 => 89.4495, std.dev.: 0.0644)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/viterbi/viterbi: -26.20% (0.2431 => 0.1794, std.dev.: 0.0224)
  SingleSource/Benchmarks/Misc/whetstone: -16.96% (0.1097 => 0.0911, std.dev.: 0.0032)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -13.99% (0.1151 => 0.0990, std.dev.: 0.0013)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -13.54% (0.1322 => 0.1143, std.dev.: 0.0017)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -13.24% (0.1646 => 0.1428, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -11.06% (1.5932 => 1.4170, std.dev.: 0.0075)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -10.98% (0.1075 => 0.0957, std.dev.: 0.0025)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -9.76% (0.1886 => 0.1702, std.dev.: 0.0035)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -9.58% (5.1587 => 4.6645, std.dev.: 0.0382)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.95% (0.2416 => 0.2224, std.dev.: 0.0033)
  MultiSource/Applications/lemon/lemon: -7.05% (1.3155 => 1.2228, std.dev.: 0.0152)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.95% (0.7381 => 0.6868, std.dev.: 0.0040)
  MultiSource/Applications/Burg/burg: -6.76% (1.5375 => 1.4336, std.dev.: 0.0286)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -6.54% (15.9860 => 14.9399, std.dev.: 0.1324)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -6.53% (0.1563 => 0.1461, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.70% (2.0439 => 1.9273, std.dev.: 0.0133)
  SingleSource/Benchmarks/Linpack/linpack-pc: -3.65% (0.2738 => 0.2638, std.dev.: 0.0021)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.53% (0.5748 => 0.5545, std.dev.: 0.0032)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -3.52% (0.3378 => 0.3259, std.dev.: 0.0026)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.81% (1.2911 => 0.7255, std.dev.: 0.0108)
  MultiSource/Applications/lemon/lemon: -33.13% (1.3499 => 0.9027, std.dev.: 0.0730)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.47% (4.4050 => 3.2392, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/salsa20: -21.33% (10.3398 => 8.1341, std.dev.: 0.4065)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -19.00% (6.2328 => 5.0484, std.dev.: 0.0077)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.63% (25.3677 => 21.1489, std.dev.: 0.1392)
  MultiSource/Applications/SIBsim4/SIBsim4: -12.24% (3.5327 => 3.1002, std.dev.: 0.1096)
  SingleSource/Benchmarks/Shootout-C++/hash: -9.04% (0.7941 => 0.7223, std.dev.: 0.0243)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -8.78% (0.3267 => 0.2980, std.dev.: 0.0077)
  MultiSource/Benchmarks/nbench/nbench: -7.32% (22.3004 => 20.6672, std.dev.: 0.1138)
  SingleSource/Benchmarks/Misc/flops: -6.69% (10.2170 => 9.5338, std.dev.: 0.1598)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.53% (0.1945 => 0.1818, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -5.63% (4.5717 => 4.3142, std.dev.: 0.0287)
  MultiSource/Applications/SPASS/SPASS: -5.35% (8.8720 => 8.3975, std.dev.: 0.1472)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -5.18% (4.2334 => 4.0142, std.dev.: 0.0375)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.14% (0.2777 => 0.2662, std.dev.: 0.0029)
  MultiSource/Applications/sqlite3/sqlite3: -3.64% (4.6358 => 4.4672, std.dev.: 0.0355)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.97% (2.8537 => 2.7690, std.dev.: 0.0273)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.71% (5.7342 => 5.5790, std.dev.: 0.0557)
  MultiSource/Applications/aha/aha: -1.68% (3.6251 => 3.5643, std.dev.: 0.0092)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.29% (12.1841 => 12.0268, std.dev.: 0.0487)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.98% (0.1441 => 0.1398, std.dev.: 0.0012)

Report Time: 1.30s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130529/94c76765/attachment.html>


More information about the llvm-testresults mailing list