[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jun 18 19:57:17 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12520?compare_to=12516&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12520, Order: 184263, Start Time: 2013-06-19 01:07:51, End Time: 2013-06-19 02:58:14
      To: 12516, Order: 184247, Start Time: 2013-06-18 22:55:40, End Time: 2013-06-19 00:47:15
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 14 (48 on baseline)
Performance Improvements: 21 (30 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1072 (1029 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/constpool: 17.43% (9.3704 => 11.0033, std.dev.: 0.5188)
  MultiSource/Applications/SPASS/SPASS: 8.91% (17.3207 => 18.8646, std.dev.: 0.4297)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 5.51% (1.6859 => 1.7788, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.56% (1.5742 => 1.6303, std.dev.: 0.0154)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.69% (1.6609 => 1.7055, std.dev.: 0.0153)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.78% (0.0269 => 0.0376, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 21.64% (3.5182 => 4.2795, std.dev.: 0.1634)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 17.89% (4.1236 => 4.8614, std.dev.: 0.1688)
  MultiSource/Benchmarks/nbench/nbench: 12.89% (19.6036 => 22.1299, std.dev.: 0.6999)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 4.62% (39.6856 => 41.5196, std.dev.: 0.6467)
  SingleSource/Benchmarks/Misc/pi: 3.00% (1.9030 => 1.9601, std.dev.: 0.0197)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 2.68% (1.1269 => 1.1571, std.dev.: 0.0063)
  SingleSource/Benchmarks/Shootout-C++/fibo: 1.25% (4.7770 => 4.8367, std.dev.: 0.0177)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.10% (11.4772 => 11.6037, std.dev.: 0.0381)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -30.55% (0.1100 => 0.0764, std.dev.: 0.0055)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: -29.44% (0.1257 => 0.0887, std.dev.: 0.0135)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: -26.68% (0.9731 => 0.7135, std.dev.: 0.0187)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: -23.70% (1.4985 => 1.1434, std.dev.: 0.1324)
  MultiSource/Benchmarks/MallocBench/gs/gs: -22.73% (6.0980 => 4.7118, std.dev.: 0.2577)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -22.41% (0.1111 => 0.0862, std.dev.: 0.0024)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -15.43% (0.1121 => 0.0948, std.dev.: 0.0050)
  MultiSource/Applications/minisat/minisat: -12.40% (0.9005 => 0.7888, std.dev.: 0.0164)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -9.44% (0.4618 => 0.4182, std.dev.: 0.0115)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -9.01% (4.6588 => 4.2390, std.dev.: 0.1400)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -8.61% (1.0776 => 0.9848, std.dev.: 0.0213)
  SingleSource/Benchmarks/Shootout-C++/moments: -6.81% (0.4432 => 0.4130, std.dev.: 0.0079)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -4.90% (0.2225 => 0.2116, std.dev.: 0.0034)
  MultiSource/Benchmarks/PAQ8p/paq8p: -4.41% (2.6304 => 2.5144, std.dev.: 0.0362)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -3.66% (1.0031 => 0.9664, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -2.86% (1.4367 => 1.3956, std.dev.: 0.0078)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -31.96% (0.0801 => 0.0545, std.dev.: 0.0092)
  MultiSource/Benchmarks/McCat/08-main/main: -21.02% (0.0980 => 0.0774, std.dev.: 0.0036)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -5.64% (1.6726 => 1.5783, std.dev.: 0.0365)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.84% (1.7171 => 1.6684, std.dev.: 0.0138)
  MultiSource/Applications/aha/aha: -1.53% (3.6448 => 3.5891, std.dev.: 0.0127)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.64% (0.1396 => 0.1405, std.dev.: 0.0289)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.71% (0.1067 => 0.1416, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/ary: 8.88% (0.2747 => 0.2991, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 7.40% (1.6563 => 1.7788, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.03% (1.5612 => 1.6709, std.dev.: 0.0247)
  MultiSource/Applications/SPASS/SPASS: 6.95% (17.6379 => 18.8646, std.dev.: 0.4297)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.90% (1.4485 => 1.5484, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 6.54% (1.5727 => 1.6756, std.dev.: 0.0237)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.19% (1.6292 => 1.7300, std.dev.: 0.0166)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 6.06% (1.5372 => 1.6303, std.dev.: 0.0154)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 5.96% (1.7006 => 1.8019, std.dev.: 0.0344)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 5.40% (1.6070 => 1.6937, std.dev.: 0.0260)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 5.21% (1.4999 => 1.5781, std.dev.: 0.0110)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.79% (1.6275 => 1.7055, std.dev.: 0.0153)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.19% (6.6236 => 6.9010, std.dev.: 0.0267)
  MultiSource/Applications/kimwitu++/kc: 3.56% (20.1855 => 20.9035, std.dev.: 0.0952)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/sgefa/sgefa: 33.53% (1.1695 => 1.5616, std.dev.: 0.0228)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 27.45% (16.4665 => 20.9873, std.dev.: 0.5163)
  MultiSource/Benchmarks/Olden/mst/mst: 23.11% (0.2099 => 0.2584, std.dev.: 0.0055)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 22.27% (3.5000 => 4.2795, std.dev.: 0.1634)
  SingleSource/Benchmarks/Stanford/Puzzle: 19.18% (0.1455 => 0.1734, std.dev.: 0.0077)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 18.22% (1.0251 => 1.2119, std.dev.: 0.0548)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 17.74% (4.6452 => 5.4692, std.dev.: 0.2929)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 16.65% (1.3530 => 1.5783, std.dev.: 0.0365)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.64% (6.1372 => 7.1582, std.dev.: 0.1085)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 16.39% (4.1768 => 4.8614, std.dev.: 0.1688)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 10.13% (0.4480 => 0.4934, std.dev.: 0.0104)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 8.81% (10.2418 => 11.1439, std.dev.: 0.2906)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.30% (5.2003 => 5.6321, std.dev.: 0.0274)
  SingleSource/Benchmarks/Misc/pi: 7.00% (1.8318 => 1.9601, std.dev.: 0.0197)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.42% (0.8276 => 0.8807, std.dev.: 0.0176)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.11% (3.1853 => 3.3798, std.dev.: 0.0358)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 5.99% (39.1740 => 41.5196, std.dev.: 0.6467)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.94% (3.2201 => 3.4114, std.dev.: 0.0123)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.74% (4.6639 => 4.8852, std.dev.: 0.0152)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.73% (94.2966 => 98.7534, std.dev.: 1.1701)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.51% (5.9362 => 6.2037, std.dev.: 0.0537)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.16% (1.0571 => 1.1011, std.dev.: 0.0051)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.02% (21.4874 => 22.3502, std.dev.: 0.2417)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 4.01% (4.8986 => 5.0951, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.70% (2.9004 => 3.0076, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.40% (5.2788 => 5.4582, std.dev.: 0.0125)
  MultiSource/Applications/lua/lua: 3.28% (28.2496 => 29.1773, std.dev.: 0.1490)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.18% (5.5010 => 5.6760, std.dev.: 0.0248)
  SingleSource/Benchmarks/Shootout/methcall: 2.65% (8.3425 => 8.5635, std.dev.: 0.0508)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 2.48% (1.1291 => 1.1571, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.15% (5.6582 => 5.7799, std.dev.: 0.0113)
  MultiSource/Benchmarks/Olden/bh/bh: 1.93% (2.4435 => 2.4907, std.dev.: 0.0122)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.76% (4.3727 => 4.4496, std.dev.: 0.0267)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -34.68% (0.1113 => 0.0727, std.dev.: 0.0085)
  MultiSource/Applications/viterbi/viterbi: -21.43% (0.2431 => 0.1910, std.dev.: 0.0184)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -13.45% (0.0803 => 0.0695, std.dev.: 0.0039)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -6.30% (1.0314 => 0.9664, std.dev.: 0.0089)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -42.87% (1.2911 => 0.7376, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.96% (4.4050 => 3.2175, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -24.37% (6.2328 => 4.7137, std.dev.: 0.0558)
  MultiSource/Benchmarks/FreeBench/neural/neural: -23.65% (0.3513 => 0.2682, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc/salsa20: -21.16% (10.3398 => 8.1514, std.dev.: 0.4029)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.03% (25.3677 => 21.3017, std.dev.: 0.0711)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -14.06% (11.6227 => 9.9881, std.dev.: 0.0123)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -10.33% (7.0179 => 6.2929, std.dev.: 0.0253)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.26% (1.6679 => 1.5135, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout-C++/hash: -8.87% (0.7941 => 0.7237, std.dev.: 0.0139)
  MultiSource/Applications/lambda-0_1_3/lambda: -8.84% (9.1099 => 8.3049, std.dev.: 0.0143)
  MultiSource/Applications/siod/siod: -8.41% (3.7240 => 3.4108, std.dev.: 0.0732)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.43% (48.3307 => 44.7375, std.dev.: 0.4848)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.72% (5.5889 => 5.2132, std.dev.: 0.0287)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.10% (4.5717 => 4.2927, std.dev.: 0.0106)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.77% (3.5327 => 3.3288, std.dev.: 0.0542)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -5.55% (0.1945 => 0.1837, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.42% (4.2167 => 4.0304, std.dev.: 0.0231)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.30% (5.3184 => 5.0898, std.dev.: 0.0753)
  SingleSource/Benchmarks/Misc/flops: -3.66% (10.2170 => 9.8435, std.dev.: 0.0050)
  SingleSource/Benchmarks/Shootout/sieve: -2.90% (8.0178 => 7.7853, std.dev.: 0.0263)
  MultiSource/Applications/sqlite3/sqlite3: -2.78% (4.6358 => 4.5068, std.dev.: 0.0320)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.70% (3.8665 => 3.7622, std.dev.: 0.0118)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.49% (5.7342 => 5.5917, std.dev.: 0.0327)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.23% (12.1841 => 12.0339, std.dev.: 0.0209)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.18% (2.8573 => 2.8235, std.dev.: 0.0122)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.50% (0.1441 => 0.1405, std.dev.: 0.0289)

Report Time: 1.21s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130618/c99a50e8/attachment.html>


More information about the llvm-testresults mailing list