[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jul 24 08:42:24 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13712?compare_to=13708&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13712, Order: 187034, Start Time: 2013-07-24 13:53:25, End Time: 2013-07-24 15:43:58
      To: 13708, Order: 187030, Start Time: 2013-07-24 11:44:09, End Time: 2013-07-24 13:30:06
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 57 (37 on baseline)
Performance Improvements: 0 (10 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1050 (1060 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 55.57% (0.3468 => 0.5395, std.dev.: 0.0209)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 51.15% (1.4628 => 2.2110, std.dev.: 0.0220)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 48.28% (0.2473 => 0.3667, std.dev.: 0.0217)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 42.20% (0.7369 => 1.0479, std.dev.: 0.0752)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 36.48% (0.0965 => 0.1317, std.dev.: 0.0136)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 33.27% (0.2934 => 0.3910, std.dev.: 0.0294)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 31.74% (0.3866 => 0.5093, std.dev.: 0.0374)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 24.93% (0.9698 => 1.2116, std.dev.: 0.0685)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 24.29% (0.9025 => 1.1217, std.dev.: 0.0655)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 22.43% (1.3433 => 1.6446, std.dev.: 0.1024)
  MultiSource/Applications/obsequi/Obsequi: 20.43% (1.2131 => 1.4609, std.dev.: 0.0585)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.64% (5.8318 => 6.6853, std.dev.: 0.2158)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 11.98% (0.0910 => 0.1019, std.dev.: 0.0023)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 11.77% (1.6606 => 1.8560, std.dev.: 0.0491)
  MultiSource/Applications/kimwitu++/kc: 9.79% (19.4228 => 21.3249, std.dev.: 0.1123)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 8.58% (1.3800 => 1.4984, std.dev.: 0.0310)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.46% (1.5965 => 1.6996, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 5.64% (1.3529 => 1.4292, std.dev.: 0.0296)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 5.56% (1.3484 => 1.4234, std.dev.: 0.0249)
  MultiSource/Applications/JM/lencod/lencod: 5.41% (17.3486 => 18.2872, std.dev.: 0.1607)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.98% (0.2509 => 0.2634, std.dev.: 0.0013)
  MultiSource/Applications/sqlite3/sqlite3: 4.65% (17.5875 => 18.4054, std.dev.: 0.2183)
  MultiSource/Applications/oggenc/oggenc: 4.37% (5.7271 => 5.9774, std.dev.: 0.0543)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.08% (1.4344 => 1.4929, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 4.00% (1.3692 => 1.4240, std.dev.: 0.0130)
  SingleSource/Benchmarks/Shootout-C++/lists1: 3.99% (0.3434 => 0.3571, std.dev.: 0.0045)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 1.52% (0.6912 => 0.7017, std.dev.: 0.0025)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 50.61% (0.0976 => 0.1470, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 49.51% (2.9134 => 4.3558, std.dev.: 0.1107)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 49.22% (0.0579 => 0.0864, std.dev.: 0.0016)
  MultiSource/Applications/lemon/lemon: 42.60% (0.8993 => 1.2824, std.dev.: 0.1424)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 39.39% (0.0264 => 0.0368, std.dev.: 0.0003)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 38.29% (0.0538 => 0.0744, std.dev.: 0.0059)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 36.14% (0.0689 => 0.0938, std.dev.: 0.0011)
  MultiSource/Benchmarks/Olden/bisort/bisort: 35.40% (0.6938 => 0.9394, std.dev.: 0.0223)
  MultiSource/Applications/minisat/minisat: 28.45% (6.2484 => 8.0261, std.dev.: 0.1116)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 28.39% (1.4613 => 1.8762, std.dev.: 0.0785)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 22.88% (1.3083 => 1.6076, std.dev.: 0.0941)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 18.18% (2.4918 => 2.9447, std.dev.: 0.0683)
  SingleSource/Benchmarks/Misc/flops-7: 15.59% (1.7285 => 1.9979, std.dev.: 0.0582)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 13.04% (29.6954 => 33.5682, std.dev.: 0.4402)
  SingleSource/Benchmarks/Linpack/linpack-pc: 9.96% (46.8366 => 51.5010, std.dev.: 0.1729)
  MultiSource/Benchmarks/Olden/em3d/em3d: 9.64% (4.7361 => 5.1927, std.dev.: 0.0151)
  MultiSource/Applications/obsequi/Obsequi: 9.28% (2.4098 => 2.6335, std.dev.: 0.0226)
  SingleSource/Benchmarks/Shootout-C++/lists1: 8.71% (0.6082 => 0.6612, std.dev.: 0.0193)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 8.45% (3.3179 => 3.5981, std.dev.: 0.1071)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.78% (91.3526 => 96.6300, std.dev.: 0.1785)
  MultiSource/Applications/lua/lua: 4.58% (29.8821 => 31.2496, std.dev.: 0.0944)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.94% (1.0553 => 1.0969, std.dev.: 0.0042)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 3.53% (21.4633 => 22.2202, std.dev.: 0.2937)
  MultiSource/Benchmarks/Olden/bh/bh: 3.28% (2.3963 => 2.4748, std.dev.: 0.0150)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.04% (46.1806 => 47.5822, std.dev.: 0.0785)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.66% (3.5291 => 3.6230, std.dev.: 0.0321)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.68% (1.5950 => 1.6218, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout/hash: 1.45% (4.1725 => 4.2332, std.dev.: 0.0167)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.24% (3.7160 => 3.7622, std.dev.: 0.0114)
  SingleSource/Benchmarks/Shootout/methcall: 1.10% (8.4630 => 8.5561, std.dev.: 0.0089)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.83% (0.1323 => 0.1334, std.dev.: 0.0257)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 53.79% (0.3508 => 0.5395, std.dev.: 0.0209)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 49.19% (0.2458 => 0.3667, std.dev.: 0.0217)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 43.80% (1.5376 => 2.2110, std.dev.: 0.0220)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: 39.29% (0.7523 => 1.0479, std.dev.: 0.0752)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 36.62% (0.0964 => 0.1317, std.dev.: 0.0136)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 34.57% (0.0810 => 0.1090, std.dev.: 0.0104)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 33.77% (0.2923 => 0.3910, std.dev.: 0.0294)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 31.50% (0.3873 => 0.5093, std.dev.: 0.0374)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 28.80% (0.9407 => 1.2116, std.dev.: 0.0685)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 24.43% (0.9015 => 1.1217, std.dev.: 0.0655)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 19.35% (1.3780 => 1.6446, std.dev.: 0.1024)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 11.52% (1.6643 => 1.8560, std.dev.: 0.0491)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.75% (1.4037 => 1.4984, std.dev.: 0.0310)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.01% (1.6185 => 1.6996, std.dev.: 0.0069)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 4.23% (0.2527 => 0.2634, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/lists1: 3.78% (0.3441 => 0.3571, std.dev.: 0.0045)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 52.81% (0.0962 => 0.1470, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 50.03% (2.9033 => 4.3558, std.dev.: 0.1107)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 49.48% (0.0578 => 0.0864, std.dev.: 0.0016)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 46.17% (0.0509 => 0.0744, std.dev.: 0.0059)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 38.35% (0.0266 => 0.0368, std.dev.: 0.0003)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 36.73% (0.0686 => 0.0938, std.dev.: 0.0011)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 28.01% (1.2558 => 1.6076, std.dev.: 0.0941)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 25.76% (0.0458 => 0.0576, std.dev.: 0.0000)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 22.27% (2.9428 => 3.5981, std.dev.: 0.1071)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 16.38% (1.6121 => 1.8762, std.dev.: 0.0785)
  SingleSource/Benchmarks/Misc/flops-7: 15.29% (1.7330 => 1.9979, std.dev.: 0.0582)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.62% (2.1022 => 2.4095, std.dev.: 0.0079)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 12.60% (29.8131 => 33.5682, std.dev.: 0.4402)
  SingleSource/Benchmarks/Shootout-C++/lists1: 9.58% (0.6034 => 0.6612, std.dev.: 0.0193)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.10% (2.6992 => 2.9447, std.dev.: 0.0683)
  SingleSource/Benchmarks/Linpack/linpack-pc: 6.57% (48.3256 => 51.5010, std.dev.: 0.1729)
  MultiSource/Benchmarks/PAQ8p/paq8p: 3.16% (93.6732 => 96.6300, std.dev.: 0.1785)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.49% (3.5351 => 3.6230, std.dev.: 0.0321)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.64% (1.5957 => 1.6218, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout/hash: 1.16% (4.1846 => 4.2332, std.dev.: 0.0167)
  SingleSource/Benchmarks/Shootout/methcall: 1.12% (8.4614 => 8.5561, std.dev.: 0.0089)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/ClamAV/clamscan: -10.60% (19.4145 => 17.3574, std.dev.: 0.1992)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -9.82% (0.3655 => 0.3296, std.dev.: 0.0066)
  MultiSource/Applications/JM/ldecod/ldecod: -8.78% (8.6720 => 7.9104, std.dev.: 0.2175)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -7.18% (1.7797 => 1.6519, std.dev.: 0.0266)
  MultiSource/Applications/SIBsim4/SIBsim4: -6.48% (1.7461 => 1.6329, std.dev.: 0.0190)
  MultiSource/Applications/sqlite3/sqlite3: -3.96% (19.1635 => 18.4054, std.dev.: 0.2183)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -2.39% (0.7189 => 0.7017, std.dev.: 0.0025)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -33.82% (0.0816 => 0.0540, std.dev.: 0.0024)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -3.05% (0.4783 => 0.4637, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.88% (4.9231 => 4.8307, std.dev.: 0.0082)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.19% (0.1378 => 0.1334, std.dev.: 0.0257)

Report Time: 1.00s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130724/e9a5ca44/attachment.html>


More information about the llvm-testresults mailing list