[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue May 28 08:34:15 PDT 2013


http://llvm.org/perf/db_default/v4/nts/11806?compare_to=11802&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 11806, Order: 182769, Start Time: 2013-05-28 13:48:42, End Time: 2013-05-28 15:34:48
      To: 11802, Order: 182763, Start Time: 2013-05-28 11:05:21, End Time: 2013-05-28 13:01:39
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 7 (8 on baseline)
Performance Improvements: 64 (40 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1036 (1059 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 6.07% (0.2980 => 0.3161, std.dev.: 0.0051)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.81% (0.6323 => 0.6564, std.dev.: 0.0027)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.72% (1.0555 => 1.0948, std.dev.: 0.0084)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 3.25% (2.5292 => 2.6114, std.dev.: 0.0254)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.85% (3.2015 => 3.2928, std.dev.: 0.0080)
  SingleSource/Benchmarks/Shootout/methcall: 2.23% (8.3450 => 8.5308, std.dev.: 0.0206)
  SingleSource/Benchmarks/Dhrystone/fldry: 1.79% (0.6549 => 0.6666, std.dev.: 0.0040)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Stanford/RealMM: -36.92% (0.0642 => 0.0405, std.dev.: 0.0045)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -31.78% (1.3573 => 0.9259, std.dev.: 0.0774)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -29.46% (0.1456 => 0.1027, std.dev.: 0.0006)
  SingleSource/Benchmarks/Stanford/IntMM: -27.00% (0.0611 => 0.0446, std.dev.: 0.0022)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: -22.55% (0.1335 => 0.1034, std.dev.: 0.0024)
  MultiSource/Benchmarks/Olden/bisort/bisort: -20.33% (0.0910 => 0.0725, std.dev.: 0.0006)
  MultiSource/Benchmarks/FreeBench/mason/mason: -18.81% (0.0808 => 0.0656, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout/objinst: -17.34% (0.0594 => 0.0491, std.dev.: 0.0013)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -17.08% (0.1224 => 0.1015, std.dev.: 0.0006)
  MultiSource/Benchmarks/Olden/health/health: -16.93% (0.1890 => 0.1570, std.dev.: 0.0028)
  MultiSource/Benchmarks/Olden/mst/mst: -16.73% (0.1662 => 0.1384, std.dev.: 0.0008)
  MultiSource/Benchmarks/Olden/em3d/em3d: -15.72% (0.2385 => 0.2010, std.dev.: 0.0011)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -15.28% (0.3363 => 0.2849, std.dev.: 0.0002)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -15.24% (6.5873 => 5.5834, std.dev.: 0.1509)
  MultiSource/Benchmarks/McCat/09-vor/vor: -13.11% (0.4082 => 0.3547, std.dev.: 0.0025)
  MultiSource/Benchmarks/McCat/18-imp/imp: -12.87% (0.4553 => 0.3967, std.dev.: 0.0017)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -12.81% (0.2592 => 0.2260, std.dev.: 0.0025)
  MultiSource/Benchmarks/Olden/tsp/tsp: -12.49% (0.1545 => 0.1352, std.dev.: 0.0011)
  MultiSource/Benchmarks/Olden/power/power: -12.47% (0.1644 => 0.1439, std.dev.: 0.0060)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -11.47% (0.1229 => 0.1088, std.dev.: 0.0018)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -11.39% (0.1826 => 0.1618, std.dev.: 0.0003)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -10.36% (0.1042 => 0.0934, std.dev.: 0.0016)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -9.89% (0.3863 => 0.3481, std.dev.: 0.0094)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -9.83% (0.1922 => 0.1733, std.dev.: 0.0027)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -9.77% (1.4454 => 1.3042, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -9.73% (1.8580 => 1.6773, std.dev.: 0.0542)
  MultiSource/Applications/minisat/minisat: -9.30% (0.8527 => 0.7734, std.dev.: 0.0013)
  MultiSource/Benchmarks/McCat/08-main/main: -8.52% (0.3252 => 0.2975, std.dev.: 0.0003)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: -8.03% (0.1494 => 0.1374, std.dev.: 0.0012)
  SingleSource/Benchmarks/Linpack/linpack-pc: -7.93% (0.2850 => 0.2624, std.dev.: 0.0070)
  MultiSource/Benchmarks/McCat/05-eks/eks: -7.77% (0.5883 => 0.5426, std.dev.: 0.0057)
  MultiSource/Applications/lemon/lemon: -7.50% (1.3141 => 1.2156, std.dev.: 0.0377)
  MultiSource/Benchmarks/Olden/bh/bh: -7.04% (0.3607 => 0.3353, std.dev.: 0.0015)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -6.45% (1.2525 => 1.1717, std.dev.: 0.0056)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -6.21% (0.1916 => 0.1797, std.dev.: 0.0035)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -4.24% (0.5472 => 0.5240, std.dev.: 0.0067)
  MultiSource/Benchmarks/Prolangs-C/football/football: -4.22% (1.0520 => 1.0076, std.dev.: 0.0136)
  MultiSource/Applications/hbd/hbd: -3.96% (1.6957 => 1.6285, std.dev.: 0.0010)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -3.47% (1.2152 => 1.1730, std.dev.: 0.0129)
  MultiSource/Applications/lua/lua: -2.67% (4.4183 => 4.3003, std.dev.: 0.0092)
  MultiSource/Applications/obsequi/Obsequi: -2.23% (1.1849 => 1.1585, std.dev.: 0.0070)
  MultiSource/Applications/hexxagon/hexxagon: -2.18% (1.1099 => 1.0857, std.dev.: 0.0009)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: -46.25% (0.2478 => 0.1332, std.dev.: 0.0065)
  SingleSource/Benchmarks/Shootout/heapsort: -35.54% (4.5166 => 2.9114, std.dev.: 0.2590)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -31.60% (1.1069 => 0.7571, std.dev.: 0.0675)
  SingleSource/Benchmarks/Stanford/Towers: -30.77% (0.0351 => 0.0243, std.dev.: 0.0017)
  MultiSource/Benchmarks/Olden/bisort/bisort: -28.56% (0.9430 => 0.6737, std.dev.: 0.0105)
  MultiSource/Applications/minisat/minisat: -21.21% (7.9504 => 6.2642, std.dev.: 0.2031)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -14.99% (0.5024 => 0.4271, std.dev.: 0.0268)
  MultiSource/Benchmarks/McCat/09-vor/vor: -13.70% (0.1343 => 0.1159, std.dev.: 0.0025)
  MultiSource/Applications/obsequi/Obsequi: -12.45% (2.5111 => 2.1984, std.dev.: 0.0085)
  SingleSource/Benchmarks/Shootout-C++/hash: -10.06% (0.8001 => 0.7196, std.dev.: 0.0263)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -7.06% (1.3258 => 1.2322, std.dev.: 0.0118)
  MultiSource/Benchmarks/Olden/tsp/tsp: -6.37% (1.7125 => 1.6034, std.dev.: 0.0110)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -4.65% (0.3485 => 0.3323, std.dev.: 0.0014)
  MultiSource/Benchmarks/Olden/health/health: -4.58% (0.3469 => 0.3310, std.dev.: 0.0039)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.18% (0.3255 => 0.3119, std.dev.: 0.0025)
  MultiSource/Applications/lua/lua: -3.88% (30.2787 => 29.1026, std.dev.: 0.3060)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -3.44% (2.6046 => 2.5150, std.dev.: 0.0338)
  MultiSource/Benchmarks/Olden/bh/bh: -2.99% (2.4967 => 2.4220, std.dev.: 0.0140)
  SingleSource/Benchmarks/McGill/queens: -1.47% (1.6620 => 1.6376, std.dev.: 0.0088)
  SingleSource/Benchmarks/Misc/mandel-2: -1.36% (0.8440 => 0.8325, std.dev.: 0.0032)
  SingleSource/Benchmarks/Misc/ffbench: -1.19% (1.3963 => 1.3797, std.dev.: 0.0009)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.04% (5.0277 => 4.9756, std.dev.: 0.0097)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.42% (0.1414 => 0.1408, std.dev.: 0.0038)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.07% (0.9806 => 1.0892, std.dev.: 0.0170)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 3.57% (1.0571 => 1.0948, std.dev.: 0.0084)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 3.18% (2.5309 => 2.6114, std.dev.: 0.0254)
  MultiSource/Applications/lua/lua: 3.02% (28.2496 => 29.1026, std.dev.: 0.3060)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.87% (3.2009 => 3.2928, std.dev.: 0.0080)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.57% (3.9713 => 4.0735, std.dev.: 0.0229)
  SingleSource/Benchmarks/Shootout/methcall: 2.26% (8.3425 => 8.5308, std.dev.: 0.0206)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 1.25% (88.2998 => 89.4019, std.dev.: 0.2404)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -16.94% (0.0803 => 0.0667, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -14.59% (0.7918 => 0.6763, std.dev.: 0.0223)
  MultiSource/Benchmarks/MiBench/network-patricia/network-patricia: -13.12% (0.1075 => 0.0934, std.dev.: 0.0016)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -10.47% (0.8025 => 0.7185, std.dev.: 0.0118)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.96% (1.7804 => 1.6208, std.dev.: 0.0551)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -8.25% (0.1224 => 0.1123, std.dev.: 0.0031)
  MultiSource/Applications/lemon/lemon: -7.59% (1.3155 => 1.2156, std.dev.: 0.0377)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.26% (0.7381 => 0.6845, std.dev.: 0.0083)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -6.48% (0.1853 => 0.1733, std.dev.: 0.0027)
  MultiSource/Benchmarks/McCat/18-imp/imp: -5.53% (0.4199 => 0.3967, std.dev.: 0.0017)
  MultiSource/Benchmarks/Olden/em3d/em3d: -5.05% (0.2117 => 0.2010, std.dev.: 0.0011)
  MultiSource/Benchmarks/McCat/05-eks/eks: -4.77% (0.5698 => 0.5426, std.dev.: 0.0057)
  MultiSource/Benchmarks/McCat/09-vor/vor: -4.73% (0.3723 => 0.3547, std.dev.: 0.0025)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -4.71% (1.3686 => 1.3042, std.dev.: 0.0048)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -2.41% (1.2006 => 1.1717, std.dev.: 0.0056)
  MultiSource/Applications/minisat/minisat: -1.40% (0.7844 => 0.7734, std.dev.: 0.0013)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.55% (1.2911 => 0.7288, std.dev.: 0.0023)
  MultiSource/Benchmarks/Olden/mst/mst: -36.54% (0.2099 => 0.1332, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.43% (4.4050 => 3.2408, std.dev.: 0.1358)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -26.14% (1.0251 => 0.7571, std.dev.: 0.0675)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -25.36% (6.2328 => 4.6523, std.dev.: 0.1955)
  MultiSource/Benchmarks/Olden/bisort/bisort: -21.72% (0.8606 => 0.6737, std.dev.: 0.0105)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.18% (25.3677 => 21.2641, std.dev.: 0.0982)
  MultiSource/Applications/minisat/minisat: -15.01% (7.3703 => 6.2642, std.dev.: 0.2031)
  SingleSource/Benchmarks/Misc/salsa20: -13.06% (10.3398 => 8.9890, std.dev.: 0.0086)
  MultiSource/Applications/SIBsim4/SIBsim4: -12.15% (3.5327 => 3.1036, std.dev.: 0.0459)
  MultiSource/Benchmarks/nbench/nbench: -11.95% (22.3004 => 19.6366, std.dev.: 0.8775)
  SingleSource/Benchmarks/Shootout-C++/hash: -9.38% (0.7941 => 0.7196, std.dev.: 0.0263)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.05% (48.3307 => 44.4405, std.dev.: 0.3519)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.72% (4.5717 => 4.2645, std.dev.: 0.0285)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.72% (0.2777 => 0.2646, std.dev.: 0.0020)
  MultiSource/Applications/sqlite3/sqlite3: -3.78% (4.6358 => 4.4604, std.dev.: 0.0537)
  SingleSource/Benchmarks/Misc/flops: -3.49% (10.2170 => 9.8608, std.dev.: 0.0163)
  MultiSource/Benchmarks/Olden/tsp/tsp: -3.49% (1.6613 => 1.6034, std.dev.: 0.0110)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.88% (5.7342 => 5.5690, std.dev.: 0.0584)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -2.76% (1.6679 => 1.6218, std.dev.: 0.0045)
  MultiSource/Applications/obsequi/Obsequi: -1.85% (2.2398 => 2.1984, std.dev.: 0.0085)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.34% (2.8573 => 2.8189, std.dev.: 0.0128)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.11% (8.5243 => 8.4293, std.dev.: 0.0186)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -1.08% (1.6105 => 1.5931, std.dev.: 0.0040)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.29% (0.1441 => 0.1408, std.dev.: 0.0038)

Report Time: 0.61s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130528/3285f276/attachment.html>


More information about the llvm-testresults mailing list