[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 7 02:28:41 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16061?compare_to=16058&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16061, Order: 192089, Start Time: 2013-10-07 07:41:01, End Time: 2013-10-07 09:31:41
      To: 16058, Order: 192086, Start Time: 2013-10-07 05:26:15, End Time: 2013-10-07 07:16:40
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 31 (42 on baseline)
Performance Improvements: 3 (13 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1073 (1052 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 57.80% (0.7038 => 1.1106, std.dev.: 0.0245)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 54.27% (0.9466 => 1.4603, std.dev.: 0.0279)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 47.44% (0.1779 => 0.2623, std.dev.: 0.0099)
  MultiSource/Benchmarks/MallocBench/gs/gs: 43.37% (4.6421 => 6.6554, std.dev.: 0.3089)
  MultiSource/Benchmarks/Olden/mst/mst: 42.15% (0.1331 => 0.1892, std.dev.: 0.0208)
  MultiSource/Benchmarks/McCat/05-eks/eks: 31.00% (0.5445 => 0.7133, std.dev.: 0.0323)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 29.03% (5.5458 => 7.1557, std.dev.: 0.2716)
  MultiSource/Applications/obsequi/Obsequi: 28.79% (1.1595 => 1.4933, std.dev.: 0.1109)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 23.94% (0.8813 => 1.0923, std.dev.: 0.0809)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 17.93% (0.7083 => 0.8353, std.dev.: 0.0219)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.11% (0.1264 => 0.1455, std.dev.: 0.0041)
  MultiSource/Applications/kimwitu++/kc: 11.73% (18.9668 => 21.1917, std.dev.: 0.3239)
  MultiSource/Benchmarks/sim/sim: 8.41% (0.3721 => 0.4034, std.dev.: 0.0032)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 119.43% (0.1379 => 0.3026, std.dev.: 0.0238)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 57.71% (0.0584 => 0.0921, std.dev.: 0.0014)
  MultiSource/Benchmarks/Olden/bisort/bisort: 52.18% (0.6654 => 1.0126, std.dev.: 0.0124)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 36.55% (1.3071 => 1.7848, std.dev.: 0.0673)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 31.18% (0.4288 => 0.5625, std.dev.: 0.0313)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.45% (1.3063 => 1.5734, std.dev.: 0.0312)
  MultiSource/Benchmarks/llubenchmark/llu: 17.82% (2.0289 => 2.3904, std.dev.: 0.0610)
  MultiSource/Applications/obsequi/Obsequi: 12.09% (2.3575 => 2.6425, std.dev.: 0.0319)
  SingleSource/Benchmarks/Misc/salsa20: 7.02% (7.5131 => 8.0407, std.dev.: 0.1137)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 6.49% (0.3711 => 0.3952, std.dev.: 0.0025)
  MultiSource/Applications/sqlite3/sqlite3: 5.66% (4.2786 => 4.5207, std.dev.: 0.0179)
  MultiSource/Applications/lua/lua: 2.88% (29.7044 => 30.5586, std.dev.: 0.2947)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.73% (39.4631 => 40.5387, std.dev.: 0.2138)
  MultiSource/Benchmarks/Olden/em3d/em3d: 2.44% (5.0309 => 5.1538, std.dev.: 0.0137)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.92% (1.2665 => 1.2908, std.dev.: 0.0050)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.84% (1.6658 => 1.6964, std.dev.: 0.0110)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.34% (2.5049 => 2.5384, std.dev.: 0.0038)
  MultiSource/Benchmarks/sim/sim: 1.14% (3.8309 => 3.8746, std.dev.: 0.0131)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout-C++/EH/except: -10.29% (0.2322 => 0.2083, std.dev.: 0.0061)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/nestedloop: -8.77% (0.1722 => 0.1571, std.dev.: 0.0017)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -2.97% (2.5506 => 2.4749, std.dev.: 0.0176)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1356 => 0.1355, std.dev.: 0.0113)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 58.52% (0.9212 => 1.4603, std.dev.: 0.0279)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 58.30% (0.1657 => 0.2623, std.dev.: 0.0099)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 57.82% (0.7037 => 1.1106, std.dev.: 0.0245)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 49.72% (0.1597 => 0.2391, std.dev.: 0.0296)
  MultiSource/Benchmarks/MallocBench/gs/gs: 45.05% (4.5883 => 6.6554, std.dev.: 0.3089)
  MultiSource/Benchmarks/Olden/mst/mst: 44.32% (0.1311 => 0.1892, std.dev.: 0.0208)
  MultiSource/Benchmarks/McCat/05-eks/eks: 37.57% (0.5185 => 0.7133, std.dev.: 0.0323)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 35.45% (0.1024 => 0.1387, std.dev.: 0.0136)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 30.07% (5.5014 => 7.1557, std.dev.: 0.2716)
  MultiSource/Applications/obsequi/Obsequi: 29.28% (1.1551 => 1.4933, std.dev.: 0.1109)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 26.03% (0.8667 => 1.0923, std.dev.: 0.0809)
  MultiSource/Applications/lua/lua: 22.65% (4.2242 => 5.1811, std.dev.: 0.3590)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 16.27% (0.7184 => 0.8353, std.dev.: 0.0219)
  MultiSource/Applications/kimwitu++/kc: 15.42% (18.3608 => 21.1917, std.dev.: 0.3239)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 15.20% (0.1263 => 0.1455, std.dev.: 0.0041)
  SingleSource/Benchmarks/Linpack/linpack-pc: 14.85% (0.2949 => 0.3387, std.dev.: 0.0102)
  MultiSource/Benchmarks/sim/sim: 8.09% (0.3732 => 0.4034, std.dev.: 0.0032)
  MultiSource/Applications/oggenc/oggenc: 3.40% (5.3339 => 5.5154, std.dev.: 0.0350)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.19% (1.0952 => 1.1192, std.dev.: 0.0050)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 119.75% (0.1377 => 0.3026, std.dev.: 0.0238)
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.63% (7.6426 => 12.5053, std.dev.: 0.0699)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 56.63% (0.0588 => 0.0921, std.dev.: 0.0014)
  MultiSource/Benchmarks/Olden/bisort/bisort: 52.34% (0.6647 => 1.0126, std.dev.: 0.0124)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 35.80% (1.3143 => 1.7848, std.dev.: 0.0673)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 32.10% (0.4258 => 0.5625, std.dev.: 0.0313)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 20.96% (1.3008 => 1.5734, std.dev.: 0.0312)
  MultiSource/Applications/obsequi/Obsequi: 20.75% (2.1884 => 2.6425, std.dev.: 0.0319)
  MultiSource/Benchmarks/llubenchmark/llu: 20.19% (1.9889 => 2.3904, std.dev.: 0.0610)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.47% (8.1346 => 8.6612, std.dev.: 0.0587)
  MultiSource/Applications/sqlite3/sqlite3: 5.79% (4.2733 => 4.5207, std.dev.: 0.0179)
  SingleSource/UnitTests/Vector/multiplies: 5.68% (0.5561 => 0.5877, std.dev.: 0.0076)
  MultiSource/Applications/lua/lua: 3.52% (29.5202 => 30.5586, std.dev.: 0.2947)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.02% (0.3836 => 0.3952, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.89% (5.7757 => 5.9426, std.dev.: 0.0225)
  MultiSource/Benchmarks/Olden/em3d/em3d: 2.49% (5.0288 => 5.1538, std.dev.: 0.0137)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.19% (1.5940 => 1.6289, std.dev.: 0.0130)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.15% (1.7652 => 1.8032, std.dev.: 0.0069)
  MultiSource/Applications/siod/siod: 2.02% (3.5310 => 3.6025, std.dev.: 0.0148)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.83% (2.4920 => 2.5377, std.dev.: 0.0050)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.47% (39.9519 => 40.5387, std.dev.: 0.2138)
  MultiSource/Benchmarks/sim/sim: 1.13% (3.8312 => 3.8746, std.dev.: 0.0131)
  SingleSource/Benchmarks/Shootout/fib2: 1.11% (3.5966 => 3.6367, std.dev.: 0.0101)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.11% (0.1483 => 0.1170, std.dev.: 0.0000)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -51.86% (0.5226 => 0.2516, std.dev.: 0.0571)
  MultiSource/Applications/sgefa/sgefa: -46.81% (1.5790 => 0.8399, std.dev.: 0.0415)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.33% (15.9508 => 13.0277, std.dev.: 0.3197)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.46% (20.8247 => 18.4383, std.dev.: 0.1655)
  SingleSource/Benchmarks/Linpack/linpack-pc: -9.68% (57.2347 => 51.6921, std.dev.: 2.0047)
  MultiSource/Benchmarks/mafft/pairlocalalign: -8.35% (50.0284 => 45.8535, std.dev.: 0.8409)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.45% (3.7437 => 3.5398, std.dev.: 0.0500)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.87% (4.3592 => 4.1907, std.dev.: 0.0583)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -2.99% (2.5513 => 2.4749, std.dev.: 0.0176)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.60% (17.1431 => 16.6966, std.dev.: 0.0667)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.14% (2.5938 => 2.5384, std.dev.: 0.0038)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.79% (2.4471 => 2.4032, std.dev.: 0.0105)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.52% (0.1348 => 0.1355, std.dev.: 0.0113)

Report Time: 1.00s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131007/b5d16dfa/attachment.html>


More information about the llvm-testresults mailing list