[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Dec 2 11:01:13 PST 2013


http://llvm.org/perf/db_default/v4/nts/17827?compare_to=17820&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 17827, Order: 196117, Start Time: 2013-12-02 17:14:39, End Time: 2013-12-02 19:05:17
      To: 17820, Order: 196100, Start Time: 2013-12-02 14:58:51, End Time: 2013-12-02 16:50:27
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 26 (27 on baseline)
Performance Improvements: 16 (7 on baseline)
Unchanged Tests: 1068 (1076 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/McGill/misr: 66.21% (0.0731 => 0.1215, std.dev.: 0.0035)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 56.11% (0.1431 => 0.2234, std.dev.: 0.0259)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 51.05% (0.2850 => 0.4305, std.dev.: 0.0116)
  MultiSource/Benchmarks/Prolangs-C++/office/office: 44.04% (0.2130 => 0.3068, std.dev.: 0.0310)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 39.89% (0.1058 => 0.1480, std.dev.: 0.0141)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 16.96% (1.5411 => 1.8024, std.dev.: 0.0802)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: 38.72% (1.2956 => 1.7973, std.dev.: 0.0876)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 29.66% (0.1460 => 0.1893, std.dev.: 0.0039)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 25.67% (1.2511 => 1.5723, std.dev.: 0.0175)
  SingleSource/Benchmarks/Shootout/heapsort: 25.30% (3.7745 => 4.7295, std.dev.: 0.2517)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 24.13% (0.0460 => 0.0571, std.dev.: 0.0000)
  SingleSource/Benchmarks/Misc/flops: 22.72% (7.8484 => 9.6319, std.dev.: 0.0092)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 18.42% (3.6734 => 4.3499, std.dev.: 0.2198)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.61% (2.1182 => 2.3853, std.dev.: 0.0137)
  SingleSource/Benchmarks/Misc/salsa20: 8.55% (7.5373 => 8.1819, std.dev.: 0.0440)
  MultiSource/Applications/obsequi/Obsequi: 8.53% (2.1667 => 2.3516, std.dev.: 0.0669)
  MultiSource/Applications/lua/lua: 6.85% (28.4466 => 30.3961, std.dev.: 0.4183)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.22% (5.5087 => 5.7960, std.dev.: 0.0668)
  SingleSource/Benchmarks/Shootout/ary3: 3.54% (5.1006 => 5.2814, std.dev.: 0.0316)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.38% (0.3818 => 0.3947, std.dev.: 0.0019)
  SingleSource/Benchmarks/Shootout-C++/methcall: 2.82% (7.7271 => 7.9451, std.dev.: 0.0270)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.74% (1.6488 => 1.6940, std.dev.: 0.0009)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.54% (2.4884 => 2.5515, std.dev.: 0.0175)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.44% (1.5862 => 1.6249, std.dev.: 0.0045)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.86% (2.3761 => 2.4202, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.35% (5.0537 => 5.1218, std.dev.: 0.0185)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Regression/C++/EH/inlined_cleanup: -45.85% (0.0349 => 0.0189, std.dev.: 0.0048)
  SingleSource/UnitTests/2003-05-12-MinIntProblem: -43.88% (0.0278 => 0.0156, std.dev.: 0.0025)
  SingleSource/UnitTests/2003-07-09-LoadShorts: -38.84% (0.0430 => 0.0263, std.dev.: 0.0013)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -38.73% (0.1358 => 0.0832, std.dev.: 0.0115)
  SingleSource/UnitTests/2008-04-20-LoopBug2: -38.21% (0.0280 => 0.0173, std.dev.: 0.0040)
  SingleSource/Regression/C++/EH/function_try_block: -36.66% (0.0521 => 0.0330, std.dev.: 0.0058)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -32.55% (0.1106 => 0.0746, std.dev.: 0.0102)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -22.50% (0.0871 => 0.0675, std.dev.: 0.0046)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: -16.23% (0.0844 => 0.0707, std.dev.: 0.0017)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -15.35% (0.0795 => 0.0673, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -7.38% (1.4762 => 1.3672, std.dev.: 0.0320)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -11.35% (2.5526 => 2.2630, std.dev.: 0.1055)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -7.81% (0.5226 => 0.4818, std.dev.: 0.0130)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -7.29% (65.6706 => 60.8860, std.dev.: 1.0422)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -5.17% (1.5341 => 1.4548, std.dev.: 0.0242)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.00% (8.7364 => 8.5621, std.dev.: 0.0256)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/McGill/misr: 81.07% (0.0671 => 0.1215, std.dev.: 0.0035)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 55.57% (0.1436 => 0.2234, std.dev.: 0.0259)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: 48.14% (0.2906 => 0.4305, std.dev.: 0.0116)
  MultiSource/Benchmarks/Prolangs-C++/office/office: 40.93% (0.2177 => 0.3068, std.dev.: 0.0310)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 40.82% (0.1051 => 0.1480, std.dev.: 0.0141)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 20.21% (1.4994 => 1.8024, std.dev.: 0.0802)
  SingleSource/Benchmarks/Shootout-C++/lists: 3.96% (0.2578 => 0.2680, std.dev.: 0.0035)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 60.37% (2.9492 => 4.7295, std.dev.: 0.2517)
  SingleSource/Benchmarks/Stanford/Queens: 53.82% (0.0262 => 0.0403, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 45.26% (2.9945 => 4.3499, std.dev.: 0.2198)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 28.06% (1.2278 => 1.5723, std.dev.: 0.0175)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 25.38% (1.4335 => 1.7973, std.dev.: 0.0876)
  SingleSource/Benchmarks/Shootout/ary3: 14.87% (4.5977 => 5.2814, std.dev.: 0.0316)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.48% (2.1020 => 2.3853, std.dev.: 0.0137)
  SingleSource/Benchmarks/Shootout/strcat: 12.14% (0.1417 => 0.1589, std.dev.: 0.0050)
  SingleSource/Benchmarks/Shootout-C++/ary3: 9.33% (4.6797 => 5.1162, std.dev.: 0.1224)
  SingleSource/Benchmarks/Misc/salsa20: 7.73% (7.5947 => 8.1819, std.dev.: 0.0440)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.49% (5.0320 => 5.4090, std.dev.: 0.0019)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.39% (5.4994 => 5.7960, std.dev.: 0.0668)
  MultiSource/Applications/lua/lua: 4.33% (29.1357 => 30.3961, std.dev.: 0.4183)
  SingleSource/Benchmarks/Misc/flops: 3.93% (9.2673 => 9.6319, std.dev.: 0.0092)
  SingleSource/Benchmarks/Shootout-C++/methcall: 3.28% (7.6931 => 7.9451, std.dev.: 0.0270)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.86% (1.5797 => 1.6249, std.dev.: 0.0045)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.00% (1.5986 => 1.6306, std.dev.: 0.0096)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.44% (1.6699 => 1.6940, std.dev.: 0.0009)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.34% (2.3882 => 2.4202, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.22% (5.0601 => 5.1218, std.dev.: 0.0185)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.98% (0.1774 => 0.1668, std.dev.: 0.0016)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -16.91% (2.8850 => 2.3971, std.dev.: 0.1680)
  MultiSource/Benchmarks/nbench/nbench: -10.08% (23.4696 => 21.1027, std.dev.: 0.5772)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -7.68% (0.5219 => 0.4818, std.dev.: 0.0130)
  MultiSource/Benchmarks/sim/sim: -5.02% (4.0134 => 3.8120, std.dev.: 0.0451)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.53% (6.0535 => 5.8397, std.dev.: 0.0620)
  SingleSource/Benchmarks/Shootout-C++/hash2: -1.72% (3.6605 => 3.5974, std.dev.: 0.0163)

Report Time: 0.65s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131202/b9e7167e/attachment.html>


More information about the llvm-testresults mailing list