[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results

Thu Sep 26 19:39:53 PDT 2013

http://llvm.org/perf/db_default/v4/nts/15709?compare_to=15705&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15709, Order: 191472, Start Time: 2013-09-27 00:51:02, End Time: 2013-09-27 02:42:41
      To: 15705, Order: 191465, Start Time: 2013-09-26 22:35:29, End Time: 2013-09-27 00:25:11
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 36 (48 on baseline)
Performance Improvements: 4 (16 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1067 (1043 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 76.71% (0.1374 => 0.2428, std.dev.: 0.0048)
  MultiSource/Benchmarks/Olden/tsp/tsp: 76.03% (0.1360 => 0.2394, std.dev.: 0.0093)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 68.84% (0.1011 => 0.1707, std.dev.: 0.0027)
  MultiSource/Benchmarks/McCat/15-trie/trie: 66.16% (0.0653 => 0.1085, std.dev.: 0.0100)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 61.93% (0.2640 => 0.4275, std.dev.: 0.0309)
  MultiSource/Benchmarks/Olden/mst/mst: 57.73% (0.1346 => 0.2123, std.dev.: 0.0171)
  MultiSource/Benchmarks/McCat/09-vor/vor: 54.85% (0.3568 => 0.5525, std.dev.: 0.0400)
  MultiSource/Benchmarks/McCat/05-eks/eks: 40.37% (0.5316 => 0.7462, std.dev.: 0.0254)
  MultiSource/Applications/spiff/spiff: 38.23% (0.9220 => 1.2745, std.dev.: 0.0501)
  MultiSource/Benchmarks/McCat/18-imp/imp: 34.02% (0.4112 => 0.5511, std.dev.: 0.0436)
  MultiSource/Benchmarks/MallocBench/gs/gs: 32.25% (4.6781 => 6.1868, std.dev.: 0.3931)
  MultiSource/Applications/obsequi/Obsequi: 30.83% (1.1706 => 1.5315, std.dev.: 0.1341)
  MultiSource/Applications/lua/lua: 22.68% (4.3386 => 5.3226, std.dev.: 0.2470)
  MultiSource/Applications/sqlite3/sqlite3: 16.24% (16.7811 => 19.5067, std.dev.: 0.1080)
  MultiSource/Applications/kimwitu++/kc: 12.95% (18.8500 => 21.2909, std.dev.: 0.4404)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.98% (25.3131 => 27.5874, std.dev.: 0.4944)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 109.57% (0.1359 => 0.2848, std.dev.: 0.0172)
  MultiSource/Applications/d/make_dparser: 71.69% (0.0385 => 0.0661, std.dev.: 0.0012)
  MultiSource/Applications/lemon/lemon: 69.31% (0.8807 => 1.4911, std.dev.: 0.1045)
  MultiSource/Benchmarks/Olden/bisort/bisort: 52.73% (0.6621 => 1.0112, std.dev.: 0.0745)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 43.63% (0.0965 => 0.1386, std.dev.: 0.0035)
  MultiSource/Applications/minisat/minisat: 38.01% (6.3748 => 8.7980, std.dev.: 0.1162)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 26.22% (1.4593 => 1.8420, std.dev.: 0.1205)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 23.62% (1.2750 => 1.5761, std.dev.: 0.1118)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 21.71% (0.0502 => 0.0611, std.dev.: 0.0022)
  MultiSource/Benchmarks/llubenchmark/llu: 18.18% (1.9950 => 2.3577, std.dev.: 0.1016)
  MultiSource/Benchmarks/Olden/tsp/tsp: 16.83% (1.5522 => 1.8135, std.dev.: 0.0799)
  MultiSource/Benchmarks/Olden/power/power: 4.50% (1.2459 => 1.3020, std.dev.: 0.0190)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.67% (3.4871 => 3.6151, std.dev.: 0.0473)
  MultiSource/Applications/siod/siod: 3.58% (3.6201 => 3.7498, std.dev.: 0.0118)
  MultiSource/Applications/lua/lua: 3.43% (29.8122 => 30.8333, std.dev.: 0.1508)
  SingleSource/Benchmarks/Shootout/hash: 3.17% (4.9836 => 5.1418, std.dev.: 0.0131)
  MultiSource/Benchmarks/Olden/em3d/em3d: 2.85% (5.0305 => 5.1739, std.dev.: 0.0420)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.61% (3.5572 => 3.6500, std.dev.: 0.0326)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.94% (4.1956 => 4.2770, std.dev.: 0.0242)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.25% (3.7821 => 3.8292, std.dev.: 0.0056)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -11.18% (0.0903 => 0.0802, std.dev.: 0.0024)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/sieve: -17.13% (8.4933 => 7.0385, std.dev.: 0.1452)
  SingleSource/Regression/C/uint64_to_float: -6.99% (1.4827 => 1.3790, std.dev.: 0.0167)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.46% (41.1072 => 40.5090, std.dev.: 0.1947)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 32.05% (0.1351 => 0.1784, std.dev.: 0.0129)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Olden/tsp/tsp: 84.58% (0.1297 => 0.2394, std.dev.: 0.0093)
  MultiSource/Benchmarks/McCat/04-bisect/bisect: 82.15% (0.1333 => 0.2428, std.dev.: 0.0048)
  MultiSource/Benchmarks/McCat/15-trie/trie: 75.85% (0.0617 => 0.1085, std.dev.: 0.0100)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: 68.18% (0.1015 => 0.1707, std.dev.: 0.0027)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 62.24% (0.2635 => 0.4275, std.dev.: 0.0309)
  MultiSource/Benchmarks/Olden/mst/mst: 61.94% (0.1311 => 0.2123, std.dev.: 0.0171)
  MultiSource/Benchmarks/McCat/09-vor/vor: 58.76% (0.3480 => 0.5525, std.dev.: 0.0400)
  MultiSource/Benchmarks/McCat/05-eks/eks: 43.92% (0.5185 => 0.7462, std.dev.: 0.0254)
  MultiSource/Applications/spiff/spiff: 43.03% (0.8911 => 1.2745, std.dev.: 0.0501)
  MultiSource/Benchmarks/McCat/18-imp/imp: 41.85% (0.3885 => 0.5511, std.dev.: 0.0436)
  MultiSource/Benchmarks/MallocBench/gs/gs: 34.84% (4.5883 => 6.1868, std.dev.: 0.3931)
  MultiSource/Applications/obsequi/Obsequi: 32.59% (1.1551 => 1.5315, std.dev.: 0.1341)
  MultiSource/Applications/lua/lua: 26.00% (4.2242 => 5.3226, std.dev.: 0.2470)
  MultiSource/Applications/sqlite3/sqlite3: 19.76% (16.2888 => 19.5067, std.dev.: 0.1080)
  MultiSource/Applications/kimwitu++/kc: 15.96% (18.3608 => 21.2909, std.dev.: 0.4404)
  MultiSource/Applications/minisat/minisat: 12.90% (0.7439 => 0.8399, std.dev.: 0.0334)
  MultiSource/Applications/lemon/lemon: 12.79% (1.1862 => 1.3379, std.dev.: 0.0547)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 12.08% (24.6139 => 27.5874, std.dev.: 0.4944)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.33% (1.0756 => 1.1975, std.dev.: 0.0424)
  MultiSource/Benchmarks/Prolangs-C++/ocean/ocean: 7.16% (0.1467 => 0.1572, std.dev.: 0.0030)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 106.83% (0.1377 => 0.2848, std.dev.: 0.0172)
  MultiSource/Applications/lemon/lemon: 74.89% (0.8526 => 1.4911, std.dev.: 0.1045)
  MultiSource/Applications/d/make_dparser: 72.14% (0.0384 => 0.0661, std.dev.: 0.0012)
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.07% (7.6426 => 12.4626, std.dev.: 0.0776)
  MultiSource/Benchmarks/Olden/bisort/bisort: 52.13% (0.6647 => 1.0112, std.dev.: 0.0745)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 46.05% (0.0949 => 0.1386, std.dev.: 0.0035)
  MultiSource/Applications/minisat/minisat: 40.18% (6.2760 => 8.7980, std.dev.: 0.1162)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 22.94% (0.0497 => 0.0611, std.dev.: 0.0022)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 21.40% (0.1374 => 0.1668, std.dev.: 0.0022)
  MultiSource/Benchmarks/llubenchmark/llu: 18.54% (1.9889 => 2.3577, std.dev.: 0.1016)
  MultiSource/Benchmarks/Olden/tsp/tsp: 16.60% (1.5553 => 1.8135, std.dev.: 0.0799)
  MultiSource/Benchmarks/Olden/power/power: 6.98% (1.2170 => 1.3020, std.dev.: 0.0190)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.50% (8.1346 => 8.6635, std.dev.: 0.0638)
  MultiSource/Applications/siod/siod: 6.20% (3.5310 => 3.7498, std.dev.: 0.0118)
  SingleSource/UnitTests/Vector/multiplies: 6.13% (0.5561 => 0.5902, std.dev.: 0.0078)
  MultiSource/Applications/lua/lua: 4.45% (29.5202 => 30.8333, std.dev.: 0.1508)
  MultiSource/Applications/spiff/spiff: 3.38% (2.8194 => 2.9147, std.dev.: 0.0366)
  MultiSource/Applications/hexxagon/hexxagon: 2.92% (14.7810 => 15.2129, std.dev.: 0.0485)
  MultiSource/Benchmarks/Olden/em3d/em3d: 2.89% (5.0288 => 5.1739, std.dev.: 0.0420)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.50% (1.7652 => 1.8094, std.dev.: 0.0158)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.41% (5.4925 => 5.6246, std.dev.: 0.0434)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.13% (2.4920 => 2.5452, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.04% (3.1569 => 3.2212, std.dev.: 0.0229)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.88% (3.8582 => 3.9309, std.dev.: 0.0034)
  SingleSource/Benchmarks/Misc/ffbench: 1.54% (1.4030 => 1.4246, std.dev.: 0.0060)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 1.39% (39.9519 => 40.5090, std.dev.: 0.1947)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (3.7874 => 3.8292, std.dev.: 0.0056)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.05% (16.7972 => 16.9741, std.dev.: 0.0474)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -21.51% (0.1483 => 0.1164, std.dev.: 0.0063)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -52.14% (0.5226 => 0.2501, std.dev.: 0.0605)
  MultiSource/Applications/sgefa/sgefa: -46.85% (1.5790 => 0.8393, std.dev.: 0.0347)
  SingleSource/Benchmarks/Linpack/linpack-pc: -26.47% (57.2347 => 42.0872, std.dev.: 3.6384)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.91% (15.9508 => 12.9339, std.dev.: 0.4573)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -12.07% (20.8247 => 18.3108, std.dev.: 0.1426)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.62% (3.4956 => 3.1243, std.dev.: 0.0434)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.25% (3.0561 => 2.8650, std.dev.: 0.0657)
  SingleSource/Regression/C/uint64_to_float: -5.08% (1.4528 => 1.3790, std.dev.: 0.0167)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.44% (3.7437 => 3.6151, std.dev.: 0.0473)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.96% (17.1431 => 16.6364, std.dev.: 0.1374)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.14% (2.5938 => 2.5382, std.dev.: 0.0027)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.89% (4.3592 => 4.2770, std.dev.: 0.0242)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.33% (2.4471 => 2.4145, std.dev.: 0.0047)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.20% (89.7126 => 88.6401, std.dev.: 0.0696)
  SingleSource/Benchmarks/Shootout/hash: -1.14% (5.2009 => 5.1418, std.dev.: 0.0131)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 32.34% (0.1348 => 0.1784, std.dev.: 0.0129)

Report Time: 0.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130926/85559eb0/attachment.html>

[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results