[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results

Tue Oct 22 17:46:59 PDT 2013

http://llvm.org/perf/db_default/v4/nts/16586?compare_to=16582&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16586, Order: 193203, Start Time: 2013-10-22 22:56:47, End Time: 2013-10-23 00:50:17
      To: 16582, Order: 193189, Start Time: 2013-10-22 20:37:29, End Time: 2013-10-22 22:33:00
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 36 (62 on baseline)
Performance Improvements: 17 (16 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1054 (1029 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 44.05% (0.2704 => 0.3895, std.dev.: 0.0411)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 32.64% (0.7365 => 0.9769, std.dev.: 0.0913)
  MultiSource/Benchmarks/Olden/tsp/tsp: 30.76% (0.1476 => 0.1930, std.dev.: 0.0117)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 30.41% (0.2335 => 0.3045, std.dev.: 0.0068)
  MultiSource/Applications/hbd/hbd: 29.27% (1.6466 => 2.1285, std.dev.: 0.1282)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 26.01% (0.2161 => 0.2723, std.dev.: 0.0129)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 25.56% (0.7769 => 0.9755, std.dev.: 0.0394)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 21.87% (0.1125 => 0.1371, std.dev.: 0.0059)
  MultiSource/Benchmarks/MallocBench/gs/gs: 18.06% (5.0849 => 6.0034, std.dev.: 0.2811)
  MultiSource/Benchmarks/McCat/18-imp/imp: 17.85% (0.4453 => 0.5248, std.dev.: 0.0150)
  MultiSource/Applications/lua/lua: 16.68% (4.3440 => 5.0685, std.dev.: 0.2712)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 12.45% (0.2626 => 0.2953, std.dev.: 0.0025)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.96% (4.3924 => 4.9176, std.dev.: 0.0453)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 11.74% (1.1202 => 1.2517, std.dev.: 0.0263)
  MultiSource/Applications/sqlite3/sqlite3: 9.15% (17.4755 => 19.0737, std.dev.: 0.4220)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.06% (2.9044 => 3.1674, std.dev.: 0.0730)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 4.50% (2.1502 => 2.2469, std.dev.: 0.0123)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/lemon/lemon: 63.22% (0.9517 => 1.5534, std.dev.: 0.0660)
  SingleSource/Benchmarks/Stanford/Bubblesort: 62.99% (0.0308 => 0.0502, std.dev.: 0.0038)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 57.71% (0.8753 => 1.3804, std.dev.: 0.0179)
  SingleSource/Benchmarks/Stanford/Quicksort: 43.41% (0.0258 => 0.0370, std.dev.: 0.0034)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 37.25% (4.8525 => 6.6599, std.dev.: 0.1516)
  MultiSource/Applications/JM/ldecod/ldecod: 35.99% (0.0689 => 0.0937, std.dev.: 0.0048)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 35.97% (0.1454 => 0.1977, std.dev.: 0.0189)
  MultiSource/Benchmarks/llubenchmark/llu: 20.42% (2.0125 => 2.4235, std.dev.: 0.0790)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.10% (2.1140 => 2.4120, std.dev.: 0.0048)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 9.84% (0.4176 => 0.4587, std.dev.: 0.0088)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 6.12% (4.0171 => 4.2628, std.dev.: 0.0558)
  MultiSource/Benchmarks/Olden/tsp/tsp: 4.50% (1.6442 => 1.7182, std.dev.: 0.0128)
  SingleSource/Benchmarks/Misc/salsa20: 3.95% (7.8513 => 8.1616, std.dev.: 0.0640)
  SingleSource/Benchmarks/Misc/flops: 2.83% (9.3699 => 9.6346, std.dev.: 0.0136)
  SingleSource/Benchmarks/Misc/fp-convert: 1.99% (7.3953 => 7.5427, std.dev.: 0.0139)
  SingleSource/Benchmarks/Shootout/methcall: 1.74% (8.4884 => 8.6357, std.dev.: 0.0041)
  SingleSource/Benchmarks/Shootout/fib2: 1.66% (3.5905 => 3.6500, std.dev.: 0.0049)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 1.65% (2.0893 => 2.1237, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.37% (5.9464 => 6.0279, std.dev.: 0.0026)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/NPB-serial/is/is: -22.29% (0.1099 => 0.0854, std.dev.: 0.0051)
  SingleSource/Benchmarks/Shootout-C++/methcall: -20.32% (0.2711 => 0.2160, std.dev.: 0.0192)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -14.92% (1.4842 => 1.2628, std.dev.: 0.0662)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: -11.71% (0.1307 => 0.1154, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -9.67% (1.4662 => 1.3244, std.dev.: 0.0196)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -6.60% (0.2258 => 0.2109, std.dev.: 0.0025)
  MultiSource/Applications/SPASS/SPASS: -3.27% (17.5733 => 16.9990, std.dev.: 0.1470)
  MultiSource/Applications/treecc/treecc: -1.70% (2.4077 => 2.3667, std.dev.: 0.0114)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/simul/simul: -95.83% (0.0120 => 0.0005, std.dev.: 0.0037)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -29.00% (0.0438 => 0.0311, std.dev.: 0.0046)
  SingleSource/Benchmarks/Shootout/hash: -10.31% (5.8562 => 5.2522, std.dev.: 0.2187)
  MultiSource/Applications/spiff/spiff: -7.09% (3.0242 => 2.8097, std.dev.: 0.0811)
  MultiSource/Applications/minisat/minisat: -6.08% (9.2946 => 8.7292, std.dev.: 0.0232)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -5.78% (2.5044 => 2.3597, std.dev.: 0.0351)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -5.43% (1.4738 => 1.3937, std.dev.: 0.0175)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -4.16% (4.7726 => 4.5740, std.dev.: 0.0038)
  MultiSource/Applications/siod/siod: -2.56% (3.5913 => 3.4994, std.dev.: 0.0296)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 35.56% (0.1330 => 0.1803, std.dev.: 0.0147)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Stanford/Towers: 70.51% (0.0495 => 0.0844, std.dev.: 0.0100)
  MultiSource/Benchmarks/McCat/08-main/main: 49.02% (0.2870 => 0.4277, std.dev.: 0.0249)
  MultiSource/Benchmarks/Olden/tsp/tsp: 48.80% (0.1297 => 0.1930, std.dev.: 0.0117)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: 47.82% (0.2635 => 0.3895, std.dev.: 0.0411)
  SingleSource/Benchmarks/Shootout/ackermann: 44.31% (0.0246 => 0.0355, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 42.94% (0.1905 => 0.2723, std.dev.: 0.0129)
  MultiSource/Benchmarks/Prolangs-C/gnugo/gnugo: 38.82% (0.7037 => 0.9769, std.dev.: 0.0913)
  MultiSource/Benchmarks/McCat/01-qbsort/qbsort: 37.60% (0.1024 => 0.1409, std.dev.: 0.0142)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 36.93% (0.9212 => 1.2614, std.dev.: 0.1223)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 35.79% (0.7184 => 0.9755, std.dev.: 0.0394)
  MultiSource/Applications/hbd/hbd: 35.61% (1.5696 => 2.1285, std.dev.: 0.1282)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: 35.34% (0.1013 => 0.1371, std.dev.: 0.0059)
  MultiSource/Benchmarks/McCat/18-imp/imp: 35.08% (0.3885 => 0.5248, std.dev.: 0.0150)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 34.79% (0.2259 => 0.3045, std.dev.: 0.0068)
  MultiSource/Benchmarks/MallocBench/gs/gs: 30.84% (4.5883 => 6.0034, std.dev.: 0.2811)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 29.07% (5.5014 => 7.1008, std.dev.: 0.5828)
  MultiSource/Applications/ClamAV/clamscan: 24.81% (16.5398 => 20.6427, std.dev.: 0.6716)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 21.73% (4.0397 => 4.9176, std.dev.: 0.0453)
  MultiSource/Benchmarks/Olden/mst/mst: 20.44% (0.1311 => 0.1579, std.dev.: 0.0098)
  MultiSource/Applications/lua/lua: 19.99% (4.2242 => 5.0685, std.dev.: 0.2712)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 19.56% (2.6492 => 3.1674, std.dev.: 0.0730)
  MultiSource/Applications/sqlite3/sqlite3: 17.10% (16.2888 => 19.0737, std.dev.: 0.4220)
  MultiSource/Benchmarks/Prolangs-C/football/football: 17.08% (0.9828 => 1.1507, std.dev.: 0.0602)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 16.37% (1.0756 => 1.2517, std.dev.: 0.0263)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 15.37% (1.9476 => 2.2469, std.dev.: 0.0123)
  MultiSource/Applications/kimwitu++/kc: 14.79% (18.3608 => 21.0771, std.dev.: 0.4445)
  MultiSource/Applications/JM/ldecod/ldecod: 14.52% (7.4026 => 8.4778, std.dev.: 0.3938)
  MultiSource/Applications/lemon/lemon: 14.12% (1.1862 => 1.3537, std.dev.: 0.0385)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 13.53% (0.2601 => 0.2953, std.dev.: 0.0025)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: 9.80% (0.1051 => 0.1154, std.dev.: 0.0025)
  MultiSource/Applications/siod/siod: 8.55% (2.4480 => 2.6572, std.dev.: 0.0574)
  MultiSource/Applications/SPASS/SPASS: 5.16% (16.1646 => 16.9990, std.dev.: 0.1470)
  MultiSource/Applications/treecc/treecc: 5.11% (2.2516 => 2.3667, std.dev.: 0.0114)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 104.21% (0.1377 => 0.2812, std.dev.: 0.0161)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 86.29% (0.7410 => 1.3804, std.dev.: 0.0179)
  MultiSource/Applications/lemon/lemon: 82.20% (0.8526 => 1.5534, std.dev.: 0.0660)
  SingleSource/Benchmarks/Stanford/Bubblesort: 79.93% (0.0279 => 0.0502, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.58% (7.6426 => 12.5020, std.dev.: 0.0709)
  MultiSource/Benchmarks/Olden/bisort/bisort: 54.16% (0.6647 => 1.0247, std.dev.: 0.0125)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 46.44% (4.5479 => 6.6599, std.dev.: 0.1516)
  MultiSource/Applications/JM/ldecod/ldecod: 43.93% (0.0651 => 0.0937, std.dev.: 0.0048)
  MultiSource/Applications/minisat/minisat: 39.09% (6.2760 => 8.7292, std.dev.: 0.0232)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 30.63% (1.3143 => 1.7169, std.dev.: 0.1064)
  SingleSource/Benchmarks/Shootout/ary3: 27.52% (4.6972 => 5.9901, std.dev.: 0.2298)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 22.01% (1.3008 => 1.5871, std.dev.: 0.0252)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 21.92% (1.1431 => 1.3937, std.dev.: 0.0175)
  MultiSource/Benchmarks/llubenchmark/llu: 21.85% (1.9889 => 2.4235, std.dev.: 0.0790)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 14.25% (2.1111 => 2.4120, std.dev.: 0.0048)
  MultiSource/Benchmarks/Olden/tsp/tsp: 10.47% (1.5553 => 1.7182, std.dev.: 0.0128)
  SingleSource/Benchmarks/McGill/chomp: 9.36% (1.0161 => 1.1112, std.dev.: 0.0164)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.42% (3.1730 => 3.4085, std.dev.: 0.0342)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 6.55% (4.0006 => 4.2628, std.dev.: 0.0558)
  SingleSource/Benchmarks/Misc/salsa20: 4.68% (7.7964 => 8.1616, std.dev.: 0.0640)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.19% (89.7126 => 92.5743, std.dev.: 0.2545)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.15% (4.0596 => 4.1875, std.dev.: 0.0438)
  MultiSource/Benchmarks/Olden/power/power: 2.96% (1.2170 => 1.2530, std.dev.: 0.0114)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.36% (1.7652 => 1.8068, std.dev.: 0.0096)
  SingleSource/Benchmarks/Misc/flops: 2.03% (9.4433 => 9.6346, std.dev.: 0.0136)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.55% (8.1346 => 8.2606, std.dev.: 0.0265)
  SingleSource/Benchmarks/Shootout/fib2: 1.48% (3.5966 => 3.6500, std.dev.: 0.0049)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.42% (16.7972 => 17.0362, std.dev.: 0.0242)
  SingleSource/Benchmarks/Shootout/methcall: 1.08% (8.5434 => 8.6357, std.dev.: 0.0041)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -19.82% (0.1483 => 0.1189, std.dev.: 0.0036)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -49.33% (0.5226 => 0.2648, std.dev.: 0.0306)
  MultiSource/Applications/sgefa/sgefa: -42.65% (1.5790 => 0.9055, std.dev.: 0.0062)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -31.25% (0.0400 => 0.0275, std.dev.: 0.0047)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.49% (15.9508 => 13.0012, std.dev.: 0.4296)
  MultiSource/Benchmarks/mafft/pairlocalalign: -18.22% (50.0284 => 40.9118, std.dev.: 2.5986)
  SingleSource/Benchmarks/Linpack/linpack-pc: -14.84% (57.2347 => 48.7390, std.dev.: 1.9310)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.20% (20.8247 => 18.4928, std.dev.: 0.1062)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.75% (3.4956 => 3.1197, std.dev.: 0.1088)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.65% (0.3304 => 0.2985, std.dev.: 0.0033)
  MultiSource/Benchmarks/Olden/em3d/em3d: -8.31% (5.0288 => 4.6111, std.dev.: 0.0818)
  MultiSource/Applications/JM/lencod/lencod: -5.52% (8.1785 => 7.7270, std.dev.: 0.1011)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.78% (3.7874 => 3.6822, std.dev.: 0.0264)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.45% (17.1431 => 16.7223, std.dev.: 0.0595)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.64% (4.3592 => 4.2879, std.dev.: 0.0228)
  SingleSource/Benchmarks/Misc/whetstone: -1.27% (3.6303 => 3.5843, std.dev.: 0.0099)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 33.75% (0.1348 => 0.1803, std.dev.: 0.0147)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131022/069a3fa8/attachment.html>

[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

[llvm-testresults] chinook-clangslave1O3-plainclang_DEV__powerpc64 test results