[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Oct 22 10:46:24 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16575?compare_to=16573&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16575, Order: 193166, Start Time: 2013-10-22 16:02:26, End Time: 2013-10-22 17:49:40
      To: 16573, Order: 193160, Start Time: 2013-10-22 13:47:10, End Time: 2013-10-22 15:36:44
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 6 (32 on baseline)
Performance Improvements: 27 (21 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1074 (1054 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 17.03% (4.6830 => 5.4803, std.dev.: 0.2076)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.87% (3.5149 => 3.7214, std.dev.: 0.0730)
  SingleSource/Benchmarks/McGill/misr: 3.91% (0.3991 => 0.4147, std.dev.: 0.0004)
  SingleSource/Benchmarks/Misc/fp-convert: 2.86% (7.5477 => 7.7639, std.dev.: 0.0441)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.08% (2.5200 => 2.5471, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.02% (3.1724 => 3.2047, std.dev.: 0.0076)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/McCat/05-eks/eks: -35.55% (0.8389 => 0.5407, std.dev.: 0.0292)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -32.61% (0.1521 => 0.1025, std.dev.: 0.0037)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -27.08% (1.6151 => 1.1777, std.dev.: 0.0069)
  MultiSource/Benchmarks/McCat/09-vor/vor: -26.33% (0.4983 => 0.3671, std.dev.: 0.0353)
  MultiSource/Benchmarks/McCat/18-imp/imp: -25.85% (0.5509 => 0.4085, std.dev.: 0.0061)
  MultiSource/Applications/aha/aha: -19.83% (0.1629 => 0.1306, std.dev.: 0.0098)
  MultiSource/Applications/lua/lua: -16.34% (5.1538 => 4.3119, std.dev.: 0.0227)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -14.29% (0.1764 => 0.1512, std.dev.: 0.0051)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -13.05% (1.3500 => 1.1738, std.dev.: 0.0621)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: -11.87% (5.6817 => 5.0073, std.dev.: 0.1829)
  MultiSource/Applications/oggenc/oggenc: -9.71% (6.0687 => 5.4796, std.dev.: 0.1399)
  MultiSource/Benchmarks/Bullet/bullet: -9.27% (36.9800 => 33.5530, std.dev.: 1.1566)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -8.42% (1.3927 => 1.2755, std.dev.: 0.0113)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -7.85% (8.0550 => 7.4230, std.dev.: 0.1081)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -7.37% (1.3508 => 1.2512, std.dev.: 0.0104)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -6.64% (0.2935 => 0.2740, std.dev.: 0.0060)
  MultiSource/Benchmarks/Prolangs-C++/city/city: -6.00% (1.5931 => 1.4975, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -5.04% (1.4140 => 1.3427, std.dev.: 0.0127)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -4.64% (47.2860 => 45.0926, std.dev.: 0.3940)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.44% (1.3048 => 1.2729, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.33% (1.2518 => 1.2351, std.dev.: 0.0050)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/SPASS/SPASS: -26.74% (11.0234 => 8.0753, std.dev.: 1.0915)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -21.30% (0.0690 => 0.0543, std.dev.: 0.0001)
  MultiSource/Benchmarks/McCat/09-vor/vor: -14.32% (0.1327 => 0.1137, std.dev.: 0.0031)
  MultiSource/Benchmarks/Bullet/bullet: -4.45% (7.3852 => 7.0564, std.dev.: 0.0097)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.33% (0.3428 => 0.3314, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.08% (5.1334 => 5.0264, std.dev.: 0.0190)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 5.14% (0.1304 => 0.1371, std.dev.: 0.0076)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/oourafft: 6.97% (0.2294 => 0.2454, std.dev.: 0.0008)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 5.80% (0.4624 => 0.4892, std.dev.: 0.0049)
  MultiSource/Benchmarks/McCat/18-imp/imp: 5.15% (0.3885 => 0.4085, std.dev.: 0.0061)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.37% (1.1393 => 1.1777, std.dev.: 0.0069)
  MultiSource/Benchmarks/MallocBench/gs/gs: 3.35% (4.5883 => 4.7422, std.dev.: 0.0381)
  MultiSource/Benchmarks/Prolangs-C/football/football: 3.08% (0.9828 => 1.0131, std.dev.: 0.0084)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 2.76% (0.5609 => 0.5764, std.dev.: 0.0032)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.73% (9.9903 => 10.2628, std.dev.: 0.0347)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.17% (1.8775 => 1.9183, std.dev.: 0.0051)
  MultiSource/Applications/lua/lua: 2.08% (4.2242 => 4.3119, std.dev.: 0.0227)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.03% (1.0952 => 1.1174, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.64% (1.2152 => 1.2351, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.39% (1.3278 => 1.3463, std.dev.: 0.0010)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 1.24% (1.4792 => 1.4975, std.dev.: 0.0068)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.78% (7.6426 => 12.5168, std.dev.: 0.0456)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 21.44% (1.1431 => 1.3882, std.dev.: 0.0513)
  SingleSource/Benchmarks/Shootout/ary3: 16.67% (4.6972 => 5.4803, std.dev.: 0.2076)
  SingleSource/Benchmarks/McGill/misr: 9.97% (0.3771 => 0.4147, std.dev.: 0.0004)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0120)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.72% (3.1730 => 3.3544, std.dev.: 0.0177)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.60% (6.5990 => 6.9685, std.dev.: 0.1282)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 4.25% (0.3836 => 0.3999, std.dev.: 0.0060)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.57% (5.3716 => 5.5633, std.dev.: 0.0517)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.14% (89.7126 => 92.5255, std.dev.: 0.6788)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 3.10% (1.1013 => 1.1354, std.dev.: 0.0116)
  MultiSource/Benchmarks/Olden/power/power: 2.38% (1.2170 => 1.2460, std.dev.: 0.0011)
  SingleSource/Benchmarks/Misc/fp-convert: 2.32% (7.5877 => 7.7639, std.dev.: 0.0441)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.79% (8.1346 => 8.2802, std.dev.: 0.0244)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.62% (1.7652 => 1.7938, std.dev.: 0.0087)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.60% (16.7972 => 17.0660, std.dev.: 0.0407)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.51% (3.1569 => 3.2047, std.dev.: 0.0076)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.38% (6.7429 => 6.8360, std.dev.: 0.0229)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: -8.13% (0.2571 => 0.2362, std.dev.: 0.0013)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -53.27% (0.5226 => 0.2442, std.dev.: 0.0060)
  MultiSource/Applications/sgefa/sgefa: -42.98% (1.5790 => 0.9004, std.dev.: 0.0076)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -32.00% (0.0400 => 0.0272, std.dev.: 0.0000)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.58% (57.2347 => 43.7398, std.dev.: 3.4878)
  MultiSource/Benchmarks/mafft/pairlocalalign: -18.29% (50.0284 => 40.8795, std.dev.: 1.7261)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.01% (15.9508 => 13.2383, std.dev.: 0.2381)
  MultiSource/Benchmarks/FreeBench/mason/mason: -12.02% (0.3304 => 0.2907, std.dev.: 0.0149)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.83% (20.8247 => 18.3619, std.dev.: 0.2018)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.57% (3.4956 => 3.1260, std.dev.: 0.0308)
  MultiSource/Applications/JM/lencod/lencod: -6.70% (8.1785 => 7.6309, std.dev.: 0.0794)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.34% (0.3501 => 0.3314, std.dev.: 0.0038)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.74% (0.7474 => 0.7120, std.dev.: 0.0107)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.34% (2.5938 => 2.4813, std.dev.: 0.0246)
  MultiSource/Applications/SIBsim4/SIBsim4: -2.87% (3.7437 => 3.6362, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.48% (17.1431 => 16.7175, std.dev.: 0.0615)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.47% (1.1075 => 1.0802, std.dev.: 0.0094)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.34% (3.7874 => 3.6988, std.dev.: 0.0231)
  SingleSource/Benchmarks/Misc/oourafft: -2.12% (3.7484 => 3.6689, std.dev.: 0.0272)
  SingleSource/Benchmarks/Misc/flops: -1.82% (9.4433 => 9.2712, std.dev.: 0.0619)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.54% (2.4471 => 2.4094, std.dev.: 0.0076)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.71% (0.1348 => 0.1371, std.dev.: 0.0076)

Report Time: 0.73s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131022/a2475c42/attachment.html>


More information about the llvm-testresults mailing list