[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Oct 8 05:06:23 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16102?compare_to=16099&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16102, Order: 192177, Start Time: 2013-10-08 10:23:27, End Time: 2013-10-08 12:09:24
      To: 16099, Order: 192176, Start Time: 2013-10-08 08:17:55, End Time: 2013-10-08 10:01:55
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 17 (39 on baseline)
Performance Improvements: 6 (20 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1084 (1048 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.01% (4.1492 => 4.2326, std.dev.: 0.0072)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 20.35% (1.4854 => 1.7877, std.dev.: 0.0413)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 11.24% (0.4162 => 0.4630, std.dev.: 0.0002)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 9.65% (1.1041 => 1.2107, std.dev.: 0.0027)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 7.16% (2.8536 => 3.0578, std.dev.: 0.0017)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 4.56% (1.0227 => 1.0693, std.dev.: 0.0048)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.18% (0.6970 => 0.7261, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.40% (6.7233 => 6.9519, std.dev.: 0.0715)
  MultiSource/Applications/aha/aha: 3.00% (3.6092 => 3.7173, std.dev.: 0.0339)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.91% (5.2352 => 5.3874, std.dev.: 0.0176)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.73% (3.1317 => 3.2173, std.dev.: 0.0012)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 2.58% (0.3877 => 0.3977, std.dev.: 0.0011)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.36% (12.9779 => 13.2836, std.dev.: 0.0640)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.83% (1.0463 => 1.0654, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.71% (11.7140 => 11.9144, std.dev.: 0.0615)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.69% (1.7865 => 1.8167, std.dev.: 0.0040)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.13% (2.4969 => 2.5250, std.dev.: 0.0081)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: -20.15% (3.8647 => 3.0861, std.dev.: 0.1622)
  MultiSource/Benchmarks/Prolangs-C++/life/life: -3.29% (2.5598 => 2.4757, std.dev.: 0.0319)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -3.26% (1.6951 => 1.6399, std.dev.: 0.0176)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: -1.75% (4.0225 => 3.9521, std.dev.: 0.0225)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -1.48% (21.5818 => 21.2627, std.dev.: 0.1199)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -1.18% (61.3037 => 60.5830, std.dev.: 0.2027)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.22% (0.1351 => 0.1354, std.dev.: 0.0014)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 4.78% (4.0397 => 4.2326, std.dev.: 0.0072)
  MultiSource/Applications/lambda-0_1_3/lambda: 4.11% (0.8014 => 0.8343, std.dev.: 0.0069)
  MultiSource/Applications/siod/siod: 3.60% (2.4480 => 2.5362, std.dev.: 0.0079)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.30% (2.6492 => 2.7367, std.dev.: 0.0137)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.09% (0.9494 => 0.9787, std.dev.: 0.0080)
  MultiSource/Applications/spiff/spiff: 2.79% (0.8911 => 0.9160, std.dev.: 0.0083)
  MultiSource/Applications/SPASS/SPASS: 2.65% (16.1646 => 16.5934, std.dev.: 0.1099)
  MultiSource/Applications/Burg/burg: 2.64% (1.3994 => 1.4364, std.dev.: 0.0134)
  MultiSource/Applications/JM/ldecod/ldecod: 2.49% (7.4026 => 7.5867, std.dev.: 0.0542)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.41% (1.2932 => 1.3244, std.dev.: 0.0112)
  MultiSource/Applications/hbd/hbd: 2.29% (1.5696 => 1.6055, std.dev.: 0.0068)
  MultiSource/Applications/treecc/treecc: 2.15% (2.2516 => 2.2999, std.dev.: 0.0086)
  MultiSource/Applications/oggenc/oggenc: 1.91% (5.3339 => 5.4360, std.dev.: 0.0167)
  MultiSource/Applications/d/make_dparser: 1.90% (3.4962 => 3.5626, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.68% (1.2007 => 1.2209, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc-C++/bigfib: 1.66% (0.6439 => 0.6546, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.52% (1.2494 => 1.2684, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.36% (1.3278 => 1.3458, std.dev.: 0.0040)
  MultiSource/Applications/hexxagon/hexxagon: 1.23% (1.0276 => 1.0402, std.dev.: 0.0041)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.30% (7.6426 => 12.4805, std.dev.: 0.0520)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 20.55% (1.4830 => 1.7877, std.dev.: 0.0413)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 9.93% (1.1013 => 1.2107, std.dev.: 0.0027)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.34% (8.1346 => 8.6507, std.dev.: 0.1772)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 5.61% (0.1871 => 0.1976, std.dev.: 0.0006)
  SingleSource/UnitTests/Vector/multiplies: 5.43% (0.5561 => 0.5863, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 5.35% (6.5990 => 6.9519, std.dev.: 0.0715)
  SingleSource/Benchmarks/McGill/misr: 5.12% (0.3771 => 0.3964, std.dev.: 0.0001)
  MultiSource/Applications/aha/aha: 4.04% (3.5731 => 3.7173, std.dev.: 0.0339)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 4.02% (5.7757 => 6.0078, std.dev.: 0.0025)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 3.69% (0.2842 => 0.2947, std.dev.: 0.0013)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.68% (0.3836 => 0.3977, std.dev.: 0.0011)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.92% (1.7652 => 1.8167, std.dev.: 0.0040)
  MultiSource/Applications/siod/siod: 2.89% (3.5310 => 3.6330, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.54% (4.4696 => 4.5830, std.dev.: 0.0255)
  SingleSource/Regression/C/uint64_to_float: 2.09% (1.4528 => 1.4831, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.69% (1.0477 => 1.0654, std.dev.: 0.0001)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.61% (5.3022 => 5.3874, std.dev.: 0.0176)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.32% (3.8582 => 3.9091, std.dev.: 0.0069)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.31% (16.7972 => 17.0166, std.dev.: 0.0318)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.70% (0.1483 => 0.1176, std.dev.: 0.0023)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.52% (0.5226 => 0.2377, std.dev.: 0.0516)
  MultiSource/Applications/sgefa/sgefa: -47.06% (1.5790 => 0.8360, std.dev.: 0.0228)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -26.25% (0.0400 => 0.0295, std.dev.: 0.0005)
  SingleSource/Benchmarks/Linpack/linpack-pc: -22.20% (57.2347 => 44.5307, std.dev.: 2.9480)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -16.72% (15.9508 => 13.2836, std.dev.: 0.0640)
  MultiSource/Benchmarks/FreeBench/mason/mason: -11.77% (0.3304 => 0.2915, std.dev.: 0.0029)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.25% (20.8247 => 18.4825, std.dev.: 0.1449)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.96% (3.4956 => 3.2173, std.dev.: 0.0012)
  SingleSource/Benchmarks/Stanford/Puzzle: -7.74% (0.1834 => 0.1692, std.dev.: 0.0043)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.19% (50.0284 => 46.4299, std.dev.: 0.2783)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -6.50% (1.1075 => 1.0355, std.dev.: 0.0278)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -4.76% (30.1838 => 28.7460, std.dev.: 0.1138)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.76% (0.7474 => 0.7118, std.dev.: 0.0095)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.04% (4.3592 => 4.1833, std.dev.: 0.0507)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.41% (36.8417 => 35.5839, std.dev.: 0.4671)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.37% (5.4473 => 5.2635, std.dev.: 0.0418)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.65% (2.5938 => 2.5250, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.95% (17.1431 => 16.8093, std.dev.: 0.0239)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.67% (2.4471 => 2.4062, std.dev.: 0.0091)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.45% (0.1348 => 0.1354, std.dev.: 0.0014)

Report Time: 1.09s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131008/1b6994bc/attachment.html>


More information about the llvm-testresults mailing list