[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Aug 7 12:12:59 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14185?compare_to=14182&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14185, Order: 187893, Start Time: 2013-08-07 17:25:27, End Time: 2013-08-07 19:14:51
      To: 14182, Order: 187888, Start Time: 2013-08-07 15:17:04, End Time: 2013-08-07 17:01:47
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 13 (33 on baseline)
Performance Improvements: 3 (29 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1089 (1043 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/nbench/nbench: 33.94% (1.3254 => 1.7752, std.dev.: 0.0097)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 22.58% (5.1099 => 6.2635, std.dev.: 0.4200)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.31% (1.4927 => 1.6615, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 9.28% (1.4610 => 1.5966, std.dev.: 0.0199)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.84% (1.4029 => 1.5129, std.dev.: 0.0307)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/flops: 20.73% (8.1353 => 9.8214, std.dev.: 0.0352)
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.23% (4.1201 => 4.8298, std.dev.: 0.1231)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.62% (0.6320 => 0.6675, std.dev.: 0.0037)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 3.72% (39.9741 => 41.4593, std.dev.: 0.4312)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 3.23% (4.4417 => 4.5853, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.51% (12.8772 => 13.1998, std.dev.: 0.0250)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.90% (1.6289 => 1.6599, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.26% (4.4993 => 4.5559, std.dev.: 0.0125)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.86% (5.1336 => 4.9870, std.dev.: 0.0553)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.18% (2.3669 => 2.3154, std.dev.: 0.0109)
  SingleSource/Benchmarks/Shootout-C++/lists: -1.24% (16.5962 => 16.3899, std.dev.: 0.0351)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: 0.68% (0.1316 => 0.1325, std.dev.: 0.0038)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.17% (0.2677 => 0.2735, std.dev.: 0.0311)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 39.50% (0.0200 => 0.0279, std.dev.: 0.0080)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -2.77% (0.2813 => 0.2735, std.dev.: 0.0311)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -19.13% (0.0345 => 0.0279, std.dev.: 0.0080)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/bigstack: 41.42% (0.0466 => 0.0659, std.dev.: 0.0006)
  MultiSource/Benchmarks/nbench/nbench: 29.79% (1.3677 => 1.7752, std.dev.: 0.0097)
  MultiSource/Benchmarks/FreeBench/distray/distray: 17.91% (0.1033 => 0.1218, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 8.19% (1.5357 => 1.6615, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.94% (1.5361 => 1.5966, std.dev.: 0.0199)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 75.73% (3.7285 => 6.5522, std.dev.: 0.0222)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.29% (2.8867 => 4.2806, std.dev.: 0.0117)
  MultiSource/Benchmarks/FreeBench/neural/neural: 40.11% (0.3171 => 0.4443, std.dev.: 0.0352)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: 33.14% (0.0341 => 0.0454, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout/hash: 22.45% (4.1846 => 5.1242, std.dev.: 0.0592)
  SingleSource/Benchmarks/Shootout-C++/hash: 19.33% (0.6295 => 0.7512, std.dev.: 0.0096)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.94% (7.0762 => 7.8504, std.dev.: 0.0290)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.37% (1.2557 => 1.3608, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.35% (5.4910 => 5.9495, std.dev.: 0.0347)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 8.16% (0.1348 => 0.1458, std.dev.: 0.0014)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.95% (48.3256 => 52.1657, std.dev.: 0.3483)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.39% (3.2027 => 3.4394, std.dev.: 0.0144)
  MultiSource/Benchmarks/FreeBench/mason/mason: 6.43% (0.2799 => 0.2979, std.dev.: 0.0068)
  SingleSource/Benchmarks/McGill/chomp: 6.30% (1.0051 => 1.0684, std.dev.: 0.0168)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.67% (3.4085 => 3.6016, std.dev.: 0.0288)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 5.58% (4.3151 => 4.5559, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.24% (5.1471 => 5.3655, std.dev.: 0.0418)
  SingleSource/Benchmarks/Misc/whetstone: 4.17% (3.4559 => 3.5999, std.dev.: 0.0133)
  MultiSource/Applications/spiff/spiff: 3.89% (2.7609 => 2.8684, std.dev.: 0.0385)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.25% (25.0200 => 25.8334, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.03% (4.8739 => 5.0215, std.dev.: 0.0328)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.01% (0.6480 => 0.6675, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.85% (3.3877 => 3.4843, std.dev.: 0.0250)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 2.75% (4.4624 => 4.5853, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.62% (12.8625 => 13.1998, std.dev.: 0.0250)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 2.41% (3.3464 => 3.4271, std.dev.: 0.0149)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.07% (1.5957 => 1.6287, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.19% (3.7593 => 3.8042, std.dev.: 0.0111)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Applications/hbd/hbd: -17.47% (2.0193 => 1.6666, std.dev.: 0.0166)
  MultiSource/Applications/sgefa/sgefa: -13.89% (0.4809 => 0.4141, std.dev.: 0.0069)
  MultiSource/Applications/ClamAV/clamscan: -11.59% (19.4145 => 17.1644, std.dev.: 0.4989)
  MultiSource/Applications/siod/siod: -6.80% (2.7150 => 2.5304, std.dev.: 0.0474)
  MultiSource/Applications/minisat/minisat: -5.82% (0.8278 => 0.7796, std.dev.: 0.0057)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -37.79% (1.4194 => 0.8830, std.dev.: 0.1409)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.39% (2.1022 => 1.4212, std.dev.: 0.1042)
  MultiSource/Benchmarks/MallocBench/gs/gs: -28.60% (0.1189 => 0.0849, std.dev.: 0.0087)
  MultiSource/Applications/viterbi/viterbi: -27.13% (3.4923 => 2.5450, std.dev.: 0.0385)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.63% (6.9552 => 5.2422, std.dev.: 0.0388)
  MultiSource/Applications/JM/ldecod/ldecod: -24.10% (0.0859 => 0.0652, std.dev.: 0.0065)
  SingleSource/Benchmarks/Misc/perlin: -21.35% (4.5989 => 3.6172, std.dev.: 0.0058)
  SingleSource/Benchmarks/Misc/mandel: -13.96% (1.1996 => 1.0321, std.dev.: 0.0397)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -11.78% (0.3557 => 0.3138, std.dev.: 0.0147)
  SingleSource/Benchmarks/Shootout/strcat: -7.16% (0.1593 => 0.1479, std.dev.: 0.0017)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.84% (47.2250 => 44.9384, std.dev.: 0.6111)
  SingleSource/Benchmarks/Misc/fbench: -4.49% (4.9602 => 4.7374, std.dev.: 0.0263)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.18% (1.1024 => 1.0563, std.dev.: 0.0052)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.72% (0.7806 => 0.7516, std.dev.: 0.0064)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.54% (21.6864 => 20.9195, std.dev.: 0.2012)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -3.53% (1.7207 => 1.6599, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.39% (6.0444 => 5.8393, std.dev.: 0.0459)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -2.66% (5.2218 => 5.0827, std.dev.: 0.0513)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.39% (8.6172 => 8.4109, std.dev.: 0.0674)
  SingleSource/Benchmarks/Misc/oourafft: -2.16% (3.7891 => 3.7074, std.dev.: 0.0216)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.74% (2.8052 => 2.7564, std.dev.: 0.0130)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.58% (5.0180 => 4.9388, std.dev.: 0.0275)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.36% (4.9231 => 4.8561, std.dev.: 0.0229)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -1.08% (2.1343 => 2.1113, std.dev.: 0.0072)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.85% (0.1378 => 0.1325, std.dev.: 0.0038)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130807/6fcb8329/attachment.html>


More information about the llvm-testresults mailing list