[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Oct 29 17:03:04 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16815?compare_to=16808&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16815, Order: 193653, Start Time: 2013-10-29 22:08:39, End Time: 2013-10-30 00:06:29
      To: 16808, Order: 193614, Start Time: 2013-10-29 16:04:33, End Time: 2013-10-29 18:02:52
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 20 (37 on baseline)
Performance Improvements: 18 (17 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1069 (1053 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 68.03% (0.0463 => 0.0778, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc/pi: 55.16% (0.0223 => 0.0346, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc-C++/mandel-text: 51.44% (0.0243 => 0.0368, std.dev.: 0.0036)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 12.86% (53.0552 => 59.8773, std.dev.: 0.6696)
  SingleSource/Benchmarks/Shootout-C++/fibo: 12.61% (0.1887 => 0.2125, std.dev.: 0.0020)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 76.00% (2.8307 => 4.9821, std.dev.: 0.3450)
  SingleSource/Benchmarks/Shootout/heapsort: 75.92% (2.9499 => 5.1896, std.dev.: 0.0957)
  SingleSource/Benchmarks/Shootout-C++/ary: 29.06% (0.0382 => 0.0493, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout/ary3: 28.29% (4.6864 => 6.0123, std.dev.: 0.0998)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.69% (4.9783 => 5.3609, std.dev.: 0.0574)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.01% (3.6079 => 3.8609, std.dev.: 0.0056)
  SingleSource/Benchmarks/Misc/mandel-2: 5.05% (0.8355 => 0.8777, std.dev.: 0.0079)
  SingleSource/Regression/C/uint64_to_float: 4.39% (1.4274 => 1.4901, std.dev.: 0.0073)
  SingleSource/Benchmarks/Stanford/FloatMM: 3.67% (0.6950 => 0.7205, std.dev.: 0.0048)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: 3.23% (0.7112 => 0.7342, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.18% (3.1530 => 3.2217, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.10% (5.1286 => 5.2364, std.dev.: 0.0066)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.66% (2.3805 => 2.4200, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/dt: 1.04% (0.9843 => 0.9945, std.dev.: 0.0018)
  SingleSource/Benchmarks/CoyoteBench/almabench: 1.01% (35.0990 => 35.4518, std.dev.: 0.0740)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -22.99% (2.2709 => 1.7488, std.dev.: 0.1701)
  MultiSource/Applications/kimwitu++/kc: -14.13% (21.8457 => 18.7587, std.dev.: 0.3961)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -11.38% (0.1450 => 0.1285, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -11.03% (1.5418 => 1.3717, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -9.69% (1.4509 => 1.3103, std.dev.: 0.0140)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -9.61% (1.5894 => 1.4367, std.dev.: 0.0391)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -5.44% (0.1855 => 0.1754, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.34% (1.3323 => 1.2611, std.dev.: 0.0244)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.30% (1.3125 => 1.2560, std.dev.: 0.0115)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -3.73% (1.2778 => 1.2301, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.52% (1.4108 => 1.3612, std.dev.: 0.0192)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.70% (1.3535 => 1.3170, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -2.36% (1.3808 => 1.3482, std.dev.: 0.0101)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.60% (1.2034 => 1.1842, std.dev.: 0.0031)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc/pi: -18.40% (2.0401 => 1.6648, std.dev.: 0.0214)
  MultiSource/Applications/minisat/minisat: -9.89% (7.2973 => 6.5756, std.dev.: 0.2205)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -4.20% (0.3334 => 0.3194, std.dev.: 0.0052)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -1.02% (23.6379 => 23.3971, std.dev.: 0.0807)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.78% (0.1405 => 0.1394, std.dev.: 0.0216)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Misc/pi: 69.61% (0.0204 => 0.0346, std.dev.: 0.0027)
  SingleSource/Benchmarks/Shootout/heapsort: 64.14% (0.0474 => 0.0778, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc-C++/mandel-text: 46.61% (0.0251 => 0.0368, std.dev.: 0.0036)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 35.22% (44.2807 => 59.8773, std.dev.: 0.6696)
  MultiSource/Benchmarks/Bullet/bullet: 21.46% (32.7552 => 39.7835, std.dev.: 2.6356)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 19.22% (24.6139 => 29.3448, std.dev.: 0.7877)
  SingleSource/Benchmarks/Shootout-C++/fibo: 11.90% (0.1899 => 0.2125, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.11% (1.2523 => 1.3789, std.dev.: 0.0386)
  MultiSource/Applications/JM/ldecod/ldecod: 5.91% (7.4026 => 7.8399, std.dev.: 0.0152)
  MultiSource/Applications/siod/siod: 5.13% (2.4480 => 2.5737, std.dev.: 0.0357)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 3.94% (1.1393 => 1.1842, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 2.65% (1.2948 => 1.3291, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.63% (1.3365 => 1.3717, std.dev.: 0.0121)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: 2.33% (1.1580 => 1.1850, std.dev.: 0.0100)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 65.46% (3.0111 => 4.9821, std.dev.: 0.3450)
  SingleSource/Benchmarks/Shootout-C++/methcall: 60.35% (7.6426 => 12.2552, std.dev.: 0.1424)
  SingleSource/Benchmarks/Shootout-C++/matrix: 49.31% (2.8554 => 4.2633, std.dev.: 0.1260)
  SingleSource/Benchmarks/Shootout/heapsort: 44.56% (3.5900 => 5.1896, std.dev.: 0.0957)
  SingleSource/Benchmarks/Shootout-C++/ary: 29.40% (0.0381 => 0.0493, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout/ary3: 28.00% (4.6972 => 6.0123, std.dev.: 0.0998)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 22.89% (1.1431 => 1.4048, std.dev.: 0.0433)
  MultiSource/Benchmarks/Bullet/bullet: 14.33% (7.0333 => 8.0412, std.dev.: 0.1773)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.60% (3.5550 => 3.8609, std.dev.: 0.0056)
  SingleSource/Benchmarks/Shootout-C++/fibo: 8.46% (4.9428 => 5.3609, std.dev.: 0.0574)
  MultiSource/Benchmarks/PAQ8p/paq8p: 6.63% (96.7834 => 103.1973, std.dev.: 2.0232)
  SingleSource/UnitTests/Vector/multiplies: 6.58% (0.5561 => 0.5927, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc/salsa20: 4.59% (7.7964 => 8.1542, std.dev.: 0.0358)
  SingleSource/Benchmarks/Misc/mandel-2: 4.50% (0.8399 => 0.8777, std.dev.: 0.0079)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.40% (89.7126 => 92.7668, std.dev.: 0.4280)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.27% (2.5368 => 2.6197, std.dev.: 0.0318)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.11% (5.3716 => 5.5388, std.dev.: 0.0642)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.71% (5.0980 => 5.2364, std.dev.: 0.0066)
  SingleSource/Regression/C/uint64_to_float: 2.57% (1.4528 => 1.4901, std.dev.: 0.0073)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.21% (1.0477 => 1.0709, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.05% (3.1569 => 3.2217, std.dev.: 0.0051)
  SingleSource/Benchmarks/Misc/dt: 1.76% (0.9773 => 0.9945, std.dev.: 0.0018)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.55% (3.5683 => 3.6235, std.dev.: 0.0117)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.61% (0.5226 => 0.2372, std.dev.: 0.0489)
  MultiSource/Applications/sgefa/sgefa: -42.94% (1.5790 => 0.9009, std.dev.: 0.0064)
  SingleSource/Benchmarks/Linpack/linpack-pc: -22.99% (57.2347 => 44.0744, std.dev.: 3.2496)
  MultiSource/Benchmarks/FreeBench/mason/mason: -18.04% (0.3304 => 0.2708, std.dev.: 0.0066)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.34% (15.9508 => 13.1847, std.dev.: 0.4963)
  SingleSource/Benchmarks/Shootout-C++/moments: -12.61% (0.1285 => 0.1123, std.dev.: 0.0054)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.44% (20.8247 => 18.4427, std.dev.: 0.0273)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.79% (50.0284 => 44.6306, std.dev.: 0.2954)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.00% (3.4956 => 3.1460, std.dev.: 0.0124)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.45% (3.7437 => 3.4274, std.dev.: 0.0565)
  MultiSource/Applications/lambda-0_1_3/lambda: -6.32% (8.1346 => 7.6205, std.dev.: 0.1023)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.27% (2.5938 => 2.4831, std.dev.: 0.0188)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.25% (3.7874 => 3.6642, std.dev.: 0.0057)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.63% (17.1431 => 16.6925, std.dev.: 0.1587)
  SingleSource/Benchmarks/Misc/oourafft: -2.49% (3.7484 => 3.6552, std.dev.: 0.0310)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.41% (4.3592 => 4.2542, std.dev.: 0.0170)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.11% (2.4471 => 2.4200, std.dev.: 0.0027)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 3.41% (0.1348 => 0.1394, std.dev.: 0.0216)

Report Time: 1.25s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131029/f0c37deb/attachment.html>


More information about the llvm-testresults mailing list