[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Dec 3 02:34:27 PST 2013


http://llvm.org/perf/db_default/v4/nts/17873?compare_to=17866&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 17873, Order: 196255, Start Time: 2013-12-03 08:51:40, End Time: 2013-12-03 10:38:32
      To: 17866, Order: 196209, Start Time: 2013-12-03 06:38:47, End Time: 2013-12-03 08:26:03
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 29 (36 on baseline)
Performance Improvements: 30 (19 on baseline)
Unchanged Tests: 1051 (1055 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/recursive: 91.87% (0.0283 => 0.0543, std.dev.: 0.0003)
  SingleSource/Benchmarks/Stanford/Queens: 48.09% (0.0470 => 0.0696, std.dev.: 0.0039)
  SingleSource/Benchmarks/Stanford/FloatMM: 44.92% (0.0463 => 0.0671, std.dev.: 0.0045)
  SingleSource/Regression/C/matrixTranspose: 43.92% (0.0296 => 0.0426, std.dev.: 0.0025)
  SingleSource/Regression/C/testtrace: 42.75% (0.0262 => 0.0374, std.dev.: 0.0029)
  MultiSource/Applications/viterbi/viterbi: 14.64% (0.2493 => 0.2858, std.dev.: 0.0065)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.66% (4.3285 => 4.5736, std.dev.: 0.0290)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Stanford/Quicksort: 41.44% (0.0263 => 0.0372, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout-C++/ary3: 25.17% (4.9040 => 6.1381, std.dev.: 0.3359)
  SingleSource/Benchmarks/Shootout/matrix: 17.90% (1.7939 => 2.1150, std.dev.: 0.0007)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.67% (2.1148 => 2.3827, std.dev.: 0.0107)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 8.70% (2.3310 => 2.5338, std.dev.: 0.0294)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 8.62% (0.8198 => 0.8905, std.dev.: 0.0179)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 7.76% (0.4843 => 0.5219, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 6.22% (6.3854 => 6.7825, std.dev.: 0.1242)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.97% (40.1814 => 42.5811, std.dev.: 0.4671)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 4.91% (0.3605 => 0.3782, std.dev.: 0.0015)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 4.67% (1.9962 => 2.0895, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/EH/except: 4.63% (0.4708 => 0.4926, std.dev.: 0.0032)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 4.02% (1.8213 => 1.8945, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/flops: 4.02% (9.2659 => 9.6380, std.dev.: 0.0313)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.97% (0.3724 => 0.3872, std.dev.: 0.0031)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.71% (5.4650 => 5.6676, std.dev.: 0.0101)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.29% (3.9863 => 4.1175, std.dev.: 0.0402)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.03% (3.1568 => 3.2209, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.89% (5.9009 => 6.0126, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout/methcall: 1.83% (8.5133 => 8.6687, std.dev.: 0.0243)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.72% (4.8369 => 4.9202, std.dev.: 0.0165)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.43% (2.5760 => 2.6129, std.dev.: 0.0074)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: -35.98% (0.1056 => 0.0676, std.dev.: 0.0054)
  SingleSource/Benchmarks/Stanford/Perm: -24.31% (0.0469 => 0.0355, std.dev.: 0.0040)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -16.41% (1.3678 => 1.1433, std.dev.: 0.0151)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -12.23% (0.1455 => 0.1277, std.dev.: 0.0068)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -10.54% (1.2860 => 1.1504, std.dev.: 0.0412)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -10.26% (0.1004 => 0.0901, std.dev.: 0.0003)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -10.05% (0.3145 => 0.2829, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -8.94% (1.4137 => 1.2873, std.dev.: 0.0439)
  MultiSource/Applications/sqlite3/sqlite3: -6.77% (17.2996 => 16.1286, std.dev.: 0.2714)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -6.49% (1.5395 => 1.4396, std.dev.: 0.0195)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -6.20% (0.2338 => 0.2193, std.dev.: 0.0032)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.94% (0.2777 => 0.2612, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -5.62% (0.2261 => 0.2134, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.51% (1.3602 => 1.2853, std.dev.: 0.0031)
  MultiSource/Applications/lemon/lemon: -4.92% (1.2820 => 1.2189, std.dev.: 0.0225)
  MultiSource/Applications/JM/ldecod/ldecod: -4.76% (8.4868 => 8.0829, std.dev.: 0.0823)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -4.63% (1.0153 => 0.9683, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -4.61% (1.3819 => 1.3182, std.dev.: 0.0118)
  SingleSource/Benchmarks/Shootout-C++/matrix: -4.50% (0.2509 => 0.2396, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -4.43% (1.4435 => 1.3795, std.dev.: 0.0116)
  SingleSource/Benchmarks/Shootout-C++/ary3: -3.98% (0.2661 => 0.2555, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -3.19% (1.3149 => 1.2729, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -2.34% (1.2461 => 1.2169, std.dev.: 0.0065)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -2.14% (1.7394 => 1.7021, std.dev.: 0.0105)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -2.10% (1.3689 => 1.3401, std.dev.: 0.0072)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -19.00% (2.9921 => 2.4237, std.dev.: 0.0106)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -10.88% (0.3787 => 0.3375, std.dev.: 0.0150)
  MultiSource/Benchmarks/nbench/nbench: -9.26% (23.0543 => 20.9190, std.dev.: 0.7203)
  SingleSource/Benchmarks/McGill/chomp: -2.73% (1.0732 => 1.0439, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -1.55% (5.1390 => 5.0591, std.dev.: 0.0226)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/recursive: 91.20% (0.0284 => 0.0543, std.dev.: 0.0003)
  SingleSource/Regression/C/2003-05-22-LocalTypeTest: 76.35% (0.0148 => 0.0261, std.dev.: 0.0027)
  SingleSource/Regression/C/2004-03-15-IndirectGoto: 68.90% (0.0164 => 0.0277, std.dev.: 0.0015)
  SingleSource/Regression/C/matrixTranspose: 57.78% (0.0270 => 0.0426, std.dev.: 0.0025)
  SingleSource/Benchmarks/Stanford/Queens: 56.76% (0.0444 => 0.0696, std.dev.: 0.0039)
  SingleSource/Regression/C/testtrace: 52.03% (0.0246 => 0.0374, std.dev.: 0.0029)
  SingleSource/Benchmarks/Stanford/FloatMM: 50.45% (0.0446 => 0.0671, std.dev.: 0.0045)
  MultiSource/Applications/viterbi/viterbi: 41.42% (0.2021 => 0.2858, std.dev.: 0.0065)
  MultiSource/Applications/SIBsim4/SIBsim4: 9.73% (1.5198 => 1.6677, std.dev.: 0.0342)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.07% (2.7572 => 3.0074, std.dev.: 0.0777)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 7.07% (4.2717 => 4.5736, std.dev.: 0.0290)
  MultiSource/Applications/JM/ldecod/ldecod: 5.58% (7.6560 => 8.0829, std.dev.: 0.0823)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/heapsort: 39.98% (2.9945 => 4.1917, std.dev.: 0.1184)
  SingleSource/Benchmarks/Shootout-C++/ary3: 31.16% (4.6797 => 6.1381, std.dev.: 0.3359)
  SingleSource/Benchmarks/Shootout/matrix: 17.76% (1.7960 => 2.1150, std.dev.: 0.0007)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.35% (2.1020 => 2.3827, std.dev.: 0.0107)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 8.49% (2.3355 => 2.5338, std.dev.: 0.0294)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 7.02% (0.3534 => 0.3782, std.dev.: 0.0015)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 5.91% (1.9729 => 2.0895, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 5.63% (6.4210 => 6.7825, std.dev.: 0.1242)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 5.00% (40.5530 => 42.5811, std.dev.: 0.4671)
  SingleSource/Benchmarks/Misc/salsa20: 4.68% (7.5947 => 7.9504, std.dev.: 0.1342)
  MultiSource/Applications/sgefa/sgefa: 4.19% (0.8745 => 0.9111, std.dev.: 0.0122)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 4.12% (4.5883 => 4.7774, std.dev.: 0.0433)
  SingleSource/Benchmarks/Misc/flops: 4.00% (9.2673 => 9.6380, std.dev.: 0.0313)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 3.57% (3.9755 => 4.1175, std.dev.: 0.0402)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.47% (61.0792 => 63.2014, std.dev.: 0.7367)
  SingleSource/Benchmarks/McGill/chomp: 3.37% (1.0099 => 1.0439, std.dev.: 0.0037)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.06% (5.4994 => 5.6676, std.dev.: 0.0101)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.91% (1.8409 => 1.8945, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/fp-convert: 2.87% (7.3892 => 7.6014, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.20% (6.5291 => 6.6729, std.dev.: 0.0328)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.10% (3.1547 => 3.2209, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 2.02% (5.8933 => 6.0126, std.dev.: 0.0010)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 1.99% (4.8243 => 4.9202, std.dev.: 0.0165)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.50% (2.3882 => 2.4240, std.dev.: 0.0006)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.45% (0.0688 => 0.0506, std.dev.: 0.0010)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -9.61% (0.3247 => 0.2935, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.87% (1.3819 => 1.2869, std.dev.: 0.0353)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -5.98% (0.1774 => 0.1668, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -5.94% (1.5305 => 1.4396, std.dev.: 0.0195)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.74% (1.4113 => 1.3303, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -5.33% (1.2544 => 1.1876, std.dev.: 0.0245)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -5.29% (0.2758 => 0.2612, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.13% (1.4125 => 1.3401, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -5.11% (1.2824 => 1.2169, std.dev.: 0.0065)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -5.04% (1.0197 => 0.9683, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.83% (1.3505 => 1.2853, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.89% (1.3660 => 1.3128, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.24% (1.3264 => 1.2834, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -3.03% (1.3127 => 1.2729, std.dev.: 0.0061)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -15.99% (2.8850 => 2.4237, std.dev.: 0.0106)
  MultiSource/Benchmarks/nbench/nbench: -10.87% (23.4696 => 20.9190, std.dev.: 0.7203)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.06% (6.0535 => 5.8680, std.dev.: 0.0084)
  SingleSource/Benchmarks/Shootout-C++/hash2: -1.89% (3.6605 => 3.5912, std.dev.: 0.0152)

Report Time: 1.18s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131203/ff2490a1/attachment.html>


More information about the llvm-testresults mailing list