[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Oct 15 15:52:36 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16348?compare_to=16330&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16348, Order: 192731, Start Time: 2013-10-15 21:02:21, End Time: 2013-10-15 22:55:44
      To: 16330, Order: 192673, Start Time: 2013-10-15 06:04:58, End Time: 2013-10-15 07:52:54
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 28 (41 on baseline)
Performance Improvements: 8 (16 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1071 (1050 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 76.34% (0.2367 => 0.4174, std.dev.: 0.0097)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 67.30% (0.0841 => 0.1407, std.dev.: 0.0043)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 53.22% (0.2187 => 0.3351, std.dev.: 0.0257)
  MultiSource/Benchmarks/mafft/pairlocalalign: 14.55% (10.2541 => 11.7462, std.dev.: 0.2227)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 11.75% (0.2195 => 0.2453, std.dev.: 0.0025)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 9.40% (0.3882 => 0.4247, std.dev.: 0.0088)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.25% (1.2312 => 1.3328, std.dev.: 0.0212)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 8.16% (0.6424 => 0.6948, std.dev.: 0.0166)
  MultiSource/Applications/SPASS/SPASS: 7.35% (16.5420 => 17.7578, std.dev.: 0.3574)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 103.64% (0.1346 => 0.2741, std.dev.: 0.0214)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 29.18% (1.3117 => 1.6944, std.dev.: 0.0644)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 26.72% (0.0670 => 0.0849, std.dev.: 0.0055)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 23.09% (35.8584 => 44.1372, std.dev.: 1.8982)
  MultiSource/Benchmarks/McCat/09-vor/vor: 22.91% (0.1139 => 0.1400, std.dev.: 0.0061)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 14.67% (21.5938 => 24.7612, std.dev.: 0.8413)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 13.02% (9.4084 => 10.6334, std.dev.: 0.3321)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 12.27% (64.5203 => 72.4353, std.dev.: 2.3040)
  MultiSource/Benchmarks/mafft/pairlocalalign: 10.68% (40.8129 => 45.1711, std.dev.: 0.8247)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 8.29% (31.3095 => 33.9051, std.dev.: 0.7922)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.37% (2.9470 => 3.1347, std.dev.: 0.0401)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 4.83% (12.8328 => 13.4521, std.dev.: 0.1132)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 4.35% (5.0371 => 5.2562, std.dev.: 0.0185)
  MultiSource/Applications/lua/lua: 4.19% (28.0418 => 29.2170, std.dev.: 0.2732)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.66% (2.6001 => 2.6953, std.dev.: 0.0133)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.91% (39.4055 => 40.5503, std.dev.: 0.3840)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 2.00% (5.0925 => 5.1942, std.dev.: 0.0390)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.96% (3.1590 => 3.2208, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.92% (5.2444 => 5.3453, std.dev.: 0.0390)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/sumarray-dbl: -40.16% (0.0376 => 0.0225, std.dev.: 0.0014)
  SingleSource/Benchmarks/Shootout-C++/lists1: -10.38% (0.3498 => 0.3135, std.dev.: 0.0132)
  SingleSource/Benchmarks/Shootout-C++/ary: -7.52% (0.2712 => 0.2508, std.dev.: 0.0074)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: -21.61% (5.9806 => 4.6880, std.dev.: 0.4941)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -7.26% (7.2279 => 6.7035, std.dev.: 0.0293)
  SingleSource/Benchmarks/Misc/ReedSolomon: -5.82% (9.1048 => 8.5748, std.dev.: 0.1867)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -4.41% (3.0561 => 2.9212, std.dev.: 0.0049)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.96% (5.6493 => 5.4822, std.dev.: 0.0308)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.63% (0.1348 => 0.1370, std.dev.: 0.0047)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 78.76% (0.2335 => 0.4174, std.dev.: 0.0097)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 71.79% (0.0819 => 0.1407, std.dev.: 0.0043)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 53.08% (0.2189 => 0.3351, std.dev.: 0.0257)
  SingleSource/UnitTests/Vector/constpool: 35.77% (8.8921 => 12.0726, std.dev.: 1.0126)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 21.24% (0.1657 => 0.2009, std.dev.: 0.0128)
  MultiSource/Applications/lua/lua: 18.59% (4.2242 => 5.0094, std.dev.: 0.2915)
  MultiSource/Benchmarks/mafft/pairlocalalign: 17.58% (9.9903 => 11.7462, std.dev.: 0.2227)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 13.60% (1.3365 => 1.5183, std.dev.: 0.0679)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 12.35% (2.6492 => 2.9764, std.dev.: 0.1138)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 11.12% (0.3822 => 0.4247, std.dev.: 0.0088)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 10.34% (0.6297 => 0.6948, std.dev.: 0.0166)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 10.05% (0.2229 => 0.2453, std.dev.: 0.0025)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 9.95% (4.0397 => 4.4418, std.dev.: 0.1254)
  MultiSource/Applications/SPASS/SPASS: 9.86% (16.1646 => 17.7578, std.dev.: 0.3574)
  SingleSource/Benchmarks/Shootout-C++/lists: 9.12% (0.2577 => 0.2812, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 8.93% (1.2235 => 1.3328, std.dev.: 0.0212)
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 7.46% (0.4624 => 0.4969, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.68% (1.2086 => 1.2652, std.dev.: 0.0164)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 99.06% (0.1377 => 0.2741, std.dev.: 0.0214)
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.60% (7.6426 => 12.5035, std.dev.: 0.0483)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 30.49% (4.5479 => 5.9345, std.dev.: 0.4289)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 30.21% (0.0652 => 0.0849, std.dev.: 0.0055)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 28.92% (1.3143 => 1.6944, std.dev.: 0.0644)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 26.45% (1.1431 => 1.4455, std.dev.: 0.0308)
  MultiSource/Benchmarks/McCat/09-vor/vor: 22.81% (0.1140 => 0.1400, std.dev.: 0.0061)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 19.80% (36.8417 => 44.1372, std.dev.: 1.8982)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 19.31% (60.7119 => 72.4353, std.dev.: 2.3040)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 15.05% (21.5217 => 24.7612, std.dev.: 0.8413)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 12.42% (9.4586 => 10.6334, std.dev.: 0.3321)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 12.33% (30.1838 => 33.9051, std.dev.: 0.7922)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.63% (4.9428 => 5.4682, std.dev.: 0.0125)
  SingleSource/UnitTests/Vector/multiplies: 6.91% (0.5561 => 0.5945, std.dev.: 0.0028)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.72% (2.9372 => 3.1347, std.dev.: 0.0401)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 6.25% (2.5368 => 2.6953, std.dev.: 0.0133)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.70% (3.1730 => 3.3539, std.dev.: 0.0584)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.37% (89.7126 => 92.7351, std.dev.: 0.0299)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.06% (5.3716 => 5.4822, std.dev.: 0.0308)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.02% (3.1569 => 3.2208, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.58% (6.5990 => 6.7035, std.dev.: 0.0293)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.08% (8.1346 => 8.2228, std.dev.: 0.0296)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 1.05% (4.0596 => 4.1022, std.dev.: 0.0150)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.38% (0.5226 => 0.2384, std.dev.: 0.0164)
  MultiSource/Applications/sgefa/sgefa: -42.53% (1.5790 => 0.9074, std.dev.: 0.0054)
  SingleSource/Benchmarks/Linpack/linpack-pc: -35.97% (57.2347 => 36.6487, std.dev.: 7.0346)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -30.75% (0.0400 => 0.0277, std.dev.: 0.0037)
  MultiSource/Benchmarks/Olden/em3d/em3d: -28.75% (5.0288 => 3.5828, std.dev.: 0.0503)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.67% (15.9508 => 13.4521, std.dev.: 0.1132)
  MultiSource/Benchmarks/FreeBench/mason/mason: -12.29% (0.3304 => 0.2898, std.dev.: 0.0038)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.37% (20.8247 => 18.4564, std.dev.: 0.1601)
  MultiSource/Benchmarks/mafft/pairlocalalign: -9.71% (50.0284 => 45.1711, std.dev.: 0.8247)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.41% (3.4956 => 3.1666, std.dev.: 0.1253)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -4.41% (3.0561 => 2.9212, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.85% (17.1431 => 16.6552, std.dev.: 0.0310)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.69% (3.7874 => 3.6855, std.dev.: 0.0094)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.59% (2.5938 => 2.5266, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.87% (5.4473 => 5.3453, std.dev.: 0.0390)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.87% (4.3592 => 4.2776, std.dev.: 0.0106)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.63% (0.1348 => 0.1370, std.dev.: 0.0047)

Report Time: 1.16s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131015/2580faed/attachment.html>


More information about the llvm-testresults mailing list