[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 14 15:42:11 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16316?compare_to=16312&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16316, Order: 192613, Start Time: 2013-10-14 20:51:22, End Time: 2013-10-14 22:45:19
      To: 16312, Order: 192606, Start Time: 2013-10-14 18:35:42, End Time: 2013-10-14 20:22:56
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 47 (60 on baseline)
Performance Improvements: 9 (16 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1051 (1031 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/Vector/simple: 78.44% (0.0218 => 0.0389, std.dev.: 0.0017)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 68.21% (0.0840 => 0.1413, std.dev.: 0.0078)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 59.34% (0.1424 => 0.2269, std.dev.: 0.0182)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 48.49% (0.2650 => 0.3935, std.dev.: 0.0307)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 39.88% (0.3413 => 0.4774, std.dev.: 0.0284)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 37.76% (0.5686 => 0.7833, std.dev.: 0.0267)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 35.18% (0.2362 => 0.3193, std.dev.: 0.0051)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 29.39% (5.0168 => 6.4912, std.dev.: 0.0408)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 27.52% (0.6638 => 0.8465, std.dev.: 0.0503)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 24.55% (4.9096 => 6.1149, std.dev.: 0.4202)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 15.67% (14.8927 => 17.2260, std.dev.: 0.2992)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 12.79% (1.1204 => 1.2637, std.dev.: 0.0256)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 11.71% (4.1041 => 4.5845, std.dev.: 0.0374)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 10.14% (1.3456 => 1.4820, std.dev.: 0.0489)
  MultiSource/Applications/aha/aha: 9.47% (0.1278 => 0.1399, std.dev.: 0.0038)
  SingleSource/Benchmarks/McGill/chomp: 8.65% (0.2244 => 0.2438, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/methcall: 8.02% (0.2058 => 0.2223, std.dev.: 0.0007)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 6.67% (0.3537 => 0.3773, std.dev.: 0.0072)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 6.26% (0.5158 => 0.5481, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 5.70% (1.2939 => 1.3677, std.dev.: 0.0060)
  MultiSource/Applications/hexxagon/hexxagon: 3.55% (1.0367 => 1.0735, std.dev.: 0.0108)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 89.68% (0.0252 => 0.0478, std.dev.: 0.0043)
  SingleSource/Benchmarks/Shootout/heapsort: 64.43% (2.9675 => 4.8796, std.dev.: 0.4525)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 40.38% (0.7540 => 1.0585, std.dev.: 0.0600)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 33.70% (2.3981 => 3.2062, std.dev.: 0.1094)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 29.81% (4.5798 => 5.9450, std.dev.: 0.3545)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 29.43% (35.5754 => 46.0450, std.dev.: 0.9417)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 19.22% (21.0424 => 25.0873, std.dev.: 0.5875)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 16.82% (40.8128 => 47.6779, std.dev.: 2.4501)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 10.78% (2.3211 => 2.5713, std.dev.: 0.0274)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 9.56% (0.3316 => 0.3633, std.dev.: 0.0060)
  MultiSource/Benchmarks/mafft/pairlocalalign: 9.51% (40.7784 => 44.6577, std.dev.: 1.1638)
  MultiSource/Benchmarks/Bullet/bullet: 9.16% (7.0604 => 7.7073, std.dev.: 0.0308)
  SingleSource/Benchmarks/Misc/salsa20: 8.36% (7.5052 => 8.1323, std.dev.: 0.2132)
  MultiSource/Applications/sgefa/sgefa: 7.72% (0.8384 => 0.9031, std.dev.: 0.0074)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 6.00% (2.6588 => 2.8182, std.dev.: 0.0286)
  SingleSource/Regression/C/uint64_to_float: 5.72% (1.4032 => 1.4835, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.62% (3.5706 => 3.7356, std.dev.: 0.0613)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 4.40% (39.4147 => 41.1483, std.dev.: 0.2515)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 4.31% (88.8086 => 92.6336, std.dev.: 0.3417)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 4.12% (3.2135 => 3.3458, std.dev.: 0.0340)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 4.03% (1.5841 => 1.6479, std.dev.: 0.0125)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.44% (2.5544 => 2.6422, std.dev.: 0.0054)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 2.64% (1.4961 => 1.5356, std.dev.: 0.0032)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.94% (2.4778 => 2.5258, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.86% (5.2945 => 5.3931, std.dev.: 0.0209)
  SingleSource/Benchmarks/Misc/flops: 1.60% (9.4691 => 9.6206, std.dev.: 0.0317)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Olden/em3d/em3d: -29.24% (5.0304 => 3.5594, std.dev.: 0.0494)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -25.81% (0.1976 => 0.1466, std.dev.: 0.0033)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -6.83% (1.1879 => 1.1068, std.dev.: 0.0266)
  SingleSource/Benchmarks/Stanford/FloatMM: -4.74% (0.7295 => 0.6949, std.dev.: 0.0045)
  MultiSource/Applications/lambda-0_1_3/lambda: -4.20% (8.6386 => 8.2762, std.dev.: 0.0173)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -2.36% (1.6376 => 1.5989, std.dev.: 0.0045)
  SingleSource/Benchmarks/Misc/whetstone: -1.55% (3.6448 => 3.5884, std.dev.: 0.0109)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.13% (3.9045 => 3.8605, std.dev.: 0.0072)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -1.10% (3.7214 => 3.6803, std.dev.: 0.0094)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 4.47% (0.1321 => 0.1380, std.dev.: 0.0080)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 72.53% (0.0819 => 0.1413, std.dev.: 0.0078)
  SingleSource/UnitTests/Vector/simple: 69.87% (0.0229 => 0.0389, std.dev.: 0.0017)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 63.59% (0.1387 => 0.2269, std.dev.: 0.0182)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 44.88% (0.2716 => 0.3935, std.dev.: 0.0307)
  MultiSource/Benchmarks/Prolangs-C/loader/loader: 41.49% (0.3374 => 0.4774, std.dev.: 0.0284)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 39.65% (0.5609 => 0.7833, std.dev.: 0.0267)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 36.75% (0.2335 => 0.3193, std.dev.: 0.0051)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 31.69% (4.9293 => 6.4912, std.dev.: 0.0408)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 27.93% (0.6617 => 0.8465, std.dev.: 0.0503)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: 24.53% (4.9105 => 6.1149, std.dev.: 0.4202)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 18.99% (14.4764 => 17.2260, std.dev.: 0.2992)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 16.85% (2.6492 => 3.0957, std.dev.: 0.1255)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 15.39% (1.0952 => 1.2637, std.dev.: 0.0256)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 13.49% (4.0397 => 4.5845, std.dev.: 0.0374)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 11.61% (1.3278 => 1.4820, std.dev.: 0.0489)
  SingleSource/Benchmarks/McGill/chomp: 10.72% (0.2202 => 0.2438, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout-C++/methcall: 9.45% (0.2031 => 0.2223, std.dev.: 0.0007)
  MultiSource/Applications/aha/aha: 9.38% (0.1279 => 0.1399, std.dev.: 0.0038)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 8.62% (0.5046 => 0.5481, std.dev.: 0.0066)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.64% (0.1597 => 0.1703, std.dev.: 0.0030)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 5.83% (0.3565 => 0.3773, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 5.76% (1.2932 => 1.3677, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.86% (1.2086 => 1.2673, std.dev.: 0.0194)
  MultiSource/Applications/hexxagon/hexxagon: 4.47% (1.0276 => 1.0735, std.dev.: 0.0108)
  MultiSource/Applications/siod/siod: 4.27% (2.4480 => 2.5525, std.dev.: 0.0234)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 3.43% (1.0756 => 1.1125, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 3.35% (1.2550 => 1.2971, std.dev.: 0.0129)
  MultiSource/Applications/hbd/hbd: 1.92% (1.5696 => 1.5997, std.dev.: 0.0110)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.50% (7.6426 => 12.4957, std.dev.: 0.0842)
  MultiSource/Benchmarks/Ptrdist/ft/ft: 42.85% (0.7410 => 1.0585, std.dev.: 0.0600)
  SingleSource/Benchmarks/Polybench/medley/reg_detect/reg_detect: 38.55% (0.0345 => 0.0478, std.dev.: 0.0043)
  SingleSource/Benchmarks/Shootout/heapsort: 35.92% (3.5900 => 4.8796, std.dev.: 0.4525)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 33.54% (2.4010 => 3.2062, std.dev.: 0.1094)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 30.72% (4.5479 => 5.9450, std.dev.: 0.3545)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 24.98% (36.8417 => 46.0450, std.dev.: 0.9417)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 24.15% (1.1431 => 1.4192, std.dev.: 0.0385)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 17.55% (40.5588 => 47.6779, std.dev.: 2.4501)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 16.57% (21.5217 => 25.0873, std.dev.: 0.5875)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 11.39% (2.3084 => 2.5713, std.dev.: 0.0274)
  MultiSource/Benchmarks/Bullet/bullet: 9.58% (7.0333 => 7.7073, std.dev.: 0.0308)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 7.35% (2.9372 => 3.1532, std.dev.: 0.0803)
  SingleSource/UnitTests/Vector/multiplies: 7.17% (0.5561 => 0.5960, std.dev.: 0.0011)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: 6.03% (2.6579 => 2.8182, std.dev.: 0.0286)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.45% (3.1730 => 3.3458, std.dev.: 0.0340)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 5.08% (3.5550 => 3.7356, std.dev.: 0.0613)
  MultiSource/Applications/hexxagon/hexxagon: 4.21% (14.7810 => 15.4028, std.dev.: 0.1546)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 4.15% (2.5368 => 2.6422, std.dev.: 0.0054)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.26% (89.7126 => 92.6336, std.dev.: 0.3417)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 3.07% (1.4898 => 1.5356, std.dev.: 0.0032)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: 3.01% (1.4830 => 1.5276, std.dev.: 0.0173)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.99% (39.9519 => 41.1483, std.dev.: 0.2515)
  MultiSource/Applications/siod/siod: 2.17% (3.5310 => 3.6076, std.dev.: 0.0208)
  SingleSource/Regression/C/uint64_to_float: 2.11% (1.4528 => 1.4835, std.dev.: 0.0017)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.91% (3.5683 => 3.6366, std.dev.: 0.0086)
  SingleSource/Benchmarks/Misc/flops: 1.88% (9.4433 => 9.6206, std.dev.: 0.0317)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.74% (8.1346 => 8.2762, std.dev.: 0.0173)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.58% (1.0477 => 1.0643, std.dev.: 0.0053)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.36% (2.4920 => 2.5258, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout/fib2: 1.30% (3.5966 => 3.6435, std.dev.: 0.0079)
  SingleSource/Benchmarks/Shootout/methcall: 1.25% (8.5434 => 8.6504, std.dev.: 0.0323)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -53.98% (0.5226 => 0.2405, std.dev.: 0.0176)
  MultiSource/Applications/sgefa/sgefa: -42.81% (1.5790 => 0.9031, std.dev.: 0.0074)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -29.25% (0.0400 => 0.0283, std.dev.: 0.0039)
  MultiSource/Benchmarks/Olden/em3d/em3d: -29.22% (5.0288 => 3.5594, std.dev.: 0.0494)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -21.65% (0.1871 => 0.1466, std.dev.: 0.0033)
  SingleSource/Benchmarks/Linpack/linpack-pc: -17.70% (57.2347 => 47.1024, std.dev.: 2.6725)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.65% (15.9508 => 13.1353, std.dev.: 0.3076)
  MultiSource/Benchmarks/FreeBench/mason/mason: -12.20% (0.3304 => 0.2901, std.dev.: 0.0034)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.71% (20.8247 => 18.3865, std.dev.: 0.0539)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.74% (50.0284 => 44.6577, std.dev.: 1.1638)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.41% (3.4956 => 3.1318, std.dev.: 0.0199)
  SingleSource/Benchmarks/Stanford/FloatMM: -4.64% (0.7287 => 0.6949, std.dev.: 0.0045)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.65% (2.5938 => 2.4991, std.dev.: 0.0242)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.83% (3.7874 => 3.6803, std.dev.: 0.0094)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.31% (4.3592 => 4.3022, std.dev.: 0.0089)
  SingleSource/Benchmarks/Misc/whetstone: -1.15% (3.6303 => 3.5884, std.dev.: 0.0109)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 2.37% (0.1348 => 0.1380, std.dev.: 0.0080)

Report Time: 0.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131014/3bf5fb66/attachment.html>


More information about the llvm-testresults mailing list