[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 7 22:38:01 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16092?compare_to=16088&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16092, Order: 192160, Start Time: 2013-10-08 03:54:26, End Time: 2013-10-08 05:41:02
      To: 16088, Order: 192151, Start Time: 2013-10-08 01:41:01, End Time: 2013-10-08 03:30:23
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 12 (34 on baseline)
Performance Improvements: 5 (18 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1090 (1055 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 31.45% (3.0042 => 3.9490, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout/sieve: 15.14% (7.3767 => 8.4939, std.dev.: 0.0005)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.51% (2.8242 => 2.9517, std.dev.: 0.0491)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 4.00% (2.1242 => 2.2091, std.dev.: 0.0022)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.93% (3.5420 => 3.6458, std.dev.: 0.0181)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.80% (1.5899 => 1.6344, std.dev.: 0.0121)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.57% (5.5242 => 5.6661, std.dev.: 0.0106)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 2.41% (2.4684 => 2.5278, std.dev.: 0.0110)
  SingleSource/Benchmarks/Shootout/lists: 1.80% (7.3803 => 7.5130, std.dev.: 0.0070)
  MultiSource/Applications/siod/siod: 1.20% (3.5945 => 3.6376, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.11% (16.6641 => 16.8490, std.dev.: 0.0553)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.09% (3.7880 => 3.8291, std.dev.: 0.0002)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -6.78% (0.2450 => 0.2284, std.dev.: 0.0015)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.55% (0.5815 => 0.5667, std.dev.: 0.0048)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -1.25% (1.6293 => 1.6090, std.dev.: 0.0047)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/lpbench: -8.21% (4.1152 => 3.7774, std.dev.: 0.1193)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.13% (6.0297 => 5.9613, std.dev.: 0.0239)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.42% (0.1341 => 0.1360, std.dev.: 0.0142)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.54% (0.4624 => 0.4834, std.dev.: 0.0045)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.71% (0.3096 => 0.3211, std.dev.: 0.0045)
  MultiSource/Applications/Burg/burg: 3.09% (1.3994 => 1.4426, std.dev.: 0.0123)
  MultiSource/Benchmarks/Prolangs-C/football/football: 2.56% (0.9828 => 1.0080, std.dev.: 0.0043)
  MultiSource/Benchmarks/Prolangs-C/unix-smail/unix-smail: 2.55% (0.6617 => 0.6786, std.dev.: 0.0023)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.49% (7.2661 => 7.4471, std.dev.: 0.0173)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 2.49% (1.8775 => 1.9242, std.dev.: 0.0140)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.32% (0.8667 => 0.8868, std.dev.: 0.0073)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 2.30% (1.0952 => 1.1204, std.dev.: 0.0050)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.29% (0.6297 => 0.6441, std.dev.: 0.0005)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 64.24% (7.6426 => 12.5524, std.dev.: 0.0508)
  SingleSource/Benchmarks/Shootout-C++/matrix: 38.30% (2.8554 => 3.9490, std.dev.: 0.0008)
  SingleSource/Benchmarks/Shootout/sieve: 17.56% (7.2254 => 8.4939, std.dev.: 0.0005)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0038)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.27% (8.1346 => 8.6445, std.dev.: 0.0387)
  MultiSource/Applications/aha/aha: 6.01% (3.5731 => 3.7877, std.dev.: 0.0345)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.48% (5.3716 => 5.6661, std.dev.: 0.0106)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.31% (0.3836 => 0.3963, std.dev.: 0.0010)
  SingleSource/Benchmarks/McGill/misr: 3.08% (0.3771 => 0.3887, std.dev.: 0.0036)
  MultiSource/Applications/siod/siod: 3.02% (3.5310 => 3.6376, std.dev.: 0.0126)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.88% (2.1472 => 2.2091, std.dev.: 0.0022)
  MultiSource/Applications/hexxagon/hexxagon: 2.62% (14.7810 => 15.1688, std.dev.: 0.0160)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.53% (1.5940 => 1.6344, std.dev.: 0.0121)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.17% (3.5683 => 3.6458, std.dev.: 0.0181)
  SingleSource/Regression/C/uint64_to_float: 2.05% (1.4528 => 1.4826, std.dev.: 0.0072)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.02% (2.4920 => 2.5423, std.dev.: 0.0127)
  SingleSource/Benchmarks/Shootout/lists: 1.94% (7.3703 => 7.5130, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.65% (3.1569 => 3.2089, std.dev.: 0.0057)
  SingleSource/Benchmarks/Shootout/fib2: 1.55% (3.5966 => 3.6522, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout/methcall: 1.37% (8.5434 => 8.6604, std.dev.: 0.0212)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.29% (16.7972 => 17.0143, std.dev.: 0.0402)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.29% (3.8582 => 3.9080, std.dev.: 0.0118)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.17% (6.7429 => 6.8221, std.dev.: 0.0001)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (3.7874 => 3.8291, std.dev.: 0.0002)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.63% (0.1483 => 0.1177, std.dev.: 0.0052)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -9.12% (0.1195 => 0.1086, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout-C++/matrix: -8.21% (0.2571 => 0.2360, std.dev.: 0.0011)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.86% (0.5226 => 0.2359, std.dev.: 0.0296)
  MultiSource/Applications/sgefa/sgefa: -47.16% (1.5790 => 0.8343, std.dev.: 0.0161)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -25.75% (0.0400 => 0.0297, std.dev.: 0.0005)
  SingleSource/Benchmarks/Linpack/linpack-pc: -23.18% (57.2347 => 43.9671, std.dev.: 1.2440)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.89% (15.9508 => 12.9371, std.dev.: 0.1904)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.84% (20.8247 => 18.5676, std.dev.: 0.1018)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.28% (3.4956 => 3.1364, std.dev.: 0.0380)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -7.88% (4.1004 => 3.7774, std.dev.: 0.1193)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.67% (50.0284 => 46.6915, std.dev.: 0.2534)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.52% (2.5938 => 2.5026, std.dev.: 0.0182)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.09% (3.7437 => 3.6282, std.dev.: 0.0406)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -2.38% (4.3592 => 4.2553, std.dev.: 0.0335)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.72% (17.1431 => 16.8490, std.dev.: 0.0553)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -1.16% (2.3365 => 2.3094, std.dev.: 0.0039)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.03% (2.4471 => 2.4218, std.dev.: 0.0012)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.89% (0.1348 => 0.1360, std.dev.: 0.0142)

Report Time: 0.98s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131008/0770afa2/attachment.html>


More information about the llvm-testresults mailing list