[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 21 12:44:59 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16542?compare_to=16539&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16542, Order: 193090, Start Time: 2013-10-21 17:51:57, End Time: 2013-10-21 19:48:15
      To: 16539, Order: 193083, Start Time: 2013-10-21 15:40:25, End Time: 2013-10-21 17:24:36
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 32 (43 on baseline)
Performance Improvements: 9 (18 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1066 (1046 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/methcall: 68.39% (0.0348 => 0.0586, std.dev.: 0.0046)
  MultiSource/Applications/hbd/hbd: 49.59% (1.5728 => 2.3528, std.dev.: 0.0494)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 49.30% (0.0503 => 0.0751, std.dev.: 0.0080)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 31.73% (0.5628 => 0.7414, std.dev.: 0.0538)
  MultiSource/Applications/hexxagon/hexxagon: 30.74% (1.0366 => 1.3553, std.dev.: 0.0236)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 17.83% (1.3615 => 1.6042, std.dev.: 0.0513)
  SingleSource/Benchmarks/Shootout/lists: 16.22% (0.0783 => 0.0910, std.dev.: 0.0015)
  MultiSource/Applications/kimwitu++/kc: 13.23% (18.8587 => 21.3529, std.dev.: 0.6121)
  SingleSource/Benchmarks/Shootout-C++/lists: 12.90% (0.2582 => 0.2915, std.dev.: 0.0118)
  SingleSource/Benchmarks/Shootout-C++/sieve: 10.97% (0.2844 => 0.3156, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 10.65% (1.2339 => 1.3653, std.dev.: 0.0278)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.41% (1.2563 => 1.3871, std.dev.: 0.0205)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 9.00% (6.1335 => 6.6858, std.dev.: 0.1785)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.97% (1.2214 => 1.3310, std.dev.: 0.0312)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 68.24% (2.9633 => 4.9855, std.dev.: 0.1205)
  MultiSource/Applications/minisat/minisat: 30.77% (6.3692 => 8.3292, std.dev.: 0.5106)
  SingleSource/Benchmarks/Shootout/ary3: 23.39% (4.6848 => 5.7807, std.dev.: 0.0834)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 21.05% (0.3330 => 0.4031, std.dev.: 0.0146)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 19.94% (4.0668 => 4.8776, std.dev.: 0.2839)
  MultiSource/Benchmarks/mafft/pairlocalalign: 15.44% (40.8090 => 47.1099, std.dev.: 0.2369)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.44% (4.9559 => 5.4731, std.dev.: 0.0692)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 9.17% (12.7655 => 13.9361, std.dev.: 0.1969)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 7.84% (2.9372 => 3.1676, std.dev.: 0.0252)
  MultiSource/Applications/JM/lencod/lencod: 7.61% (7.4092 => 7.9734, std.dev.: 0.0465)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 6.70% (6.2501 => 6.6691, std.dev.: 0.0237)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 6.57% (2.3471 => 2.5013, std.dev.: 0.0396)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 5.56% (39.4439 => 41.6376, std.dev.: 0.1229)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.52% (3.9748 => 4.1942, std.dev.: 0.0511)
  SingleSource/Benchmarks/Misc/flops: 3.98% (9.2720 => 9.6409, std.dev.: 0.0149)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.58% (5.7037 => 5.8506, std.dev.: 0.0256)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.53% (4.0871 => 4.1907, std.dev.: 0.0304)
  SingleSource/Benchmarks/Misc/flops-5: 1.44% (2.7757 => 2.8156, std.dev.: 0.0058)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/sieve: -15.85% (8.4934 => 7.1468, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -12.94% (7.3890 => 6.4332, std.dev.: 0.1150)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -6.28% (3.7212 => 3.4875, std.dev.: 0.0365)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -6.11% (3.8618 => 3.6259, std.dev.: 0.0832)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.96% (5.2488 => 5.0407, std.dev.: 0.0755)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -3.18% (5.9976 => 5.8069, std.dev.: 0.0482)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.84% (4.6193 => 4.4883, std.dev.: 0.0157)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.88% (2.5268 => 2.4793, std.dev.: 0.0145)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -1.36% (23.7174 => 23.3957, std.dev.: 0.1015)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.81% (0.1362 => 0.1351, std.dev.: 0.0345)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/methcall: 60.11% (0.0366 => 0.0586, std.dev.: 0.0046)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 50.50% (0.0499 => 0.0751, std.dev.: 0.0080)
  MultiSource/Applications/hbd/hbd: 49.90% (1.5696 => 2.3528, std.dev.: 0.0494)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: 32.18% (0.5609 => 0.7414, std.dev.: 0.0538)
  MultiSource/Applications/hexxagon/hexxagon: 31.89% (1.0276 => 1.3553, std.dev.: 0.0236)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 20.03% (1.3365 => 1.6042, std.dev.: 0.0513)
  MultiSource/Applications/kimwitu++/kc: 16.30% (18.3608 => 21.3529, std.dev.: 0.6121)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 14.93% (5.5014 => 6.3227, std.dev.: 0.3091)
  SingleSource/Benchmarks/Shootout-C++/lists: 13.12% (0.2577 => 0.2915, std.dev.: 0.0118)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.35% (1.2152 => 1.3653, std.dev.: 0.0278)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 11.50% (1.3036 => 1.4535, std.dev.: 0.0568)
  SingleSource/Benchmarks/Shootout-C++/sieve: 11.13% (0.2840 => 0.3156, std.dev.: 0.0089)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 10.91% (6.0284 => 6.6858, std.dev.: 0.1785)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.85% (1.2007 => 1.3310, std.dev.: 0.0312)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 10.76% (1.2523 => 1.3871, std.dev.: 0.0205)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 8.21% (1.2250 => 1.3256, std.dev.: 0.0364)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.34% (7.6426 => 12.4837, std.dev.: 0.0829)
  SingleSource/Benchmarks/Shootout/heapsort: 38.87% (3.5900 => 4.9855, std.dev.: 0.1205)
  MultiSource/Applications/minisat/minisat: 32.72% (6.2760 => 8.3292, std.dev.: 0.5106)
  SingleSource/Benchmarks/Shootout/ary3: 23.07% (4.6972 => 5.7807, std.dev.: 0.0834)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 20.79% (1.1431 => 1.3807, std.dev.: 0.0538)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 18.95% (4.1004 => 4.8776, std.dev.: 0.2839)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 16.44% (0.3462 => 0.4031, std.dev.: 0.0146)
  SingleSource/Benchmarks/Shootout-C++/fibo: 10.73% (4.9428 => 5.4731, std.dev.: 0.0692)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: 8.36% (2.3084 => 2.5013, std.dev.: 0.0396)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 7.84% (2.9372 => 3.1676, std.dev.: 0.0252)
  SingleSource/UnitTests/Vector/multiplies: 6.49% (0.5561 => 0.5922, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.35% (3.1730 => 3.3428, std.dev.: 0.0134)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.23% (3.9856 => 4.1942, std.dev.: 0.0511)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 4.22% (39.9519 => 41.6376, std.dev.: 0.1229)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.29% (89.7126 => 92.6648, std.dev.: 0.1998)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.23% (4.0596 => 4.1907, std.dev.: 0.0304)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 2.81% (2.5368 => 2.6082, std.dev.: 0.0157)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.76% (1.7652 => 1.8140, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.73% (5.6951 => 5.8506, std.dev.: 0.0256)
  MultiSource/Applications/hexxagon/hexxagon: 2.49% (14.7810 => 15.1495, std.dev.: 0.0955)
  MultiSource/Benchmarks/Olden/power/power: 2.47% (1.2170 => 1.2470, std.dev.: 0.0084)
  SingleSource/Benchmarks/Misc/flops: 2.09% (9.4433 => 9.6409, std.dev.: 0.0149)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.86% (8.1346 => 8.2860, std.dev.: 0.0472)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.70% (5.4925 => 5.5858, std.dev.: 0.0243)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.19% (16.7972 => 16.9979, std.dev.: 0.0645)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.16% (6.6028 => 6.6792, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.06% (6.5990 => 6.6691, std.dev.: 0.0237)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -50.38% (0.5226 => 0.2593, std.dev.: 0.0441)
  MultiSource/Applications/sgefa/sgefa: -42.30% (1.5790 => 0.9111, std.dev.: 0.0037)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -31.25% (0.0400 => 0.0275, std.dev.: 0.0043)
  SingleSource/Benchmarks/Linpack/linpack-pc: -18.23% (57.2347 => 46.8011, std.dev.: 2.9380)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -12.63% (15.9508 => 13.9361, std.dev.: 0.1969)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.87% (20.8247 => 18.3537, std.dev.: 0.1503)
  MultiSource/Benchmarks/FreeBench/mason/mason: -11.35% (0.3304 => 0.2929, std.dev.: 0.0062)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.58% (3.4956 => 3.1256, std.dev.: 0.0435)
  MultiSource/Benchmarks/mafft/pairlocalalign: -5.83% (50.0284 => 47.1099, std.dev.: 0.2369)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.41% (2.5938 => 2.4793, std.dev.: 0.0145)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.19% (0.7474 => 0.7161, std.dev.: 0.0114)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.84% (5.2422 => 5.0407, std.dev.: 0.0755)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -3.05% (2.4471 => 2.3724, std.dev.: 0.0202)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -3.04% (3.7874 => 3.6722, std.dev.: 0.0129)
  MultiSource/Applications/SIBsim4/SIBsim4: -2.90% (3.7437 => 3.6350, std.dev.: 0.0242)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.88% (17.1431 => 16.6499, std.dev.: 0.1111)
  MultiSource/Applications/JM/lencod/lencod: -2.51% (8.1785 => 7.9734, std.dev.: 0.0465)
  SingleSource/Benchmarks/Shootout/sieve: -1.09% (7.2254 => 7.1468, std.dev.: 0.0074)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.22% (0.1348 => 0.1351, std.dev.: 0.0345)

Report Time: 0.73s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131021/48a1307a/attachment.html>


More information about the llvm-testresults mailing list