[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Oct 6 09:57:11 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16040?compare_to=16037&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16040, Order: 192065, Start Time: 2013-10-06 15:13:43, End Time: 2013-10-06 17:00:11
      To: 16037, Order: 192062, Start Time: 2013-10-06 13:02:27, End Time: 2013-10-06 14:52:45
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 19 (30 on baseline)
Performance Improvements: 29 (16 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1059 (1061 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 19.64% (6.5210 => 7.8018, std.dev.: 0.1075)
  SingleSource/Benchmarks/Shootout/sieve: 18.55% (7.1632 => 8.4920, std.dev.: 0.0032)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.36% (2.1036 => 2.3637, std.dev.: 0.0205)
  SingleSource/Benchmarks/Shootout-C++/fibo: 9.14% (4.9497 => 5.4022, std.dev.: 0.0399)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.19% (3.5386 => 3.7221, std.dev.: 0.0011)
  SingleSource/Regression/C/uint64_to_float: 4.51% (1.4172 => 1.4811, std.dev.: 0.0031)
  SingleSource/Benchmarks/Shootout/matrix: 4.36% (2.0257 => 2.1140, std.dev.: 0.0035)
  MultiSource/Applications/aha/aha: 4.13% (3.6271 => 3.7769, std.dev.: 0.0028)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.36% (0.6305 => 0.6517, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.92% (4.4933 => 4.6247, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.75% (5.3111 => 5.4039, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.74% (3.9218 => 3.9901, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.57% (4.0675 => 4.1312, std.dev.: 0.0112)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.56% (6.5798 => 6.6825, std.dev.: 0.0281)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.50% (11.8354 => 12.0134, std.dev.: 0.0332)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.30% (1.6020 => 1.6229, std.dev.: 0.0016)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.26% (1.2817 => 1.2978, std.dev.: 0.0046)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.12% (2.5087 => 2.5368, std.dev.: 0.0034)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.07% (3.7855 => 3.8261, std.dev.: 0.0043)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -43.64% (0.4542 => 0.2560, std.dev.: 0.0391)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -27.33% (0.3074 => 0.2234, std.dev.: 0.0083)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -13.27% (1.4163 => 1.2283, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -11.68% (1.4880 => 1.3142, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -11.27% (1.4274 => 1.2666, std.dev.: 0.0350)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -10.45% (1.8467 => 1.6537, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -10.03% (1.5117 => 1.3601, std.dev.: 0.0146)
  MultiSource/Benchmarks/nbench/nbench: -9.76% (1.3928 => 1.2568, std.dev.: 0.0409)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -9.30% (1.4728 => 1.3358, std.dev.: 0.0344)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -8.45% (1.4911 => 1.3651, std.dev.: 0.0172)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -8.01% (1.3213 => 1.2154, std.dev.: 0.0122)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -5.69% (0.6187 => 0.5835, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.58% (1.2895 => 1.2305, std.dev.: 0.0126)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.30% (0.2745 => 0.2627, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.85% (1.3674 => 1.3148, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.65% (1.3186 => 1.2705, std.dev.: 0.0124)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.60% (1.2824 => 1.2491, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.28% (1.3402 => 1.3097, std.dev.: 0.0084)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -2.25% (1.2841 => 1.2552, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.14% (1.3527 => 1.3238, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.10% (1.2924 => 1.2652, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.08% (1.2518 => 1.2257, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.39% (1.4650 => 1.4447, std.dev.: 0.0039)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: -31.04% (4.2406 => 2.9243, std.dev.: 0.2775)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -5.16% (2.6973 => 2.5580, std.dev.: 0.0469)
  MultiSource/Benchmarks/PAQ8p/paq8p: -4.84% (99.5012 => 94.6819, std.dev.: 1.3775)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.49% (4.2938 => 4.1010, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -1.89% (5.1530 => 5.0557, std.dev.: 0.0160)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -1.67% (5.8876 => 5.7894, std.dev.: 0.0114)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.40% (0.1352 => 0.1279, std.dev.: 0.0172)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/09-vor/vor: 3.33% (0.3480 => 0.3596, std.dev.: 0.0040)
  MultiSource/Applications/treecc/treecc: 2.25% (2.2516 => 2.3022, std.dev.: 0.0186)
  MultiSource/Benchmarks/MallocBench/gs/gs: 1.85% (4.5883 => 4.6734, std.dev.: 0.0213)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 1.66% (1.0756 => 1.0935, std.dev.: 0.0021)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.73% (7.6426 => 12.5136, std.dev.: 0.0557)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 21.10% (6.4425 => 7.8018, std.dev.: 0.1075)
  SingleSource/Benchmarks/Shootout/matrix: 18.70% (1.7809 => 2.1140, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout/sieve: 17.53% (7.2254 => 8.4920, std.dev.: 0.0032)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 11.97% (2.1111 => 2.3637, std.dev.: 0.0205)
  SingleSource/Benchmarks/Shootout-C++/fibo: 9.29% (4.9428 => 5.4022, std.dev.: 0.0399)
  MultiSource/Applications/obsequi/Obsequi: 7.22% (2.1884 => 2.3464, std.dev.: 0.0369)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0005)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.45% (8.1346 => 8.6595, std.dev.: 0.0122)
  MultiSource/Applications/aha/aha: 5.70% (3.5731 => 3.7769, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 4.83% (3.5550 => 3.7268, std.dev.: 0.0650)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.43% (3.5642 => 3.7221, std.dev.: 0.0011)
  MultiSource/Applications/spiff/spiff: 3.90% (2.8194 => 2.9294, std.dev.: 0.0267)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.47% (4.4696 => 4.6247, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.81% (4.0181 => 4.1312, std.dev.: 0.0112)
  MultiSource/Benchmarks/Olden/power/power: 2.38% (1.2170 => 1.2460, std.dev.: 0.0002)
  MultiSource/Applications/hexxagon/hexxagon: 2.16% (14.7810 => 15.1005, std.dev.: 0.0907)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.11% (11.7654 => 12.0134, std.dev.: 0.0332)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.96% (1.7652 => 1.7998, std.dev.: 0.0050)
  SingleSource/Regression/C/uint64_to_float: 1.95% (1.4528 => 1.4811, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.92% (5.3022 => 5.4039, std.dev.: 0.0024)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.80% (2.4920 => 2.5368, std.dev.: 0.0034)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.50% (1.0477 => 1.0634, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.47% (5.4925 => 5.5732, std.dev.: 0.0252)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.21% (6.6028 => 6.6825, std.dev.: 0.0281)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.02% (3.7874 => 3.8261, std.dev.: 0.0043)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.04% (1.2622 => 1.2491, std.dev.: 0.0046)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -55.24% (0.5226 => 0.2339, std.dev.: 0.0093)
  MultiSource/Applications/sgefa/sgefa: -47.05% (1.5790 => 0.8361, std.dev.: 0.0021)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -32.75% (0.0400 => 0.0269, std.dev.: 0.0018)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.86% (15.9508 => 12.9419, std.dev.: 0.3498)
  SingleSource/Benchmarks/Linpack/linpack-pc: -16.42% (57.2347 => 47.8385, std.dev.: 1.8966)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -14.86% (1.7197 => 1.4642, std.dev.: 0.0518)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -12.35% (20.8247 => 18.2527, std.dev.: 0.2416)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -9.62% (3.4956 => 3.1592, std.dev.: 0.0300)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.23% (50.0284 => 46.4112, std.dev.: 0.3363)
  MultiSource/Applications/SIBsim4/SIBsim4: -4.72% (3.7437 => 3.5669, std.dev.: 0.0502)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -4.03% (2.5938 => 2.4893, std.dev.: 0.0223)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.73% (17.1431 => 16.8466, std.dev.: 0.1042)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.34% (89.7126 => 88.5077, std.dev.: 0.1738)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -1.24% (2.4471 => 2.4168, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/matmul_f64_4x4: -1.15% (1.5170 => 1.4995, std.dev.: 0.0067)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -5.12% (0.1348 => 0.1279, std.dev.: 0.0172)

Report Time: 0.82s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131006/4aa8956f/attachment.html>


More information about the llvm-testresults mailing list