[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Sep 20 13:45:59 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15500?compare_to=15496&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15500, Order: 191100, Start Time: 2013-09-20 19:03:56, End Time: 2013-09-20 20:48:40
      To: 15496, Order: 191092, Start Time: 2013-09-20 16:49:20, End Time: 2013-09-20 18:38:57
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 22 (36 on baseline)
Performance Improvements: 31 (21 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1054 (1050 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.34% (1.2166 => 1.2329, std.dev.: 0.0002)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Linpack/linpack-pc: 70.93% (27.4668 => 46.9492, std.dev.: 1.7700)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 35.40% (0.0291 => 0.0394, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/pi: 22.39% (2.1334 => 2.6111, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.28% (3.5958 => 3.8574, std.dev.: 0.0041)
  MultiSource/Applications/spiff/spiff: 5.63% (2.8204 => 2.9792, std.dev.: 0.0165)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 5.44% (0.3785 => 0.3991, std.dev.: 0.0006)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 5.30% (1.1557 => 1.2169, std.dev.: 0.0007)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 4.26% (0.5091 => 0.5308, std.dev.: 0.0021)
  MultiSource/Benchmarks/BitBench/five11/five11: 4.08% (5.4264 => 5.6479, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.08% (3.5749 => 3.7207, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.75% (5.2404 => 5.4368, std.dev.: 0.0003)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 3.40% (0.3680 => 0.3805, std.dev.: 0.0017)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 2.82% (0.6271 => 0.6448, std.dev.: 0.0035)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 2.75% (3.1305 => 3.2167, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.62% (4.4961 => 4.6137, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 2.60% (5.1955 => 5.3307, std.dev.: 0.0353)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.02% (11.7771 => 12.0149, std.dev.: 0.0342)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.94% (2.4946 => 2.5429, std.dev.: 0.0011)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.66% (2.5081 => 2.5497, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.58% (11.9495 => 12.1382, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout/fib2: 1.25% (3.6080 => 3.6530, std.dev.: 0.0017)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -40.77% (0.1484 => 0.0879, std.dev.: 0.0004)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -29.41% (0.1105 => 0.0780, std.dev.: 0.0039)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -16.89% (0.1196 => 0.0994, std.dev.: 0.0058)
  MultiSource/Benchmarks/mafft/pairlocalalign: -15.14% (11.9954 => 10.1796, std.dev.: 0.0943)
  MultiSource/Applications/SPASS/SPASS: -14.10% (19.1785 => 16.4739, std.dev.: 0.1685)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -12.02% (0.1921 => 0.1690, std.dev.: 0.0037)
  MultiSource/Benchmarks/McCat/03-testtrie/testtrie: -10.13% (0.1135 => 0.1020, std.dev.: 0.0007)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -8.62% (0.1821 => 0.1664, std.dev.: 0.0006)
  MultiSource/Benchmarks/Bullet/bullet: -7.13% (36.0967 => 33.5221, std.dev.: 0.8275)
  MultiSource/Benchmarks/McCat/18-imp/imp: -7.08% (0.4237 => 0.3937, std.dev.: 0.0013)
  MultiSource/Benchmarks/McCat/05-eks/eks: -6.75% (0.5731 => 0.5344, std.dev.: 0.0043)
  MultiSource/Benchmarks/Olden/bh/bh: -6.73% (0.3519 => 0.3282, std.dev.: 0.0006)
  MultiSource/Benchmarks/McCat/09-vor/vor: -6.23% (0.3774 => 0.3539, std.dev.: 0.0016)
  MultiSource/Applications/kimwitu++/kc: -5.55% (19.9529 => 18.8454, std.dev.: 0.2971)
  MultiSource/Benchmarks/Prolangs-C++/deriv2/deriv2: -5.22% (0.3026 => 0.2868, std.dev.: 0.0004)
  MultiSource/Applications/spiff/spiff: -4.72% (0.9621 => 0.9167, std.dev.: 0.0043)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.51% (0.6089 => 0.5875, std.dev.: 0.0029)
  MultiSource/Applications/treecc/treecc: -3.27% (2.3520 => 2.2750, std.dev.: 0.0204)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -2.34% (1.2602 => 1.2307, std.dev.: 0.0055)
  MultiSource/Applications/d/make_dparser: -2.14% (3.6348 => 3.5570, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.85% (1.2840 => 1.2603, std.dev.: 0.0017)
  MultiSource/Applications/siod/siod: -1.76% (2.5506 => 2.5058, std.dev.: 0.0162)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: -28.46% (1.7974 => 1.2859, std.dev.: 0.0149)
  MultiSource/Applications/sgefa/sgefa: -6.80% (0.8966 => 0.8356, std.dev.: 0.0024)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -6.62% (10.1279 => 9.4578, std.dev.: 0.2495)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.12% (6.8922 => 6.6084, std.dev.: 0.0221)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -4.02% (41.0503 => 39.4021, std.dev.: 0.6043)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.31% (3.6438 => 3.5232, std.dev.: 0.0454)
  SingleSource/Benchmarks/Shootout-C++/ary3: -1.93% (5.0282 => 4.9311, std.dev.: 0.0368)
  MultiSource/Applications/siod/siod: -1.28% (3.6700 => 3.6232, std.dev.: 0.0081)
  MultiSource/Applications/obsequi/Obsequi: -1.00% (2.3800 => 2.3561, std.dev.: 0.0031)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.37% (0.1358 => 0.1353, std.dev.: 0.0138)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/05-eks/eks: 3.07% (0.5185 => 0.5344, std.dev.: 0.0043)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.98% (0.5705 => 0.5875, std.dev.: 0.0029)
  MultiSource/Applications/spiff/spiff: 2.87% (0.8911 => 0.9167, std.dev.: 0.0043)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.65% (0.8802 => 0.9035, std.dev.: 0.0052)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.62% (24.6139 => 25.2599, std.dev.: 0.1789)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.52% (1.5333 => 1.5719, std.dev.: 0.0107)
  MultiSource/Applications/siod/siod: 2.36% (2.4480 => 2.5058, std.dev.: 0.0162)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 2.12% (1.2728 => 1.2998, std.dev.: 0.0078)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.08% (0.6439 => 0.6573, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.01% (1.2086 => 1.2329, std.dev.: 0.0002)
  MultiSource/Applications/d/make_dparser: 1.74% (3.4962 => 3.5570, std.dev.: 0.0120)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.26% (1.3235 => 1.3402, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.23% (1.2152 => 1.2301, std.dev.: 0.0013)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 1.16% (1.4792 => 1.4963, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.09% (1.3498 => 1.3645, std.dev.: 0.0042)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 57.54% (1.6574 => 2.6111, std.dev.: 0.0002)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 10.50% (1.1013 => 1.2169, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.51% (3.5550 => 3.8574, std.dev.: 0.0041)
  MultiSource/Applications/obsequi/Obsequi: 7.66% (2.1884 => 2.3561, std.dev.: 0.0031)
  SingleSource/UnitTests/Vector/multiplies: 6.20% (0.5561 => 0.5906, std.dev.: 0.0043)
  MultiSource/Applications/spiff/spiff: 5.67% (2.8194 => 2.9792, std.dev.: 0.0165)
  MultiSource/Benchmarks/BitBench/five11/five11: 5.14% (5.3716 => 5.6479, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.39% (3.5642 => 3.7207, std.dev.: 0.0008)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 4.04% (0.3836 => 0.3991, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.82% (5.7757 => 5.9963, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.22% (4.4696 => 4.6137, std.dev.: 0.0069)
  MultiSource/Applications/siod/siod: 2.61% (3.5310 => 3.6232, std.dev.: 0.0081)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.43% (0.5182 => 0.5308, std.dev.: 0.0021)
  MultiSource/Benchmarks/Olden/power/power: 2.37% (1.2170 => 1.2459, std.dev.: 0.0015)
  MultiSource/Applications/sqlite3/sqlite3: 2.27% (4.2733 => 4.3703, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.12% (11.7654 => 12.0149, std.dev.: 0.0342)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.03% (1.7652 => 1.8011, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.76% (11.9288 => 12.1382, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout/fib2: 1.57% (3.5966 => 3.6530, std.dev.: 0.0017)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.41% (1.0477 => 1.0625, std.dev.: 0.0013)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.17% (16.7972 => 16.9933, std.dev.: 0.0205)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -19.76% (0.1483 => 0.1190, std.dev.: 0.0098)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -9.46% (0.1195 => 0.1082, std.dev.: 0.0035)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.27% (0.5226 => 0.2390, std.dev.: 0.0694)
  MultiSource/Applications/sgefa/sgefa: -47.08% (1.5790 => 0.8356, std.dev.: 0.0024)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.90% (15.9508 => 12.9364, std.dev.: 0.0828)
  SingleSource/Benchmarks/Linpack/linpack-pc: -17.97% (57.2347 => 46.9492, std.dev.: 1.7700)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -12.58% (4.0006 => 3.4972, std.dev.: 0.1117)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.53% (20.8247 => 18.4233, std.dev.: 0.1380)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.96% (0.3304 => 0.2975, std.dev.: 0.0001)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.98% (3.4956 => 3.2167, std.dev.: 0.0006)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.46% (50.0284 => 46.2945, std.dev.: 0.3031)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.89% (3.7437 => 3.5232, std.dev.: 0.0454)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.54% (0.7474 => 0.7135, std.dev.: 0.0108)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -4.25% (4.3592 => 4.1741, std.dev.: 0.0560)
  SingleSource/Benchmarks/Misc/salsa20: -3.88% (7.7964 => 7.4941, std.dev.: 0.0540)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.74% (2.4471 => 2.3800, std.dev.: 0.0210)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.33% (17.1431 => 16.7432, std.dev.: 0.0504)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -1.96% (2.5938 => 2.5429, std.dev.: 0.0011)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -1.75% (0.6563 => 0.6448, std.dev.: 0.0035)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -1.31% (3.8582 => 3.8078, std.dev.: 0.0021)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -1.06% (89.7126 => 88.7661, std.dev.: 0.2694)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 0.37% (0.1348 => 0.1353, std.dev.: 0.0138)

Report Time: 1.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130920/ed7619b5/attachment.html>


More information about the llvm-testresults mailing list