[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Jun 30 03:27:04 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12917?compare_to=12913&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12917, Order: 185280, Start Time: 2013-06-30 08:44:56, End Time: 2013-06-30 10:28:12
      To: 12913, Order: 185277, Start Time: 2013-06-30 03:45:20, End Time: 2013-06-30 05:27:25
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 8 (40 on baseline)
Performance Improvements: 1 (67 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1098 (1000 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 17.81% (13.9739 => 16.4626, std.dev.: 0.4814)
  SingleSource/Benchmarks/Misc/pi: 11.76% (2.1249 => 2.3747, std.dev.: 0.0194)
  SingleSource/Benchmarks/Misc/fp-convert: 5.95% (7.5919 => 8.0434, std.dev.: 0.0105)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 4.75% (0.2652 => 0.2778, std.dev.: 0.0025)
  SingleSource/Regression/C/uint64_to_float: 2.06% (1.5016 => 1.5325, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/lists1: 1.66% (0.6095 => 0.6196, std.dev.: 0.0035)
  SingleSource/Benchmarks/Shootout/hash: 1.42% (4.1797 => 4.2389, std.dev.: 0.0085)
  SingleSource/Benchmarks/Shootout-C++/matrix: 1.04% (4.3204 => 4.3654, std.dev.: 0.0002)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -8.03% (7.5557 => 6.9488, std.dev.: 0.0943)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 3.32% (0.1295 => 0.1338, std.dev.: 0.0016)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.17% (0.2721 => 0.2916, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.73% (1.4238 => 1.4626, std.dev.: 0.0066)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 2.64% (1.5862 => 1.6280, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 2.43% (1.5727 => 1.6109, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 2.36% (1.5959 => 1.6336, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.36% (1.4202 => 1.4537, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.15% (1.5735 => 1.6073, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 2.07% (1.6070 => 1.6402, std.dev.: 0.0124)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.97% (1.4081 => 1.4358, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.89% (1.6563 => 1.6876, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.89% (1.6299 => 1.6607, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.85% (1.6993 => 1.7307, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc-C++/bigfib: 1.74% (0.7059 => 0.7182, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.66% (1.5984 => 1.6250, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 1.61% (1.5806 => 1.6060, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.39% (1.7102 => 1.7339, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.15% (1.6292 => 1.6480, std.dev.: 0.0014)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/viterbi/viterbi: 35.67% (2.5688 => 3.4850, std.dev.: 0.0376)
  SingleSource/Benchmarks/Misc/pi: 29.64% (1.8318 => 2.3747, std.dev.: 0.0194)
  MultiSource/Applications/sgefa/sgefa: 29.17% (1.1695 => 1.5107, std.dev.: 0.0065)
  SingleSource/Benchmarks/Misc/perlin: 26.62% (3.6271 => 4.5926, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 23.41% (6.1372 => 7.5739, std.dev.: 0.0163)
  SingleSource/Benchmarks/Misc/mandel: 17.14% (1.0293 => 1.2057, std.dev.: 0.0006)
  SingleSource/Benchmarks/Stanford/Puzzle: 16.08% (0.1455 => 0.1689, std.dev.: 0.0074)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 15.98% (0.9806 => 1.1373, std.dev.: 0.0261)
  SingleSource/Benchmarks/Shootout/strcat: 8.24% (0.1456 => 0.1576, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 7.88% (5.2003 => 5.6103, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.11% (3.1853 => 3.3800, std.dev.: 0.0029)
  MultiSource/Applications/lua/lua: 5.92% (28.2496 => 29.9212, std.dev.: 0.2675)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.75% (3.2201 => 3.3732, std.dev.: 0.0118)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.66% (4.6639 => 4.8813, std.dev.: 0.0185)
  SingleSource/Benchmarks/Misc/fbench: 4.30% (4.7508 => 4.9549, std.dev.: 0.0048)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.26% (2.8994 => 3.0229, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.50% (5.2788 => 5.4635, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.83% (5.5010 => 5.6569, std.dev.: 0.0038)
  SingleSource/Benchmarks/CoyoteBench/almabench: 2.22% (34.3107 => 35.0711, std.dev.: 0.0120)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.11% (4.3727 => 4.4651, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.98% (5.6582 => 5.7705, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout/methcall: 1.76% (8.3425 => 8.4891, std.dev.: 0.0500)
  SingleSource/Benchmarks/Shootout-C++/lists: 1.32% (16.5355 => 16.7536, std.dev.: 0.0174)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -36.75% (0.1113 => 0.0704, std.dev.: 0.0018)
  MultiSource/Applications/viterbi/viterbi: -25.42% (0.2431 => 0.1813, std.dev.: 0.0035)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -16.31% (0.0803 => 0.0672, std.dev.: 0.0029)
  SingleSource/Benchmarks/Misc/whetstone: -14.68% (0.1097 => 0.0936, std.dev.: 0.0005)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: -12.63% (0.1322 => 0.1155, std.dev.: 0.0022)
  MultiSource/Applications/JM/lencod/lencod: -9.99% (18.9387 => 17.0468, std.dev.: 0.0710)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -8.74% (51.0211 => 46.5634, std.dev.: 0.1089)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -8.70% (0.1861 => 0.1699, std.dev.: 0.0012)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -8.45% (1.5932 => 1.4586, std.dev.: 0.0216)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.95% (1.6793 => 1.5794, std.dev.: 0.0097)
  MultiSource/Applications/kimwitu++/kc: -4.60% (20.1855 => 19.2564, std.dev.: 0.2986)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -4.35% (0.2416 => 0.2311, std.dev.: 0.0012)
  MultiSource/Applications/SPASS/SPASS: -3.76% (17.6379 => 16.9751, std.dev.: 0.0692)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.50% (0.5748 => 0.5547, std.dev.: 0.0015)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.75% (1.2911 => 0.7263, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -37.93% (4.4050 => 2.7344, std.dev.: 0.1149)
  MultiSource/Applications/lemon/lemon: -29.12% (1.3499 => 0.9568, std.dev.: 0.0949)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -24.76% (6.2328 => 4.6894, std.dev.: 0.1738)
  SingleSource/Benchmarks/Misc/salsa20: -23.08% (10.3398 => 7.9529, std.dev.: 0.4900)
  SingleSource/Benchmarks/Shootout-C++/hash: -21.29% (0.7941 => 0.6250, std.dev.: 0.0157)
  SingleSource/Benchmarks/Shootout/hash: -21.00% (5.3656 => 4.2389, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.89% (4.8986 => 3.8751, std.dev.: 0.0117)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -20.00% (1.8291 => 1.4633, std.dev.: 0.1165)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -19.83% (5.7264 => 4.5906, std.dev.: 0.0466)
  MultiSource/Applications/lambda-0_1_3/lambda: -17.95% (9.1099 => 7.4744, std.dev.: 0.0520)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.79% (25.3677 => 21.3619, std.dev.: 0.0620)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -15.76% (3.5000 => 2.9483, std.dev.: 0.0722)
  SingleSource/Benchmarks/Shootout-C++/fibo: -14.77% (4.8330 => 4.1191, std.dev.: 0.0034)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -14.76% (0.1945 => 0.1658, std.dev.: 0.0022)
  MultiSource/Benchmarks/mafft/pairlocalalign: -14.02% (48.3307 => 41.5540, std.dev.: 0.1581)
  MultiSource/Benchmarks/Olden/tsp/tsp: -13.60% (1.6613 => 1.4353, std.dev.: 0.0363)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -13.46% (1.6679 => 1.4434, std.dev.: 0.0153)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -9.73% (10.2418 => 9.2448, std.dev.: 0.2136)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -9.52% (3.2030 => 2.8982, std.dev.: 0.0693)
  MultiSource/Applications/siod/siod: -9.39% (3.7240 => 3.3744, std.dev.: 0.0311)
  SingleSource/Regression/C/uint64_to_float: -9.06% (1.6851 => 1.5325, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.56% (9.8728 => 9.0275, std.dev.: 0.0201)
  MultiSource/Applications/sqlite3/sqlite3: -8.24% (4.6358 => 4.2538, std.dev.: 0.1347)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -7.17% (1.3530 => 1.2560, std.dev.: 0.0368)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.17% (4.5717 => 4.2440, std.dev.: 0.0568)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.73% (5.5889 => 5.2127, std.dev.: 0.0459)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -6.64% (2.8537 => 2.6641, std.dev.: 0.0296)
  SingleSource/Benchmarks/Shootout-C++/hash2: -6.16% (3.5939 => 3.3725, std.dev.: 0.0432)
  SingleSource/Benchmarks/Misc/flops: -5.79% (10.2170 => 9.6254, std.dev.: 0.0821)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -5.31% (1.3084 => 1.2389, std.dev.: 0.0114)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.84% (5.3184 => 5.0609, std.dev.: 0.0695)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.24% (5.3276 => 5.1017, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -4.12% (4.5935 => 4.4044, std.dev.: 0.0131)
  SingleSource/Benchmarks/Shootout/ary3: -4.05% (6.0122 => 5.7685, std.dev.: 0.0687)
  SingleSource/Benchmarks/Misc/whetstone: -3.82% (3.5970 => 3.4595, std.dev.: 0.0034)
  SingleSource/Benchmarks/Shootout/heapsort: -3.77% (2.9988 => 2.8858, std.dev.: 0.0140)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -3.74% (1.6440 => 1.5825, std.dev.: 0.0033)
  MultiSource/Applications/hexxagon/hexxagon: -3.61% (15.4979 => 14.9382, std.dev.: 0.0543)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -3.60% (4.1768 => 4.0263, std.dev.: 0.0145)
  MultiSource/Applications/SIBsim4/SIBsim4: -2.92% (3.5327 => 3.4294, std.dev.: 0.0345)
  SingleSource/Benchmarks/Shootout/sieve: -2.89% (8.0178 => 7.7857, std.dev.: 0.0008)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.74% (3.8665 => 3.7607, std.dev.: 0.0165)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -2.32% (4.6452 => 4.5375, std.dev.: 0.0243)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.23% (4.5094 => 4.4087, std.dev.: 0.0004)
  MultiSource/Benchmarks/Olden/power/power: -2.17% (1.2558 => 1.2286, std.dev.: 0.0080)
  SingleSource/Benchmarks/Dhrystone/dry: -2.13% (0.5126 => 0.5017, std.dev.: 0.0039)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: -1.99% (1.1791 => 1.1556, std.dev.: 0.0033)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.70% (1.6980 => 1.6691, std.dev.: 0.0049)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.69% (6.3757 => 6.2682, std.dev.: 0.0265)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.68% (4.9946 => 4.9106, std.dev.: 0.0195)
  SingleSource/Benchmarks/Shootout/lists: -1.47% (7.2961 => 7.1889, std.dev.: 0.0108)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.37% (12.1841 => 12.0177, std.dev.: 0.0066)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -7.15% (0.1441 => 0.1338, std.dev.: 0.0016)

Report Time: 2.96s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130630/3ea56c40/attachment.html>


More information about the llvm-testresults mailing list