[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Nov 1 11:10:26 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16902?compare_to=16898&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16902, Order: 193862, Start Time: 2013-11-01 16:21:39, End Time: 2013-11-01 18:13:56
      To: 16898, Order: 193858, Start Time: 2013-11-01 13:58:23, End Time: 2013-11-01 15:58:24
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 14 (25 on baseline)
Performance Improvements: 27 (24 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1066 (1058 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/city/city: 33.44% (0.0308 => 0.0411, std.dev.: 0.0033)
  SingleSource/Benchmarks/Stanford/Treesort: 16.09% (0.0634 => 0.0736, std.dev.: 0.0001)
  SingleSource/Benchmarks/Stanford/Puzzle: 16.04% (0.1596 => 0.1852, std.dev.: 0.0002)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 9.77% (0.4616 => 0.5067, std.dev.: 0.0008)
  SingleSource/Benchmarks/McGill/misr: 5.97% (0.3919 => 0.4153, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/salsa20: 5.78% (7.6326 => 8.0739, std.dev.: 0.0428)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.74% (2.1269 => 2.2064, std.dev.: 0.0042)
  SingleSource/Benchmarks/Stanford/FloatMM: 3.55% (0.7036 => 0.7286, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 3.40% (5.9171 => 6.1180, std.dev.: 0.0081)
  SingleSource/Benchmarks/Shootout/methcall: 2.53% (8.3861 => 8.5985, std.dev.: 0.0410)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.46% (1.8503 => 1.8958, std.dev.: 0.0020)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.35% (2.4803 => 2.5139, std.dev.: 0.0096)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.30% (8.9025 => 9.0178, std.dev.: 0.0368)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.01% (1.6725 => 1.6894, std.dev.: 0.0032)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2002-10-13-BadLoad: -61.18% (0.0170 => 0.0066, std.dev.: 0.0020)
  SingleSource/Regression/C/2004-03-15-IndirectGoto: -48.68% (0.0341 => 0.0175, std.dev.: 0.0002)
  SingleSource/Regression/C++/EH/simple_rethrow: -46.15% (0.0429 => 0.0231, std.dev.: 0.0021)
  SingleSource/Regression/C++/EH/throw_rethrow_test: -45.28% (0.0519 => 0.0284, std.dev.: 0.0088)
  SingleSource/Regression/C++/EH/ConditionalExpr: -44.70% (0.0443 => 0.0245, std.dev.: 0.0061)
  SingleSource/Regression/C/casts: -43.43% (0.0700 => 0.0396, std.dev.: 0.0016)
  SingleSource/Regression/C++/global_ctor: -41.34% (0.0404 => 0.0237, std.dev.: 0.0041)
  SingleSource/Regression/C++/EH/simple_throw: -41.16% (0.0311 => 0.0183, std.dev.: 0.0026)
  SingleSource/Regression/C/sumarray2d: -39.89% (0.0539 => 0.0324, std.dev.: 0.0034)
  SingleSource/UnitTests/2003-07-09-LoadShorts: -29.07% (0.0375 => 0.0266, std.dev.: 0.0026)
  SingleSource/Benchmarks/Shootout-C++/lists: -24.96% (0.3489 => 0.2618, std.dev.: 0.0197)
  MultiSource/Benchmarks/mafft/pairlocalalign: -18.44% (12.5288 => 10.2181, std.dev.: 0.4604)
  SingleSource/Benchmarks/CoyoteBench/almabench: -13.07% (0.0903 => 0.0785, std.dev.: 0.0003)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -11.62% (0.4476 => 0.3956, std.dev.: 0.0072)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -11.45% (0.4034 => 0.3572, std.dev.: 0.0056)
  SingleSource/UnitTests/Vector/constpool: -11.12% (10.3211 => 9.1733, std.dev.: 0.2270)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -8.92% (0.1581 => 0.1440, std.dev.: 0.0018)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.34% (0.5547 => 0.5362, std.dev.: 0.0051)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: -35.47% (2.4355 => 1.5716, std.dev.: 0.1027)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -20.85% (1.8811 => 1.4888, std.dev.: 0.0076)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -18.46% (12.0662 => 9.8386, std.dev.: 0.4291)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -12.71% (4.4497 => 3.8842, std.dev.: 0.1778)
  SingleSource/Benchmarks/Shootout/strcat: -8.19% (0.1588 => 0.1458, std.dev.: 0.0049)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -8.03% (6.7296 => 6.1895, std.dev.: 0.1942)
  SingleSource/Benchmarks/Dhrystone/dry: -6.19% (0.5185 => 0.4864, std.dev.: 0.0066)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -4.76% (2.9721 => 2.8307, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.86% (6.0286 => 5.9165, std.dev.: 0.0304)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.44% (0.1319 => 0.1338, std.dev.: 0.0288)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 7.36% (0.3096 => 0.3324, std.dev.: 0.0032)
  MultiSource/Applications/JM/lencod/lencod: 5.20% (16.5902 => 17.4530, std.dev.: 0.1968)
  MultiSource/Applications/JM/ldecod/ldecod: 4.36% (7.4026 => 7.7255, std.dev.: 0.1181)
  MultiSource/Applications/siod/siod: 3.91% (2.4480 => 2.5438, std.dev.: 0.0361)
  MultiSource/Benchmarks/nbench/nbench: 1.71% (1.2484 => 1.2698, std.dev.: 0.0077)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 60.56% (7.6426 => 12.2713, std.dev.: 0.0547)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 55.52% (4.4696 => 6.9510, std.dev.: 0.0569)
  SingleSource/Benchmarks/Shootout-C++/matrix: 47.08% (2.8554 => 4.1997, std.dev.: 0.0435)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 36.04% (4.2391 => 5.7668, std.dev.: 0.0992)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 20.09% (1.1431 => 1.3728, std.dev.: 0.0627)
  SingleSource/Benchmarks/McGill/misr: 10.13% (0.3771 => 0.4153, std.dev.: 0.0002)
  SingleSource/UnitTests/Vector/multiplies: 6.60% (0.5561 => 0.5928, std.dev.: 0.0005)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 6.56% (3.1730 => 3.3811, std.dev.: 0.0113)
  SingleSource/Benchmarks/Misc/salsa20: 3.56% (7.7964 => 8.0739, std.dev.: 0.0428)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 3.16% (2.5368 => 2.6170, std.dev.: 0.0274)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.11% (89.7126 => 92.5044, std.dev.: 0.3249)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 2.76% (2.1472 => 2.2064, std.dev.: 0.0042)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.55% (1.7652 => 1.8102, std.dev.: 0.0037)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.37% (1.8519 => 1.8958, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.07% (5.7757 => 5.8951, std.dev.: 0.0443)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.01% (3.1569 => 3.2205, std.dev.: 0.0172)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.90% (6.0038 => 6.1180, std.dev.: 0.0081)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.65% (1.0477 => 1.0650, std.dev.: 0.0020)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.55% (8.8798 => 9.0178, std.dev.: 0.0368)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.12% (1.6707 => 1.6894, std.dev.: 0.0032)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -53.44% (0.5226 => 0.2433, std.dev.: 0.0401)
  MultiSource/Applications/sgefa/sgefa: -42.15% (1.5790 => 0.9135, std.dev.: 0.0012)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -36.25% (0.0400 => 0.0255, std.dev.: 0.0028)
  SingleSource/Benchmarks/Linpack/linpack-pc: -17.69% (57.2347 => 47.1100, std.dev.: 1.9753)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -17.45% (4.0181 => 3.3168, std.dev.: 0.1007)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -15.09% (15.9508 => 13.5439, std.dev.: 0.5575)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -11.26% (20.8247 => 18.4800, std.dev.: 0.0455)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -10.07% (3.4956 => 3.1437, std.dev.: 0.0209)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -9.69% (0.1238 => 0.1118, std.dev.: 0.0034)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.13% (3.7437 => 3.4018, std.dev.: 0.0204)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -7.38% (3.0561 => 2.8307, std.dev.: 0.0093)
  MultiSource/Applications/lambda-0_1_3/lambda: -6.45% (8.1346 => 7.6103, std.dev.: 0.0465)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.86% (0.3501 => 0.3331, std.dev.: 0.0034)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.92% (4.3592 => 4.1885, std.dev.: 0.0502)
  SingleSource/Benchmarks/Shootout-C++/ary3: -3.91% (5.0002 => 4.8047, std.dev.: 0.0746)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -3.55% (5.4473 => 5.2540, std.dev.: 0.0727)
  MultiSource/Benchmarks/Olden/power/power: -3.13% (1.2170 => 1.1789, std.dev.: 0.0028)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -3.08% (2.5938 => 2.5139, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -2.98% (17.1431 => 16.6316, std.dev.: 0.1135)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.97% (3.7874 => 3.6749, std.dev.: 0.0067)
  SingleSource/Benchmarks/Misc/oourafft: -2.58% (3.7484 => 3.6517, std.dev.: 0.0259)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: -2.32% (1.4898 => 1.4552, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -1.60% (6.0128 => 5.9165, std.dev.: 0.0304)
  SingleSource/Benchmarks/Misc/fp-convert: -1.29% (7.5877 => 7.4901, std.dev.: 0.0334)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.74% (0.1348 => 0.1338, std.dev.: 0.0288)

Report Time: 0.76s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131101/749721ba/attachment.html>


More information about the llvm-testresults mailing list