[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Jun 19 16:16:19 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12550?compare_to=12547&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12550, Order: 184349, Start Time: 2013-06-19 21:23:45, End Time: 2013-06-19 23:17:16
      To: 12547, Order: 184330, Start Time: 2013-06-19 19:08:03, End Time: 2013-06-19 20:59:33
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 26 (56 on baseline)
Performance Improvements: 12 (33 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1069 (1018 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-08-02-CastTest: 70.06% (0.0167 => 0.0284, std.dev.: 0.0013)
  SingleSource/UnitTests/2003-07-10-SignConversions: 63.24% (0.0185 => 0.0302, std.dev.: 0.0020)
  SingleSource/UnitTests/2003-07-08-BitOpsTest: 59.04% (0.0188 => 0.0299, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 46.45% (0.0816 => 0.1195, std.dev.: 0.0049)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 46.26% (0.1204 => 0.1761, std.dev.: 0.0097)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 46.21% (0.2865 => 0.4189, std.dev.: 0.0245)
  SingleSource/UnitTests/2003-08-05-CastFPToUint: 45.50% (0.0222 => 0.0323, std.dev.: 0.0034)
  SingleSource/UnitTests/SignlessTypes/ccc: 37.59% (0.0274 => 0.0377, std.dev.: 0.0035)
  SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 25.65% (0.0460 => 0.0578, std.dev.: 0.0028)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 24.81% (1.2910 => 1.6113, std.dev.: 0.0736)
  SingleSource/Benchmarks/Misc/perlin: 23.13% (0.0614 => 0.0756, std.dev.: 0.0041)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.35% (4.3012 => 4.5315, std.dev.: 0.0216)
  SingleSource/Regression/C++/ofstream_ctor: 4.36% (0.2365 => 0.2468, std.dev.: 0.0009)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/flops-7: 21.74% (1.7752 => 2.1611, std.dev.: 0.0127)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 21.28% (0.2105 => 0.2553, std.dev.: 0.0080)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 14.66% (0.1228 => 0.1408, std.dev.: 0.0007)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 10.33% (31.2720 => 34.5031, std.dev.: 0.2280)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 9.75% (2.7569 => 3.0257, std.dev.: 0.0346)
  MultiSource/Benchmarks/llubenchmark/llu: 6.22% (2.0166 => 2.1420, std.dev.: 0.0408)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.95% (3.0146 => 3.1940, std.dev.: 0.0484)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 3.91% (1.4841 => 1.5421, std.dev.: 0.0115)
  SingleSource/Benchmarks/Misc/fp-convert: 3.53% (7.7881 => 8.0629, std.dev.: 0.0138)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.74% (5.3435 => 5.4365, std.dev.: 0.0322)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.46% (6.0924 => 6.1816, std.dev.: 0.0273)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.44% (3.2840 => 3.3312, std.dev.: 0.0080)
  MultiSource/Applications/sqlite3/sqlite3: 1.32% (4.4441 => 4.5028, std.dev.: 0.0107)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: -34.38% (0.1149 => 0.0754, std.dev.: 0.0139)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: -30.18% (0.1196 => 0.0835, std.dev.: 0.0039)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -22.19% (0.2064 => 0.1606, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: -16.88% (0.0995 => 0.0827, std.dev.: 0.0026)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: -11.03% (0.2810 => 0.2500, std.dev.: 0.0089)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -5.83% (1.0267 => 0.9668, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.99% (1.5845 => 1.5530, std.dev.: 0.0007)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/McCat/09-vor/vor: -21.66% (0.1533 => 0.1201, std.dev.: 0.0043)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -20.92% (1.6805 => 1.3289, std.dev.: 0.1352)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: -19.27% (0.1069 => 0.0863, std.dev.: 0.0024)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -8.80% (0.9321 => 0.8501, std.dev.: 0.0135)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -2.05% (2.5318 => 2.4799, std.dev.: 0.0179)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.07% (0.1385 => 0.1384, std.dev.: 0.0018)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2002-08-02-CastTest: 74.23% (0.0163 => 0.0284, std.dev.: 0.0013)
  SingleSource/UnitTests/2003-07-10-SignConversions: 71.59% (0.0176 => 0.0302, std.dev.: 0.0020)
  SingleSource/UnitTests/2003-07-08-BitOpsTest: 67.98% (0.0178 => 0.0299, std.dev.: 0.0019)
  SingleSource/UnitTests/Vector/divides: 61.61% (0.0211 => 0.0341, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/bicg/bicg: 53.40% (0.0779 => 0.1195, std.dev.: 0.0049)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 53.22% (0.2734 => 0.4189, std.dev.: 0.0245)
  SingleSource/UnitTests/2003-08-05-CastFPToUint: 51.64% (0.0213 => 0.0323, std.dev.: 0.0034)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 48.66% (0.0522 => 0.0776, std.dev.: 0.0053)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 43.96% (1.1193 => 1.6113, std.dev.: 0.0736)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 33.21% (0.1322 => 0.1761, std.dev.: 0.0097)
  SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 29.02% (0.0448 => 0.0578, std.dev.: 0.0028)
  SingleSource/Benchmarks/Misc/perlin: 21.54% (0.0622 => 0.0756, std.dev.: 0.0041)
  MultiSource/Benchmarks/Bullet/bullet: 12.34% (35.5296 => 39.9136, std.dev.: 1.2630)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.91% (2.6076 => 2.8659, std.dev.: 0.0043)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 9.00% (51.0211 => 55.6131, std.dev.: 1.2484)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 8.58% (4.1734 => 4.5315, std.dev.: 0.0216)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 7.37% (1.5735 => 1.6894, std.dev.: 0.0198)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 7.06% (0.2721 => 0.2913, std.dev.: 0.0068)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.03% (25.9348 => 27.4978, std.dev.: 0.3648)
  SingleSource/Regression/C++/ofstream_ctor: 4.58% (0.2360 => 0.2468, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.12% (1.4165 => 1.4749, std.dev.: 0.0162)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 3.91% (1.4081 => 1.4632, std.dev.: 0.0190)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 3.31% (0.3113 => 0.3216, std.dev.: 0.0040)
  SingleSource/Benchmarks/Shootout-C++/moments: 2.90% (0.4006 => 0.4122, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.79% (1.5108 => 1.5530, std.dev.: 0.0007)
  MultiSource/Applications/siod/siod: 2.62% (2.4944 => 2.5598, std.dev.: 0.0010)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 51.87% (6.0122 => 9.1308, std.dev.: 0.7795)
  MultiSource/Applications/sgefa/sgefa: 33.54% (1.1695 => 1.5618, std.dev.: 0.0255)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 28.42% (16.4665 => 21.1468, std.dev.: 0.3461)
  SingleSource/Benchmarks/Stanford/Puzzle: 23.37% (0.1455 => 0.1795, std.dev.: 0.0035)
  SingleSource/Benchmarks/Misc-C++/oopack_v1p8: 23.21% (0.2072 => 0.2553, std.dev.: 0.0080)
  SingleSource/Benchmarks/Misc/flops-7: 20.15% (1.7987 => 2.1611, std.dev.: 0.0127)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 20.14% (0.1172 => 0.1408, std.dev.: 0.0007)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 19.28% (2.5366 => 3.0257, std.dev.: 0.0346)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.63% (6.1372 => 7.1576, std.dev.: 0.0179)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 15.35% (10.2418 => 11.8142, std.dev.: 0.2469)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.05% (39.1740 => 42.7193, std.dev.: 0.7273)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.15% (5.2003 => 5.6243, std.dev.: 0.0468)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 6.30% (32.4581 => 34.5031, std.dev.: 0.2280)
  MultiSource/Benchmarks/PAQ8p/paq8p: 5.26% (94.2966 => 99.2577, std.dev.: 1.3649)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.91% (4.6639 => 4.8928, std.dev.: 0.0139)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.54% (1.0571 => 1.1051, std.dev.: 0.0051)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 4.43% (3.9713 => 4.1474, std.dev.: 0.0361)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 4.32% (1.4783 => 1.5421, std.dev.: 0.0115)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.23% (3.1853 => 3.3199, std.dev.: 0.0379)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.13% (5.9362 => 6.1816, std.dev.: 0.0273)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 3.91% (4.8986 => 5.0900, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.85% (2.9004 => 3.0122, std.dev.: 0.0142)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 3.85% (4.0156 => 4.1700, std.dev.: 0.0502)
  MultiSource/Benchmarks/Bullet/bullet: 3.70% (7.1938 => 7.4602, std.dev.: 0.0212)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.52% (5.2788 => 5.4646, std.dev.: 0.0437)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.50% (1.7925 => 1.8374, std.dev.: 0.0120)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.45% (4.3727 => 4.4797, std.dev.: 0.0117)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.16% (39.9248 => 40.7852, std.dev.: 0.3163)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.76% (5.6582 => 5.7576, std.dev.: 0.0102)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.26% (2.9023 => 2.9390, std.dev.: 0.0130)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -34.86% (0.1113 => 0.0725, std.dev.: 0.0033)
  MultiSource/Applications/viterbi/viterbi: -23.65% (0.2431 => 0.1856, std.dev.: 0.0048)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.51% (1.6793 => 1.5868, std.dev.: 0.0091)
  MultiSource/Applications/JM/lencod/lencod: -4.64% (18.9387 => 18.0597, std.dev.: 0.3373)
  MultiSource/Applications/oggenc/oggenc: -3.88% (5.9886 => 5.7564, std.dev.: 0.0702)
  MultiSource/Applications/ClamAV/clamscan: -2.34% (17.3229 => 16.9182, std.dev.: 0.0268)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.15% (1.2911 => 0.7340, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.86% (4.4050 => 3.2217, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -23.62% (6.2328 => 4.7607, std.dev.: 0.0245)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.03% (25.3677 => 21.3022, std.dev.: 0.0185)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -13.96% (11.6227 => 9.9999, std.dev.: 0.0097)
  SingleSource/Benchmarks/Misc/salsa20: -12.85% (10.3398 => 9.0114, std.dev.: 0.0650)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -10.45% (7.0179 => 6.2845, std.dev.: 0.0116)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.20% (1.6679 => 1.5144, std.dev.: 0.0187)
  MultiSource/Applications/siod/siod: -8.62% (3.7240 => 3.4030, std.dev.: 0.0073)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -8.56% (0.1542 => 0.1410, std.dev.: 0.0017)
  MultiSource/Applications/lambda-0_1_3/lambda: -8.55% (9.1099 => 8.3308, std.dev.: 0.0194)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.80% (48.3307 => 44.5586, std.dev.: 0.3729)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.73% (5.5889 => 5.2128, std.dev.: 0.0286)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -6.05% (4.5717 => 4.2951, std.dev.: 0.0172)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -5.90% (9.8728 => 9.2903, std.dev.: 0.0200)
  MultiSource/Applications/SIBsim4/SIBsim4: -5.70% (3.5327 => 3.3312, std.dev.: 0.0080)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.62% (0.4445 => 0.4195, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.44% (4.2167 => 4.0293, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/flops: -3.78% (10.2170 => 9.8307, std.dev.: 0.0329)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -3.02% (1.8989 => 1.8416, std.dev.: 0.0208)
  SingleSource/Benchmarks/Shootout/sieve: -2.93% (8.0178 => 7.7825, std.dev.: 0.0090)
  MultiSource/Applications/sqlite3/sqlite3: -2.87% (4.6358 => 4.5028, std.dev.: 0.0107)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.75% (3.8665 => 3.7602, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.98% (4.5094 => 4.4200, std.dev.: 0.0173)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.64% (5.7342 => 5.6399, std.dev.: 0.0196)
  MultiSource/Applications/viterbi/viterbi: -1.38% (2.5688 => 2.5333, std.dev.: 0.0094)
  MultiSource/Applications/aha/aha: -1.23% (3.6251 => 3.5806, std.dev.: 0.0093)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.96% (0.1441 => 0.1384, std.dev.: 0.0018)

Report Time: 0.74s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130619/8a7b513a/attachment.html>


More information about the llvm-testresults mailing list