[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Jul 1 20:59:14 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12978?compare_to=12974&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12978, Order: 185401, Start Time: 2013-07-02 02:15:18, End Time: 2013-07-02 04:00:23
      To: 12974, Order: 185394, Start Time: 2013-07-02 00:06:27, End Time: 2013-07-02 01:53:02
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 7 (33 on baseline)
Performance Improvements: 2 (65 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1098 (1009 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 17.44% (1.5997 => 1.8787, std.dev.: 0.0070)
  MultiSource/Benchmarks/nbench/nbench: 11.75% (19.8345 => 22.1657, std.dev.: 0.7963)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.29% (48.8245 => 50.4304, std.dev.: 0.0856)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.66% (1.0608 => 1.0784, std.dev.: 0.0048)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.59% (11.4409 => 11.6231, std.dev.: 0.0095)
  SingleSource/Regression/C/uint64_to_float: 1.44% (1.5171 => 1.5389, std.dev.: 0.0083)
  SingleSource/Benchmarks/Shootout-C++/random: 1.05% (2.4478 => 2.4735, std.dev.: 0.0015)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.06% (1.6974 => 1.6624, std.dev.: 0.0042)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.52% (6.3335 => 6.2372, std.dev.: 0.0148)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.21% (0.1326 => 0.1310, std.dev.: 0.0378)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.95% (0.2721 => 0.2910, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 2.43% (1.6073 => 1.6463, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.99% (1.6299 => 1.6624, std.dev.: 0.0042)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/viterbi/viterbi: 35.70% (2.5688 => 3.4858, std.dev.: 0.0453)
  MultiSource/Applications/sgefa/sgefa: 30.35% (1.1695 => 1.5244, std.dev.: 0.0145)
  SingleSource/Benchmarks/Misc/perlin: 26.79% (3.6271 => 4.5987, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 20.99% (6.1372 => 7.4257, std.dev.: 0.1127)
  SingleSource/Benchmarks/Misc/mandel: 17.21% (1.0293 => 1.2064, std.dev.: 0.0128)
  SingleSource/Benchmarks/Stanford/Puzzle: 17.11% (0.1455 => 0.1704, std.dev.: 0.0018)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.50% (0.9806 => 1.0934, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.00% (5.2003 => 5.6161, std.dev.: 0.0223)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.35% (3.1853 => 3.3875, std.dev.: 0.0010)
  MultiSource/Applications/lua/lua: 5.98% (28.2496 => 29.9400, std.dev.: 0.6070)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.66% (3.2201 => 3.3700, std.dev.: 0.0361)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.53% (4.6639 => 4.8750, std.dev.: 0.0213)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.51% (1.0571 => 1.1048, std.dev.: 0.0024)
  MultiSource/Benchmarks/mafft/pairlocalalign: 4.34% (48.3307 => 50.4304, std.dev.: 0.0856)
  SingleSource/Benchmarks/Misc/fbench: 4.34% (4.7508 => 4.9570, std.dev.: 0.0075)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.16% (2.8994 => 3.0200, std.dev.: 0.0046)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 3.69% (1.2224 => 1.2675, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 3.57% (5.2788 => 5.4670, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.95% (5.5010 => 5.6632, std.dev.: 0.0074)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.39% (4.3727 => 4.4770, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 2.30% (4.6379 => 4.7447, std.dev.: 0.0380)
  SingleSource/Benchmarks/Shootout/methcall: 2.27% (8.3425 => 8.5317, std.dev.: 0.0694)
  SingleSource/Benchmarks/CoyoteBench/almabench: 2.22% (34.3107 => 35.0714, std.dev.: 0.0210)
  MultiSource/Benchmarks/sim/sim: 2.12% (3.8805 => 3.9628, std.dev.: 0.0144)
  SingleSource/Benchmarks/Misc/ffbench: 2.07% (1.3696 => 1.3979, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.92% (5.6582 => 5.7667, std.dev.: 0.0027)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 1.91% (1.7925 => 1.8267, std.dev.: 0.0128)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 1.69% (1.0605 => 1.0784, std.dev.: 0.0048)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 1.31% (1.2579 => 1.2744, std.dev.: 0.0062)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.08% (11.4990 => 11.6231, std.dev.: 0.0095)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: -13.20% (0.7918 => 0.6873, std.dev.: 0.0222)
  SingleSource/UnitTests/Vector/Altivec/alti_isamax: -9.92% (0.2006 => 0.1807, std.dev.: 0.0017)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -9.57% (1.0314 => 0.9327, std.dev.: 0.0276)
  SingleSource/UnitTests/2006-12-11-LoadConstants: -9.15% (0.1563 => 0.1420, std.dev.: 0.0004)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -8.54% (0.8025 => 0.7340, std.dev.: 0.0263)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -8.53% (51.0211 => 46.6675, std.dev.: 0.1357)
  MultiSource/Benchmarks/Prolangs-C/bison/mybison: -8.47% (1.7804 => 1.6296, std.dev.: 0.0509)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.73% (0.7381 => 0.6884, std.dev.: 0.0185)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -5.94% (0.1853 => 0.1743, std.dev.: 0.0024)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -5.41% (0.2753 => 0.2604, std.dev.: 0.0037)
  MultiSource/Applications/kimwitu++/kc: -4.81% (20.1855 => 19.2153, std.dev.: 0.2396)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -3.88% (0.2961 => 0.2846, std.dev.: 0.0005)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -3.77% (1.3686 => 1.3170, std.dev.: 0.0088)
  SingleSource/Benchmarks/Shootout-C++/hash: -2.37% (0.4554 => 0.4446, std.dev.: 0.0028)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.37% (1.2911 => 0.7312, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -37.95% (4.4050 => 2.7335, std.dev.: 0.0038)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -24.59% (1.6105 => 1.2144, std.dev.: 0.0039)
  SingleSource/Benchmarks/Shootout/hash: -22.26% (5.3656 => 4.1714, std.dev.: 0.1377)
  SingleSource/Benchmarks/Shootout-C++/hash: -21.06% (0.7941 => 0.6269, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -21.00% (4.8986 => 3.8701, std.dev.: 0.0359)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -20.09% (5.7264 => 4.5761, std.dev.: 0.0312)
  SingleSource/Benchmarks/CoyoteBench/fftbench: -19.23% (1.8291 => 1.4774, std.dev.: 0.1229)
  MultiSource/Applications/kimwitu++/kc: -19.06% (0.0556 => 0.0450, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.43% (6.2328 => 5.0842, std.dev.: 0.0043)
  MultiSource/Applications/lambda-0_1_3/lambda: -17.99% (9.1099 => 7.4712, std.dev.: 0.0488)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.85% (25.3677 => 21.3457, std.dev.: 0.0301)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -14.24% (0.1945 => 0.1668, std.dev.: 0.0061)
  MultiSource/Benchmarks/Olden/tsp/tsp: -13.75% (1.6613 => 1.4328, std.dev.: 0.0203)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -13.32% (1.6679 => 1.4457, std.dev.: 0.0245)
  SingleSource/Benchmarks/Misc/salsa20: -13.15% (10.3398 => 8.9799, std.dev.: 0.0172)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -9.32% (10.2418 => 9.2871, std.dev.: 0.2959)
  SingleSource/Regression/C/uint64_to_float: -8.68% (1.6851 => 1.5389, std.dev.: 0.0083)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -8.42% (9.8728 => 9.0414, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -7.33% (4.5717 => 4.2364, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.63% (5.5889 => 5.2184, std.dev.: 0.0388)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -6.49% (0.1542 => 0.1442, std.dev.: 0.0025)
  MultiSource/Applications/sqlite3/sqlite3: -6.38% (4.6358 => 4.3400, std.dev.: 0.0776)
  SingleSource/Benchmarks/Shootout-C++/hash2: -6.28% (3.5939 => 3.3681, std.dev.: 0.0115)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -5.48% (1.3084 => 1.2367, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.87% (5.3184 => 5.0596, std.dev.: 0.0785)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -4.81% (2.8537 => 2.7164, std.dev.: 0.0223)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: -4.20% (4.5935 => 4.4006, std.dev.: 0.0473)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.12% (5.3276 => 5.1083, std.dev.: 0.0692)
  SingleSource/Benchmarks/Misc/flops: -4.02% (10.2170 => 9.8063, std.dev.: 0.0084)
  SingleSource/Benchmarks/Misc/whetstone: -3.91% (3.5970 => 3.4562, std.dev.: 0.0161)
  MultiSource/Benchmarks/PAQ8p/paq8p: -3.90% (94.2966 => 90.6196, std.dev.: 1.1986)
  MultiSource/Applications/hexxagon/hexxagon: -3.63% (15.4979 => 14.9349, std.dev.: 0.1557)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -3.16% (1.6440 => 1.5921, std.dev.: 0.0115)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -2.92% (0.6548 => 0.6357, std.dev.: 0.0021)
  SingleSource/Benchmarks/Shootout/sieve: -2.87% (8.0178 => 7.7879, std.dev.: 0.0025)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.60% (3.8665 => 3.7658, std.dev.: 0.0020)
  MultiSource/Benchmarks/Bullet/bullet: -2.58% (7.1938 => 7.0082, std.dev.: 0.0256)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -2.45% (3.6122 => 3.5236, std.dev.: 0.0146)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.39% (5.7342 => 5.5972, std.dev.: 0.0132)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.36% (4.5094 => 4.4029, std.dev.: 0.0059)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.17% (6.3757 => 6.2372, std.dev.: 0.0148)
  MultiSource/Benchmarks/Ptrdist/bc/bc: -1.92% (1.1291 => 1.1074, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.90% (4.2167 => 4.1364, std.dev.: 0.0301)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.75% (4.9946 => 4.9073, std.dev.: 0.0179)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.65% (5.9068 => 5.8092, std.dev.: 0.0300)
  MultiSource/Benchmarks/Olden/power/power: -1.44% (1.2558 => 1.2377, std.dev.: 0.0009)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.40% (12.1841 => 12.0140, std.dev.: 0.0535)
  SingleSource/Benchmarks/Shootout/lists: -1.36% (7.2961 => 7.1969, std.dev.: 0.0142)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.29% (9.6556 => 9.5310, std.dev.: 0.0224)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -1.06% (1.8989 => 1.8787, std.dev.: 0.0070)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -9.09% (0.1441 => 0.1310, std.dev.: 0.0378)

Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130701/b016afec/attachment.html>


More information about the llvm-testresults mailing list