[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jun 4 20:04:56 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12059?compare_to=12056&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12059, Order: 183283, Start Time: 2013-06-05 01:18:37, End Time: 2013-06-05 03:05:37
      To: 12056, Order: 183274, Start Time: 2013-06-04 23:09:41, End Time: 2013-06-05 00:56:11
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 23 (31 on baseline)
Performance Improvements: 2 (43 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1082 (1033 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 65.26% (0.2608 => 0.4310, std.dev.: 0.0048)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 50.92% (0.0489 => 0.0738, std.dev.: 0.0039)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: 36.51% (0.1408 => 0.1922, std.dev.: 0.0174)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 36.16% (0.1225 => 0.1668, std.dev.: 0.0116)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 32.17% (0.1610 => 0.2128, std.dev.: 0.0161)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 13.73% (14.7269 => 16.7495, std.dev.: 0.7591)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.25% (1.4235 => 1.5124, std.dev.: 0.0212)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 5.64% (1.4530 => 1.5350, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 5.34% (1.3815 => 1.4553, std.dev.: 0.0232)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 5.27% (1.4259 => 1.5011, std.dev.: 0.0096)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 78.60% (0.0215 => 0.0384, std.dev.: 0.0029)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 76.12% (0.0423 => 0.0745, std.dev.: 0.0018)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 57.74% (0.0885 => 0.1396, std.dev.: 0.0025)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 27.02% (1.4763 => 1.8752, std.dev.: 0.0171)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 16.01% (2.7227 => 3.1587, std.dev.: 0.0280)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 13.53% (0.2660 => 0.3020, std.dev.: 0.0012)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 7.73% (15.4985 => 16.6966, std.dev.: 0.2383)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 4.01% (20.8755 => 21.7116, std.dev.: 0.1795)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 2.35% (39.7172 => 40.6520, std.dev.: 0.3141)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.10% (5.5202 => 5.6361, std.dev.: 0.0331)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.85% (5.3613 => 5.4605, std.dev.: 0.0270)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.60% (5.8429 => 5.9361, std.dev.: 0.0118)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.57% (1.7006 => 1.7273, std.dev.: 0.0089)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.27% (7.3031 => 7.0643, std.dev.: 0.0164)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -1.58% (3.2874 => 3.2355, std.dev.: 0.0194)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 3.31% (0.1450 => 0.1498, std.dev.: 0.0215)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: 57.64% (0.2734 => 0.4310, std.dev.: 0.0048)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: 34.30% (0.1242 => 0.1668, std.dev.: 0.0116)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: 31.60% (0.1617 => 0.2128, std.dev.: 0.0161)
  MultiSource/Benchmarks/MiBench/telecomm-adpcm/telecomm-adpcm: 27.24% (0.0580 => 0.0738, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.77% (1.4165 => 1.5124, std.dev.: 0.0212)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 6.36% (0.2721 => 0.2894, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 6.23% (1.4131 => 1.5011, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 5.21% (1.3832 => 1.4553, std.dev.: 0.0232)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 3.92% (1.4771 => 1.5350, std.dev.: 0.0080)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/BitBench/uuencode/uuencode: 104.26% (0.0188 => 0.0384, std.dev.: 0.0029)
  MultiSource/Benchmarks/MiBench/network-dijkstra/network-dijkstra: 60.22% (0.0465 => 0.0745, std.dev.: 0.0018)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 58.28% (0.0882 => 0.1396, std.dev.: 0.0025)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 24.52% (2.5366 => 3.1587, std.dev.: 0.0280)
  MultiSource/Applications/sgefa/sgefa: 18.22% (1.1695 => 1.3826, std.dev.: 0.0005)
  SingleSource/Benchmarks/Stanford/Puzzle: 16.36% (0.1455 => 0.1693, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 15.80% (6.1372 => 7.1068, std.dev.: 0.0407)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 8.75% (0.2777 => 0.3020, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.09% (5.2003 => 5.6209, std.dev.: 0.0264)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.78% (0.8276 => 0.8837, std.dev.: 0.0144)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.20% (3.1853 => 3.3829, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.65% (3.2201 => 3.3697, std.dev.: 0.0121)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.21% (1.0571 => 1.1016, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.06% (5.2788 => 5.4932, std.dev.: 0.0207)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.98% (5.5010 => 5.6649, std.dev.: 0.0536)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.50% (4.3727 => 4.4819, std.dev.: 0.0055)
  SingleSource/Benchmarks/Shootout/methcall: 2.11% (8.3425 => 8.5183, std.dev.: 0.0359)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.86% (5.6582 => 5.7636, std.dev.: 0.0276)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 1.73% (1.6980 => 1.7273, std.dev.: 0.0089)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.48% (3.6122 => 3.6656, std.dev.: 0.0147)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.18% (4.8986 => 4.9563, std.dev.: 0.0079)
  SingleSource/Benchmarks/Misc/oourafft: 1.07% (3.7315 => 3.7716, std.dev.: 0.0114)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/garage/garage: -34.95% (0.1113 => 0.0724, std.dev.: 0.0044)
  MultiSource/Applications/viterbi/viterbi: -24.56% (0.2431 => 0.1834, std.dev.: 0.0127)
  SingleSource/Benchmarks/Misc/whetstone: -15.13% (0.1097 => 0.0931, std.dev.: 0.0021)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -9.89% (51.0211 => 45.9769, std.dev.: 0.9443)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -7.83% (1.0314 => 0.9506, std.dev.: 0.0265)
  SingleSource/Benchmarks/Shootout-C++/strcat: -6.11% (0.2309 => 0.2168, std.dev.: 0.0010)
  MultiSource/Applications/kimwitu++/kc: -5.78% (20.1855 => 19.0179, std.dev.: 0.4487)
  SingleSource/Benchmarks/Shootout-C++/objinst: -5.55% (0.2397 => 0.2264, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -5.21% (0.2151 => 0.2039, std.dev.: 0.0020)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -4.95% (6.6236 => 6.2955, std.dev.: 0.0932)
  SingleSource/Benchmarks/Shootout-C++/ary2: -4.88% (0.2951 => 0.2807, std.dev.: 0.0017)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -4.50% (0.2753 => 0.2629, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout-C++/hash: -4.24% (0.4554 => 0.4361, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: -2.76% (0.3617 => 0.3517, std.dev.: 0.0019)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -44.07% (1.2911 => 0.7221, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -26.55% (4.4050 => 3.2355, std.dev.: 0.0194)
  MultiSource/Benchmarks/Olden/bisort/bisort: -21.83% (0.8606 => 0.6727, std.dev.: 0.0641)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -18.96% (6.2328 => 5.0512, std.dev.: 0.0383)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -15.87% (25.3677 => 21.3410, std.dev.: 0.2587)
  MultiSource/Applications/minisat/minisat: -15.41% (7.3703 => 6.2343, std.dev.: 0.1567)
  SingleSource/Benchmarks/Misc/salsa20: -13.02% (10.3398 => 8.9931, std.dev.: 0.0128)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -10.75% (10.2418 => 9.1411, std.dev.: 0.3785)
  MultiSource/Benchmarks/mafft/pairlocalalign: -10.01% (48.3307 => 43.4949, std.dev.: 0.0125)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.37% (1.6679 => 1.5117, std.dev.: 0.0202)
  SingleSource/Benchmarks/Shootout-C++/hash: -8.26% (0.7941 => 0.7285, std.dev.: 0.0217)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.72% (5.5889 => 5.2131, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.55% (9.8728 => 9.2264, std.dev.: 0.0475)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: -6.53% (0.1945 => 0.1818, std.dev.: 0.0031)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.78% (0.4445 => 0.4188, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -4.79% (4.5717 => 4.3527, std.dev.: 0.0383)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.56% (5.3184 => 5.0758, std.dev.: 0.0151)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -4.17% (5.3276 => 5.1053, std.dev.: 0.0350)
  MultiSource/Applications/hexxagon/hexxagon: -4.06% (15.4979 => 14.8693, std.dev.: 0.0275)
  MultiSource/Benchmarks/Olden/tsp/tsp: -3.64% (1.6613 => 1.6009, std.dev.: 0.0147)
  SingleSource/Benchmarks/Misc/flops: -3.56% (10.2170 => 9.8532, std.dev.: 0.0093)
  SingleSource/Benchmarks/Shootout/sieve: -3.03% (8.0178 => 7.7747, std.dev.: 0.0157)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.86% (3.8665 => 3.7561, std.dev.: 0.0098)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -2.65% (2.8537 => 2.7782, std.dev.: 0.0181)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.10% (4.2167 => 4.1280, std.dev.: 0.0099)
  SingleSource/Benchmarks/Misc/ReedSolomon: -1.74% (8.5243 => 8.3756, std.dev.: 0.0033)
  MultiSource/Benchmarks/BitBench/five11/five11: -1.71% (5.7342 => 5.6361, std.dev.: 0.0331)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -1.17% (9.6556 => 9.5428, std.dev.: 0.0079)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: -1.14% (2.8573 => 2.8246, std.dev.: 0.0116)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 3.96% (0.1441 => 0.1498, std.dev.: 0.0215)

Report Time: 0.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130604/d447be33/attachment.html>


More information about the llvm-testresults mailing list