[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Aug 7 09:59:54 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14182?compare_to=14179&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14182, Order: 187888, Start Time: 2013-08-07 15:17:04, End Time: 2013-08-07 17:01:47
      To: 14179, Order: 187883, Start Time: 2013-08-07 13:10:17, End Time: 2013-08-07 14:55:50
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

New Failures: 0 (2 on baseline)
Performance Regressions: 5 (28 on baseline)
Performance Improvements: 1 (58 on baseline)
Existing Failures: 3 (1 on baseline)
Unchanged Tests: 1099 (1019 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 6.67% (0.8330 => 0.8886, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 4.47% (6.2417 => 6.5205, std.dev.: 0.0425)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 4.16% (1.2920 => 1.3458, std.dev.: 0.0010)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.69% (5.5674 => 5.7171, std.dev.: 0.0421)
  MultiSource/Applications/lua/lua: 2.58% (29.6806 => 30.4452, std.dev.: 0.1664)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -9.83% (0.2982 => 0.2689, std.dev.: 0.0022)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Applications/ClamAV/clamscan: -0.60% (0.1324 => 0.1316, std.dev.: 0.0378)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -0.82% (0.2699 => 0.2677, std.dev.: 0.0696)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -20.95% (0.0253 => 0.0200, std.dev.: 0.0033)

================================
Run-Over-Baseline Changes Detail
================================

New Failures - Execution Time
-----------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm
  MultiSource/Benchmarks/mediabench/gsm/toast/toast
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -4.83% (0.2813 => 0.2677, std.dev.: 0.0696)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -42.03% (0.0345 => 0.0200, std.dev.: 0.0033)

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/bigstack: 41.63% (0.0466 => 0.0660, std.dev.: 0.0020)
  MultiSource/Benchmarks/FreeBench/distray/distray: 15.97% (0.1033 => 0.1198, std.dev.: 0.0014)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.57% (0.9407 => 0.9649, std.dev.: 0.0080)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 74.88% (3.7285 => 6.5205, std.dev.: 0.0425)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.58% (2.8867 => 4.2891, std.dev.: 0.0319)
  MultiSource/Benchmarks/FreeBench/neural/neural: 29.99% (0.3171 => 0.4122, std.dev.: 0.0183)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 25.33% (0.0458 => 0.0574, std.dev.: 0.0000)
  SingleSource/Benchmarks/Shootout/hash: 23.12% (4.1846 => 5.1519, std.dev.: 0.1313)
  SingleSource/Benchmarks/Shootout-C++/hash: 15.97% (0.6295 => 0.7300, std.dev.: 0.0312)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.85% (7.0762 => 7.8437, std.dev.: 0.0187)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.59% (0.1678 => 0.1839, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.34% (5.4910 => 5.9490, std.dev.: 0.0422)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.94% (48.3256 => 52.1617, std.dev.: 0.3342)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 7.64% (1.2557 => 1.3516, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 5.99% (5.3042 => 5.6218, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.67% (3.4085 => 3.6016, std.dev.: 0.0031)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.50% (5.5008 => 5.8031, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.27% (4.3151 => 4.4993, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.24% (5.1471 => 5.3653, std.dev.: 0.0734)
  SingleSource/Benchmarks/Misc/whetstone: 3.87% (3.4559 => 3.5897, std.dev.: 0.0116)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.26% (25.0200 => 25.8368, std.dev.: 0.0562)
  MultiSource/Applications/spiff/spiff: 3.15% (2.7609 => 2.8479, std.dev.: 0.0182)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.12% (4.8739 => 5.0258, std.dev.: 0.0263)
  SingleSource/Benchmarks/Shootout-C++/hash2: 3.06% (3.3877 => 3.4915, std.dev.: 0.0247)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: 2.70% (1.3104 => 1.3458, std.dev.: 0.0010)
  SingleSource/Benchmarks/Shootout/matrix: 2.32% (1.7358 => 1.7760, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.83% (3.3464 => 3.4075, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.82% (5.0417 => 5.1336, std.dev.: 0.0194)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: -21.83% (6.0938 => 4.7638, std.dev.: 0.0237)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.23% (1.5228 => 1.2147, std.dev.: 0.0338)
  MultiSource/Applications/obsequi/Obsequi: -19.01% (1.4685 => 1.1894, std.dev.: 0.0097)
  MultiSource/Applications/sgefa/sgefa: -14.91% (0.4809 => 0.4092, std.dev.: 0.0223)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -14.06% (1.3985 => 1.2019, std.dev.: 0.0060)
  MultiSource/Benchmarks/Olden/em3d/em3d: -12.89% (0.2367 => 0.2062, std.dev.: 0.0037)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -11.02% (0.1870 => 0.1664, std.dev.: 0.0018)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -8.98% (0.3073 => 0.2797, std.dev.: 0.0025)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -8.42% (0.1947 => 0.1783, std.dev.: 0.0025)
  MultiSource/Applications/kimwitu++/kc: -7.10% (21.0770 => 19.5811, std.dev.: 0.0502)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -6.89% (1.5144 => 1.4101, std.dev.: 0.0035)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -6.03% (6.1631 => 5.7912, std.dev.: 0.0548)
  MultiSource/Applications/minisat/minisat: -5.74% (0.8278 => 0.7803, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.70% (1.4721 => 1.4029, std.dev.: 0.0194)
  MultiSource/Benchmarks/Olden/bh/bh: -4.33% (0.3603 => 0.3447, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/consumer-jpeg/consumer-jpeg: -3.31% (5.2851 => 5.1099, std.dev.: 0.0267)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -3.05% (0.3309 => 0.3208, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.80% (1.5357 => 1.4927, std.dev.: 0.0141)
  MultiSource/Benchmarks/McCat/18-imp/imp: -2.65% (0.4153 => 0.4043, std.dev.: 0.0033)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -2.61% (1.5376 => 1.4974, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -1.63% (1.4037 => 1.3808, std.dev.: 0.0086)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.24% (1.6686 => 1.6479, std.dev.: 0.0077)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MallocBench/gs/gs: -35.83% (0.1189 => 0.0763, std.dev.: 0.0038)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.49% (2.1022 => 1.4191, std.dev.: 0.0039)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -29.04% (0.0816 => 0.0579, std.dev.: 0.0035)
  MultiSource/Applications/viterbi/viterbi: -26.32% (3.4923 => 2.5732, std.dev.: 0.0152)
  MultiSource/Applications/JM/ldecod/ldecod: -25.03% (0.0859 => 0.0644, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.63% (6.9552 => 5.2420, std.dev.: 0.3176)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -22.29% (0.0884 => 0.0687, std.dev.: 0.0041)
  MultiSource/Applications/minisat/minisat: -22.13% (8.0162 => 6.2426, std.dev.: 0.0884)
  SingleSource/Benchmarks/Misc/perlin: -21.35% (4.5989 => 3.6169, std.dev.: 0.0299)
  MultiSource/Applications/obsequi/Obsequi: -18.66% (2.6081 => 2.1214, std.dev.: 0.0608)
  SingleSource/Benchmarks/Misc/mandel: -14.05% (1.1996 => 1.0310, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.14% (6.2627 => 5.4395, std.dev.: 0.2684)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.55% (0.5173 => 0.4627, std.dev.: 0.0044)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -8.99% (0.3649 => 0.3321, std.dev.: 0.0063)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gesummv/gesummv: -7.91% (0.2047 => 0.1885, std.dev.: 0.0011)
  SingleSource/Benchmarks/Shootout/strcat: -7.03% (0.1593 => 0.1481, std.dev.: 0.0016)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.22% (47.2250 => 44.2875, std.dev.: 0.9047)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -6.20% (0.4969 => 0.4661, std.dev.: 0.0049)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.34% (1.7207 => 1.6289, std.dev.: 0.0219)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.79% (3.8119 => 3.6295, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc/fbench: -4.52% (4.9602 => 4.7360, std.dev.: 0.0145)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.34% (0.7355 => 0.7036, std.dev.: 0.0010)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.16% (1.1024 => 1.0565, std.dev.: 0.0030)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.67% (21.6864 => 20.8913, std.dev.: 0.0155)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.31% (6.0444 => 5.8443, std.dev.: 0.0258)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.11% (0.7806 => 0.7563, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.03% (6.1482 => 5.9620, std.dev.: 0.0123)
  MultiSource/Benchmarks/Olden/bh/bh: -2.94% (2.4879 => 2.4148, std.dev.: 0.0225)
  MultiSource/Applications/sgefa/sgefa: -2.49% (1.4030 => 1.3681, std.dev.: 0.0047)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.35% (8.6172 => 8.4145, std.dev.: 0.0118)
  SingleSource/Benchmarks/Misc/oourafft: -2.20% (3.7891 => 3.7057, std.dev.: 0.0052)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.02% (34.8438 => 34.1391, std.dev.: 0.1081)
  MultiSource/Applications/lua/lua: -2.01% (31.0707 => 30.4452, std.dev.: 0.1664)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.61% (5.8810 => 5.7866, std.dev.: 0.0163)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -1.54% (5.0180 => 4.9405, std.dev.: 0.0016)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -1.42% (2.9568 => 2.9149, std.dev.: 0.0137)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -4.50% (0.1378 => 0.1316, std.dev.: 0.0378)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130807/095a39b2/attachment.html>


More information about the llvm-testresults mailing list