[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Oct 21 10:21:18 PDT 2013


http://llvm.org/perf/db_default/v4/nts/16539?compare_to=16536&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 16539, Order: 193083, Start Time: 2013-10-21 15:40:25, End Time: 2013-10-21 17:24:36
      To: 16536, Order: 193081, Start Time: 2013-10-21 13:32:30, End Time: 2013-10-21 15:19:13
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 30 (60 on baseline)
Performance Improvements: 4 (18 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1073 (1029 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 2.13% (1.3921 => 1.4217, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.39% (1.2268 => 1.2439, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.16% (1.2074 => 1.2214, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.09% (1.2617 => 1.2754, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.01% (1.2183 => 1.2306, std.dev.: 0.0037)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/sieve: 20.11% (7.0715 => 8.4934, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.94% (6.4284 => 7.3890, std.dev.: 0.2196)
  MultiSource/Benchmarks/nbench/nbench: 10.35% (20.3726 => 22.4804, std.dev.: 0.2889)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 9.02% (10.9445 => 11.9313, std.dev.: 0.0978)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.86% (3.6140 => 3.8618, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.68% (5.7846 => 5.9976, std.dev.: 0.0061)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 3.51% (1.4426 => 1.4932, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.46% (3.5969 => 3.7212, std.dev.: 0.0012)
  MultiSource/Applications/sgefa/sgefa: 3.09% (0.8921 => 0.9197, std.dev.: 0.0004)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 2.77% (9.2515 => 9.5080, std.dev.: 0.0393)
  MultiSource/Applications/siod/siod: 2.63% (3.5012 => 3.5933, std.dev.: 0.0214)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.27% (4.5169 => 4.6193, std.dev.: 0.0055)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.00% (4.1939 => 4.2777, std.dev.: 0.0163)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.86% (2.4806 => 2.5268, std.dev.: 0.0025)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.76% (1.6519 => 1.6810, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.70% (3.1668 => 3.2207, std.dev.: 0.0000)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.61% (5.5354 => 5.6246, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout/random: 1.52% (2.4423 => 2.4794, std.dev.: 0.0004)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.50% (3.1413 => 3.1883, std.dev.: 0.0160)
  MultiSource/Applications/viterbi/viterbi: 1.39% (2.6603 => 2.6973, std.dev.: 0.0060)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.18% (18.4015 => 18.6182, std.dev.: 0.0547)
  SingleSource/Benchmarks/Shootout/fib2: 1.12% (3.6135 => 3.6538, std.dev.: 0.0041)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.10% (23.4595 => 23.7174, std.dev.: 0.0453)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.06% (5.9638 => 6.0269, std.dev.: 0.0008)
  SingleSource/Benchmarks/Misc/oourafft: 1.02% (3.6698 => 3.7073, std.dev.: 0.0124)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vectorizer/gcc-loops: -2.75% (0.5426 => 0.5277, std.dev.: 0.0028)
  MultiSource/Benchmarks/PAQ8p/paq8p: -1.09% (2.5770 => 2.5488, std.dev.: 0.0096)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: -1.44% (3.6676 => 3.6147, std.dev.: 0.0178)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -1.43% (12.9513 => 12.7655, std.dev.: 0.0571)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.15% (0.1364 => 0.1362, std.dev.: 0.0204)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.65% (0.3096 => 0.3209, std.dev.: 0.0018)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 3.24% (0.5705 => 0.5890, std.dev.: 0.0018)
  MultiSource/Applications/oggenc/oggenc: 3.23% (5.3339 => 5.5063, std.dev.: 0.0502)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.21% (1.5333 => 1.5825, std.dev.: 0.0088)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.01% (24.6139 => 25.3553, std.dev.: 0.0382)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.72% (9.9903 => 10.2620, std.dev.: 0.0463)
  MultiSource/Applications/SPASS/SPASS: 2.69% (16.1646 => 16.5995, std.dev.: 0.0780)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.48% (7.2661 => 7.4463, std.dev.: 0.0266)
  MultiSource/Benchmarks/Bullet/bullet: 2.34% (32.7552 => 33.5221, std.dev.: 0.1716)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.33% (1.2932 => 1.3233, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.99% (1.2695 => 1.2948, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 1.87% (1.3365 => 1.3615, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.82% (1.2086 => 1.2306, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.72% (1.2007 => 1.2214, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.65% (1.3036 => 1.3251, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.63% (1.2550 => 1.2754, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.61% (1.4304 => 1.4535, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 1.54% (1.2152 => 1.2339, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.51% (1.2201 => 1.2385, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.50% (1.2981 => 1.3176, std.dev.: 0.0025)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 1.47% (1.3235 => 1.3429, std.dev.: 0.0041)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.45% (1.3303 => 1.3496, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.45% (1.3249 => 1.3441, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.44% (1.3042 => 1.3230, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.42% (1.2630 => 1.2809, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.38% (1.0952 => 1.1103, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.31% (1.2652 => 1.2818, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.30% (1.3498 => 1.3674, std.dev.: 0.0039)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 1.22% (1.2116 => 1.2264, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.20% (1.2948 => 1.3103, std.dev.: 0.0041)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 1.17% (44.2807 => 44.8000, std.dev.: 0.1741)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.12% (1.2494 => 1.2634, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.10% (1.3514 => 1.3662, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.04% (1.2639 => 1.2771, std.dev.: 0.0042)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 63.69% (7.6426 => 12.5102, std.dev.: 0.0848)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 23.53% (1.1431 => 1.4121, std.dev.: 0.0459)
  SingleSource/Benchmarks/Shootout/sieve: 17.55% (7.2254 => 8.4934, std.dev.: 0.0032)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.69% (6.4425 => 7.3890, std.dev.: 0.2196)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.63% (3.5550 => 3.8618, std.dev.: 0.0036)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 7.70% (2.4753 => 2.6658, std.dev.: 0.0221)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0002)
  MultiSource/Applications/aha/aha: 5.73% (3.5731 => 3.7780, std.dev.: 0.0649)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 5.43% (3.1730 => 3.3453, std.dev.: 0.0478)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.40% (3.5642 => 3.7212, std.dev.: 0.0012)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.29% (96.7834 => 100.9308, std.dev.: 1.2447)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.84% (5.7757 => 5.9976, std.dev.: 0.0061)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 3.81% (0.3836 => 0.3982, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.35% (4.4696 => 4.6193, std.dev.: 0.0055)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.16% (89.7126 => 92.5511, std.dev.: 0.3884)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 3.13% (4.0181 => 4.1439, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.41% (5.4925 => 5.6246, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.02% (3.1569 => 3.2207, std.dev.: 0.0000)
  MultiSource/Applications/siod/siod: 1.76% (3.5310 => 3.5933, std.dev.: 0.0214)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.67% (1.0477 => 1.0652, std.dev.: 0.0009)
  SingleSource/Benchmarks/Shootout/fib2: 1.59% (3.5966 => 3.6538, std.dev.: 0.0041)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.37% (16.7972 => 17.0277, std.dev.: 0.0508)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.35% (2.4920 => 2.5257, std.dev.: 0.0030)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.30% (3.5683 => 3.6147, std.dev.: 0.0178)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.20% (8.1346 => 8.2319, std.dev.: 0.0313)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.05% (23.4704 => 23.7174, std.dev.: 0.0453)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -20.63% (0.1483 => 0.1177, std.dev.: 0.0000)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.19% (0.5226 => 0.2394, std.dev.: 0.0435)
  MultiSource/Applications/sgefa/sgefa: -41.75% (1.5790 => 0.9197, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -31.75% (0.0400 => 0.0273, std.dev.: 0.0049)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.97% (15.9508 => 12.7655, std.dev.: 0.0571)
  SingleSource/Benchmarks/Linpack/linpack-pc: -19.52% (57.2347 => 46.0647, std.dev.: 0.5356)
  MultiSource/Benchmarks/mafft/pairlocalalign: -18.43% (50.0284 => 40.8090, std.dev.: 0.1613)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -10.60% (20.8247 => 18.6182, std.dev.: 0.0547)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -8.79% (3.4956 => 3.1883, std.dev.: 0.0160)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.44% (30.1838 => 28.5429, std.dev.: 0.3098)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.34% (3.7437 => 3.6185, std.dev.: 0.0207)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.07% (17.1431 => 16.6160, std.dev.: 0.1081)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -2.84% (2.4471 => 2.3777, std.dev.: 0.0216)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.58% (2.5938 => 2.5268, std.dev.: 0.0025)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -2.35% (3.7874 => 3.6985, std.dev.: 0.0003)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.87% (4.3592 => 4.2777, std.dev.: 0.0163)
  SingleSource/Benchmarks/Misc-C++/Large/ray: -1.50% (4.9459 => 4.8717, std.dev.: 0.0260)
  SingleSource/Benchmarks/Misc/oourafft: -1.10% (3.7484 => 3.7073, std.dev.: 0.0124)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.04% (0.1348 => 0.1362, std.dev.: 0.0204)

Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131021/7ecfdf02/attachment.html>


More information about the llvm-testresults mailing list