[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Aug 19 09:35:05 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14569?compare_to=14566&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14569, Order: 188675, Start Time: 2013-08-19 14:49:14, End Time: 2013-08-19 16:37:10
      To: 14566, Order: 188668, Start Time: 2013-08-19 12:30:35, End Time: 2013-08-19 14:25:20
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 13 (49 on baseline)
Performance Improvements: 28 (55 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1066 (1003 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 43.66% (0.3392 => 0.4873, std.dev.: 0.0153)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 20.23% (0.1063 => 0.1278, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 13.83% (1.5257 => 1.7367, std.dev.: 0.0741)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 10.87% (1.5193 => 1.6844, std.dev.: 0.0369)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 10.50% (1.4597 => 1.6130, std.dev.: 0.0247)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 9.71% (1.3999 => 1.5358, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 9.66% (1.4811 => 1.6242, std.dev.: 0.0155)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 9.40% (1.3729 => 1.5020, std.dev.: 0.0336)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 8.58% (1.3861 => 1.5050, std.dev.: 0.0357)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 8.46% (1.4959 => 1.6225, std.dev.: 0.0368)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.58% (1.5379 => 1.6544, std.dev.: 0.0377)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 6.77% (1.4050 => 1.5001, std.dev.: 0.0045)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/fib2: 1.41% (4.8861 => 4.9551, std.dev.: 0.0196)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -35.13% (0.2024 => 0.1313, std.dev.: 0.0211)
  MultiSource/Benchmarks/SciMark2-C/scimark2: -22.73% (0.5016 => 0.3876, std.dev.: 0.0382)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -18.22% (0.7191 => 0.5881, std.dev.: 0.0240)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -12.09% (1.0310 => 0.9064, std.dev.: 0.0443)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: -8.13% (0.8731 => 0.8021, std.dev.: 0.0095)
  SingleSource/Benchmarks/Misc/ReedSolomon: -6.97% (0.2510 => 0.2335, std.dev.: 0.0012)
  MultiSource/Benchmarks/sim/sim: -5.76% (0.4046 => 0.3813, std.dev.: 0.0028)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -4.97% (0.2614 => 0.2484, std.dev.: 0.0027)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -4.68% (0.2413 => 0.2300, std.dev.: 0.0034)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.35% (0.7698 => 0.7363, std.dev.: 0.0032)
  MultiSource/Applications/minisat/minisat: -3.64% (0.8131 => 0.7835, std.dev.: 0.0051)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -3.30% (6.7351 => 6.5126, std.dev.: 0.0605)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: -2.14% (0.6668 => 0.6525, std.dev.: 0.0023)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: -42.01% (2.4904 => 1.4441, std.dev.: 0.3903)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -28.99% (1.2261 => 0.8706, std.dev.: 0.0556)
  MultiSource/Benchmarks/nbench/nbench: -16.83% (22.2839 => 18.5329, std.dev.: 0.9659)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/mvt/mvt: -11.57% (0.3051 => 0.2698, std.dev.: 0.0117)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -10.88% (41.1078 => 36.6367, std.dev.: 1.1324)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -6.50% (0.3121 => 0.2918, std.dev.: 0.0051)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: -6.24% (63.9173 => 59.9275, std.dev.: 1.3907)
  SingleSource/Benchmarks/Dhrystone/fldry: -4.61% (0.7014 => 0.6691, std.dev.: 0.0032)
  SingleSource/Benchmarks/BenchmarkGame/recursive: -4.45% (2.5098 => 2.3980, std.dev.: 0.0286)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.94% (1.6346 => 1.6029, std.dev.: 0.0090)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -1.83% (5.9307 => 5.8223, std.dev.: 0.0233)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -1.48% (1.4387 => 1.4174, std.dev.: 0.0033)
  MultiSource/Applications/lua/lua: -1.41% (30.0863 => 29.6634, std.dev.: 0.1474)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.16% (7.9376 => 7.8457, std.dev.: 0.0026)
  SingleSource/Benchmarks/Misc/flops-4: -1.12% (1.6325 => 1.6142, std.dev.: 0.0068)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 1.14% (0.1319 => 0.1334, std.dev.: 0.0052)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 33.32% (0.3655 => 0.4873, std.dev.: 0.0153)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: 18.33% (0.1080 => 0.1278, std.dev.: 0.0019)
  MultiSource/Benchmarks/FreeBench/distray/distray: 17.91% (0.1033 => 0.1218, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 15.50% (1.5037 => 1.7367, std.dev.: 0.0741)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 11.32% (1.6185 => 1.8017, std.dev.: 0.0252)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 11.08% (1.3826 => 1.5358, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.20% (1.3630 => 1.5020, std.dev.: 0.0336)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 10.12% (1.4750 => 1.6242, std.dev.: 0.0155)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 7.98% (1.5357 => 1.6582, std.dev.: 0.0374)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.91% (1.4947 => 1.6130, std.dev.: 0.0247)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 7.77% (1.5629 => 1.6844, std.dev.: 0.0369)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 7.08% (1.5361 => 1.6449, std.dev.: 0.0352)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 6.88% (1.5479 => 1.6544, std.dev.: 0.0377)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 5.33% (1.4721 => 1.5505, std.dev.: 0.0187)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 5.10% (1.6226 => 1.7054, std.dev.: 0.0258)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 5.07% (1.5144 => 1.5912, std.dev.: 0.0289)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 4.97% (1.4783 => 1.5518, std.dev.: 0.0199)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.66% (1.4333 => 1.5001, std.dev.: 0.0045)
  SingleSource/Benchmarks/Misc/oourafft: 4.64% (0.2284 => 0.2390, std.dev.: 0.0027)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.63% (0.9941 => 1.0202, std.dev.: 0.0083)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.80% (0.9407 => 0.9576, std.dev.: 0.0063)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 68.90% (3.7285 => 6.2974, std.dev.: 0.1133)
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.55% (2.8867 => 4.2881, std.dev.: 0.2051)
  MultiSource/Benchmarks/FreeBench/neural/neural: 37.56% (0.3171 => 0.4362, std.dev.: 0.0037)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 25.46% (1.5030 => 1.8857, std.dev.: 0.0155)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 18.39% (2.9428 => 3.4841, std.dev.: 0.1463)
  SingleSource/Benchmarks/Shootout-C++/hash: 16.20% (0.6295 => 0.7315, std.dev.: 0.0353)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.87% (7.0762 => 7.8457, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 9.83% (5.4910 => 6.0307, std.dev.: 0.0114)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 8.70% (0.1678 => 0.1824, std.dev.: 0.0021)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.02% (1.2557 => 1.3564, std.dev.: 0.0021)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.94% (48.3256 => 52.1609, std.dev.: 0.3553)
  MultiSource/Benchmarks/FreeBench/mason/mason: 6.29% (0.2799 => 0.2975, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 6.15% (4.3151 => 4.5803, std.dev.: 0.0285)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.86% (3.4085 => 3.6081, std.dev.: 0.0321)
  MultiSource/Applications/siod/siod: 4.97% (3.3761 => 3.5438, std.dev.: 0.0564)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.95% (3.3384 => 3.5038, std.dev.: 0.0173)
  SingleSource/Benchmarks/Misc/whetstone: 3.88% (3.4559 => 3.5900, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.75% (4.8739 => 5.0569, std.dev.: 0.0214)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.27% (25.0200 => 25.8387, std.dev.: 0.1321)
  SingleSource/Benchmarks/Shootout-C++/hash2: 3.00% (3.3877 => 3.4895, std.dev.: 0.0303)
  MultiSource/Applications/spiff/spiff: 2.90% (2.7609 => 2.8411, std.dev.: 0.0051)
  SingleSource/Benchmarks/Misc/ffbench: 2.30% (1.3679 => 1.3994, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 2.27% (4.9995 => 5.1129, std.dev.: 0.0076)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 2.17% (2.8156 => 2.8768, std.dev.: 0.0196)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.59% (4.9040 => 4.9820, std.dev.: 0.0232)
  SingleSource/Benchmarks/BenchmarkGame/partialsums: 1.33% (1.1618 => 1.1772, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.24% (3.0680 => 3.1059, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.15% (9.7023 => 9.8139, std.dev.: 0.0162)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/power/power: -34.38% (0.2237 => 0.1468, std.dev.: 0.0127)
  MultiSource/Benchmarks/Olden/bisort/bisort: -31.53% (0.1072 => 0.0734, std.dev.: 0.0021)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -23.56% (0.0675 => 0.0516, std.dev.: 0.0026)
  MultiSource/Benchmarks/MallocBench/gs/gs: -22.10% (6.0938 => 4.7469, std.dev.: 0.0227)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -22.08% (0.1114 => 0.0868, std.dev.: 0.0067)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -20.81% (1.5228 => 1.2059, std.dev.: 0.0361)
  MultiSource/Benchmarks/Olden/health/health: -20.37% (0.1993 => 0.1587, std.dev.: 0.0096)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -19.80% (0.3576 => 0.2868, std.dev.: 0.0144)
  MultiSource/Applications/obsequi/Obsequi: -19.35% (1.4685 => 1.1844, std.dev.: 0.0093)
  MultiSource/Applications/hbd/hbd: -17.44% (2.0193 => 1.6671, std.dev.: 0.0069)
  MultiSource/Applications/lua/lua: -17.01% (5.3200 => 4.4151, std.dev.: 0.0977)
  MultiSource/Applications/hexxagon/hexxagon: -15.31% (1.3285 => 1.1251, std.dev.: 0.0059)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -13.72% (1.3985 => 1.2066, std.dev.: 0.0422)
  MultiSource/Applications/sgefa/sgefa: -12.62% (0.4809 => 0.4202, std.dev.: 0.0054)
  MultiSource/Applications/kimwitu++/kc: -7.48% (21.0770 => 19.5010, std.dev.: 0.2140)
  MultiSource/Benchmarks/Ptrdist/ks/ks: -7.04% (0.1947 => 0.1810, std.dev.: 0.0013)
  MultiSource/Applications/siod/siod: -6.83% (2.7150 => 2.5297, std.dev.: 0.0675)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: -5.91% (6.1631 => 5.7988, std.dev.: 0.0216)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -5.43% (0.2432 => 0.2300, std.dev.: 0.0034)
  MultiSource/Applications/minisat/minisat: -5.35% (0.8278 => 0.7835, std.dev.: 0.0051)
  MultiSource/Benchmarks/McCat/05-eks/eks: -2.40% (0.5634 => 0.5499, std.dev.: 0.0043)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.66% (0.7487 => 0.7363, std.dev.: 0.0032)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.58% (2.1022 => 1.4174, std.dev.: 0.0033)
  MultiSource/Benchmarks/MallocBench/gs/gs: -30.03% (0.1189 => 0.0832, std.dev.: 0.0029)
  MultiSource/Applications/viterbi/viterbi: -27.25% (3.4923 => 2.5407, std.dev.: 0.0499)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.45% (6.9552 => 5.2546, std.dev.: 0.0399)
  SingleSource/Benchmarks/Misc/perlin: -21.46% (4.5989 => 3.6119, std.dev.: 0.0024)
  MultiSource/Benchmarks/Ptrdist/ft/ft: -20.58% (1.0962 => 0.8706, std.dev.: 0.0556)
  MultiSource/Applications/obsequi/Obsequi: -18.95% (2.6081 => 2.1138, std.dev.: 0.0743)
  MultiSource/Benchmarks/nbench/nbench: -15.79% (22.0083 => 18.5329, std.dev.: 0.9659)
  SingleSource/Benchmarks/Misc/mandel: -14.00% (1.1996 => 1.0316, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.69% (6.2627 => 5.4056, std.dev.: 0.3075)
  MultiSource/Benchmarks/Olden/perimeter/perimeter: -12.54% (0.3557 => 0.3111, std.dev.: 0.0076)
  MultiSource/Benchmarks/FreeBench/analyzer/analyzer: -12.44% (0.0884 => 0.0774, std.dev.: 0.0000)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -10.01% (0.5173 => 0.4655, std.dev.: 0.0197)
  MultiSource/Applications/SIBsim4/SIBsim4: -8.10% (3.5791 => 3.2893, std.dev.: 0.0977)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: -6.66% (1.3148 => 1.2272, std.dev.: 0.0313)
  SingleSource/Benchmarks/Shootout-C++/EH/except: -5.33% (0.4969 => 0.4704, std.dev.: 0.0102)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -4.99% (2.7049 => 2.5700, std.dev.: 0.0510)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: -4.93% (1.1024 => 1.0481, std.dev.: 0.0147)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -4.88% (0.7355 => 0.6996, std.dev.: 0.0027)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: -4.66% (0.3773 => 0.3597, std.dev.: 0.0040)
  SingleSource/Benchmarks/Misc/fbench: -4.57% (4.9602 => 4.7337, std.dev.: 0.0176)
  MultiSource/Applications/lua/lua: -4.53% (31.0707 => 29.6634, std.dev.: 0.1474)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.49% (47.2250 => 45.1053, std.dev.: 0.6661)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.10% (3.8119 => 3.6556, std.dev.: 0.0519)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -4.05% (2.8052 => 2.6916, std.dev.: 0.0373)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.87% (21.6864 => 20.8470, std.dev.: 0.2948)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.29% (0.7806 => 0.7549, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.49% (6.1482 => 5.9954, std.dev.: 0.0211)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.44% (6.0444 => 5.8971, std.dev.: 0.0133)
  MultiSource/Applications/sgefa/sgefa: -2.37% (1.4030 => 1.3698, std.dev.: 0.0016)
  SingleSource/Benchmarks/Misc/oourafft: -2.35% (3.7891 => 3.7002, std.dev.: 0.0053)
  SingleSource/Benchmarks/CoyoteBench/almabench: -2.05% (34.8438 => 34.1282, std.dev.: 0.0896)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: -1.65% (1.2012 => 1.1814, std.dev.: 0.0023)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.19% (0.1378 => 0.1334, std.dev.: 0.0052)

Report Time: 0.68s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130819/db5cb3d8/attachment.html>


More information about the llvm-testresults mailing list