[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Sep 29 19:26:48 PDT 2013


http://llvm.org/perf/db_default/v4/nts/15800?compare_to=15797&baseline=15193
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:16

Comparing:
     Run: 15800, Order: 191648, Start Time: 2013-09-30 00:48:13, End Time: 2013-09-30 02:29:42
      To: 15797, Order: 191647, Start Time: 2013-09-29 21:59:03, End Time: 2013-09-29 23:40:12
Baseline: 15193, Order: 190525, Start Time: 2013-09-11 14:56:37, End Time: 2013-09-11 16:46:18

===============
Tests Summary
===============

Performance Regressions: 17 (104 on baseline)
Performance Improvements: 2 (25 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1088 (978 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/McCat/05-eks/eks: 2.17% (0.5301 => 0.5416, std.dev.: 0.0022)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 1.57% (0.6684 => 0.6789, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.36% (1.2015 => 1.2179, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.27% (1.3493 => 1.3665, std.dev.: 0.0013)
  MultiSource/Applications/oggenc/oggenc: 1.25% (5.3887 => 5.4561, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.12% (1.2583 => 1.2724, std.dev.: 0.0026)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 7.09% (6.8997 => 7.3887, std.dev.: 0.1206)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 5.14% (1.8058 => 1.8986, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.55% (5.7909 => 5.9965, std.dev.: 0.0192)
  SingleSource/Benchmarks/Shootout-C++/lists: 3.34% (15.6868 => 16.2103, std.dev.: 0.0250)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.23% (5.2658 => 5.4358, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.46% (4.0318 => 4.1310, std.dev.: 0.0060)
  SingleSource/Benchmarks/Shootout/lists: 2.40% (7.2965 => 7.4713, std.dev.: 0.0193)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 1.95% (21.0977 => 21.5097, std.dev.: 0.1062)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 1.92% (9.2816 => 9.4602, std.dev.: 0.0238)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.28% (5.0460 => 5.1104, std.dev.: 0.0009)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 1.12% (2.9096 => 2.9423, std.dev.: 0.0045)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.48% (1.2361 => 1.2178, std.dev.: 0.0070)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -1.01% (6.1833 => 6.1207, std.dev.: 0.0222)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.44% (0.1352 => 0.1346, std.dev.: 0.0004)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/Prolangs-C/cdecl/cdecl: 4.84% (0.4624 => 0.4848, std.dev.: 0.0009)
  MultiSource/Benchmarks/McCat/05-eks/eks: 4.46% (0.5185 => 0.5416, std.dev.: 0.0022)
  MultiSource/Applications/sqlite3/sqlite3: 4.04% (16.2888 => 16.9467, std.dev.: 0.1765)
  MultiSource/Applications/lambda-0_1_3/lambda: 3.88% (0.8014 => 0.8325, std.dev.: 0.0038)
  MultiSource/Applications/siod/siod: 3.74% (2.4480 => 2.5395, std.dev.: 0.0032)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 3.57% (2.6492 => 2.7437, std.dev.: 0.0247)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 3.55% (4.0397 => 4.1833, std.dev.: 0.0023)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 3.10% (1.9476 => 2.0080, std.dev.: 0.0027)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 2.98% (0.3822 => 0.3936, std.dev.: 0.0021)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 2.96% (0.5705 => 0.5874, std.dev.: 0.0043)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 2.78% (0.6297 => 0.6472, std.dev.: 0.0019)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.71% (1.5333 => 1.5748, std.dev.: 0.0116)
  MultiSource/Applications/kimwitu++/kc: 2.70% (18.3608 => 18.8567, std.dev.: 0.0514)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 2.67% (1.3365 => 1.3722, std.dev.: 0.0017)
  MultiSource/Applications/SPASS/SPASS: 2.63% (16.1646 => 16.5890, std.dev.: 0.0700)
  MultiSource/Benchmarks/Bullet/bullet: 2.60% (32.7552 => 33.6057, std.dev.: 0.0372)
  SingleSource/Benchmarks/Misc-C++/bigfib: 2.53% (0.6439 => 0.6602, std.dev.: 0.0054)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 2.50% (0.8667 => 0.8884, std.dev.: 0.0079)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 2.48% (7.2661 => 7.4466, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 2.44% (1.2932 => 1.3247, std.dev.: 0.0105)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.40% (0.5046 => 0.5167, std.dev.: 0.0002)
  MultiSource/Applications/JM/lencod/lencod: 2.30% (16.5902 => 16.9714, std.dev.: 0.0592)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.29% (0.8802 => 0.9004, std.dev.: 0.0041)
  MultiSource/Applications/oggenc/oggenc: 2.29% (5.3339 => 5.4561, std.dev.: 0.0061)
  MultiSource/Applications/d/make_dparser: 2.27% (3.4962 => 3.5754, std.dev.: 0.0156)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.25% (9.9903 => 10.2148, std.dev.: 0.0625)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 2.23% (14.4764 => 14.7998, std.dev.: 0.0307)
  MultiSource/Applications/lemon/lemon: 2.15% (1.1862 => 1.2117, std.dev.: 0.0052)
  MultiSource/Benchmarks/MallocBench/gs/gs: 2.07% (4.5883 => 4.6834, std.dev.: 0.0309)
  MultiSource/Applications/ClamAV/clamscan: 2.07% (16.5398 => 16.8823, std.dev.: 0.0633)
  MultiSource/Applications/JM/ldecod/ldecod: 2.07% (7.4026 => 7.5555, std.dev.: 0.0264)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 2.05% (1.2086 => 1.2334, std.dev.: 0.0022)
  MultiSource/Applications/hexxagon/hexxagon: 2.02% (1.0276 => 1.0484, std.dev.: 0.0029)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 2.01% (1.0756 => 1.0972, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 1.90% (1.2695 => 1.2936, std.dev.: 0.0020)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: 1.74% (1.0952 => 1.1143, std.dev.: 0.0017)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 1.74% (24.6139 => 25.0431, std.dev.: 0.1345)
  MultiSource/Benchmarks/Prolangs-C++/city/city: 1.64% (1.4792 => 1.5034, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.63% (1.4304 => 1.4537, std.dev.: 0.0012)
  MultiSource/Applications/lua/lua: 1.54% (4.2242 => 4.2891, std.dev.: 0.0159)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.53% (1.3498 => 1.3705, std.dev.: 0.0004)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 1.53% (6.0284 => 6.1207, std.dev.: 0.0222)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.47% (1.4599 => 1.4814, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 1.43% (1.2007 => 1.2179, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 1.39% (1.2550 => 1.2724, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.39% (1.2201 => 1.2370, std.dev.: 0.0002)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: 1.38% (1.4041 => 1.4235, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 1.29% (1.2948 => 1.3115, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 1.27% (1.2639 => 1.2800, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.27% (1.3249 => 1.3417, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.24% (1.3499 => 1.3667, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 1.22% (1.3303 => 1.3465, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 1.21% (1.2523 => 1.2675, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.17% (1.3042 => 1.3195, std.dev.: 0.0007)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: 1.17% (4.6423 => 4.6964, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.15% (1.2468 => 1.2611, std.dev.: 0.0011)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.14% (1.2981 => 1.3129, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.12% (1.3514 => 1.3665, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.10% (1.2660 => 1.2799, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 1.07% (1.2494 => 1.2628, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.06% (1.2652 => 1.2786, std.dev.: 0.0005)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/methcall: 65.51% (7.6426 => 12.6489, std.dev.: 0.0126)
  SingleSource/Benchmarks/Misc/pi: 57.52% (1.6574 => 2.6108, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/matrix: 38.30% (2.8554 => 3.9491, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout/matrix: 18.55% (1.7809 => 2.1112, std.dev.: 0.0009)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: 18.49% (0.1374 => 0.1628, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout/sieve: 17.55% (7.2254 => 8.4932, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 14.69% (6.4425 => 7.3887, std.dev.: 0.1206)
  SingleSource/Benchmarks/Misc/ReedSolomon: 12.77% (8.5256 => 9.6139, std.dev.: 0.0814)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 10.61% (1.1013 => 1.2181, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 8.74% (3.5550 => 3.8656, std.dev.: 0.0034)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 6.73% (0.1871 => 0.1997, std.dev.: 0.0001)
  SingleSource/UnitTests/Vector/multiplies: 6.64% (0.5561 => 0.5930, std.dev.: 0.0000)
  MultiSource/Applications/lambda-0_1_3/lambda: 6.40% (8.1346 => 8.6556, std.dev.: 0.0075)
  MultiSource/Benchmarks/sim/sim: 6.13% (3.8312 => 4.0661, std.dev.: 0.0028)
  MultiSource/Applications/aha/aha: 5.65% (3.5731 => 3.7749, std.dev.: 0.0059)
  MultiSource/Applications/hexxagon/hexxagon: 5.13% (14.7810 => 15.5395, std.dev.: 0.1064)
  SingleSource/Benchmarks/McGill/misr: 5.09% (0.3771 => 0.3963, std.dev.: 0.0000)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 4.40% (3.5642 => 3.7210, std.dev.: 0.0013)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 4.22% (0.3836 => 0.3998, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.82% (5.7757 => 5.9965, std.dev.: 0.0192)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 3.16% (4.4696 => 4.6109, std.dev.: 0.0090)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 3.06% (2.1472 => 2.2128, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc/fp-convert: 3.05% (7.5877 => 7.8192, std.dev.: 0.0310)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.82% (11.7654 => 12.0976, std.dev.: 0.0081)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 2.81% (4.0181 => 4.1310, std.dev.: 0.0060)
  MultiSource/Applications/siod/siod: 2.71% (3.5310 => 3.6266, std.dev.: 0.0054)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.52% (1.8519 => 1.8986, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.41% (5.4925 => 5.6251, std.dev.: 0.0001)
  MultiSource/Benchmarks/Olden/power/power: 2.41% (1.2170 => 1.2463, std.dev.: 0.0001)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: 2.35% (1.7652 => 1.8067, std.dev.: 0.0036)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 2.31% (3.5683 => 3.6508, std.dev.: 0.0062)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.14% (1.5940 => 1.6281, std.dev.: 0.0035)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.07% (2.4920 => 2.5436, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.01% (3.1569 => 3.2204, std.dev.: 0.0004)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.88% (3.8582 => 3.9308, std.dev.: 0.0015)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 1.68% (1.0477 => 1.0653, std.dev.: 0.0000)
  SingleSource/Benchmarks/Shootout/fib2: 1.55% (3.5966 => 3.6525, std.dev.: 0.0013)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 1.46% (1.6707 => 1.6951, std.dev.: 0.0000)
  SingleSource/Benchmarks/Shootout/lists: 1.37% (7.3703 => 7.4713, std.dev.: 0.0193)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.29% (6.6028 => 6.6882, std.dev.: 0.0048)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 1.16% (6.7429 => 6.8214, std.dev.: 0.0002)
  SingleSource/Benchmarks/Adobe-C++/stepanov_vector: 1.10% (3.7874 => 3.8290, std.dev.: 0.0001)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.09% (16.7972 => 16.9806, std.dev.: 0.0267)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -19.82% (0.1483 => 0.1189, std.dev.: 0.0088)
  SingleSource/Benchmarks/Shootout-C++/matrix: -6.77% (0.2571 => 0.2397, std.dev.: 0.0001)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -1.72% (0.7461 => 0.7333, std.dev.: 0.0039)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/FreeBench/neural/neural: -54.44% (0.5226 => 0.2381, std.dev.: 0.0019)
  MultiSource/Applications/sgefa/sgefa: -47.12% (1.5790 => 0.8349, std.dev.: 0.0029)
  SingleSource/Benchmarks/Linpack/linpack-pc: -20.11% (57.2347 => 45.7255, std.dev.: 0.6467)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -19.76% (15.9508 => 12.7994, std.dev.: 0.0132)
  SingleSource/Benchmarks/Shootout/heapsort: -17.74% (3.5900 => 2.9533, std.dev.: 0.1092)
  SingleSource/Benchmarks/Shootout-C++/ackermann: -12.77% (4.0006 => 3.4899, std.dev.: 0.1383)
  MultiSource/Benchmarks/FreeBench/mason/mason: -9.96% (0.3304 => 0.2975, std.dev.: 0.0001)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -9.91% (20.8247 => 18.7619, std.dev.: 0.0245)
  SingleSource/Benchmarks/CoyoteBench/lpbench: -9.87% (4.1004 => 3.6958, std.dev.: 0.1558)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: -7.99% (3.4956 => 3.2163, std.dev.: 0.0005)
  MultiSource/Benchmarks/mafft/pairlocalalign: -7.48% (50.0284 => 46.2857, std.dev.: 0.4098)
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -5.39% (0.7474 => 0.7071, std.dev.: 0.0127)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: -5.27% (30.1838 => 28.5936, std.dev.: 0.4339)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -5.03% (0.3501 => 0.3325, std.dev.: 0.0012)
  SingleSource/Benchmarks/Misc/salsa20: -4.04% (7.7964 => 7.4812, std.dev.: 0.0123)
  SingleSource/Benchmarks/Shootout/hash: -3.90% (5.2009 => 4.9983, std.dev.: 0.0603)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: -3.87% (36.8417 => 35.4170, std.dev.: 0.2360)
  MultiSource/Applications/SIBsim4/SIBsim4: -3.30% (3.7437 => 3.6201, std.dev.: 0.0028)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: -2.16% (2.5938 => 2.5378, std.dev.: 0.0021)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: -2.16% (1.1075 => 1.0836, std.dev.: 0.0075)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -1.94% (17.1431 => 16.8099, std.dev.: 0.0183)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -1.43% (39.9519 => 39.3825, std.dev.: 0.0480)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -0.15% (0.1348 => 0.1346, std.dev.: 0.0004)

Report Time: 0.78s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130929/cf56cac5/attachment.html>


More information about the llvm-testresults mailing list