[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Dec 15 23:17:55 PST 2013


http://llvm.org/perf/db_default/v4/nts/18469?compare_to=18467&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18469, Order: 197362, Start Time: 2013-12-16 05:41:18, End Time: 2013-12-16 07:22:16
      To: 18467, Order: 197361, Start Time: 2013-12-16 03:37:28, End Time: 2013-12-16 05:18:55
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 21 (37 on baseline)
Performance Improvements: 4 (74 on baseline)
Unchanged Tests: 1085 (999 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: 3.42% (0.3044 => 0.3148, std.dev.: 0.0012)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 2.47% (0.9083 => 0.9307, std.dev.: 0.0077)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 2.30% (0.6705 => 0.6859, std.dev.: 0.0056)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.78% (1.2793 => 1.3021, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.24% (1.2908 => 1.3068, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.21% (1.2471 => 1.2622, std.dev.: 0.0011)
  MultiSource/Applications/oggenc/oggenc: 1.17% (5.6016 => 5.6669, std.dev.: 0.0122)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.01% (4.2149 => 4.2574, std.dev.: 0.0042)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 34.44% (0.1475 => 0.1983, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.89% (3.1876 => 3.5346, std.dev.: 0.1020)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 6.99% (3.5779 => 3.8280, std.dev.: 0.0173)
  SingleSource/Benchmarks/Shootout/lists: 6.92% (7.0129 => 7.4981, std.dev.: 0.0497)
  SingleSource/Benchmarks/Misc/fp-convert: 4.19% (7.3676 => 7.6763, std.dev.: 0.0749)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.91% (1.6383 => 1.6859, std.dev.: 0.0038)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 2.50% (2.4695 => 2.5312, std.dev.: 0.0031)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 2.11% (59.6823 => 60.9438, std.dev.: 0.2624)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.92% (23.3859 => 23.8352, std.dev.: 0.0105)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.90% (1.5987 => 1.6291, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.56% (16.5336 => 16.7908, std.dev.: 0.0527)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 1.33% (4.0461 => 4.0999, std.dev.: 0.0055)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.28% (5.3651 => 5.4338, std.dev.: 0.0052)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: -9.83% (3.2236 => 2.9066, std.dev.: 0.0150)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/gramschmidt/gramschmidt: -5.38% (2.4042 => 2.2749, std.dev.: 0.0228)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.08% (21.5844 => 20.9193, std.dev.: 0.2420)
  MultiSource/Benchmarks/mafft/pairlocalalign: -2.64% (52.3951 => 51.0110, std.dev.: 0.4775)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 38.99% (15.7419 => 21.8789, std.dev.: 0.2767)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 27.34% (0.3859 => 0.4914, std.dev.: 0.0038)
  MultiSource/Applications/lemon/lemon: 8.79% (1.2200 => 1.3272, std.dev.: 0.0019)
  MultiSource/Benchmarks/McCat/08-main/main: 3.59% (0.3007 => 0.3115, std.dev.: 0.0041)
  SingleSource/Benchmarks/Misc-C++/bigfib: 3.10% (0.6412 => 0.6611, std.dev.: 0.0065)
  MultiSource/Applications/oggenc/oggenc: 3.09% (5.4968 => 5.6669, std.dev.: 0.0122)
  MultiSource/Applications/SIBsim4/SIBsim4: 1.83% (1.5198 => 1.5476, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.37% (1.2845 => 1.3021, std.dev.: 0.0021)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 40.71% (2.8607 => 4.0253, std.dev.: 0.0005)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 19.63% (5.9583 => 7.1279, std.dev.: 0.0559)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.91% (3.1585 => 3.5346, std.dev.: 0.1020)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.96% (1.3838 => 1.5078, std.dev.: 0.0001)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 7.67% (0.3534 => 0.3805, std.dev.: 0.0008)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 7.65% (1.1019 => 1.1862, std.dev.: 0.0047)
  SingleSource/Benchmarks/Stanford/Puzzle: 7.55% (0.1668 => 0.1794, std.dev.: 0.0025)
  SingleSource/Benchmarks/Shootout/lists: 7.22% (6.9930 => 7.4981, std.dev.: 0.0497)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.01% (3.5771 => 3.8280, std.dev.: 0.0173)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 6.72% (2.8568 => 3.0487, std.dev.: 0.0265)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.23% (3.5027 => 3.7210, std.dev.: 0.0204)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: 5.85% (1.9729 => 2.0883, std.dev.: 0.0036)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.44% (1.2278 => 1.2946, std.dev.: 0.0049)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 5.35% (0.6261 => 0.6596, std.dev.: 0.0009)
  MultiSource/Applications/siod/siod: 4.83% (3.4258 => 3.5911, std.dev.: 0.0095)
  SingleSource/Benchmarks/Stanford/FloatMM: 3.96% (0.6939 => 0.7214, std.dev.: 0.0033)
  SingleSource/Benchmarks/Misc/fp-convert: 3.89% (7.3892 => 7.6763, std.dev.: 0.0749)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.80% (5.0601 => 5.2525, std.dev.: 0.0016)
  MultiSource/Applications/sgefa/sgefa: 3.61% (0.8745 => 0.9061, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.53% (5.2486 => 5.4338, std.dev.: 0.0052)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.56% (3.4043 => 3.4914, std.dev.: 0.0301)
  SingleSource/Benchmarks/Shootout-C++/lists: 2.09% (15.6810 => 16.0085, std.dev.: 0.0516)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.91% (1.5986 => 1.6291, std.dev.: 0.0089)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 1.87% (23.3972 => 23.8352, std.dev.: 0.0105)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.79% (2.5025 => 2.5474, std.dev.: 0.0072)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.68% (2.4894 => 2.5312, std.dev.: 0.0031)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.48% (2.3882 => 2.4236, std.dev.: 0.0007)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.02% (16.6205 => 16.7908, std.dev.: 0.0527)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 1.00% (4.0593 => 4.0999, std.dev.: 0.0055)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.89% (0.0688 => 0.0503, std.dev.: 0.0007)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -17.39% (0.1938 => 0.1601, std.dev.: 0.0028)
  MultiSource/Benchmarks/McCat/12-IOtest/iotest: -13.32% (0.1051 => 0.0911, std.dev.: 0.0045)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -10.39% (0.1088 => 0.0975, std.dev.: 0.0019)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -7.64% (5.8749 => 5.4260, std.dev.: 0.0213)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -7.49% (0.1523 => 0.1409, std.dev.: 0.0015)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.47% (0.3402 => 0.3148, std.dev.: 0.0012)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.34% (0.6882 => 0.6377, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -7.25% (1.3676 => 1.2685, std.dev.: 0.0014)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -7.11% (0.3247 => 0.3016, std.dev.: 0.0002)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -6.80% (0.2824 => 0.2632, std.dev.: 0.0009)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: -6.68% (1.5034 => 1.4029, std.dev.: 0.0015)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -6.67% (1.0197 => 0.9517, std.dev.: 0.0179)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.60% (2.0207 => 1.8874, std.dev.: 0.0019)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.46% (0.1673 => 0.1565, std.dev.: 0.0019)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -6.35% (0.2252 => 0.2109, std.dev.: 0.0055)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.26% (0.1774 => 0.1663, std.dev.: 0.0004)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -5.91% (0.2540 => 0.2390, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.16% (1.4125 => 1.3396, std.dev.: 0.0070)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.14% (1.4113 => 1.3388, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -5.09% (1.3819 => 1.3115, std.dev.: 0.0178)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -5.06% (1.1409 => 1.0832, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.01% (1.3505 => 1.2829, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.75% (1.3146 => 1.2522, std.dev.: 0.0067)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.74% (1.3127 => 1.2505, std.dev.: 0.0105)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -4.50% (15.4053 => 14.7123, std.dev.: 0.1699)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -4.50% (1.3918 => 1.3292, std.dev.: 0.0072)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.47% (1.2824 => 1.2251, std.dev.: 0.0032)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: -4.42% (0.2758 => 0.2636, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.42% (1.2914 => 1.2343, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.33% (1.3660 => 1.3068, std.dev.: 0.0051)
  MultiSource/Benchmarks/mediabench/gsm/toast/toast: -4.30% (1.4449 => 1.3828, std.dev.: 0.0080)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.21% (1.5305 => 1.4660, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.12% (1.2785 => 1.2258, std.dev.: 0.0121)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.64% (1.3264 => 1.2781, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.58% (1.3702 => 1.3212, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.54% (1.2724 => 1.2273, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.54% (1.3460 => 1.2983, std.dev.: 0.0027)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -3.50% (0.6995 => 0.6750, std.dev.: 0.0081)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -3.37% (1.1767 => 1.1370, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -3.20% (1.3608 => 1.3173, std.dev.: 0.0070)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -3.11% (0.5879 => 0.5696, std.dev.: 0.0034)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.09% (1.4074 => 1.3639, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -3.09% (1.3024 => 1.2622, std.dev.: 0.0011)
  MultiSource/Applications/d/make_dparser: -2.90% (3.6428 => 3.5370, std.dev.: 0.0084)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: -2.88% (0.3714 => 0.3607, std.dev.: 0.0008)
  MultiSource/Applications/obsequi/Obsequi: -2.80% (1.1905 => 1.1572, std.dev.: 0.0034)
  MultiSource/Benchmarks/Prolangs-C/plot2fig/plot2fig: -2.79% (0.5663 => 0.5505, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -2.75% (1.3510 => 1.3139, std.dev.: 0.0057)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.73% (4.7807 => 4.6504, std.dev.: 0.0443)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: -2.33% (0.8880 => 0.8673, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.32% (1.3457 => 1.3145, std.dev.: 0.0043)
  MultiSource/Benchmarks/nbench/nbench: -2.30% (1.2647 => 1.2356, std.dev.: 0.0040)
  MultiSource/Benchmarks/Prolangs-C/archie-client/archie: -2.12% (0.7375 => 0.7219, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.04% (1.3551 => 1.3274, std.dev.: 0.0101)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -2.04% (1.3068 => 1.2801, std.dev.: 0.0081)
  MultiSource/Benchmarks/McCat/05-eks/eks: -1.90% (0.5322 => 0.5221, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.80% (1.2670 => 1.2442, std.dev.: 0.0010)
  MultiSource/Benchmarks/FreeBench/pifft/pifft: -1.70% (1.1016 => 1.0829, std.dev.: 0.0058)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.68% (0.8331 => 0.8191, std.dev.: 0.0029)
  MultiSource/Applications/JM/ldecod/ldecod: -1.64% (7.6560 => 7.5302, std.dev.: 0.0338)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -1.63% (1.1608 => 1.1419, std.dev.: 0.0045)
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -1.56% (1.6656 => 1.6396, std.dev.: 0.0100)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: -1.45% (1.2495 => 1.2314, std.dev.: 0.0036)
  MultiSource/Applications/kimwitu++/kc: -1.18% (18.6861 => 18.4656, std.dev.: 0.0607)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/VersaBench/dbms/dbms: -17.51% (2.8850 => 2.3797, std.dev.: 0.1406)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -7.97% (1.4335 => 1.3192, std.dev.: 0.0048)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.47% (2.5559 => 2.3906, std.dev.: 0.0539)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -4.42% (2.9945 => 2.8620, std.dev.: 0.0444)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: -3.72% (0.8636 => 0.8315, std.dev.: 0.0088)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -3.42% (6.0535 => 5.8463, std.dev.: 0.0119)
  MultiSource/Applications/sqlite3/sqlite3: -3.32% (4.2978 => 4.1553, std.dev.: 0.0293)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: -3.13% (21.5962 => 20.9193, std.dev.: 0.2420)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.48% (40.4190 => 39.4168, std.dev.: 0.1970)

Report Time: 0.63s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131216/3ca6d03f/attachment.html>


More information about the llvm-testresults mailing list