[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Wed Aug 21 14:30:48 PDT 2013


http://llvm.org/perf/db_default/v4/nts/14651?compare_to=14647&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 14651, Order: 188918, Start Time: 2013-08-21 19:37:04, End Time: 2013-08-21 21:32:55
      To: 14647, Order: 188906, Start Time: 2013-08-21 17:13:35, End Time: 2013-08-21 19:07:39
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 25 (50 on baseline)
Performance Improvements: 35 (28 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1047 (1029 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/SignlessTypes/shr: 72.24% (0.0335 => 0.0577, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: 61.24% (0.1125 => 0.1814, std.dev.: 0.0111)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 41.94% (0.0422 => 0.0599, std.dev.: 0.0033)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 41.88% (0.0874 => 0.1240, std.dev.: 0.0132)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 18.75% (50.9876 => 60.5485, std.dev.: 0.4006)
  MultiSource/Benchmarks/mafft/pairlocalalign: 15.80% (10.9612 => 12.6926, std.dev.: 0.3357)
  MultiSource/Benchmarks/Bullet/bullet: 14.91% (38.3124 => 44.0248, std.dev.: 1.2140)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 12.67% (1.5013 => 1.6915, std.dev.: 0.0204)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 10.42% (0.3272 => 0.3613, std.dev.: 0.0070)
  SingleSource/Benchmarks/Linpack/linpack-pc: 4.61% (0.2753 => 0.2880, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/moments: 3.83% (0.4433 => 0.4603, std.dev.: 0.0065)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.61% (2.8619 => 2.9080, std.dev.: 0.0169)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 50.35% (1.6639 => 2.5017, std.dev.: 0.0211)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 39.24% (4.4849 => 6.2446, std.dev.: 0.3705)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 25.00% (3.2098 => 4.0123, std.dev.: 0.1503)
  MultiSource/Benchmarks/llubenchmark/llu: 20.46% (2.0363 => 2.4529, std.dev.: 0.0276)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 16.73% (9.6768 => 11.2955, std.dev.: 0.2287)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 15.65% (60.7931 => 70.3048, std.dev.: 2.7796)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 14.54% (40.4589 => 46.3401, std.dev.: 0.9746)
  MultiSource/Benchmarks/Bullet/bullet: 10.87% (7.0683 => 7.8366, std.dev.: 0.0409)
  SingleSource/Benchmarks/Misc/salsa20: 7.68% (8.3745 => 9.0175, std.dev.: 0.0415)
  SingleSource/Benchmarks/Misc/flops: 4.46% (9.4180 => 9.8379, std.dev.: 0.0164)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.48% (20.9679 => 21.4882, std.dev.: 0.0829)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.39% (1.6044 => 1.6428, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 1.82% (3.7407 => 3.8089, std.dev.: 0.0260)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/McCat/05-eks/eks: -32.08% (0.8157 => 0.5540, std.dev.: 0.0819)
  MultiSource/Benchmarks/Olden/tsp/tsp: -29.09% (0.1963 => 0.1392, std.dev.: 0.0100)
  MultiSource/Applications/viterbi/viterbi: -23.03% (0.2419 => 0.1862, std.dev.: 0.0152)
  MultiSource/Benchmarks/Olden/voronoi/voronoi: -22.96% (0.3851 => 0.2967, std.dev.: 0.0283)
  MultiSource/Applications/lua/lua: -21.95% (5.7169 => 4.4621, std.dev.: 0.3793)
  MultiSource/Applications/treecc/treecc: -17.14% (2.8659 => 2.3748, std.dev.: 0.1314)
  MultiSource/Applications/lambda-0_1_3/lambda: -16.92% (1.0274 => 0.8536, std.dev.: 0.0326)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -16.57% (1.4656 => 1.2227, std.dev.: 0.0384)
  MultiSource/Applications/JM/lencod/lencod: -16.34% (21.0645 => 17.6231, std.dev.: 1.3306)
  MultiSource/Applications/JM/ldecod/ldecod: -16.17% (9.3707 => 7.8553, std.dev.: 0.2364)
  MultiSource/Applications/hexxagon/hexxagon: -15.58% (1.3435 => 1.1342, std.dev.: 0.0721)
  MultiSource/Applications/ClamAV/clamscan: -14.90% (20.3380 => 17.3075, std.dev.: 1.0902)
  MultiSource/Applications/SPASS/SPASS: -14.79% (20.4099 => 17.3914, std.dev.: 0.8204)
  MultiSource/Applications/ALAC/encode/alacconvert-encode: -13.77% (1.4238 => 1.2277, std.dev.: 0.0706)
  SingleSource/Benchmarks/Shootout-C++/heapsort: -11.79% (0.2629 => 0.2319, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -11.36% (1.7083 => 1.5142, std.dev.: 0.0692)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -11.14% (1.5728 => 1.3976, std.dev.: 0.0243)
  MultiSource/Applications/SIBsim4/SIBsim4: -10.97% (1.8471 => 1.6445, std.dev.: 0.0727)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -10.47% (1.6017 => 1.4340, std.dev.: 0.0275)
  MultiSource/Applications/minisat/minisat: -8.65% (0.8844 => 0.8079, std.dev.: 0.0123)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -8.38% (1.5697 => 1.4382, std.dev.: 0.0085)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -8.25% (1.5078 => 1.3834, std.dev.: 0.0328)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -7.74% (1.6732 => 1.5437, std.dev.: 0.0488)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -7.64% (1.5375 => 1.4200, std.dev.: 0.0074)
  MultiSource/Applications/oggenc/oggenc: -7.05% (6.4499 => 5.9950, std.dev.: 0.1228)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.00% (0.2439 => 0.2317, std.dev.: 0.0026)
  SingleSource/Benchmarks/Shootout-C++/ary3: -4.01% (0.3190 => 0.3062, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -3.55% (1.4977 => 1.4446, std.dev.: 0.0201)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/SPASS/SPASS: -25.48% (11.3472 => 8.4554, std.dev.: 0.5298)
  MultiSource/Applications/minisat/minisat: -22.98% (8.9186 => 6.8692, std.dev.: 0.6837)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -5.26% (4.3311 => 4.1031, std.dev.: 0.0753)
  SingleSource/Benchmarks/Shootout-C++/lists: -3.27% (17.1658 => 16.6044, std.dev.: 0.1745)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -2.36% (5.1379 => 5.0164, std.dev.: 0.0443)
  SingleSource/Benchmarks/Shootout-C++/hash2: -1.55% (3.5391 => 3.4844, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -1.41% (5.0984 => 5.0267, std.dev.: 0.0272)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -9.54% (0.1488 => 0.1346, std.dev.: 0.0282)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/SignlessTypes/shr: 72.75% (0.0334 => 0.0577, std.dev.: 0.0021)
  MultiSource/Benchmarks/Prolangs-C++/trees/trees: 58.57% (0.1144 => 0.1814, std.dev.: 0.0111)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: 41.39% (0.0877 => 0.1240, std.dev.: 0.0132)
  MultiSource/Benchmarks/Prolangs-C++/vcirc/vcirc: 36.45% (0.0439 => 0.0599, std.dev.: 0.0033)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 23.25% (49.1253 => 60.5485, std.dev.: 0.4006)
  MultiSource/Benchmarks/Bullet/bullet: 17.44% (37.4863 => 44.0248, std.dev.: 1.2140)
  MultiSource/Benchmarks/mafft/pairlocalalign: 16.94% (10.8541 => 12.6926, std.dev.: 0.3357)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 12.49% (1.5037 => 1.6915, std.dev.: 0.0204)
  SingleSource/Benchmarks/Shootout-C++/moments: 11.59% (0.4125 => 0.4603, std.dev.: 0.0065)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 11.17% (0.3250 => 0.3613, std.dev.: 0.0070)
  SingleSource/Benchmarks/Shootout-C++/matrix: 9.70% (0.2609 => 0.2862, std.dev.: 0.0012)
  MultiSource/Benchmarks/PAQ8p/paq8p: 8.29% (2.6853 => 2.9080, std.dev.: 0.0169)
  SingleSource/Benchmarks/Linpack/linpack-pc: 6.55% (0.2703 => 0.2880, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout-C++/ary3: 5.44% (0.2904 => 0.3062, std.dev.: 0.0046)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 75.15% (3.7285 => 6.5304, std.dev.: 0.0284)
  SingleSource/Benchmarks/Shootout/ary3: 67.21% (5.8158 => 9.7246, std.dev.: 0.7021)
  SingleSource/Benchmarks/Shootout-C++/matrix: 50.93% (2.8867 => 4.3570, std.dev.: 0.0234)
  MultiSource/Benchmarks/FreeBench/neural/neural: 39.74% (0.3171 => 0.4431, std.dev.: 0.0390)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 37.19% (4.5517 => 6.2446, std.dev.: 0.3705)
  SingleSource/Benchmarks/Shootout-C++/ackermann: 36.34% (2.9428 => 4.0123, std.dev.: 0.1503)
  SingleSource/Benchmarks/Shootout/heapsort: 30.09% (2.9123 => 3.7887, std.dev.: 0.3044)
  SingleSource/Benchmarks/Misc/pi: 26.13% (1.9835 => 2.5017, std.dev.: 0.0211)
  SingleSource/Benchmarks/Shootout/hash: 25.63% (4.1846 => 5.2572, std.dev.: 0.2602)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 23.64% (9.1355 => 11.2955, std.dev.: 0.2287)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 21.79% (2.9033 => 3.5358, std.dev.: 0.1448)
  MultiSource/Benchmarks/llubenchmark/llu: 21.51% (2.0187 => 2.4529, std.dev.: 0.0276)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 16.50% (60.3477 => 70.3048, std.dev.: 2.7796)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 14.41% (40.5028 => 46.3401, std.dev.: 0.9746)
  MultiSource/Applications/lambda-0_1_3/lambda: 10.84% (7.0762 => 7.8432, std.dev.: 0.0367)
  SingleSource/Benchmarks/McGill/chomp: 9.24% (1.0051 => 1.0980, std.dev.: 0.0200)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 8.54% (14.9584 => 16.2360, std.dev.: 0.3854)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 8.45% (5.4910 => 5.9549, std.dev.: 0.0069)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.39% (1.2557 => 1.3610, std.dev.: 0.0125)
  MultiSource/Applications/siod/siod: 8.20% (3.3761 => 3.6528, std.dev.: 0.0554)
  SingleSource/Benchmarks/Linpack/linpack-pc: 8.06% (48.3256 => 52.2193, std.dev.: 0.0331)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.77% (3.2027 => 3.4514, std.dev.: 0.0924)
  MultiSource/Benchmarks/Bullet/bullet: 7.36% (7.2995 => 7.8366, std.dev.: 0.0409)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 6.60% (5.5008 => 5.8641, std.dev.: 0.1321)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.15% (5.3042 => 5.6304, std.dev.: 0.0544)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.94% (3.4085 => 3.6109, std.dev.: 0.0345)
  SingleSource/Benchmarks/Misc/ffbench: 4.50% (1.3679 => 1.4294, std.dev.: 0.0153)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 4.36% (5.1471 => 5.3717, std.dev.: 0.0767)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 4.04% (6.1245 => 6.3721, std.dev.: 0.0423)
  SingleSource/Benchmarks/CoyoteBench/huffbench: 3.66% (25.0200 => 25.9365, std.dev.: 0.1007)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.96% (1.5956 => 1.6428, std.dev.: 0.0069)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.85% (3.3877 => 3.4844, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.59% (12.8625 => 13.1953, std.dev.: 0.0138)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.36% (1.5957 => 1.6334, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 1.32% (4.9040 => 4.9689, std.dev.: 0.0179)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.23% (9.7023 => 9.8213, std.dev.: 0.0307)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Olden/bisort/bisort: -33.77% (0.1072 => 0.0710, std.dev.: 0.0118)
  MultiSource/Benchmarks/Olden/tsp/tsp: -23.43% (0.1818 => 0.1392, std.dev.: 0.0100)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: -19.71% (1.5228 => 1.2227, std.dev.: 0.0384)
  MultiSource/Applications/hbd/hbd: -15.12% (2.0193 => 1.7140, std.dev.: 0.1126)
  MultiSource/Applications/hexxagon/hexxagon: -14.63% (1.3285 => 1.1342, std.dev.: 0.0721)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -10.70% (0.7091 => 0.6332, std.dev.: 0.0177)
  MultiSource/Applications/lambda-0_1_3/lambda: -9.78% (0.9461 => 0.8536, std.dev.: 0.0326)
  MultiSource/Applications/JM/ldecod/ldecod: -9.42% (8.6720 => 7.8553, std.dev.: 0.2364)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -7.25% (0.2498 => 0.2317, std.dev.: 0.0026)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/lemon/lemon: -33.60% (1.4194 => 0.9425, std.dev.: 0.0901)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -31.67% (2.1022 => 1.4365, std.dev.: 0.0443)
  MultiSource/Applications/viterbi/viterbi: -27.17% (3.4923 => 2.5433, std.dev.: 0.1757)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.40% (6.9552 => 5.2584, std.dev.: 0.0527)
  SingleSource/Benchmarks/Misc/perlin: -21.33% (4.5989 => 3.6181, std.dev.: 0.0225)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: -14.44% (0.0956 => 0.0818, std.dev.: 0.0013)
  SingleSource/Benchmarks/Misc/mandel: -13.67% (1.1996 => 1.0356, std.dev.: 0.0222)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -12.95% (6.2627 => 5.4515, std.dev.: 0.1070)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -8.68% (0.5173 => 0.4724, std.dev.: 0.0052)
  MultiSource/Applications/SIBsim4/SIBsim4: -7.01% (3.5791 => 3.3281, std.dev.: 0.0761)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.09% (47.2250 => 44.3491, std.dev.: 0.2325)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.56% (3.8119 => 3.6380, std.dev.: 0.0237)
  SingleSource/Benchmarks/Misc/fbench: -4.49% (4.9602 => 4.7375, std.dev.: 0.0814)
  SingleSource/Benchmarks/Stanford/FloatMM: -3.56% (0.7806 => 0.7528, std.dev.: 0.0035)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: -2.48% (2.7049 => 2.6379, std.dev.: 0.0195)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.11% (8.6172 => 8.4352, std.dev.: 0.0653)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -1.79% (6.1482 => 6.0380, std.dev.: 0.0099)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -1.32% (4.9231 => 4.8580, std.dev.: 0.0048)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -1.28% (5.8810 => 5.8059, std.dev.: 0.0013)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -2.32% (0.1378 => 0.1346, std.dev.: 0.0282)

Report Time: 1.35s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130821/b444d50c/attachment.html>


More information about the llvm-testresults mailing list