[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sun Jan 5 13:50:44 PST 2014


http://llvm.org/perf/db_default/v4/nts/19776?compare_to=19765&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19776, Order: 198565, Start Time: 2014-01-05 20:08:15, End Time: 2014-01-05 21:55:28
      To: 19765, Order: 198563, Start Time: 2014-01-05 17:17:31, End Time: 2014-01-05 18:58:17
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 42 (56 on baseline)
Performance Improvements: 5 (31 on baseline)
Unchanged Tests: 1063 (1023 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/fib2: 84.48% (0.0174 => 0.0321, std.dev.: 0.0010)
  SingleSource/UnitTests/member-function-pointers: 77.62% (0.0210 => 0.0373, std.dev.: 0.0013)
  SingleSource/UnitTests/2007-03-02-VaCopy: 75.16% (0.0157 => 0.0275, std.dev.: 0.0014)
  SingleSource/UnitTests/2003-07-06-IntOverflow: 70.87% (0.0206 => 0.0352, std.dev.: 0.0010)
  SingleSource/UnitTests/stmtexpr: 67.39% (0.0184 => 0.0308, std.dev.: 0.0009)
  SingleSource/UnitTests/initp1: 64.90% (0.0490 => 0.0808, std.dev.: 0.0042)
  SingleSource/UnitTests/2002-05-19-DivTest: 63.13% (0.0160 => 0.0261, std.dev.: 0.0022)
  SingleSource/UnitTests/2007-01-04-KNR-Args: 60.22% (0.0186 => 0.0298, std.dev.: 0.0028)
  SingleSource/Benchmarks/Shootout/sieve: 54.90% (0.0255 => 0.0395, std.dev.: 0.0025)
  SingleSource/UnitTests/2002-08-19-CodegenBug: 53.65% (0.0192 => 0.0295, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout/heapsort: 48.78% (0.0451 => 0.0671, std.dev.: 0.0067)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 44.26% (0.0705 => 0.1017, std.dev.: 0.0066)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 29.96% (1.1420 => 1.4842, std.dev.: 0.0822)
  MultiSource/Applications/lua/lua: 14.93% (4.2949 => 4.9363, std.dev.: 0.1047)
  MultiSource/Applications/sqlite3/sqlite3: 10.61% (22.0751 => 24.4171, std.dev.: 0.7482)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 10.12% (0.8779 => 0.9667, std.dev.: 0.0204)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 4.80% (0.8917 => 0.9345, std.dev.: 0.0126)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.98% (1.2173 => 1.2414, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.79% (1.2519 => 1.2743, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.65% (1.2082 => 1.2281, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.11% (1.3229 => 1.3376, std.dev.: 0.0043)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 56.43% (2.8534 => 4.4637, std.dev.: 0.0628)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 29.63% (3.7742 => 4.8926, std.dev.: 0.0506)
  MultiSource/Applications/minisat/minisat: 29.07% (6.2807 => 8.1063, std.dev.: 0.2355)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 26.33% (1.4716 => 1.8590, std.dev.: 0.1500)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 19.13% (0.1364 => 0.1625, std.dev.: 0.0062)
  MultiSource/Applications/SPASS/SPASS: 15.43% (8.0261 => 9.2645, std.dev.: 0.4052)
  SingleSource/Benchmarks/Shootout/ary3: 14.48% (4.5747 => 5.2370, std.dev.: 0.0414)
  SingleSource/Benchmarks/Shootout/strcat: 11.20% (0.1456 => 0.1619, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.25% (3.1694 => 3.4942, std.dev.: 0.0924)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.54% (0.4973 => 0.5298, std.dev.: 0.0023)
  SingleSource/Benchmarks/Shootout-C++/ary3: 5.87% (4.7477 => 5.0264, std.dev.: 0.0806)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.53% (59.7796 => 62.4864, std.dev.: 0.7079)
  SingleSource/Benchmarks/Dhrystone/dry: 4.16% (0.4826 => 0.5027, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.70% (5.2336 => 5.4274, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 3.26% (3.6019 => 3.7192, std.dev.: 0.0008)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 2.62% (2.3452 => 2.4066, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.05% (11.9010 => 12.1451, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.77% (6.0015 => 6.1077, std.dev.: 0.0070)
  MultiSource/Applications/sqlite3/sqlite3: 1.30% (4.2985 => 4.3542, std.dev.: 0.0151)
  SingleSource/Benchmarks/Shootout/fib2: 1.26% (3.5835 => 3.6285, std.dev.: 0.0169)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.20% (5.2938 => 5.3575, std.dev.: 0.0208)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/matrix: -14.81% (2.1099 => 1.7975, std.dev.: 0.0550)
  MultiSource/Applications/lua/lua: -7.64% (32.3194 => 29.8517, std.dev.: 0.4945)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.51% (6.7869 => 6.5484, std.dev.: 0.0899)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -1.29% (23.7074 => 23.4021, std.dev.: 0.0180)
  SingleSource/Benchmarks/BenchmarkGame/Large/fasta: -1.06% (1.3816 => 1.3669, std.dev.: 0.0027)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/fib2: 81.36% (0.0177 => 0.0321, std.dev.: 0.0010)
  SingleSource/UnitTests/stmtexpr: 78.03% (0.0173 => 0.0308, std.dev.: 0.0009)
  SingleSource/UnitTests/member-function-pointers: 75.12% (0.0213 => 0.0373, std.dev.: 0.0013)
  SingleSource/UnitTests/2002-05-19-DivTest: 66.24% (0.0157 => 0.0261, std.dev.: 0.0022)
  SingleSource/UnitTests/initp1: 62.58% (0.0497 => 0.0808, std.dev.: 0.0042)
  SingleSource/UnitTests/2003-07-06-IntOverflow: 58.56% (0.0222 => 0.0352, std.dev.: 0.0010)
  SingleSource/UnitTests/2007-01-04-KNR-Args: 57.67% (0.0189 => 0.0298, std.dev.: 0.0028)
  MultiSource/Applications/sqlite3/sqlite3: 55.11% (15.7419 => 24.4171, std.dev.: 0.7482)
  SingleSource/UnitTests/2002-08-19-CodegenBug: 52.06% (0.0194 => 0.0295, std.dev.: 0.0018)
  SingleSource/Benchmarks/Shootout/sieve: 49.06% (0.0265 => 0.0395, std.dev.: 0.0025)
  SingleSource/Benchmarks/Shootout/heapsort: 47.80% (0.0454 => 0.0671, std.dev.: 0.0067)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/atax/atax: 40.08% (0.0726 => 0.1017, std.dev.: 0.0066)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 27.96% (0.3859 => 0.4938, std.dev.: 0.0306)
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 27.86% (1.1608 => 1.4842, std.dev.: 0.0822)
  MultiSource/Applications/lua/lua: 15.50% (4.2737 => 4.9363, std.dev.: 0.1047)
  MultiSource/Benchmarks/Prolangs-C/simulator/simulator: 8.86% (0.8880 => 0.9667, std.dev.: 0.0204)
  MultiSource/Applications/oggenc/oggenc: 6.58% (5.4968 => 5.8583, std.dev.: 0.1036)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.41% (25.9661 => 27.6295, std.dev.: 0.5245)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 6.35% (0.8787 => 0.9345, std.dev.: 0.0126)
  MultiSource/Benchmarks/McCat/09-vor/vor: 4.51% (0.3596 => 0.3758, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.48% (1.2845 => 1.3035, std.dev.: 0.0020)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.00% (2.5384 => 2.5639, std.dev.: 0.0035)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 51.35% (2.9492 => 4.4637, std.dev.: 0.0628)
  MultiSource/Applications/minisat/minisat: 26.90% (6.3881 => 8.1063, std.dev.: 0.2355)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 26.33% (1.4716 => 1.8590, std.dev.: 0.1500)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 20.61% (4.0567 => 4.8926, std.dev.: 0.0506)
  SingleSource/Benchmarks/Shootout-C++/nestedloop: 19.57% (0.1359 => 0.1625, std.dev.: 0.0062)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.56% (5.9583 => 6.9450, std.dev.: 0.1283)
  SingleSource/Benchmarks/Shootout/strcat: 14.26% (0.1417 => 0.1619, std.dev.: 0.0013)
  SingleSource/Benchmarks/Shootout/ary3: 13.90% (4.5977 => 5.2370, std.dev.: 0.0414)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 12.14% (82.2592 => 92.2429, std.dev.: 0.3243)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 10.63% (3.1585 => 3.4942, std.dev.: 0.0924)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 9.37% (3.3810 => 3.6979, std.dev.: 0.0800)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.05% (1.1019 => 1.1906, std.dev.: 0.0141)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.99% (3.5771 => 3.8629, std.dev.: 0.0058)
  SingleSource/Benchmarks/McGill/chomp: 7.70% (1.0099 => 1.0877, std.dev.: 0.0109)
  SingleSource/Benchmarks/Shootout-C++/ary3: 7.41% (4.6797 => 5.0264, std.dev.: 0.0806)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.18% (3.5027 => 3.7192, std.dev.: 0.0008)
  MultiSource/Applications/siod/siod: 5.48% (3.4258 => 3.6135, std.dev.: 0.0686)
  SingleSource/Benchmarks/Dhrystone/dry: 5.45% (0.4767 => 0.5027, std.dev.: 0.0012)
  MultiSource/Applications/SIBsim4/SIBsim4: 4.15% (3.4043 => 3.5457, std.dev.: 0.0250)
  MultiSource/Applications/sgefa/sgefa: 4.03% (0.8745 => 0.9097, std.dev.: 0.0025)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.64% (0.5112 => 0.5298, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.41% (5.2486 => 5.4274, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 3.30% (5.9126 => 6.1077, std.dev.: 0.0070)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 3.04% (2.3355 => 2.4066, std.dev.: 0.0046)
  SingleSource/Benchmarks/Shootout/lists: 2.95% (6.9930 => 7.1991, std.dev.: 0.0552)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.55% (11.7894 => 12.0903, std.dev.: 0.0365)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.50% (6.5291 => 6.6922, std.dev.: 0.0276)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.14% (11.8902 => 12.1451, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.01% (3.1547 => 3.2182, std.dev.: 0.0161)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.64% (2.5025 => 2.5436, std.dev.: 0.0046)
  MultiSource/Applications/obsequi/Obsequi: 1.61% (2.3061 => 2.3432, std.dev.: 0.0037)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 1.47% (8.8073 => 8.9369, std.dev.: 0.0020)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 1.37% (1.5797 => 1.6014, std.dev.: 0.0066)
  MultiSource/Applications/sqlite3/sqlite3: 1.31% (4.2978 => 4.3542, std.dev.: 0.0151)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -27.47% (0.0688 => 0.0499, std.dev.: 0.0010)
  MultiSource/Benchmarks/Bullet/bullet: -9.42% (36.6274 => 33.1757, std.dev.: 1.2817)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -8.50% (0.3247 => 0.2971, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -7.82% (1.3676 => 1.2607, std.dev.: 0.0234)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -5.63% (5.8749 => 5.5439, std.dev.: 0.1128)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.90% (1.4277 => 1.3578, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.67% (1.3505 => 1.2874, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.47% (1.3146 => 1.2558, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.96% (1.2544 => 1.2047, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -3.93% (1.2914 => 1.2406, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -3.85% (1.4074 => 1.3532, std.dev.: 0.0147)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.43% (1.2724 => 1.2287, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.13% (1.3460 => 1.3039, std.dev.: 0.0094)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.11% (1.3918 => 1.3485, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -2.90% (1.2785 => 1.2414, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -2.78% (1.3024 => 1.2662, std.dev.: 0.0076)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.49% (1.3182 => 1.2854, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.45% (1.2583 => 1.2275, std.dev.: 0.0028)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.38% (1.3702 => 1.3376, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.04% (1.3608 => 1.3330, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.04% (1.3457 => 1.3183, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.70% (1.3551 => 1.3321, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.65% (1.2670 => 1.2461, std.dev.: 0.0003)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.63% (1.3068 => 1.2855, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.61% (1.2952 => 1.2743, std.dev.: 0.0065)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -27.10% (0.0369 => 0.0269, std.dev.: 0.0007)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.55% (15.5356 => 12.8092, std.dev.: 0.2257)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -4.86% (6.8826 => 6.5484, std.dev.: 0.0899)
  MultiSource/Benchmarks/Bullet/bullet: -3.80% (7.4226 => 7.1405, std.dev.: 0.0594)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.42% (6.0535 => 5.9069, std.dev.: 0.0357)
  MultiSource/Applications/lambda-0_1_3/lambda: -1.63% (7.9597 => 7.8298, std.dev.: 0.0348)

Report Time: 0.93s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140105/1750395c/attachment.html>


More information about the llvm-testresults mailing list