[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Dec 19 08:54:37 PST 2013


http://llvm.org/perf/db_default/v4/nts/18643?compare_to=18636&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18643, Order: 197678, Start Time: 2013-12-19 15:09:49, End Time: 2013-12-19 16:58:59
      To: 18636, Order: 197674, Start Time: 2013-12-19 12:58:35, End Time: 2013-12-19 14:43:24
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 37 (45 on baseline)
Performance Improvements: 6 (6 on baseline)
Unchanged Tests: 1067 (1059 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/compare: 80.72% (0.0223 => 0.0403, std.dev.: 0.0015)
  SingleSource/UnitTests/conditional-gnu-ext-cxx: 78.98% (0.0157 => 0.0281, std.dev.: 0.0018)
  SingleSource/Regression/C/2008-01-07-LongDouble: 76.62% (0.0154 => 0.0272, std.dev.: 0.0013)
  SingleSource/Regression/C/2003-05-23-TransparentUnion: 73.53% (0.0170 => 0.0295, std.dev.: 0.0010)
  SingleSource/UnitTests/2003-05-07-VarArgs: 72.51% (0.0251 => 0.0433, std.dev.: 0.0023)
  SingleSource/Regression/C/sumarray2d: 56.31% (0.0325 => 0.0508, std.dev.: 0.0030)
  SingleSource/Benchmarks/Dhrystone/fldry: 25.56% (0.0583 => 0.0732, std.dev.: 0.0025)
  MultiSource/Applications/treecc/treecc: 16.81% (2.2653 => 2.6460, std.dev.: 0.0952)
  MultiSource/Applications/JM/ldecod/ldecod: 14.67% (7.5821 => 8.6941, std.dev.: 0.1832)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 12.28% (5.4289 => 6.0957, std.dev.: 0.1456)
  MultiSource/Applications/d/make_dparser: 12.27% (3.5477 => 3.9829, std.dev.: 0.1158)
  SingleSource/UnitTests/2006-12-11-LoadConstants: 11.06% (0.1428 => 0.1586, std.dev.: 0.0019)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 8.56% (27.7480 => 30.1231, std.dev.: 0.6377)
  MultiSource/Applications/siod/siod: 8.24% (2.5509 => 2.7610, std.dev.: 0.0157)
  MultiSource/Applications/sqlite3/sqlite3: 7.14% (21.8314 => 23.3895, std.dev.: 0.4658)
  MultiSource/Applications/oggenc/oggenc: 6.34% (5.6299 => 5.9866, std.dev.: 0.0170)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 6.00% (0.3818 => 0.4047, std.dev.: 0.0005)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.03% (4.2080 => 4.4197, std.dev.: 0.0735)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.04% (1.2872 => 1.3263, std.dev.: 0.0127)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 2.52% (1.2239 => 1.2547, std.dev.: 0.0061)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.57% (1.2723 => 1.2923, std.dev.: 0.0045)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 1.34% (0.8886 => 0.9005, std.dev.: 0.0031)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/d/make_dparser: 45.05% (0.0384 => 0.0557, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout/heapsort: 44.94% (2.9453 => 4.2689, std.dev.: 0.1217)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 41.23% (1.4694 => 2.0752, std.dev.: 0.0631)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 16.39% (28.7249 => 33.4315, std.dev.: 0.2194)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 9.98% (9.4755 => 10.4213, std.dev.: 0.0740)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 9.29% (35.6000 => 38.9059, std.dev.: 1.0637)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.19% (1.0608 => 1.1371, std.dev.: 0.0001)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.52% (40.4556 => 43.0944, std.dev.: 0.2274)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.25% (2.8840 => 3.0642, std.dev.: 0.0507)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.07% (1.2480 => 1.3238, std.dev.: 0.0116)
  SingleSource/Benchmarks/Misc/salsa20: 5.00% (7.8308 => 8.2221, std.dev.: 0.0555)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.37% (60.7802 => 63.4369, std.dev.: 0.7402)
  SingleSource/Benchmarks/Stanford/FloatMM: 3.86% (0.6939 => 0.7207, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 3.69% (6.6761 => 6.9224, std.dev.: 0.0750)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.33% (5.3414 => 5.4123, std.dev.: 0.0154)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/sieve: -14.51% (7.8940 => 6.7485, std.dev.: 0.2691)
  SingleSource/Benchmarks/Shootout/matrix: -14.24% (2.1115 => 1.8109, std.dev.: 0.0474)
  MultiSource/Benchmarks/BitBench/five11/five11: -3.95% (5.6495 => 5.4261, std.dev.: 0.0292)
  MultiSource/Applications/sgefa/sgefa: -2.45% (0.9062 => 0.8840, std.dev.: 0.0064)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -2.13% (2.5270 => 2.4731, std.dev.: 0.0178)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: -1.03% (1.6170 => 1.6004, std.dev.: 0.0032)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/compare: 77.53% (0.0227 => 0.0403, std.dev.: 0.0015)
  SingleSource/Regression/C/2008-01-07-LongDouble: 72.15% (0.0158 => 0.0272, std.dev.: 0.0013)
  SingleSource/Regression/C/2003-05-23-TransparentUnion: 71.51% (0.0172 => 0.0295, std.dev.: 0.0010)
  SingleSource/UnitTests/2003-05-07-VarArgs: 67.18% (0.0259 => 0.0433, std.dev.: 0.0023)
  SingleSource/UnitTests/conditional-gnu-ext-cxx: 60.57% (0.0175 => 0.0281, std.dev.: 0.0018)
  SingleSource/Regression/C/sumarray2d: 58.75% (0.0320 => 0.0508, std.dev.: 0.0030)
  SingleSource/Regression/C/DuffsDevice: 49.08% (0.0273 => 0.0407, std.dev.: 0.0047)
  MultiSource/Applications/sqlite3/sqlite3: 48.58% (15.7419 => 23.3895, std.dev.: 0.4658)
  SingleSource/Benchmarks/Dhrystone/fldry: 24.28% (0.0589 => 0.0732, std.dev.: 0.0025)
  MultiSource/Applications/treecc/treecc: 16.15% (2.2781 => 2.6460, std.dev.: 0.0952)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 16.01% (25.9661 => 30.1231, std.dev.: 0.6377)
  MultiSource/Applications/JM/ldecod/ldecod: 13.56% (7.6560 => 8.6941, std.dev.: 0.1832)
  MultiSource/Applications/lemon/lemon: 12.53% (1.2200 => 1.3729, std.dev.: 0.0341)
  MultiSource/Applications/d/make_dparser: 9.34% (3.6428 => 3.9829, std.dev.: 0.1158)
  MultiSource/Applications/oggenc/oggenc: 8.91% (5.4968 => 5.9866, std.dev.: 0.0170)
  MultiSource/Applications/siod/siod: 8.31% (2.5491 => 2.7610, std.dev.: 0.0157)
  SingleSource/Benchmarks/Shootout-C++/spellcheck: 7.69% (0.3758 => 0.4047, std.dev.: 0.0005)
  SingleSource/Benchmarks/Shootout-C++/methcall: 5.66% (0.2033 => 0.2148, std.dev.: 0.0015)
  SingleSource/Benchmarks/Misc-C++/bigfib: 4.85% (0.6412 => 0.6723, std.dev.: 0.0056)
  SingleSource/Benchmarks/Shootout-C++/ary3: 4.16% (0.2547 => 0.2653, std.dev.: 0.0015)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 2.48% (0.8787 => 0.9005, std.dev.: 0.0031)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/UnitTests/SignlessTypes/Large/cast: 193.10% (0.0058 => 0.0170, std.dev.: 0.0003)
  MultiSource/Applications/d/make_dparser: 45.05% (0.0384 => 0.0557, std.dev.: 0.0006)
  SingleSource/Benchmarks/Shootout/heapsort: 44.75% (2.9492 => 4.2689, std.dev.: 0.1217)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 41.02% (1.4716 => 2.0752, std.dev.: 0.0631)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 17.14% (5.9583 => 6.9796, std.dev.: 0.0578)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 16.63% (28.6638 => 33.4315, std.dev.: 0.2194)
  SingleSource/Benchmarks/Dhrystone/fldry: 13.19% (0.6696 => 0.7579, std.dev.: 0.0324)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 11.13% (1.0232 => 1.1371, std.dev.: 0.0001)
  SingleSource/Benchmarks/Shootout/ary3: 10.38% (4.5977 => 5.0748, std.dev.: 0.1612)
  SingleSource/Benchmarks/Misc/salsa20: 8.26% (7.5947 => 8.2221, std.dev.: 0.0555)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 8.17% (35.9684 => 38.9059, std.dev.: 1.0637)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 6.27% (40.5530 => 43.0944, std.dev.: 0.2274)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.88% (2.8940 => 3.0642, std.dev.: 0.0507)
  MultiSource/Applications/siod/siod: 5.46% (3.4258 => 3.6129, std.dev.: 0.0085)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 5.43% (1.2556 => 1.3238, std.dev.: 0.0116)
  MultiSource/Applications/SIBsim4/SIBsim4: 5.10% (3.4043 => 3.5780, std.dev.: 0.0165)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 4.32% (1.2278 => 1.2808, std.dev.: 0.0112)
  MultiSource/Applications/lua/lua: 4.04% (29.1357 => 30.3133, std.dev.: 0.4309)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 3.99% (10.0217 => 10.4213, std.dev.: 0.0740)
  SingleSource/Benchmarks/Stanford/FloatMM: 3.86% (0.6939 => 0.7207, std.dev.: 0.0043)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.86% (61.0792 => 63.4369, std.dev.: 0.7402)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.12% (5.2486 => 5.4123, std.dev.: 0.0154)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.90% (3.1547 => 3.2145, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.72% (11.7894 => 11.9916, std.dev.: 0.0485)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -4.28% (0.2824 => 0.2703, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.03% (1.2824 => 1.2307, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -3.90% (1.3146 => 1.2633, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.12% (1.2583 => 1.2316, std.dev.: 0.0071)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: -3.55% (4.2978 => 4.1453, std.dev.: 0.0489)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: -1.86% (2.5200 => 2.4731, std.dev.: 0.0178)

Report Time: 0.66s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131219/08641ebb/attachment.html>


More information about the llvm-testresults mailing list