[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Dec 3 00:22:01 PST 2013


http://llvm.org/perf/db_default/v4/nts/17866?compare_to=17860&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 17866, Order: 196209, Start Time: 2013-12-03 06:38:47, End Time: 2013-12-03 08:26:03
      To: 17860, Order: 196199, Start Time: 2013-12-03 04:30:24, End Time: 2013-12-03 06:12:42
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 69 (50 on baseline)
Performance Improvements: 9 (11 on baseline)
Unchanged Tests: 1032 (1049 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/2003-06-08-VirtualFunctions: 127.59% (0.0087 => 0.0198, std.dev.: 0.0026)
  SingleSource/UnitTests/Threads/2010-12-08-tls: 88.28% (0.0145 => 0.0273, std.dev.: 0.0015)
  SingleSource/UnitTests/DefaultInitDynArrays: 85.71% (0.0119 => 0.0221, std.dev.: 0.0012)
  SingleSource/Regression/C/globalrefs: 80.60% (0.0201 => 0.0363, std.dev.: 0.0024)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 71.06% (0.0235 => 0.0402, std.dev.: 0.0021)
  SingleSource/UnitTests/2002-10-09-ArrayResolution: 68.86% (0.0167 => 0.0282, std.dev.: 0.0023)
  SingleSource/Regression/C++/EH/exception_spec_test: 65.81% (0.0351 => 0.0582, std.dev.: 0.0039)
  SingleSource/UnitTests/2003-07-08-BitOpsTest: 65.66% (0.0166 => 0.0275, std.dev.: 0.0021)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 58.08% (0.0668 => 0.1056, std.dev.: 0.0079)
  SingleSource/UnitTests/SignlessTypes/shr: 40.43% (0.0324 => 0.0455, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout/strcat: 39.38% (0.0292 => 0.0407, std.dev.: 0.0021)
  SingleSource/Regression/C/sumarraymalloc: 36.05% (0.0319 => 0.0434, std.dev.: 0.0041)
  MultiSource/Applications/Burg/burg: 14.55% (1.4162 => 1.6222, std.dev.: 0.0584)
  MultiSource/Applications/JM/ldecod/ldecod: 12.49% (7.5445 => 8.4868, std.dev.: 0.1958)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 12.35% (1.2583 => 1.4137, std.dev.: 0.0234)
  MultiSource/Applications/JM/lencod/lencod: 11.79% (17.2314 => 19.2630, std.dev.: 0.2258)
  MultiSource/Applications/sqlite3/sqlite3: 9.20% (15.8416 => 17.2996, std.dev.: 0.0366)
  MultiSource/Benchmarks/Bullet/bullet: 8.21% (32.8877 => 35.5866, std.dev.: 0.2911)
  MultiSource/Applications/lambda-0_1_3/lambda: 7.65% (0.8305 => 0.8940, std.dev.: 0.0148)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 6.64% (0.2333 => 0.2488, std.dev.: 0.0045)
  SingleSource/Benchmarks/Shootout-C++/matrix: 5.95% (0.2368 => 0.2509, std.dev.: 0.0004)
  SingleSource/Benchmarks/Shootout-C++/ary: 5.81% (0.2477 => 0.2621, std.dev.: 0.0020)
  MultiSource/Applications/siod/siod: 5.65% (2.5255 => 2.6682, std.dev.: 0.0121)
  MultiSource/Applications/oggenc/oggenc: 5.55% (5.4207 => 5.7216, std.dev.: 0.0233)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 5.40% (0.9188 => 0.9684, std.dev.: 0.0097)
  MultiSource/Applications/SIBsim4/SIBsim4: 5.25% (1.5196 => 1.5994, std.dev.: 0.0270)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 5.15% (4.8930 => 5.1450, std.dev.: 0.0244)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 4.84% (0.2130 => 0.2233, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 4.51% (1.4502 => 1.5156, std.dev.: 0.0243)
  SingleSource/Benchmarks/Shootout-C++/lists: 4.29% (0.2567 => 0.2677, std.dev.: 0.0024)
  MultiSource/Benchmarks/mafft/pairlocalalign: 4.16% (10.1109 => 10.5318, std.dev.: 0.0651)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 3.80% (1.3436 => 1.3946, std.dev.: 0.0092)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.62% (23.8903 => 24.7561, std.dev.: 0.1724)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 3.60% (1.2415 => 1.2862, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: 3.45% (1.2981 => 1.3429, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 3.36% (1.2228 => 1.2639, std.dev.: 0.0070)
  MultiSource/Benchmarks/Trimaran/enc-3des/enc-3des: 2.88% (0.3546 => 0.3648, std.dev.: 0.0017)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 1.38% (5.4874 => 5.5631, std.dev.: 0.0180)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 56.71% (2.8765 => 4.5077, std.dev.: 0.0846)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 49.57% (2.9137 => 4.3580, std.dev.: 0.0848)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 40.29% (1.4564 => 2.0432, std.dev.: 0.0778)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 25.81% (2.3782 => 2.9921, std.dev.: 0.0336)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 19.47% (2.4047 => 2.8728, std.dev.: 0.0840)
  MultiSource/Applications/lemon/lemon: 17.66% (0.8555 => 1.0066, std.dev.: 0.0282)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 17.61% (28.5546 => 33.5830, std.dev.: 0.1847)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 12.91% (13.5907 => 15.3450, std.dev.: 0.5582)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 10.83% (0.3296 => 0.3653, std.dev.: 0.0074)
  MultiSource/Applications/SPASS/SPASS: 10.83% (8.4815 => 9.3997, std.dev.: 0.3002)
  MultiSource/Benchmarks/nbench/nbench: 9.74% (21.0082 => 23.0543, std.dev.: 0.7319)
  SingleSource/Benchmarks/Misc/salsa20: 9.04% (7.4758 => 8.1519, std.dev.: 0.0044)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 7.93% (1.0271 => 1.1086, std.dev.: 0.0141)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.88% (5.0158 => 5.4109, std.dev.: 0.0055)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 7.25% (35.5966 => 38.1779, std.dev.: 0.6518)
  MultiSource/Benchmarks/Fhourstones/fhourstones: 5.99% (1.2350 => 1.3090, std.dev.: 0.0201)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 5.71% (2.9493 => 3.1178, std.dev.: 0.0529)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 4.85% (4.1018 => 4.3007, std.dev.: 0.0028)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.79% (95.2750 => 99.8418, std.dev.: 1.3664)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.73% (5.8940 => 6.1727, std.dev.: 0.0216)
  MultiSource/Applications/sgefa/sgefa: 4.37% (0.8749 => 0.9131, std.dev.: 0.0049)
  MultiSource/Benchmarks/Bullet/bullet: 4.34% (6.9556 => 7.2577, std.dev.: 0.0548)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.70% (4.5812 => 4.7509, std.dev.: 0.0601)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.26% (0.6298 => 0.6503, std.dev.: 0.0006)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.21% (0.5039 => 0.5201, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.95% (3.7970 => 3.9090, std.dev.: 0.0312)
  SingleSource/Benchmarks/BenchmarkGame/nsieve-bits: 2.46% (1.7224 => 1.7647, std.dev.: 0.0159)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.04% (1.5971 => 1.6297, std.dev.: 0.0108)
  MultiSource/Applications/siod/siod: 1.33% (3.4270 => 3.4727, std.dev.: 0.0107)
  MultiSource/Applications/lua/lua: 1.27% (28.9389 => 29.3070, std.dev.: 0.1132)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: 1.26% (5.8001 => 5.8732, std.dev.: 0.0102)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: -28.02% (4.0181 => 2.8923, std.dev.: 0.1928)
  SingleSource/Benchmarks/Shootout/matrix: -14.88% (2.1076 => 1.7939, std.dev.: 0.0177)
  MultiSource/Applications/aha/aha: -5.82% (3.7792 => 3.5594, std.dev.: 0.0215)
  MultiSource/Applications/JM/lencod/lencod: -2.77% (8.0891 => 7.8647, std.dev.: 0.0775)
  SingleSource/Benchmarks/Shootout-C++/hash2: -2.07% (3.6603 => 3.5844, std.dev.: 0.0039)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.69% (19.0227 => 18.7012, std.dev.: 0.0631)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -1.63% (6.1087 => 6.0092, std.dev.: 0.0338)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -1.41% (8.9285 => 8.8030, std.dev.: 0.0207)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -1.19% (4.2594 => 4.2086, std.dev.: 0.0131)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/DefaultInitDynArrays: 82.64% (0.0121 => 0.0221, std.dev.: 0.0012)
  SingleSource/Regression/C/globalrefs: 81.50% (0.0200 => 0.0363, std.dev.: 0.0024)
  SingleSource/UnitTests/Threads/2010-12-08-tls: 77.27% (0.0154 => 0.0273, std.dev.: 0.0015)
  SingleSource/UnitTests/2009-04-16-BitfieldInitialization: 69.62% (0.0237 => 0.0402, std.dev.: 0.0021)
  SingleSource/Regression/C++/EH/exception_spec_test: 67.24% (0.0348 => 0.0582, std.dev.: 0.0039)
  SingleSource/UnitTests/2002-10-09-ArrayResolution: 62.07% (0.0174 => 0.0282, std.dev.: 0.0023)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-1d-imper/jacobi-1d-imper: 54.39% (0.0684 => 0.1056, std.dev.: 0.0079)
  SingleSource/Benchmarks/Shootout/strcat: 38.91% (0.0293 => 0.0407, std.dev.: 0.0021)
  SingleSource/UnitTests/SignlessTypes/shr: 37.46% (0.0331 => 0.0455, std.dev.: 0.0045)
  MultiSource/Applications/Burg/burg: 13.72% (1.4265 => 1.6222, std.dev.: 0.0584)
  MultiSource/Applications/JM/lencod/lencod: 11.37% (17.2968 => 19.2630, std.dev.: 0.2258)
  MultiSource/Applications/JM/ldecod/ldecod: 10.85% (7.6560 => 8.4868, std.dev.: 0.1958)
  MultiSource/Applications/sqlite3/sqlite3: 9.90% (15.7419 => 17.2996, std.dev.: 0.0366)
  MultiSource/Applications/lambda-0_1_3/lambda: 7.31% (0.8331 => 0.8940, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 7.24% (1.3182 => 1.4137, std.dev.: 0.0234)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 5.68% (0.2113 => 0.2233, std.dev.: 0.0037)
  SingleSource/Benchmarks/Shootout-C++/ary: 5.60% (0.2482 => 0.2621, std.dev.: 0.0020)
  MultiSource/Applications/SIBsim4/SIBsim4: 5.24% (1.5198 => 1.5994, std.dev.: 0.0270)
  MultiSource/Applications/siod/siod: 4.67% (2.5491 => 2.6682, std.dev.: 0.0121)
  SingleSource/Benchmarks/Shootout-C++/matrix: 4.54% (0.2400 => 0.2509, std.dev.: 0.0004)
  MultiSource/Applications/oggenc/oggenc: 4.09% (5.4968 => 5.7216, std.dev.: 0.0233)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.16% (10.3096 => 10.5318, std.dev.: 0.0651)
  MultiSource/Benchmarks/mediabench/jpeg/jpeg-6a/cjpeg: 1.77% (5.0556 => 5.1450, std.dev.: 0.0244)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 1.52% (1.2670 => 1.2862, std.dev.: 0.0066)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/heapsort: 52.84% (2.9492 => 4.5077, std.dev.: 0.0846)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 45.53% (2.9945 => 4.3580, std.dev.: 0.0848)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 38.84% (1.4716 => 2.0432, std.dev.: 0.0778)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 17.16% (28.6638 => 33.5830, std.dev.: 0.1847)
  MultiSource/Applications/lemon/lemon: 16.61% (0.8632 => 1.0066, std.dev.: 0.0282)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 12.40% (2.5559 => 2.8728, std.dev.: 0.0840)
  SingleSource/Benchmarks/Shootout/ary3: 11.00% (4.5977 => 5.1034, std.dev.: 0.1890)
  MultiSource/Applications/SPASS/SPASS: 10.11% (8.5363 => 9.3997, std.dev.: 0.3002)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: 8.78% (0.3358 => 0.3653, std.dev.: 0.0074)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: 8.35% (1.0232 => 1.1086, std.dev.: 0.0141)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 7.73% (2.8940 => 3.1178, std.dev.: 0.0529)
  SingleSource/Benchmarks/Shootout-C++/fibo: 7.53% (5.0320 => 5.4109, std.dev.: 0.0055)
  SingleSource/Benchmarks/Misc/salsa20: 7.34% (7.5947 => 8.1519, std.dev.: 0.0044)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 6.14% (35.9684 => 38.1779, std.dev.: 0.6518)
  MultiSource/Applications/sgefa/sgefa: 4.41% (0.8745 => 0.9131, std.dev.: 0.0049)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.39% (5.9133 => 6.1727, std.dev.: 0.0216)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 3.87% (0.6261 => 0.6503, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 3.73% (4.1462 => 4.3007, std.dev.: 0.0028)
  MultiSource/Benchmarks/VersaBench/dbms/dbms: 3.71% (2.8850 => 2.9921, std.dev.: 0.0336)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.54% (4.5883 => 4.7509, std.dev.: 0.0601)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: 2.70% (3.8062 => 3.9090, std.dev.: 0.0312)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.95% (1.5986 => 1.6297, std.dev.: 0.0108)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.63% (5.9126 => 6.0092, std.dev.: 0.0338)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.54% (6.5291 => 6.6297, std.dev.: 0.0326)
  MultiSource/Applications/siod/siod: 1.37% (3.4258 => 3.4727, std.dev.: 0.0107)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: 1.21% (1.2463 => 1.2614, std.dev.: 0.0053)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -24.42% (0.0688 => 0.0520, std.dev.: 0.0044)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -10.38% (0.3247 => 0.2910, std.dev.: 0.0111)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.90% (0.6882 => 0.6476, std.dev.: 0.0060)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.66% (25.9661 => 24.7561, std.dev.: 0.1724)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.09% (1.3146 => 1.2608, std.dev.: 0.0178)
  MultiSource/Benchmarks/Bullet/bullet: -2.84% (36.6274 => 35.5866, std.dev.: 0.2911)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -2.84% (1.1409 => 1.1085, std.dev.: 0.0084)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: -8.69% (1.4335 => 1.3090, std.dev.: 0.0201)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.98% (6.0535 => 5.8732, std.dev.: 0.0102)
  MultiSource/Benchmarks/Bullet/bullet: -2.22% (7.4226 => 7.2577, std.dev.: 0.0548)
  SingleSource/Benchmarks/Shootout-C++/hash2: -2.08% (3.6605 => 3.5844, std.dev.: 0.0039)

Report Time: 1.25s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131203/042189cb/attachment.html>


More information about the llvm-testresults mailing list