[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jan 3 11:20:10 PST 2014


http://llvm.org/perf/db_default/v4/nts/19634?compare_to=19622&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19634, Order: 198424, Start Time: 2014-01-03 17:37:01, End Time: 2014-01-03 19:24:50
      To: 19622, Order: 198419, Start Time: 2014-01-03 15:27:39, End Time: 2014-01-03 17:13:23
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 38 (63 on baseline)
Performance Improvements: 12 (14 on baseline)
Unchanged Tests: 1060 (1033 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/fib2: 70.11% (0.0184 => 0.0313, std.dev.: 0.0004)
  SingleSource/Regression/C/ConstructorDestructorAttributes: 65.22% (0.0161 => 0.0266, std.dev.: 0.0020)
  SingleSource/UnitTests/SignlessTypes/factor: 62.91% (0.0364 => 0.0593, std.dev.: 0.0007)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 61.46% (0.0698 => 0.1127, std.dev.: 0.0024)
  SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 52.82% (0.0195 => 0.0298, std.dev.: 0.0014)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 49.11% (0.0224 => 0.0334, std.dev.: 0.0010)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 34.78% (0.6774 => 0.9130, std.dev.: 0.0631)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 22.00% (1.4739 => 1.7981, std.dev.: 0.0914)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 21.72% (0.0930 => 0.1132, std.dev.: 0.0026)
  MultiSource/Applications/JM/ldecod/ldecod: 12.42% (7.6212 => 8.5680, std.dev.: 0.1269)
  MultiSource/Applications/JM/lencod/lencod: 12.31% (17.6140 => 19.7830, std.dev.: 0.5773)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 7.87% (2.7925 => 3.0122, std.dev.: 0.0851)
  MultiSource/Applications/SPASS/SPASS: 7.57% (17.0551 => 18.3464, std.dev.: 0.1932)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 7.11% (0.5261 => 0.5635, std.dev.: 0.0114)
  MultiSource/Applications/d/make_dparser: 6.89% (3.5794 => 3.8261, std.dev.: 0.0714)
  MultiSource/Applications/sqlite3/sqlite3: 4.95% (22.3072 => 23.4118, std.dev.: 0.3484)
  MultiSource/Benchmarks/mafft/pairlocalalign: 3.91% (10.3689 => 10.7740, std.dev.: 0.0619)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.79% (1.3385 => 1.3624, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 1.78% (1.2570 => 1.2794, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 1.68% (1.2137 => 1.2341, std.dev.: 0.0044)
  MultiSource/Applications/kimwitu++/kc: 1.16% (18.6605 => 18.8770, std.dev.: 0.0735)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 58.34% (1.6487 => 2.6106, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout/heapsort: 36.97% (3.2851 => 4.4995, std.dev.: 0.1019)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 32.03% (1.5965 => 2.1079, std.dev.: 0.0466)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 14.53% (35.7687 => 40.9666, std.dev.: 0.7708)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 12.19% (4.2041 => 4.7167, std.dev.: 0.0757)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 7.22% (1.2459 => 1.3359, std.dev.: 0.0062)
  SingleSource/Benchmarks/Misc/fp-convert: 6.93% (7.3250 => 7.8325, std.dev.: 0.0107)
  MultiSource/Applications/obsequi/Obsequi: 6.28% (2.2070 => 2.3456, std.dev.: 0.0097)
  SingleSource/Benchmarks/Shootout-C++/fibo: 5.22% (5.0272 => 5.2898, std.dev.: 0.0574)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 4.84% (0.3349 => 0.3511, std.dev.: 0.0045)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 4.48% (31.9387 => 33.3700, std.dev.: 0.3414)
  MultiSource/Benchmarks/Bullet/bullet: 4.17% (7.1374 => 7.4347, std.dev.: 0.0116)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.91% (3.9622 => 4.0775, std.dev.: 0.0284)
  SingleSource/Regression/C/uint64_to_float: 2.84% (1.4698 => 1.5116, std.dev.: 0.0022)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 1.88% (60.2660 => 61.3981, std.dev.: 0.4198)
  MultiSource/Benchmarks/VersaBench/bmm/bmm: 1.78% (2.6055 => 2.6519, std.dev.: 0.0171)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 1.33% (1.1830 => 1.1987, std.dev.: 0.0006)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/2003-05-12-MinIntProblem: -40.32% (0.0253 => 0.0151, std.dev.: 0.0018)
  SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: -40.07% (0.0267 => 0.0160, std.dev.: 0.0021)
  SingleSource/UnitTests/Vector/sumarray-dbl: -38.44% (0.0359 => 0.0221, std.dev.: 0.0026)
  SingleSource/UnitTests/initp1: -37.29% (0.0850 => 0.0533, std.dev.: 0.0054)
  SingleSource/UnitTests/SignlessTypes/cast2: -36.54% (0.0301 => 0.0191, std.dev.: 0.0031)
  SingleSource/UnitTests/2003-05-02-DependentPHI: -36.11% (0.0288 => 0.0184, std.dev.: 0.0028)
  SingleSource/UnitTests/SignlessTypes/div: -27.20% (0.0511 => 0.0372, std.dev.: 0.0010)
  SingleSource/UnitTests/SignlessTypes/rem: -9.80% (0.1367 => 0.1233, std.dev.: 0.0006)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Misc-C++/stepanov_container: -20.92% (5.8665 => 4.6394, std.dev.: 0.0591)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: -3.44% (4.3088 => 4.1607, std.dev.: 0.0364)
  SingleSource/Benchmarks/Misc/himenobmtxpa: -2.04% (4.1824 => 4.0972, std.dev.: 0.0138)
  SingleSource/Benchmarks/Shootout/lists: -1.27% (7.1902 => 7.0988, std.dev.: 0.0343)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/DuffsDevice: 83.52% (0.0273 => 0.0501, std.dev.: 0.0024)
  SingleSource/Benchmarks/Shootout/fib2: 76.84% (0.0177 => 0.0313, std.dev.: 0.0004)
  SingleSource/Regression/C++/2003-09-29-NonPODsByValue: 76.33% (0.0169 => 0.0298, std.dev.: 0.0014)
  SingleSource/UnitTests/SignlessTypes/factor: 74.41% (0.0340 => 0.0593, std.dev.: 0.0007)
  SingleSource/UnitTests/2007-04-10-BitfieldTest: 73.06% (0.0193 => 0.0334, std.dev.: 0.0010)
  SingleSource/Regression/C/ConstructorDestructorAttributes: 66.25% (0.0160 => 0.0266, std.dev.: 0.0020)
  SingleSource/Regression/C++/2003-05-14-array-init: 65.06% (0.0166 => 0.0274, std.dev.: 0.0011)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 62.63% (0.0693 => 0.1127, std.dev.: 0.0024)
  SingleSource/UnitTests/2006-02-04-DivRem: 60.12% (0.0173 => 0.0277, std.dev.: 0.0018)
  SingleSource/Regression/C++/BuiltinTypeInfo: 57.77% (0.0206 => 0.0325, std.dev.: 0.0026)
  SingleSource/Regression/C++/short_circuit_dtor: 53.44% (0.0189 => 0.0290, std.dev.: 0.0024)
  MultiSource/Applications/sqlite3/sqlite3: 48.72% (15.7419 => 23.4118, std.dev.: 0.3484)
  MultiSource/Benchmarks/Prolangs-C/assembler/assembler: 34.88% (0.6769 => 0.9130, std.dev.: 0.0631)
  MultiSource/Benchmarks/Prolangs-C/agrep/agrep: 22.91% (1.4629 => 1.7981, std.dev.: 0.0914)
  MultiSource/Benchmarks/Prolangs-C/allroots/allroots: 22.25% (0.0926 => 0.1132, std.dev.: 0.0026)
  MultiSource/Applications/JM/lencod/lencod: 14.37% (17.2968 => 19.7830, std.dev.: 0.5773)
  MultiSource/Applications/JM/ldecod/ldecod: 11.91% (7.6560 => 8.5680, std.dev.: 0.1269)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 9.87% (0.1145 => 0.1258, std.dev.: 0.0007)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 9.76% (0.5134 => 0.5635, std.dev.: 0.0114)
  MultiSource/Applications/SPASS/SPASS: 9.74% (16.7177 => 18.3464, std.dev.: 0.1932)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 9.25% (2.7572 => 3.0122, std.dev.: 0.0851)
  SingleSource/Benchmarks/Misc-C++/bigfib: 5.44% (0.6412 => 0.6761, std.dev.: 0.0020)
  MultiSource/Benchmarks/mafft/pairlocalalign: 4.50% (10.3096 => 10.7740, std.dev.: 0.0619)
  SingleSource/Benchmarks/Shootout-C++/wordfreq: 3.06% (0.3366 => 0.3469, std.dev.: 0.0011)
  MultiSource/Applications/kimwitu++/kc: 1.02% (18.6861 => 18.8770, std.dev.: 0.0735)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Misc/pi: 56.46% (1.6685 => 2.6106, std.dev.: 0.0003)
  SingleSource/Benchmarks/Shootout/heapsort: 52.57% (2.9492 => 4.4995, std.dev.: 0.1019)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 43.24% (1.4716 => 2.1079, std.dev.: 0.0466)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.59% (5.9583 => 6.9469, std.dev.: 0.0128)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 16.42% (28.6638 => 33.3700, std.dev.: 0.3414)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 16.27% (4.0567 => 4.7167, std.dev.: 0.0757)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 13.90% (35.9684 => 40.9666, std.dev.: 0.7708)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 13.19% (2.1020 => 2.3792, std.dev.: 0.0386)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 12.24% (82.2592 => 92.3290, std.dev.: 0.3666)
  SingleSource/Benchmarks/Shootout/strcat: 11.43% (0.1417 => 0.1579, std.dev.: 0.0049)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 8.78% (1.1019 => 1.1987, std.dev.: 0.0006)
  SingleSource/Benchmarks/Stanford/Puzzle: 8.45% (0.1668 => 0.1809, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.24% (3.3810 => 3.6595, std.dev.: 0.1042)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 7.50% (0.3534 => 0.3799, std.dev.: 0.0008)
  SingleSource/Benchmarks/McGill/chomp: 6.68% (1.0099 => 1.0774, std.dev.: 0.0251)
  MultiSource/Benchmarks/Ptrdist/anagram/anagram: 6.40% (1.2556 => 1.3359, std.dev.: 0.0062)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 6.39% (1.2278 => 1.3062, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.17% (3.5027 => 3.7188, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 6.11% (2.8940 => 3.0707, std.dev.: 0.0593)
  SingleSource/Benchmarks/Misc/fp-convert: 6.00% (7.3892 => 7.8325, std.dev.: 0.0107)
  MultiSource/Applications/lua/lua: 5.41% (29.1357 => 30.7117, std.dev.: 0.3468)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: 5.31% (4.0012 => 4.2138, std.dev.: 0.0722)
  MultiSource/Applications/siod/siod: 5.24% (3.4258 => 3.6053, std.dev.: 0.0498)
  SingleSource/Benchmarks/Shootout-C++/fibo: 5.12% (5.0320 => 5.2898, std.dev.: 0.0574)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/durbin/durbin: 4.93% (0.3346 => 0.3511, std.dev.: 0.0045)
  MultiSource/Benchmarks/MallocBench/espresso/espresso: 4.20% (0.6261 => 0.6524, std.dev.: 0.0028)
  SingleSource/Regression/C/uint64_to_float: 3.64% (1.4585 => 1.5116, std.dev.: 0.0022)
  MultiSource/Applications/sgefa/sgefa: 3.25% (0.8745 => 0.9029, std.dev.: 0.0057)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.57% (3.9755 => 4.0775, std.dev.: 0.0284)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.10% (11.8902 => 12.1398, std.dev.: 0.0043)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 2.09% (2.5025 => 2.5549, std.dev.: 0.0019)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 2.08% (21.5962 => 22.0447, std.dev.: 0.1228)
  MultiSource/Applications/sqlite3/sqlite3: 2.03% (4.2978 => 4.3850, std.dev.: 0.0074)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.95% (11.7894 => 12.0197, std.dev.: 0.0248)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.92% (5.9126 => 6.0263, std.dev.: 0.0423)
  MultiSource/Applications/obsequi/Obsequi: 1.71% (2.3061 => 2.3456, std.dev.: 0.0097)
  MultiSource/Benchmarks/Trimaran/netbench-crc/netbench-crc: 1.61% (0.6388 => 0.6491, std.dev.: 0.0017)
  SingleSource/Benchmarks/Shootout/lists: 1.51% (6.9930 => 7.0988, std.dev.: 0.0343)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -7.18% (0.3247 => 0.3014, std.dev.: 0.0076)
  MultiSource/Benchmarks/Bullet/bullet: -5.89% (36.6274 => 34.4711, std.dev.: 0.4368)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.57% (1.4277 => 1.3624, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.50% (1.3146 => 1.2555, std.dev.: 0.0199)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.60% (1.2583 => 1.2130, std.dev.: 0.0118)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.59% (1.3660 => 1.3169, std.dev.: 0.0082)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.96% (1.2544 => 1.2173, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.22% (1.2952 => 1.2794, std.dev.: 0.0059)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/mediabench/mpeg2/mpeg2dec/mpeg2decode: -27.37% (0.0369 => 0.0268, std.dev.: 0.0005)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -18.10% (15.5356 => 12.7240, std.dev.: 0.2791)
  MultiSource/Benchmarks/Fhourstones/fhourstones: -8.99% (1.4335 => 1.3047, std.dev.: 0.0290)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -5.09% (0.3970 => 0.3768, std.dev.: 0.0056)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.28% (6.0535 => 5.9153, std.dev.: 0.0467)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -1.01% (3.5813 => 3.5451, std.dev.: 0.0128)

Report Time: 0.77s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140103/ddae9f06/attachment.html>


More information about the llvm-testresults mailing list