[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Thu Jan 2 08:30:33 PST 2014


http://llvm.org/perf/db_default/v4/nts/19520?compare_to=19509&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19520, Order: 198308, Start Time: 2014-01-02 14:47:42, End Time: 2014-01-02 16:35:13
      To: 19509, Order: 198300, Start Time: 2014-01-02 12:38:25, End Time: 2014-01-02 14:21:40
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 50 (53 on baseline)
Performance Improvements: 1 (10 on baseline)
Unchanged Tests: 1059 (1047 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/EH/dead_try_block: 105.19% (0.0135 => 0.0277, std.dev.: 0.0015)
  SingleSource/UnitTests/2003-05-02-DependentPHI: 89.26% (0.0149 => 0.0282, std.dev.: 0.0023)
  SingleSource/UnitTests/2002-10-12-StructureArgs: 83.23% (0.0167 => 0.0306, std.dev.: 0.0011)
  SingleSource/UnitTests/2003-08-20-FoldBug: 82.43% (0.0148 => 0.0270, std.dev.: 0.0002)
  SingleSource/Regression/C++/EH/ConditionalExpr: 78.07% (0.0228 => 0.0406, std.dev.: 0.0003)
  SingleSource/Regression/C/PR491: 77.03% (0.0148 => 0.0262, std.dev.: 0.0013)
  SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 76.16% (0.0151 => 0.0266, std.dev.: 0.0012)
  SingleSource/Regression/C/badidx: 75.49% (0.0257 => 0.0451, std.dev.: 0.0016)
  SingleSource/UnitTests/FloatPrecision: 74.69% (0.0162 => 0.0283, std.dev.: 0.0027)
  SingleSource/UnitTests/2003-05-07-VarArgs: 71.98% (0.0257 => 0.0442, std.dev.: 0.0017)
  SingleSource/UnitTests/2002-05-02-CastTest: 68.75% (0.0256 => 0.0432, std.dev.: 0.0013)
  SingleSource/Regression/C/sumarray: 68.69% (0.0297 => 0.0501, std.dev.: 0.0029)
  SingleSource/Benchmarks/Shootout/methcall: 67.32% (0.0355 => 0.0594, std.dev.: 0.0007)
  SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 64.59% (0.0209 => 0.0344, std.dev.: 0.0031)
  SingleSource/Regression/C++/EH/inlined_cleanup: 62.90% (0.0186 => 0.0303, std.dev.: 0.0013)
  SingleSource/Regression/C++/EH/ctor_dtor_count: 62.83% (0.0191 => 0.0311, std.dev.: 0.0031)
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 53.73% (0.0201 => 0.0309, std.dev.: 0.0032)
  SingleSource/Regression/C++/fixups: 52.70% (0.0241 => 0.0368, std.dev.: 0.0024)
  SingleSource/UnitTests/2006-01-23-UnionInit: 49.06% (0.0267 => 0.0398, std.dev.: 0.0034)
  SingleSource/Regression/C++/EH/exception_spec_test: 48.15% (0.0351 => 0.0520, std.dev.: 0.0047)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 43.20% (0.0787 => 0.1127, std.dev.: 0.0107)
  MultiSource/Benchmarks/Olden/tsp/tsp: 38.52% (0.1324 => 0.1834, std.dev.: 0.0165)
  MultiSource/Applications/treecc/treecc: 11.54% (2.2808 => 2.5440, std.dev.: 0.0905)
  MultiSource/Benchmarks/mafft/pairlocalalign: 9.43% (10.1023 => 11.0554, std.dev.: 0.2004)
  MultiSource/Applications/ClamAV/clamscan: 8.72% (16.8761 => 18.3479, std.dev.: 0.5312)
  MultiSource/Applications/d/make_dparser: 8.13% (3.5643 => 3.8541, std.dev.: 0.0846)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 7.52% (44.6335 => 47.9892, std.dev.: 0.6836)
  MultiSource/Applications/oggenc/oggenc: 5.48% (5.6852 => 5.9970, std.dev.: 0.0674)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 5.36% (0.3935 => 0.4146, std.dev.: 0.0005)
  MultiSource/Benchmarks/McCat/05-eks/eks: 2.40% (0.5119 => 0.5242, std.dev.: 0.0046)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 79.05% (0.1346 => 0.2410, std.dev.: 0.0238)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 47.91% (1.4549 => 2.1519, std.dev.: 0.0517)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 35.16% (3.6954 => 4.9948, std.dev.: 0.3332)
  MultiSource/Benchmarks/Olden/bisort/bisort: 31.92% (0.6733 => 0.8882, std.dev.: 0.0190)
  SingleSource/Benchmarks/Dhrystone/dry: 16.93% (0.4860 => 0.5683, std.dev.: 0.0088)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 11.74% (9.5455 => 10.6661, std.dev.: 0.2447)
  SingleSource/Benchmarks/Misc/ReedSolomon: 8.97% (8.4880 => 9.2494, std.dev.: 0.2558)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 5.11% (2.8513 => 2.9971, std.dev.: 0.0354)
  MultiSource/Applications/sgefa/sgefa: 5.06% (0.8669 => 0.9108, std.dev.: 0.0044)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 4.47% (60.2296 => 62.9240, std.dev.: 0.2911)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.76% (5.4320 => 5.6364, std.dev.: 0.0183)
  SingleSource/Benchmarks/Misc/flops-7: 1.96% (1.7098 => 1.7433, std.dev.: 0.0071)
  MultiSource/Applications/siod/siod: 1.95% (3.5797 => 3.6495, std.dev.: 0.0223)
  SingleSource/Benchmarks/Shootout-C++/hash2: 1.71% (3.6062 => 3.6680, std.dev.: 0.0017)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 1.61% (4.0441 => 4.1091, std.dev.: 0.0081)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.54% (4.4418 => 4.5100, std.dev.: 0.0255)
  MultiSource/Applications/sqlite3/sqlite3: 1.53% (4.1379 => 4.2012, std.dev.: 0.0074)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/cholesky/cholesky: 1.51% (1.4321 => 1.4537, std.dev.: 0.0073)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.42% (7.8352 => 7.9461, std.dev.: 0.0383)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/doitgen/doitgen: 1.40% (3.5768 => 3.6267, std.dev.: 0.0138)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/UnitTests/Vectorizer/gcc-loops: -1.28% (18.9365 => 18.6934, std.dev.: 0.0877)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/EH/ConditionalExpr: 77.29% (0.0229 => 0.0406, std.dev.: 0.0003)
  SingleSource/UnitTests/FloatPrecision: 74.69% (0.0162 => 0.0283, std.dev.: 0.0027)
  SingleSource/UnitTests/2006-12-07-Compare64BitConstant: 73.86% (0.0153 => 0.0266, std.dev.: 0.0012)
  SingleSource/UnitTests/2003-08-20-FoldBug: 73.08% (0.0156 => 0.0270, std.dev.: 0.0002)
  SingleSource/Regression/C/PR491: 72.37% (0.0152 => 0.0262, std.dev.: 0.0013)
  SingleSource/Regression/C++/EH/dead_try_block: 72.05% (0.0161 => 0.0277, std.dev.: 0.0015)
  SingleSource/UnitTests/2003-05-02-DependentPHI: 71.95% (0.0164 => 0.0282, std.dev.: 0.0023)
  SingleSource/UnitTests/2003-05-07-VarArgs: 70.66% (0.0259 => 0.0442, std.dev.: 0.0017)
  SingleSource/Regression/C/sumarray: 69.26% (0.0296 => 0.0501, std.dev.: 0.0029)
  SingleSource/UnitTests/2002-10-12-StructureArgs: 69.06% (0.0181 => 0.0306, std.dev.: 0.0011)
  SingleSource/UnitTests/2002-05-02-CastTest: 68.09% (0.0257 => 0.0432, std.dev.: 0.0013)
  SingleSource/Regression/C/badidx: 67.04% (0.0270 => 0.0451, std.dev.: 0.0016)
  SingleSource/Benchmarks/Shootout/methcall: 66.85% (0.0356 => 0.0594, std.dev.: 0.0007)
  SingleSource/Regression/C++/EH/ctor_dtor_count: 58.67% (0.0196 => 0.0311, std.dev.: 0.0031)
  SingleSource/UnitTests/2004-11-28-GlobalBoolLayout: 55.66% (0.0221 => 0.0344, std.dev.: 0.0031)
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 51.47% (0.0204 => 0.0309, std.dev.: 0.0032)
  SingleSource/Regression/C++/EH/inlined_cleanup: 50.75% (0.0201 => 0.0303, std.dev.: 0.0013)
  SingleSource/Regression/C++/EH/exception_spec_test: 49.43% (0.0348 => 0.0520, std.dev.: 0.0047)
  SingleSource/UnitTests/2006-01-23-UnionInit: 45.79% (0.0273 => 0.0398, std.dev.: 0.0034)
  SingleSource/Regression/C++/fixups: 43.75% (0.0256 => 0.0368, std.dev.: 0.0024)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 43.38% (0.0786 => 0.1127, std.dev.: 0.0107)
  MultiSource/Applications/sqlite3/sqlite3: 42.20% (15.7419 => 22.3855, std.dev.: 1.0278)
  MultiSource/Benchmarks/Olden/tsp/tsp: 32.99% (0.1379 => 0.1834, std.dev.: 0.0165)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 26.74% (0.3859 => 0.4891, std.dev.: 0.0111)
  MultiSource/Applications/treecc/treecc: 11.67% (2.2781 => 2.5440, std.dev.: 0.0905)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 11.40% (25.9661 => 28.9264, std.dev.: 0.7129)
  MultiSource/Applications/siod/siod: 11.15% (2.5491 => 2.8334, std.dev.: 0.0931)
  MultiSource/Applications/oggenc/oggenc: 9.10% (5.4968 => 5.9970, std.dev.: 0.0674)
  MultiSource/Applications/ClamAV/clamscan: 8.14% (16.9661 => 18.3479, std.dev.: 0.5312)
  MultiSource/Benchmarks/mafft/pairlocalalign: 7.23% (10.3096 => 11.0554, std.dev.: 0.2004)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 6.84% (44.9186 => 47.9892, std.dev.: 0.6836)
  MultiSource/Benchmarks/McCat/08-main/main: 5.09% (0.3007 => 0.3160, std.dev.: 0.0019)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 4.96% (0.3950 => 0.4146, std.dev.: 0.0005)
  SingleSource/Benchmarks/Misc-C++/bigfib: 3.81% (0.6412 => 0.6656, std.dev.: 0.0046)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Benchmarks/Olden/mst/mst: 79.18% (0.1345 => 0.2410, std.dev.: 0.0238)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 46.23% (1.4716 => 2.1519, std.dev.: 0.0517)
  MultiSource/Benchmarks/Olden/bisort/bisort: 31.94% (0.6732 => 0.8882, std.dev.: 0.0190)
  SingleSource/Benchmarks/Misc/pi: 31.93% (1.6685 => 2.2012, std.dev.: 0.1936)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 23.12% (4.0567 => 4.9948, std.dev.: 0.3332)
  SingleSource/Benchmarks/Dhrystone/dry: 19.22% (0.4767 => 0.5683, std.dev.: 0.0088)
  SingleSource/Benchmarks/Misc/ReedSolomon: 8.80% (8.5010 => 9.2494, std.dev.: 0.2558)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.98% (3.3810 => 3.6509, std.dev.: 0.0546)
  MultiSource/Applications/siod/siod: 6.53% (3.4258 => 3.6495, std.dev.: 0.0223)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 6.43% (10.0217 => 10.6661, std.dev.: 0.2447)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 5.66% (1.2278 => 1.2973, std.dev.: 0.0105)
  MultiSource/Benchmarks/Trimaran/netbench-url/netbench-url: 4.91% (2.8568 => 2.9971, std.dev.: 0.0354)
  SingleSource/Benchmarks/Misc/fp-convert: 4.36% (7.3892 => 7.7114, std.dev.: 0.0949)
  MultiSource/Applications/sgefa/sgefa: 4.15% (0.8745 => 0.9108, std.dev.: 0.0044)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/3mm/3mm: 3.02% (61.0792 => 62.9240, std.dev.: 0.2911)
  MultiSource/Benchmarks/BitBench/five11/five11: 2.49% (5.4994 => 5.6364, std.dev.: 0.0183)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.95% (11.7894 => 12.0197, std.dev.: 0.0314)
  SingleSource/Benchmarks/Misc/flops-7: 1.45% (1.7183 => 1.7433, std.dev.: 0.0071)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 1.23% (4.0593 => 4.1091, std.dev.: 0.0081)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Bullet/bullet: -8.10% (36.6274 => 33.6612, std.dev.: 0.8185)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -7.61% (0.3247 => 0.3000, std.dev.: 0.0057)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -6.20% (0.1774 => 0.1664, std.dev.: 0.0021)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.02% (0.2540 => 0.2387, std.dev.: 0.0043)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.65% (0.6882 => 0.6493, std.dev.: 0.0116)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.48% (1.4277 => 1.3637, std.dev.: 0.0240)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.44% (1.3660 => 1.3190, std.dev.: 0.0182)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Bullet/bullet: -6.19% (7.4226 => 6.9635, std.dev.: 0.1341)
  MultiSource/Benchmarks/PAQ8p/paq8p: -3.41% (99.3511 => 95.9620, std.dev.: 0.8667)
  MultiSource/Applications/sqlite3/sqlite3: -2.25% (4.2978 => 4.2012, std.dev.: 0.0074)

Report Time: 0.78s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140102/c2b23dcf/attachment.html>


More information about the llvm-testresults mailing list