[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Dec 20 18:38:47 PST 2013


http://llvm.org/perf/db_default/v4/nts/18767?compare_to=18754&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18767, Order: 197846, Start Time: 2013-12-21 00:55:35, End Time: 2013-12-21 02:43:12
      To: 18754, Order: 197837, Start Time: 2013-12-20 22:44:06, End Time: 2013-12-21 00:30:06
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 34 (38 on baseline)
Performance Improvements: 3 (24 on baseline)
Unchanged Tests: 1073 (1048 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 72.00% (0.0200 => 0.0344, std.dev.: 0.0009)
  SingleSource/UnitTests/byval-alignment: 71.02% (0.0176 => 0.0301, std.dev.: 0.0021)
  SingleSource/Regression/C++/BuiltinTypeInfo: 67.18% (0.0195 => 0.0326, std.dev.: 0.0027)
  SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 66.82% (0.0422 => 0.0704, std.dev.: 0.0015)
  SingleSource/Regression/C++/short_circuit_dtor: 65.22% (0.0184 => 0.0304, std.dev.: 0.0025)
  SingleSource/Regression/C++/EH/function_try_block: 65.12% (0.0301 => 0.0497, std.dev.: 0.0021)
  SingleSource/Benchmarks/Misc/dt: 63.78% (0.0370 => 0.0606, std.dev.: 0.0014)
  SingleSource/Regression/C++/EH/ctor_dtor_count: 55.73% (0.0192 => 0.0299, std.dev.: 0.0041)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 30.86% (0.0823 => 0.1077, std.dev.: 0.0038)
  MultiSource/Applications/Burg/burg: 26.39% (1.4249 => 1.8009, std.dev.: 0.0765)
  SingleSource/Benchmarks/SmallPT/smallpt: 20.81% (0.1408 => 0.1701, std.dev.: 0.0106)
  MultiSource/Applications/JM/ldecod/ldecod: 8.68% (7.6227 => 8.2844, std.dev.: 0.1642)
  MultiSource/Applications/siod/siod: 6.85% (2.5908 => 2.7682, std.dev.: 0.0569)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 5.97% (5.4410 => 5.7656, std.dev.: 0.0992)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.04% (4.2727 => 4.4882, std.dev.: 0.0720)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.50% (2.7567 => 2.8808, std.dev.: 0.0334)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 2.64% (0.5191 => 0.5328, std.dev.: 0.0051)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: 2.52% (0.6317 => 0.6476, std.dev.: 0.0008)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: 26.63% (1.4647 => 1.8548, std.dev.: 0.1273)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.73% (2.1021 => 2.3696, std.dev.: 0.0109)
  SingleSource/Benchmarks/Stanford/Puzzle: 12.62% (0.1616 => 0.1820, std.dev.: 0.0016)
  MultiSource/Applications/SPASS/SPASS: 10.03% (8.4355 => 9.2812, std.dev.: 0.1997)
  SingleSource/Benchmarks/Misc/salsa20: 9.50% (7.5081 => 8.2210, std.dev.: 0.0362)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 5.98% (36.0451 => 38.2007, std.dev.: 0.7833)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 4.73% (40.2044 => 42.1069, std.dev.: 0.3308)
  SingleSource/Benchmarks/Misc/flops: 3.76% (9.2735 => 9.6218, std.dev.: 0.1059)
  SingleSource/Benchmarks/Shootout-C++/random: 3.34% (2.3910 => 2.4709, std.dev.: 0.0100)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.15% (4.8568 => 4.9612, std.dev.: 0.0395)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.94% (3.1539 => 3.2151, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 1.52% (6.5648 => 6.6646, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.28% (11.9716 => 12.1244, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.03% (3.5474 => 3.5838, std.dev.: 0.0112)
  SingleSource/Benchmarks/SmallPT/smallpt: 1.01% (16.8638 => 17.0345, std.dev.: 0.0293)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 1.00% (5.5624 => 5.6182, std.dev.: 0.0037)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Fhourstones/fhourstones: -30.05% (0.2619 => 0.1832, std.dev.: 0.0219)
  MultiSource/Benchmarks/NPB-serial/is/is: -26.01% (0.1019 => 0.0754, std.dev.: 0.0034)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: -19.90% (1.8560 => 1.4867, std.dev.: 0.1283)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C++/2008-01-29-ParamAliasesReturn: 68.63% (0.0204 => 0.0344, std.dev.: 0.0009)
  SingleSource/UnitTests/2005-05-11-Popcount-ffs-fls: 65.26% (0.0426 => 0.0704, std.dev.: 0.0015)
  SingleSource/Benchmarks/Misc/dt: 64.23% (0.0369 => 0.0606, std.dev.: 0.0014)
  SingleSource/Regression/C++/short_circuit_dtor: 60.85% (0.0189 => 0.0304, std.dev.: 0.0025)
  SingleSource/UnitTests/byval-alignment: 60.11% (0.0188 => 0.0301, std.dev.: 0.0021)
  SingleSource/Regression/C++/BuiltinTypeInfo: 58.25% (0.0206 => 0.0326, std.dev.: 0.0027)
  SingleSource/Regression/C++/EH/function_try_block: 56.78% (0.0317 => 0.0497, std.dev.: 0.0021)
  MultiSource/Applications/sqlite3/sqlite3: 44.64% (15.7419 => 22.7691, std.dev.: 0.8884)
  MultiSource/Benchmarks/McCat/17-bintr/bintr: 33.13% (0.0809 => 0.1077, std.dev.: 0.0038)
  MultiSource/Applications/Burg/burg: 26.25% (1.4265 => 1.8009, std.dev.: 0.0765)
  SingleSource/Benchmarks/SmallPT/smallpt: 20.30% (0.1414 => 0.1701, std.dev.: 0.0106)
  MultiSource/Applications/lemon/lemon: 9.28% (1.2200 => 1.3332, std.dev.: 0.0360)
  MultiSource/Applications/siod/siod: 8.60% (2.5491 => 2.7682, std.dev.: 0.0569)
  MultiSource/Applications/JM/ldecod/ldecod: 8.21% (7.6560 => 8.2844, std.dev.: 0.1642)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 6.62% (25.9661 => 27.6838, std.dev.: 0.4148)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 5.07% (4.2717 => 4.4882, std.dev.: 0.0720)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 4.48% (2.7572 => 2.8808, std.dev.: 0.0334)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.78% (0.5134 => 0.5328, std.dev.: 0.0051)
  SingleSource/Benchmarks/Adobe-C++/stepanov_abstraction: 3.35% (0.6322 => 0.6534, std.dev.: 0.0017)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: 26.04% (1.4716 => 1.8548, std.dev.: 0.1273)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 20.73% (5.9583 => 7.1933, std.dev.: 0.1522)
  MultiSource/Benchmarks/Fhourstones-3_1/fhourstones3_1: 17.19% (1.2278 => 1.4389, std.dev.: 0.0789)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.73% (2.1020 => 2.3696, std.dev.: 0.0109)
  SingleSource/Benchmarks/Stanford/Puzzle: 9.11% (0.1668 => 0.1820, std.dev.: 0.0016)
  MultiSource/Applications/SPASS/SPASS: 8.73% (8.5363 => 9.2812, std.dev.: 0.1997)
  SingleSource/Benchmarks/Misc/salsa20: 8.25% (7.5947 => 8.2210, std.dev.: 0.0362)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/symm/symm: 6.21% (35.9684 => 38.2007, std.dev.: 0.7833)
  MultiSource/Applications/lua/lua: 5.08% (29.1357 => 30.6151, std.dev.: 0.4700)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/2mm/2mm: 3.83% (40.5530 => 42.1069, std.dev.: 0.3308)
  SingleSource/Benchmarks/Misc/flops: 3.83% (9.2673 => 9.6218, std.dev.: 0.1059)
  MultiSource/Applications/SIBsim4/SIBsim4: 3.12% (3.4043 => 3.5106, std.dev.: 0.0303)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.84% (11.7894 => 12.1244, std.dev.: 0.0091)
  SingleSource/Benchmarks/Polybench/stencils/adi/adi: 2.84% (4.8243 => 4.9612, std.dev.: 0.0395)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.09% (5.5032 => 5.6182, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.08% (6.5291 => 6.6646, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.91% (3.1547 => 3.2151, std.dev.: 0.0036)
  SingleSource/Benchmarks/Misc/oourafft: 1.74% (3.6501 => 3.7135, std.dev.: 0.0202)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.09% (3.5451 => 3.5838, std.dev.: 0.0112)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -12.33% (0.1938 => 0.1699, std.dev.: 0.0021)
  MultiSource/Benchmarks/Bullet/bullet: -8.72% (36.6274 => 33.4348, std.dev.: 0.8479)
  MultiSource/Benchmarks/Trimaran/enc-md5/enc-md5: -7.61% (0.1774 => 0.1639, std.dev.: 0.0037)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.11% (0.3402 => 0.3160, std.dev.: 0.0064)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.77% (1.3819 => 1.2884, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.27% (1.3676 => 1.2818, std.dev.: 0.0091)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -6.18% (2.0207 => 1.8959, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -6.17% (1.4113 => 1.3242, std.dev.: 0.0132)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -5.90% (0.6882 => 0.6476, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.49% (1.3127 => 1.2406, std.dev.: 0.0212)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -5.31% (1.3157 => 1.2459, std.dev.: 0.0133)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -4.99% (1.4277 => 1.3564, std.dev.: 0.0065)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.73% (1.3505 => 1.2866, std.dev.: 0.0046)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -4.04% (1.3702 => 1.3148, std.dev.: 0.0136)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -4.02% (1.2824 => 1.2308, std.dev.: 0.0090)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -3.99% (1.2914 => 1.2399, std.dev.: 0.0091)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.89% (1.4125 => 1.3575, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.29% (1.3264 => 1.2828, std.dev.: 0.0131)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.14% (1.1409 => 1.1051, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.05% (1.3918 => 1.3493, std.dev.: 0.0134)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -3.02% (1.3024 => 1.2631, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.31% (1.2670 => 1.2377, std.dev.: 0.0113)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: -4.10% (5.9456 => 5.7021, std.dev.: 0.0944)
  SingleSource/Benchmarks/Shootout-C++/hash2: -2.34% (3.6605 => 3.5750, std.dev.: 0.0273)

Report Time: 1.10s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131220/71470a36/attachment.html>


More information about the llvm-testresults mailing list