[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Fri Jan 3 09:08:44 PST 2014


http://llvm.org/perf/db_default/v4/nts/19622?compare_to=19612&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 19622, Order: 198419, Start Time: 2014-01-03 15:27:39, End Time: 2014-01-03 17:13:23
      To: 19612, Order: 198407, Start Time: 2014-01-03 13:15:39, End Time: 2014-01-03 15:01:40
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 45 (61 on baseline)
Performance Improvements: 8 (16 on baseline)
Unchanged Tests: 1057 (1033 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 89.92% (0.0129 => 0.0245, std.dev.: 0.0004)
  SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: 81.63% (0.0147 => 0.0267, std.dev.: 0.0017)
  SingleSource/UnitTests/2003-10-29-ScalarReplBug: 80.65% (0.0155 => 0.0280, std.dev.: 0.0011)
  SingleSource/UnitTests/2008-04-18-LoopBug: 79.35% (0.0155 => 0.0278, std.dev.: 0.0018)
  SingleSource/UnitTests/2008-04-20-LoopBug2: 78.18% (0.0165 => 0.0294, std.dev.: 0.0002)
  SingleSource/UnitTests/vla: 76.70% (0.0442 => 0.0781, std.dev.: 0.0019)
  SingleSource/UnitTests/2003-05-02-DependentPHI: 75.61% (0.0164 => 0.0288, std.dev.: 0.0011)
  SingleSource/UnitTests/2003-08-11-VaListArg: 74.40% (0.0293 => 0.0511, std.dev.: 0.0006)
  SingleSource/UnitTests/SignlessTypes/cast2: 73.99% (0.0173 => 0.0301, std.dev.: 0.0020)
  SingleSource/UnitTests/initp1: 72.41% (0.0493 => 0.0850, std.dev.: 0.0048)
  SingleSource/UnitTests/2003-05-07-VarArgs: 69.77% (0.0258 => 0.0438, std.dev.: 0.0024)
  SingleSource/UnitTests/Vector/sumarray-dbl: 69.34% (0.0212 => 0.0359, std.dev.: 0.0022)
  SingleSource/UnitTests/2002-10-12-StructureArgs: 65.50% (0.0171 => 0.0283, std.dev.: 0.0006)
  SingleSource/UnitTests/2002-05-02-ManyArguments: 65.22% (0.0184 => 0.0304, std.dev.: 0.0004)
  SingleSource/Regression/C++/fixups: 61.98% (0.0242 => 0.0392, std.dev.: 0.0018)
  SingleSource/Regression/C/DuffsDevice: 55.56% (0.0297 => 0.0462, std.dev.: 0.0038)
  SingleSource/UnitTests/Threads/tls: 53.50% (0.0243 => 0.0373, std.dev.: 0.0012)
  SingleSource/UnitTests/SignlessTypes/div: 50.29% (0.0340 => 0.0511, std.dev.: 0.0044)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.76% (1.9809 => 2.1941, std.dev.: 0.0347)
  SingleSource/Benchmarks/McGill/chomp: 4.82% (0.2156 => 0.2260, std.dev.: 0.0005)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 3.00% (0.5108 => 0.5261, std.dev.: 0.0056)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.01% (2.7646 => 2.7925, std.dev.: 0.0104)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/UnitTests/SignlessTypes/Large/cast: 155.38% (0.0065 => 0.0166, std.dev.: 0.0002)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: 36.14% (0.1447 => 0.1970, std.dev.: 0.0161)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 22.01% (4.8083 => 5.8665, std.dev.: 0.0677)
  SingleSource/Benchmarks/Shootout/ary3: 18.41% (4.4831 => 5.3083, std.dev.: 0.2897)
  SingleSource/Benchmarks/Shootout-C++/ary3: 13.73% (4.7515 => 5.4038, std.dev.: 0.2020)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.70% (2.1043 => 2.3716, std.dev.: 0.0164)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 11.15% (28.7351 => 31.9387, std.dev.: 0.8527)
  MultiSource/Benchmarks/BitBench/drop3/drop3: 6.38% (0.4906 => 0.5219, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.38% (3.4980 => 3.7211, std.dev.: 0.0022)
  SingleSource/Benchmarks/Stanford/FloatMM: 5.42% (0.6885 => 0.7258, std.dev.: 0.0020)
  MultiSource/Benchmarks/Prolangs-C++/primes/primes: 4.44% (0.8430 => 0.8804, std.dev.: 0.0131)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.00% (97.4308 => 101.3284, std.dev.: 0.6912)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.75% (5.7799 => 5.9965, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.75% (5.0590 => 5.2485, std.dev.: 0.0014)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 2.91% (2.3700 => 2.4389, std.dev.: 0.0214)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 2.54% (4.0789 => 4.1824, std.dev.: 0.0056)
  MultiSource/Applications/hexxagon/hexxagon: 2.47% (15.1896 => 15.5645, std.dev.: 0.0184)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.06% (0.5148 => 0.5254, std.dev.: 0.0039)
  SingleSource/Benchmarks/Shootout/hash: 2.00% (5.0668 => 5.1683, std.dev.: 0.0280)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.90% (2.4888 => 2.5360, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.85% (11.9268 => 12.1474, std.dev.: 0.0044)
  MultiSource/Applications/sqlite3/sqlite3: 1.43% (4.2863 => 4.3476, std.dev.: 0.0155)
  MultiSource/Applications/lambda-0_1_3/lambda: 1.17% (7.8934 => 7.9860, std.dev.: 0.0065)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -3.66% (1.3893 => 1.3385, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -3.61% (1.2733 => 1.2273, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -1.66% (1.2375 => 1.2169, std.dev.: 0.0052)
  MultiSource/Applications/hexxagon/hexxagon: -1.30% (1.0605 => 1.0467, std.dev.: 0.0045)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.73% (6.1940 => 5.9009, std.dev.: 0.0056)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: -2.51% (3.7605 => 3.6660, std.dev.: 0.0221)
  SingleSource/Benchmarks/CoyoteBench/huffbench: -1.79% (23.8175 => 23.3921, std.dev.: 0.0038)
  SingleSource/Benchmarks/Shootout-C++/lists: -1.40% (15.8378 => 15.6154, std.dev.: 0.0857)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/UnitTests/2008-04-20-LoopBug2: 92.16% (0.0153 => 0.0294, std.dev.: 0.0002)
  SingleSource/UnitTests/2003-10-29-ScalarReplBug: 78.34% (0.0157 => 0.0280, std.dev.: 0.0011)
  SingleSource/Regression/C/2003-10-12-GlobalVarInitializers: 78.00% (0.0150 => 0.0267, std.dev.: 0.0017)
  SingleSource/UnitTests/2008-04-18-LoopBug: 77.07% (0.0157 => 0.0278, std.dev.: 0.0018)
  SingleSource/UnitTests/2003-05-02-DependentPHI: 75.61% (0.0164 => 0.0288, std.dev.: 0.0011)
  SingleSource/UnitTests/2003-08-11-VaListArg: 73.22% (0.0295 => 0.0511, std.dev.: 0.0006)
  SingleSource/UnitTests/2006-12-04-DynAllocAndRestore: 72.54% (0.0142 => 0.0245, std.dev.: 0.0004)
  SingleSource/UnitTests/initp1: 71.03% (0.0497 => 0.0850, std.dev.: 0.0048)
  SingleSource/UnitTests/SignlessTypes/cast2: 70.06% (0.0177 => 0.0301, std.dev.: 0.0020)
  SingleSource/Regression/C/DuffsDevice: 69.23% (0.0273 => 0.0462, std.dev.: 0.0038)
  SingleSource/UnitTests/2003-05-07-VarArgs: 69.11% (0.0259 => 0.0438, std.dev.: 0.0024)
  SingleSource/UnitTests/Vector/sumarray-dbl: 68.54% (0.0213 => 0.0359, std.dev.: 0.0022)
  SingleSource/UnitTests/vla: 67.96% (0.0465 => 0.0781, std.dev.: 0.0019)
  SingleSource/UnitTests/Threads/2010-12-08-tls: 66.88% (0.0154 => 0.0257, std.dev.: 0.0012)
  SingleSource/UnitTests/2002-05-02-ManyArguments: 66.12% (0.0183 => 0.0304, std.dev.: 0.0004)
  SingleSource/UnitTests/Threads/tls: 59.40% (0.0234 => 0.0373, std.dev.: 0.0012)
  SingleSource/UnitTests/2002-10-12-StructureArgs: 56.35% (0.0181 => 0.0283, std.dev.: 0.0006)
  SingleSource/Regression/C++/fixups: 53.12% (0.0256 => 0.0392, std.dev.: 0.0018)
  SingleSource/UnitTests/SignlessTypes/div: 49.42% (0.0342 => 0.0511, std.dev.: 0.0044)
  MultiSource/Applications/sqlite3/sqlite3: 41.71% (15.7419 => 22.3072, std.dev.: 0.2257)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 27.13% (0.3859 => 0.4906, std.dev.: 0.0134)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 10.62% (1.9834 => 2.1941, std.dev.: 0.0347)
  MultiSource/Applications/lemon/lemon: 10.56% (1.2200 => 1.3488, std.dev.: 0.0073)
  MultiSource/Benchmarks/Prolangs-C/football/football: 2.95% (0.9915 => 1.0207, std.dev.: 0.0056)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 2.13% (1.0830 => 1.1061, std.dev.: 0.0076)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 1.28% (2.7572 => 2.7925, std.dev.: 0.0104)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/UnitTests/SignlessTypes/Large/cast: 186.21% (0.0058 => 0.0166, std.dev.: 0.0002)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 28.18% (4.5769 => 5.8665, std.dev.: 0.0677)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 17.32% (5.9583 => 6.9901, std.dev.: 0.1079)
  SingleSource/Benchmarks/Shootout-C++/ary3: 15.47% (4.6797 => 5.4038, std.dev.: 0.2020)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 12.83% (2.1020 => 2.3716, std.dev.: 0.0164)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 12.12% (82.2592 => 92.2326, std.dev.: 0.0867)
  SingleSource/UnitTests/Vector/Altivec/alti_expandfft: 11.43% (28.6638 => 31.9387, std.dev.: 0.8527)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 8.43% (3.3810 => 3.6660, std.dev.: 0.0221)
  MultiSource/Benchmarks/Olden/treeadd/treeadd: 7.64% (0.3534 => 0.3804, std.dev.: 0.0082)
  MultiSource/Benchmarks/Ptrdist/bc/bc: 7.36% (1.1019 => 1.1830, std.dev.: 0.0100)
  SingleSource/Benchmarks/McGill/chomp: 7.26% (1.0099 => 1.0832, std.dev.: 0.0152)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.24% (3.5027 => 3.7211, std.dev.: 0.0022)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.60% (0.6939 => 0.7258, std.dev.: 0.0020)
  MultiSource/Applications/siod/siod: 4.52% (3.4258 => 3.5808, std.dev.: 0.0265)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 4.43% (2.3355 => 2.4389, std.dev.: 0.0214)
  MultiSource/Applications/hexxagon/hexxagon: 3.77% (14.9989 => 15.5645, std.dev.: 0.0184)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.72% (5.0601 => 5.2485, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.47% (5.7952 => 5.9965, std.dev.: 0.0026)
  MultiSource/Applications/sgefa/sgefa: 3.13% (0.8745 => 0.9019, std.dev.: 0.0046)
  SingleSource/Benchmarks/Misc/himenobmtxpa: 3.03% (4.0593 => 4.1824, std.dev.: 0.0056)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.98% (4.1840 => 4.3088, std.dev.: 0.0390)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 2.78% (0.5112 => 0.5254, std.dev.: 0.0039)
  SingleSource/Benchmarks/McGill/misr: 2.66% (0.4029 => 0.4136, std.dev.: 0.0012)
  MultiSource/Applications/SIBsim4/SIBsim4: 2.58% (3.4043 => 3.4921, std.dev.: 0.0330)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 2.16% (11.8902 => 12.1474, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.10% (3.1547 => 3.2210, std.dev.: 0.0010)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.99% (99.3511 => 101.3284, std.dev.: 0.6912)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.93% (5.8933 => 6.0073, std.dev.: 0.0101)
  SingleSource/Benchmarks/Adobe-C++/loop_unroll: 1.87% (2.4894 => 2.5360, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.87% (11.7894 => 12.0099, std.dev.: 0.0378)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.76% (3.1455 => 3.2010, std.dev.: 0.0085)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.47% (2.5025 => 2.5393, std.dev.: 0.0063)
  MultiSource/Applications/sqlite3/sqlite3: 1.16% (4.2978 => 4.3476, std.dev.: 0.0155)
  SingleSource/Benchmarks/Misc/ffbench: 1.13% (1.4103 => 1.4263, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.11% (4.9365 => 4.9914, std.dev.: 0.0005)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -26.45% (0.0688 => 0.0506, std.dev.: 0.0014)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -8.19% (0.3247 => 0.2981, std.dev.: 0.0021)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: -6.97% (0.2540 => 0.2363, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.47% (1.3819 => 1.2925, std.dev.: 0.0155)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -6.25% (1.4277 => 1.3385, std.dev.: 0.0125)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -5.94% (1.3676 => 1.2864, std.dev.: 0.0186)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.52% (1.3505 => 1.2895, std.dev.: 0.0215)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.45% (1.4113 => 1.3485, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.97% (1.2824 => 1.2315, std.dev.: 0.0114)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.76% (1.1409 => 1.0980, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.69% (1.3157 => 1.2671, std.dev.: 0.0054)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.48% (1.4125 => 1.3633, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -2.99% (1.2544 => 1.2169, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.46% (1.2583 => 1.2273, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.36% (1.3702 => 1.3378, std.dev.: 0.0024)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -17.36% (15.5356 => 12.8385, std.dev.: 0.2192)

Report Time: 0.79s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20140103/471513ec/attachment.html>


More information about the llvm-testresults mailing list