[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Mon Dec 23 10:40:18 PST 2013


http://llvm.org/perf/db_default/v4/nts/18889?compare_to=18881&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18889, Order: 197911, Start Time: 2013-12-23 17:00:11, End Time: 2013-12-23 18:44:46
      To: 18881, Order: 197907, Start Time: 2013-12-23 14:49:51, End Time: 2013-12-23 16:36:23
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 34 (39 on baseline)
Performance Improvements: 6 (51 on baseline)
Unchanged Tests: 1070 (1020 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/PR1386: 76.16% (0.0151 => 0.0266, std.dev.: 0.0018)
  SingleSource/Regression/C/test_indvars: 64.63% (0.0294 => 0.0484, std.dev.: 0.0038)
  SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 61.78% (0.0191 => 0.0309, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/flops-8: 60.50% (0.0319 => 0.0512, std.dev.: 0.0036)
  SingleSource/Regression/C/PR10189: 46.62% (0.0266 => 0.0390, std.dev.: 0.0023)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 6.05% (5.5560 => 5.8919, std.dev.: 0.0842)
  MultiSource/Applications/kimwitu++/kc: 5.44% (18.5129 => 19.5194, std.dev.: 0.2375)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 1.37% (1.3408 => 1.3592, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: 1.34% (1.2225 => 1.2389, std.dev.: 0.0021)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 1.30% (1.8841 => 1.9086, std.dev.: 0.0018)
  MultiSource/Benchmarks/mafft/pairlocalalign: 1.13% (10.0988 => 10.2129, std.dev.: 0.0387)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 1.11% (1.2933 => 1.3076, std.dev.: 0.0021)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: 39.28% (1.5292 => 2.1298, std.dev.: 0.0345)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 27.60% (3.7932 => 4.8400, std.dev.: 0.0237)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 25.01% (4.5722 => 5.7156, std.dev.: 0.2598)
  MultiSource/Benchmarks/BitBench/uudecode/uudecode: 13.13% (0.0914 => 0.1034, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout/ary3: 8.77% (4.5870 => 4.9895, std.dev.: 0.1441)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.41% (3.5916 => 3.8577, std.dev.: 0.0088)
  MultiSource/Applications/obsequi/Obsequi: 7.03% (2.1978 => 2.3522, std.dev.: 0.0580)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.80% (3.4826 => 3.7195, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.65% (5.5690 => 5.9394, std.dev.: 0.0012)
  MultiSource/Benchmarks/BitBench/five11/five11: 4.25% (5.4173 => 5.6477, std.dev.: 0.0671)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.64% (5.7856 => 5.9962, std.dev.: 0.0002)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.64% (0.5083 => 0.5268, std.dev.: 0.0004)
  MultiSource/Benchmarks/mafft/pairlocalalign: 2.47% (50.1923 => 51.4298, std.dev.: 0.3109)
  SingleSource/Benchmarks/Misc/fp-convert: 2.41% (7.3779 => 7.5560, std.dev.: 0.0369)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 2.31% (5.3068 => 5.4296, std.dev.: 0.0035)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.95% (3.1504 => 3.2117, std.dev.: 0.0042)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.61% (11.9304 => 12.1223, std.dev.: 0.0136)
  MultiSource/Benchmarks/MallocBench/cfrac/cfrac: 1.57% (2.4869 => 2.5260, std.dev.: 0.0013)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: 1.53% (3.8111 => 3.8694, std.dev.: 0.0008)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.28% (3.1492 => 3.1894, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 1.27% (11.9897 => 12.1418, std.dev.: 0.0166)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.04% (3.5436 => 3.5806, std.dev.: 0.0023)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/UnitTests/Vector/Altivec/casts: -19.06% (0.1490 => 0.1206, std.dev.: 0.0015)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-apml/fdtd-apml: -15.09% (0.1498 => 0.1272, std.dev.: 0.0050)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.17% (1.2596 => 1.2449, std.dev.: 0.0012)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/Shootout/sieve: -13.05% (7.7614 => 6.7483, std.dev.: 0.0924)
  SingleSource/Benchmarks/Shootout/fib2: -1.45% (3.6457 => 3.5928, std.dev.: 0.0085)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -1.17% (4.0080 => 3.9611, std.dev.: 0.0080)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Regression/C/test_indvars: 72.86% (0.0280 => 0.0484, std.dev.: 0.0038)
  SingleSource/Regression/C/PR1386: 72.73% (0.0154 => 0.0266, std.dev.: 0.0018)
  SingleSource/Regression/C/2004-08-12-InlinerAndAllocas: 71.67% (0.0180 => 0.0309, std.dev.: 0.0010)
  SingleSource/Benchmarks/Misc/flops-8: 60.50% (0.0319 => 0.0512, std.dev.: 0.0036)
  SingleSource/Regression/C/PR10189: 50.00% (0.0260 => 0.0390, std.dev.: 0.0023)
  SingleSource/Regression/C/PR640: 46.35% (0.0233 => 0.0341, std.dev.: 0.0037)
  MultiSource/Applications/sqlite3/sqlite3: 40.16% (15.7419 => 22.0637, std.dev.: 1.0330)
  MultiSource/Benchmarks/Prolangs-C/compiler/compiler: 27.62% (0.3859 => 0.4925, std.dev.: 0.0032)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 13.15% (0.1080 => 0.1222, std.dev.: 0.0003)
  MultiSource/Applications/lemon/lemon: 8.92% (1.2200 => 1.3288, std.dev.: 0.0417)
  SingleSource/UnitTests/Vector/constpool: 6.34% (9.2178 => 9.8023, std.dev.: 0.2139)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.82% (25.9661 => 27.4764, std.dev.: 0.0377)
  MultiSource/Applications/kimwitu++/kc: 4.46% (18.6861 => 19.5194, std.dev.: 0.2375)
  MultiSource/Benchmarks/Prolangs-C/football/football: 1.71% (0.9915 => 1.0085, std.dev.: 0.0019)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/CoyoteBench/fftbench: 44.73% (1.4716 => 2.1298, std.dev.: 0.0345)
  SingleSource/Benchmarks/Misc-C++/stepanov_container: 24.88% (4.5769 => 5.7156, std.dev.: 0.2598)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 19.31% (4.0567 => 4.8400, std.dev.: 0.0237)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 16.92% (5.9583 => 6.9665, std.dev.: 0.0645)
  SingleSource/Benchmarks/Shootout-C++/ary3: 13.24% (4.6797 => 5.2995, std.dev.: 0.2052)
  SingleSource/Benchmarks/Shootout/ary3: 8.52% (4.5977 => 4.9895, std.dev.: 0.1441)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 8.31% (3.1585 => 3.4209, std.dev.: 0.0582)
  SingleSource/Benchmarks/Misc-C++/Large/sphereflake: 7.86% (3.3810 => 3.6468, std.dev.: 0.0345)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 7.84% (3.5771 => 3.8577, std.dev.: 0.0088)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.19% (3.5027 => 3.7195, std.dev.: 0.0014)
  MultiSource/Applications/siod/siod: 5.47% (3.4258 => 3.6132, std.dev.: 0.0307)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.47% (5.7952 => 5.9962, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 3.45% (5.2486 => 5.4296, std.dev.: 0.0035)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.05% (0.5112 => 0.5268, std.dev.: 0.0004)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.99% (11.7894 => 12.1418, std.dev.: 0.0166)
  SingleSource/Benchmarks/Misc/fp-convert: 2.26% (7.3892 => 7.5560, std.dev.: 0.0369)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.13% (5.5032 => 5.6203, std.dev.: 0.0015)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.01% (6.5291 => 6.6602, std.dev.: 0.0242)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.95% (11.8902 => 12.1223, std.dev.: 0.0136)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 1.81% (3.1547 => 3.2117, std.dev.: 0.0042)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.76% (2.5025 => 2.5465, std.dev.: 0.0106)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 1.47% (5.8933 => 5.9799, std.dev.: 0.0137)
  SingleSource/Benchmarks/Adobe-C++/simple_types_loop_invariant: 1.40% (3.1455 => 3.1894, std.dev.: 0.0036)
  MultiSource/Benchmarks/VersaBench/ecbdes/ecbdes: 1.16% (2.3882 => 2.4159, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.00% (3.5451 => 3.5806, std.dev.: 0.0023)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/BitBench/drop3/drop3: -27.76% (0.0688 => 0.0497, std.dev.: 0.0010)
  MultiSource/Benchmarks/MiBench/office-stringsearch/office-stringsearch: -16.00% (0.1938 => 0.1628, std.dev.: 0.0011)
  MultiSource/Benchmarks/Bullet/bullet: -9.66% (36.6274 => 33.0898, std.dev.: 0.0389)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -9.42% (0.3247 => 0.2941, std.dev.: 0.0049)
  MultiSource/Benchmarks/MiBench/security-blowfish/security-blowfish: -7.05% (0.3402 => 0.3162, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -6.57% (0.6882 => 0.6430, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.16% (1.3676 => 1.2834, std.dev.: 0.0047)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -5.83% (1.4113 => 1.3290, std.dev.: 0.0070)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -5.80% (0.2810 => 0.2647, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -5.64% (1.3505 => 1.2743, std.dev.: 0.0065)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: -5.55% (2.0207 => 1.9086, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -5.52% (1.3146 => 1.2420, std.dev.: 0.0063)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.02% (1.4277 => 1.3560, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -4.94% (1.3819 => 1.3137, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -4.55% (1.5305 => 1.4608, std.dev.: 0.0051)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -4.28% (1.3660 => 1.3076, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -4.10% (1.3127 => 1.2589, std.dev.: 0.0060)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -4.05% (1.2914 => 1.2391, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.98% (1.2824 => 1.2313, std.dev.: 0.0007)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -3.94% (1.1409 => 1.0960, std.dev.: 0.0077)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.86% (1.3157 => 1.2649, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.77% (1.4125 => 1.3592, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.73% (1.3702 => 1.3191, std.dev.: 0.0083)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -3.66% (1.3918 => 1.3409, std.dev.: 0.0045)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -3.54% (1.2724 => 1.2273, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -3.34% (1.3510 => 1.3059, std.dev.: 0.0107)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.29% (1.3264 => 1.2828, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -3.16% (1.3460 => 1.3034, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.12% (1.2544 => 1.2152, std.dev.: 0.0009)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -3.10% (1.2785 => 1.2389, std.dev.: 0.0021)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -2.96% (1.4074 => 1.3658, std.dev.: 0.0066)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -2.83% (1.3551 => 1.3167, std.dev.: 0.0058)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -2.73% (1.3024 => 1.2668, std.dev.: 0.0002)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.58% (7.5124 => 7.3188, std.dev.: 0.0319)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.53% (1.2583 => 1.2265, std.dev.: 0.0024)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.43% (1.3182 => 1.2862, std.dev.: 0.0013)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -2.22% (1.2952 => 1.2664, std.dev.: 0.0036)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -2.16% (1.3457 => 1.3167, std.dev.: 0.0018)
  MultiSource/Benchmarks/MiBench/consumer-lame/consumer-lame: -2.15% (4.7807 => 4.6779, std.dev.: 0.0206)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.07% (1.3608 => 1.3326, std.dev.: 0.0032)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -1.96% (0.5879 => 0.5764, std.dev.: 0.0026)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -1.74% (1.2670 => 1.2449, std.dev.: 0.0012)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.61% (1.3068 => 1.2857, std.dev.: 0.0013)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -6.77% (2.5559 => 2.3829, std.dev.: 0.0643)
  MultiSource/Benchmarks/Bullet/bullet: -5.85% (7.4226 => 6.9885, std.dev.: 0.0108)
  MultiSource/Benchmarks/7zip/7zip-benchmark: -4.98% (10.0217 => 9.5222, std.dev.: 0.1044)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syr2k/syr2k: -2.77% (6.0535 => 5.8858, std.dev.: 0.0256)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.40% (40.4190 => 39.4479, std.dev.: 0.2324)
  MultiSource/Applications/sqlite3/sqlite3: -2.15% (4.2978 => 4.2052, std.dev.: 0.0038)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.16% (4.1462 => 4.0979, std.dev.: 0.0016)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/syrk/syrk: -1.00% (4.0012 => 3.9611, std.dev.: 0.0080)

Report Time: 0.70s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131223/61bcad23/attachment.html>


More information about the llvm-testresults mailing list