[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Sat Dec 21 11:01:14 PST 2013


http://llvm.org/perf/db_default/v4/nts/18789?compare_to=18781&baseline=17660
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:21

Comparing:
     Run: 18789, Order: 197864, Start Time: 2013-12-21 17:23:27, End Time: 2013-12-21 19:05:40
      To: 18781, Order: 197856, Start Time: 2013-12-21 05:54:06, End Time: 2013-12-21 07:34:19
Baseline: 17660, Order: 195884, Start Time: 2013-11-27 22:43:57, End Time: 2013-11-28 00:31:03

===============
Tests Summary
===============

Performance Regressions: 17 (32 on baseline)
Performance Improvements: 3 (52 on baseline)
Unchanged Tests: 1090 (1026 on baseline)
Total Tests: 1110

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: 1.69% (1.3089 => 1.3310, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.59% (1.2233 => 1.2427, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 1.57% (1.2640 => 1.2839, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 1.50% (1.2647 => 1.2837, std.dev.: 0.0030)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/matrix: 15.71% (1.8161 => 2.1015, std.dev.: 0.0052)
  SingleSource/Benchmarks/Shootout/sieve: 8.45% (7.5020 => 8.1361, std.dev.: 0.0007)
  MultiSource/Applications/oggenc/oggenc: 6.38% (0.1582 => 0.1683, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 6.34% (3.3199 => 3.5305, std.dev.: 0.0099)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemm/gemm: 5.10% (20.3990 => 21.4393, std.dev.: 0.2729)
  MultiSource/Benchmarks/FreeBench/neural/neural: 4.45% (0.4225 => 0.4413, std.dev.: 0.0008)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: 3.96% (2.3916 => 2.4862, std.dev.: 0.0165)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.81% (1.8420 => 1.8937, std.dev.: 0.0030)
  SingleSource/Benchmarks/Shootout/lists: 2.39% (7.3114 => 7.4858, std.dev.: 0.0169)
  SingleSource/Benchmarks/Shootout-C++/hash2: 2.32% (3.5828 => 3.6661, std.dev.: 0.0015)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 2.31% (18.5384 => 18.9665, std.dev.: 0.0163)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.12% (5.5013 => 5.6178, std.dev.: 0.0027)
  SingleSource/Benchmarks/Misc/flops-6: 1.22% (2.3947 => 2.4240, std.dev.: 0.0014)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/Ptrdist/ks/ks: -9.05% (1.5077 => 1.3713, std.dev.: 0.0301)
  MultiSource/Applications/JM/lencod/lencod: -6.99% (8.5489 => 7.9517, std.dev.: 0.0875)
  MultiSource/Applications/hexxagon/hexxagon: -1.56% (15.1955 => 14.9591, std.dev.: 0.0385)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Applications/sqlite3/sqlite3: 40.54% (15.7419 => 22.1230, std.dev.: 1.0031)
  MultiSource/Applications/lemon/lemon: 9.66% (1.2200 => 1.3379, std.dev.: 0.0378)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 5.67% (25.9661 => 27.4391, std.dev.: 0.0642)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.26% (1.2845 => 1.3007, std.dev.: 0.0014)
  MultiSource/Benchmarks/Prolangs-C/unix-tbl/unix-tbl: 1.15% (1.0830 => 1.0955, std.dev.: 0.0033)
  MultiSource/Benchmarks/PAQ8p/paq8p: 1.10% (2.5384 => 2.5662, std.dev.: 0.0027)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/sieve: 20.62% (6.7454 => 8.1361, std.dev.: 0.0007)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: 17.24% (5.9583 => 6.9858, std.dev.: 0.1186)
  SingleSource/Benchmarks/Shootout/matrix: 17.01% (1.7960 => 2.1015, std.dev.: 0.0052)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: 11.78% (3.1585 => 3.5305, std.dev.: 0.0099)
  SingleSource/Benchmarks/Shootout/lists: 7.05% (6.9930 => 7.4858, std.dev.: 0.0169)
  SingleSource/Benchmarks/Stanford/Puzzle: 6.47% (0.1668 => 0.1776, std.dev.: 0.0037)
  MultiSource/Applications/aha/aha: 5.81% (3.5645 => 3.7716, std.dev.: 0.0210)
  MultiSource/Applications/siod/siod: 4.86% (3.4258 => 3.5924, std.dev.: 0.0123)
  SingleSource/Benchmarks/Stanford/FloatMM: 4.77% (0.6939 => 0.7270, std.dev.: 0.0099)
  MultiSource/Benchmarks/FreeBench/neural/neural: 4.57% (0.4220 => 0.4413, std.dev.: 0.0008)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: 3.65% (5.0601 => 5.2446, std.dev.: 0.0034)
  SingleSource/Benchmarks/Misc/fp-convert: 3.61% (7.3892 => 7.6563, std.dev.: 0.0897)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 3.53% (5.7952 => 5.9997, std.dev.: 0.0107)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 3.01% (0.5112 => 0.5266, std.dev.: 0.0005)
  MultiSource/Benchmarks/Trimaran/enc-rc4/enc-rc4: 2.87% (1.8409 => 1.8937, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 2.51% (6.5291 => 6.6930, std.dev.: 0.0058)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 2.49% (1.5986 => 1.6384, std.dev.: 0.0057)
  SingleSource/Benchmarks/Polybench/stencils/jacobi-2d-imper/jacobi-2d-imper: 2.32% (1.5797 => 1.6164, std.dev.: 0.0078)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 2.32% (11.7894 => 12.0629, std.dev.: 0.0240)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 2.11% (5.9126 => 6.0373, std.dev.: 0.0374)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: 2.08% (5.5032 => 5.6178, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: 2.06% (3.1547 => 3.2196, std.dev.: 0.0005)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trmm/trmm: 2.00% (2.8940 => 2.9520, std.dev.: 0.0034)
  SingleSource/UnitTests/Vectorizer/gcc-loops: 1.87% (18.6185 => 18.9665, std.dev.: 0.0163)
  MultiSource/Benchmarks/Prolangs-C++/life/life: 1.74% (2.5025 => 2.5461, std.dev.: 0.0023)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.11% (4.9365 => 4.9913, std.dev.: 0.0016)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Bullet/bullet: -9.63% (36.6274 => 33.1012, std.dev.: 0.1764)
  MultiSource/Benchmarks/MiBench/telecomm-FFT/telecomm-fft: -8.27% (0.1523 => 0.1397, std.dev.: 0.0048)
  MultiSource/Benchmarks/MiBench/automotive-bitcount/automotive-bitcount: -8.04% (0.2810 => 0.2584, std.dev.: 0.0046)
  MultiSource/Benchmarks/Prolangs-C++/shapes/shapes: -7.91% (0.3247 => 0.2990, std.dev.: 0.0006)
  MultiSource/Benchmarks/MiBench/security-rijndael/security-rijndael: -7.08% (0.6882 => 0.6395, std.dev.: 0.0181)
  MultiSource/Benchmarks/MiBench/automotive-basicmath/automotive-basicmath: -6.34% (0.1673 => 0.1567, std.dev.: 0.0040)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: -6.13% (1.3676 => 1.2837, std.dev.: 0.0030)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: -6.09% (1.3819 => 1.2977, std.dev.: 0.0077)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: -5.95% (0.2824 => 0.2656, std.dev.: 0.0050)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: -5.82% (0.2252 => 0.2121, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: -5.26% (1.3127 => 1.2437, std.dev.: 0.0086)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: -5.11% (1.4277 => 1.3547, std.dev.: 0.0101)
  MultiSource/Benchmarks/MiBench/automotive-susan/automotive-susan: -4.88% (1.1409 => 1.0852, std.dev.: 0.0103)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: -4.82% (1.3146 => 1.2512, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -4.64% (1.2724 => 1.2134, std.dev.: 0.0083)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -4.63% (1.3505 => 1.2880, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/ControlLoops-flt/ControlLoops-flt: -4.62% (1.4113 => 1.3461, std.dev.: 0.0097)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -4.15% (1.2583 => 1.2061, std.dev.: 0.0104)
  MultiSource/Benchmarks/TSVC/Recurrences-flt/Recurrences-flt: -4.09% (1.2785 => 1.2262, std.dev.: 0.0089)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: -3.91% (1.2824 => 1.2322, std.dev.: 0.0005)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -3.90% (1.2914 => 1.2410, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -3.87% (1.5305 => 1.4713, std.dev.: 0.0025)
  MultiSource/Benchmarks/MiBench/consumer-typeset/consumer-typeset: -3.84% (15.4053 => 14.8131, std.dev.: 0.0677)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -3.82% (1.3702 => 1.3178, std.dev.: 0.0096)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: -3.80% (1.3157 => 1.2657, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -3.76% (1.3660 => 1.3147, std.dev.: 0.0095)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -3.63% (1.3457 => 1.2969, std.dev.: 0.0092)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -3.43% (1.4125 => 1.3641, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -3.39% (1.3264 => 1.2815, std.dev.: 0.0006)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -3.25% (1.2544 => 1.2136, std.dev.: 0.0020)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: -2.97% (1.3918 => 1.3505, std.dev.: 0.0098)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: -2.95% (1.3024 => 1.2640, std.dev.: 0.0022)
  MultiSource/Benchmarks/TSVC/InductionVariable-dbl/InductionVariable-dbl: -2.89% (1.3460 => 1.3071, std.dev.: 0.0009)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.87% (7.5124 => 7.2965, std.dev.: 0.0233)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -2.60% (1.3182 => 1.2839, std.dev.: 0.0017)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: -2.53% (0.5879 => 0.5730, std.dev.: 0.0013)
  MultiSource/Applications/d/make_dparser: -2.42% (3.6428 => 3.5545, std.dev.: 0.0280)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -2.09% (1.3608 => 1.3323, std.dev.: 0.0017)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -2.06% (1.2670 => 1.2409, std.dev.: 0.0037)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -1.87% (1.4074 => 1.3811, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: -1.75% (1.2952 => 1.2725, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: -1.73% (1.3551 => 1.3316, std.dev.: 0.0019)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: -1.56% (1.3068 => 1.2864, std.dev.: 0.0010)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.48% (1.3510 => 1.3310, std.dev.: 0.0018)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -1.39% (1.3750 => 1.3559, std.dev.: 0.0064)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/7zip/7zip-benchmark: -6.75% (10.0217 => 9.3448, std.dev.: 0.2134)
  MultiSource/Benchmarks/Bullet/bullet: -5.92% (7.4226 => 6.9833, std.dev.: 0.0883)
  MultiSource/Benchmarks/PAQ8p/paq8p: -3.78% (99.3511 => 95.5983, std.dev.: 1.1063)
  MultiSource/Benchmarks/ASCI_Purple/SMG2000/smg2000: -2.73% (2.5559 => 2.4862, std.dev.: 0.0165)
  MultiSource/Applications/sqlite3/sqlite3: -2.23% (4.2978 => 4.2021, std.dev.: 0.0109)
  MultiSource/Benchmarks/ASC_Sequoia/IRSmk/IRSmk: -2.10% (40.4190 => 39.5700, std.dev.: 0.1942)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -1.08% (4.1462 => 4.1013, std.dev.: 0.0003)

Report Time: 0.78s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20131221/28436e6e/attachment.html>


More information about the llvm-testresults mailing list