[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jun 25 08:40:05 PDT 2013


http://llvm.org/perf/db_default/v4/nts/12742?compare_to=12738&baseline=11681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:13

Comparing:
     Run: 12742, Order: 184834, Start Time: 2013-06-25 13:48:42, End Time: 2013-06-25 15:41:09
      To: 12738, Order: 184830, Start Time: 2013-06-25 11:40:26, End Time: 2013-06-25 13:24:49
Baseline: 11681, Order: 182589, Start Time: 2013-05-23 16:35:30, End Time: 2013-05-23 18:25:16

===============
Tests Summary
===============

Performance Regressions: 51 (53 on baseline)
Performance Improvements: 1 (32 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1055 (1022 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/hash: 58.28% (0.0604 => 0.0956, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout/sieve: 56.27% (0.0263 => 0.0411, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc/ffbench: 40.18% (0.0794 => 0.1113, std.dev.: 0.0098)
  MultiSource/Benchmarks/Olden/em3d/em3d: 34.44% (0.1992 => 0.2678, std.dev.: 0.0212)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 28.98% (0.2267 => 0.2924, std.dev.: 0.0214)
  MultiSource/Benchmarks/MiBench/telecomm-gsm/telecomm-gsm: 19.47% (1.4409 => 1.7215, std.dev.: 0.0927)
  MultiSource/Applications/JM/ldecod/ldecod: 17.77% (7.4796 => 8.8084, std.dev.: 0.1625)
  MultiSource/Benchmarks/MiBench/office-ispell/office-ispell: 13.72% (1.9142 => 2.1768, std.dev.: 0.0882)
  MultiSource/Applications/SPASS/SPASS: 10.84% (16.8257 => 18.6493, std.dev.: 0.5057)
  MultiSource/Benchmarks/FreeBench/neural/neural: 6.75% (0.2029 => 0.2166, std.dev.: 0.0043)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 6.62% (1.6448 => 1.7537, std.dev.: 0.0251)
  MultiSource/Applications/oggenc/oggenc: 6.61% (5.6105 => 5.9814, std.dev.: 0.0477)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 6.30% (1.4931 => 1.5872, std.dev.: 0.0273)
  SingleSource/Benchmarks/Misc-C++/bigfib: 6.30% (0.7100 => 0.7547, std.dev.: 0.0044)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 5.22% (0.2454 => 0.2582, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 5.05% (1.6210 => 1.7029, std.dev.: 0.0126)
  SingleSource/Benchmarks/Shootout-C++/moments: 5.04% (0.4064 => 0.4269, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 4.99% (1.6348 => 1.7163, std.dev.: 0.0141)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 4.80% (1.4095 => 1.4772, std.dev.: 0.0167)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 4.80% (1.6215 => 1.6993, std.dev.: 0.0139)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 4.45% (1.6054 => 1.6769, std.dev.: 0.0223)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.35% (1.7030 => 1.7770, std.dev.: 0.0151)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 3.88% (0.2887 => 0.2999, std.dev.: 0.0014)
  MultiSource/Benchmarks/SciMark2-C/scimark2: 3.44% (0.3716 => 0.3844, std.dev.: 0.0038)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 86.61% (5.7753 => 10.7774, std.dev.: 0.1450)
  SingleSource/Benchmarks/Shootout/heapsort: 57.42% (2.9011 => 4.5668, std.dev.: 0.0490)
  SingleSource/Benchmarks/Shootout-C++/heapsort: 38.09% (2.9380 => 4.0572, std.dev.: 0.3005)
  SingleSource/Benchmarks/CoyoteBench/fftbench: 27.01% (1.4693 => 1.8661, std.dev.: 0.1123)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.99% (1.4845 => 1.8852, std.dev.: 0.0449)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 22.77% (4.0317 => 4.9496, std.dev.: 0.2192)
  SingleSource/Benchmarks/Shootout-C++/ary: 21.04% (0.0632 => 0.0765, std.dev.: 0.0036)
  SingleSource/Benchmarks/Shootout-C++/lists1: 16.59% (0.5969 => 0.6959, std.dev.: 0.0071)
  MultiSource/Benchmarks/Olden/em3d/em3d: 9.01% (4.7594 => 5.1881, std.dev.: 0.0002)
  SingleSource/Benchmarks/Shootout-C++/ary3: 7.97% (2.0172 => 2.1780, std.dev.: 0.0067)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.46% (47.4343 => 50.9746, std.dev.: 0.3114)
  MultiSource/Benchmarks/llubenchmark/llu: 7.25% (2.0071 => 2.1526, std.dev.: 0.0268)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 5.24% (3.2598 => 3.4306, std.dev.: 0.0192)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.90% (5.8966 => 6.1856, std.dev.: 0.0415)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.68% (1.0554 => 1.1048, std.dev.: 0.0016)
  SingleSource/Benchmarks/BenchmarkGame/recursive: 3.36% (2.4713 => 2.5544, std.dev.: 0.0290)
  MultiSource/Applications/sgefa/sgefa: 3.20% (1.5591 => 1.6090, std.dev.: 0.0011)
  MultiSource/Benchmarks/Olden/bh/bh: 3.09% (2.4230 => 2.4979, std.dev.: 0.0127)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 2.91% (6.1137 => 6.2919, std.dev.: 0.0271)
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: 2.91% (2.3463 => 2.4146, std.dev.: 0.0137)
  MultiSource/Applications/siod/siod: 2.30% (3.3815 => 3.4594, std.dev.: 0.0105)
  SingleSource/Benchmarks/Shootout-C++/lists: 1.26% (16.4112 => 16.6184, std.dev.: 0.0477)
  SingleSource/Benchmarks/Polybench/stencils/fdtd-2d/fdtd-2d: 1.25% (4.5518 => 4.6088, std.dev.: 0.0219)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.14% (11.5190 => 11.6501, std.dev.: 0.0139)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.13% (3.6430 => 3.6841, std.dev.: 0.0033)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 1.09% (5.5154 => 5.5755, std.dev.: 0.0132)
  SingleSource/Benchmarks/Misc/richards_benchmark: 1.05% (1.3457 => 1.3598, std.dev.: 0.0045)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: -4.41% (0.5153 => 0.4926, std.dev.: 0.0043)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 24.11% (0.1352 => 0.1678, std.dev.: 0.0131)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  SingleSource/Benchmarks/Shootout/hash: 54.94% (0.0617 => 0.0956, std.dev.: 0.0022)
  SingleSource/Benchmarks/Shootout/sieve: 45.74% (0.0282 => 0.0411, std.dev.: 0.0014)
  SingleSource/Benchmarks/Misc/ffbench: 41.24% (0.0788 => 0.1113, std.dev.: 0.0098)
  MultiSource/Benchmarks/ASC_Sequoia/CrystalMk/CrystalMk: 31.00% (0.2232 => 0.2924, std.dev.: 0.0214)
  MultiSource/Benchmarks/Olden/em3d/em3d: 26.50% (0.2117 => 0.2678, std.dev.: 0.0212)
  MultiSource/Applications/JM/ldecod/ldecod: 18.00% (7.4648 => 8.8084, std.dev.: 0.1625)
  MultiSource/Benchmarks/FreeBench/fourinarow/fourinarow: 10.22% (0.2721 => 0.2999, std.dev.: 0.0014)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 7.99% (1.5735 => 1.6993, std.dev.: 0.0139)
  MultiSource/Benchmarks/Prolangs-C++/deriv1/deriv1: 7.90% (0.2393 => 0.2582, std.dev.: 0.0029)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 7.64% (1.6292 => 1.7537, std.dev.: 0.0251)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: 7.45% (1.4771 => 1.5872, std.dev.: 0.0273)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 7.41% (1.5612 => 1.6769, std.dev.: 0.0223)
  SingleSource/Benchmarks/Misc-C++/bigfib: 6.91% (0.7059 => 0.7547, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 6.75% (1.3838 => 1.4772, std.dev.: 0.0167)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 6.70% (1.5959 => 1.7029, std.dev.: 0.0126)
  SingleSource/Benchmarks/Shootout-C++/moments: 6.57% (0.4006 => 0.4269, std.dev.: 0.0069)
  MultiSource/Benchmarks/TSVC/LoopRerolling-flt/LoopRerolling-flt: 6.04% (1.4081 => 1.4932, std.dev.: 0.0241)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 5.46% (1.6275 => 1.7163, std.dev.: 0.0141)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 4.49% (1.7006 => 1.7770, std.dev.: 0.0151)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 4.45% (1.5372 => 1.6056, std.dev.: 0.0220)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 3.49% (1.5806 => 1.6357, std.dev.: 0.0195)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout/ary3: 79.26% (6.0122 => 10.7774, std.dev.: 0.1450)
  SingleSource/Benchmarks/Shootout/heapsort: 52.29% (2.9988 => 4.5668, std.dev.: 0.0490)
  MultiSource/Applications/sgefa/sgefa: 37.58% (1.1695 => 1.6090, std.dev.: 0.0011)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 32.29% (16.4665 => 21.7830, std.dev.: 0.5786)
  SingleSource/Benchmarks/Shootout-C++/ary: 20.85% (0.0633 => 0.0765, std.dev.: 0.0036)
  SingleSource/Benchmarks/CoyoteBench/lpbench: 18.50% (4.1768 => 4.9496, std.dev.: 0.2192)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 16.24% (6.1372 => 7.1337, std.dev.: 0.3581)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 15.41% (10.2418 => 11.8202, std.dev.: 0.4405)
  SingleSource/Benchmarks/Shootout-C++/lists1: 14.14% (0.6097 => 0.6959, std.dev.: 0.0071)
  SingleSource/Benchmarks/Stanford/Puzzle: 13.95% (0.1455 => 0.1658, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 8.12% (5.2003 => 5.6225, std.dev.: 0.0148)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 7.70% (3.1853 => 3.4306, std.dev.: 0.0192)
  SingleSource/Benchmarks/Shootout-C++/ary3: 7.63% (2.0236 => 2.1780, std.dev.: 0.0067)
  MultiSource/Benchmarks/llubenchmark/llu: 5.39% (2.0425 => 2.1526, std.dev.: 0.0268)
  MultiSource/Benchmarks/PAQ8p/paq8p: 4.99% (94.2966 => 99.0006, std.dev.: 1.7115)
  MultiSource/Benchmarks/TSVC/StatementReordering-dbl/StatementReordering-dbl: 4.93% (3.2201 => 3.3790, std.dev.: 0.0087)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 4.86% (2.9004 => 3.0413, std.dev.: 0.0161)
  MultiSource/Benchmarks/TSVC/NodeSplitting-dbl/NodeSplitting-dbl: 4.71% (4.6639 => 4.8837, std.dev.: 0.0081)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 4.51% (1.0571 => 1.1048, std.dev.: 0.0016)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: 4.37% (5.2788 => 5.5094, std.dev.: 0.0107)
  SingleSource/Benchmarks/BenchmarkGame/fannkuch: 4.31% (2.8994 => 3.0244, std.dev.: 0.0276)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 4.20% (5.9362 => 6.1856, std.dev.: 0.0415)
  MultiSource/Benchmarks/TSVC/NodeSplitting-flt/NodeSplitting-flt: 3.60% (4.6379 => 4.8050, std.dev.: 0.0488)
  MultiSource/Applications/JM/lencod/lencod: 3.03% (7.0353 => 7.2485, std.dev.: 0.0474)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-dbl/CrossingThresholds-dbl: 2.99% (5.5010 => 5.6653, std.dev.: 0.0489)
  SingleSource/Benchmarks/Adobe-C++/simple_types_constant_folding: 2.47% (4.3727 => 4.4809, std.dev.: 0.0301)
  MultiSource/Benchmarks/Olden/bh/bh: 2.23% (2.4435 => 2.4979, std.dev.: 0.0127)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 2.15% (5.6582 => 5.7796, std.dev.: 0.0197)
  SingleSource/Benchmarks/Polybench/datamining/covariance/covariance: 2.03% (3.9713 => 4.0521, std.dev.: 0.0286)
  SingleSource/Benchmarks/Shootout/methcall: 1.64% (8.3425 => 8.4793, std.dev.: 0.0285)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: 1.52% (3.6291 => 3.6841, std.dev.: 0.0033)
  SingleSource/Benchmarks/Shootout-C++/methcall: 1.31% (11.4990 => 11.6501, std.dev.: 0.0139)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/trisolv/trisolv: -16.44% (0.0803 => 0.0671, std.dev.: 0.0022)
  MultiSource/Benchmarks/MiBench/security-sha/security-sha: -11.82% (0.1151 => 0.1015, std.dev.: 0.0025)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/puzzle: -43.24% (1.2911 => 0.7328, std.dev.: 0.0175)
  MultiSource/Benchmarks/TSVC/Equivalencing-flt/Equivalencing-flt: -36.55% (4.4050 => 2.7948, std.dev.: 0.0286)
  MultiSource/Benchmarks/FreeBench/neural/neural: -25.16% (0.3513 => 0.2629, std.dev.: 0.0071)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: -23.20% (6.2328 => 4.7869, std.dev.: 0.0451)
  SingleSource/Benchmarks/Misc/flops: -20.61% (10.2170 => 8.1116, std.dev.: 0.8140)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-flt/GlobalDataFlow-flt: -20.28% (4.8986 => 3.9050, std.dev.: 0.0708)
  MultiSource/Benchmarks/TSVC/InductionVariable-flt/InductionVariable-flt: -18.57% (5.7264 => 4.6631, std.dev.: 0.1161)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -16.17% (25.3677 => 21.2660, std.dev.: 0.0514)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: -13.93% (11.6227 => 10.0036, std.dev.: 0.0110)
  SingleSource/Benchmarks/Misc/salsa20: -13.06% (10.3398 => 8.9891, std.dev.: 0.2567)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -10.34% (7.0179 => 6.2919, std.dev.: 0.0271)
  MultiSource/Benchmarks/VersaBench/beamformer/beamformer: -9.22% (1.6679 => 1.5141, std.dev.: 0.0285)
  MultiSource/Applications/lambda-0_1_3/lambda: -8.84% (9.1099 => 8.3049, std.dev.: 0.0427)
  SingleSource/Benchmarks/Polybench/linear-algebra/kernels/gemver/gemver: -8.66% (0.3267 => 0.2984, std.dev.: 0.0073)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-flt/LoopRestructuring-flt: -8.28% (4.5717 => 4.1932, std.dev.: 0.0046)
  MultiSource/Applications/siod/siod: -7.11% (3.7240 => 3.4594, std.dev.: 0.0105)
  MultiSource/Benchmarks/mafft/pairlocalalign: -6.96% (48.3307 => 44.9652, std.dev.: 0.1487)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: -6.71% (9.8728 => 9.2105, std.dev.: 0.0491)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: -6.53% (5.5889 => 5.2242, std.dev.: 0.0235)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -4.67% (5.3184 => 5.0702, std.dev.: 0.0257)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: -4.55% (4.2167 => 4.0247, std.dev.: 0.0332)
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -4.05% (0.9806 => 0.9409, std.dev.: 0.0147)
  SingleSource/Benchmarks/Adobe-C++/functionobjects: -2.82% (3.8665 => 3.7575, std.dev.: 0.0118)
  SingleSource/Benchmarks/Shootout/sieve: -2.81% (8.0178 => 7.7926, std.dev.: 0.0272)
  SingleSource/Benchmarks/Misc-C++-EH/spirit: -2.36% (6.3757 => 6.2253, std.dev.: 0.0466)
  MultiSource/Benchmarks/BitBench/five11/five11: -2.09% (5.7342 => 5.6144, std.dev.: 0.0044)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: -2.06% (4.5094 => 4.4164, std.dev.: 0.0106)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -1.68% (1.6980 => 1.6695, std.dev.: 0.0065)
  SingleSource/Benchmarks/Linpack/linpack-pc: -1.67% (51.8429 => 50.9746, std.dev.: 0.3114)
  MultiSource/Benchmarks/NPB-serial/is/is: -1.28% (12.1841 => 12.0276, std.dev.: 0.0582)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: 16.45% (0.1441 => 0.1678, std.dev.: 0.0131)

Report Time: 0.72s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130625/e9134d65/attachment.html>


More information about the llvm-testresults mailing list