[llvm-testresults] chinook-clangslave1__O3-plain__clang_DEV__powerpc64 test results

llvm-testresults at cs.uiuc.edu llvm-testresults at cs.uiuc.edu
Tue Jul 30 13:50:22 PDT 2013


http://llvm.org/perf/db_default/v4/nts/13933?compare_to=13928&baseline=13681
Nickname: chinook-clangslave1__O3-plain__clang_DEV__powerpc64:15

Comparing:
     Run: 13933, Order: 187428, Start Time: 2013-07-30 19:00:52, End Time: 2013-07-30 20:52:05
      To: 13928, Order: 187424, Start Time: 2013-07-30 16:53:14, End Time: 2013-07-30 18:37:25
Baseline: 13681, Order: 186967, Start Time: 2013-07-23 18:12:31, End Time: 2013-07-23 20:01:57

===============
Tests Summary
===============

Performance Regressions: 37 (32 on baseline)
Performance Improvements: 5 (22 on baseline)
Existing Failures: 1 (1 on baseline)
Unchanged Tests: 1065 (1053 on baseline)
Total Tests: 1108

===========================
Run-Over-Run Changes Detail
===========================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 68.70% (0.0508 => 0.0857, std.dev.: 0.0056)
  MultiSource/Benchmarks/BitBench/five11/five11: 67.04% (0.0631 => 0.1054, std.dev.: 0.0029)
  MultiSource/Benchmarks/nbench/nbench: 18.20% (1.3052 => 1.5427, std.dev.: 0.0452)
  MultiSource/Benchmarks/mafft/pairlocalalign: 15.94% (10.6722 => 12.3738, std.dev.: 0.2140)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 15.82% (1.4358 => 1.6630, std.dev.: 0.0360)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 14.12% (0.2415 => 0.2756, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 13.26% (1.3301 => 1.5065, std.dev.: 0.0280)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 13.25% (1.4333 => 1.6232, std.dev.: 0.0436)
  MultiSource/Benchmarks/TSVC/Reductions-flt/Reductions-flt: 13.10% (1.4738 => 1.6668, std.dev.: 0.0538)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: 12.52% (1.3311 => 1.4978, std.dev.: 0.0205)
  MultiSource/Benchmarks/TSVC/Recurrences-dbl/Recurrences-dbl: 11.02% (1.3345 => 1.4815, std.dev.: 0.0359)
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: 10.92% (1.3659 => 1.5150, std.dev.: 0.0525)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 10.76% (1.3386 => 1.4827, std.dev.: 0.0446)
  MultiSource/Benchmarks/PAQ8p/paq8p: 10.61% (2.5020 => 2.7674, std.dev.: 0.0705)
  MultiSource/Benchmarks/tramp3d-v4/tramp3d-v4: 9.78% (26.2305 => 28.7959, std.dev.: 0.7387)

Performance Regressions - Execution Time
----------------------------------------
  MultiSource/Applications/ALAC/decode/alacconvert-decode: 42.04% (0.0245 => 0.0348, std.dev.: 0.0013)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 26.18% (1.4788 => 1.8659, std.dev.: 0.0284)
  SingleSource/Benchmarks/Shootout-C++/fibo: 17.00% (4.1259 => 4.8271, std.dev.: 0.0079)
  SingleSource/Benchmarks/Misc/fp-convert: 16.38% (6.9241 => 8.0586, std.dev.: 0.0024)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 14.00% (14.6088 => 16.6536, std.dev.: 0.1381)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 13.18% (9.3379 => 10.5685, std.dev.: 0.4363)
  MultiSource/Benchmarks/Bullet/bullet: 11.13% (6.9898 => 7.7677, std.dev.: 0.0582)
  SingleSource/Benchmarks/Misc/salsa20: 9.51% (8.1914 => 8.9701, std.dev.: 0.0847)
  MultiSource/Benchmarks/FreeBench/neural/neural: 8.97% (0.4137 => 0.4508, std.dev.: 0.0042)
  MultiSource/Benchmarks/Olden/em3d/em3d: 8.62% (4.7567 => 5.1666, std.dev.: 0.1039)
  MultiSource/Benchmarks/TSVC/LinearDependence-flt/LinearDependence-flt: 7.04% (5.0036 => 5.3559, std.dev.: 0.1109)
  SingleSource/Benchmarks/Misc/flops-4: 6.34% (1.5325 => 1.6296, std.dev.: 0.0229)
  MultiSource/Benchmarks/mafft/pairlocalalign: 5.05% (42.7372 => 44.8948, std.dev.: 0.1059)
  MultiSource/Benchmarks/BitBench/five11/five11: 3.39% (5.5175 => 5.7046, std.dev.: 0.0419)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.47% (12.8701 => 13.1882, std.dev.: 0.0094)
  SingleSource/Benchmarks/Polybench/linear-algebra/solvers/dynprog/dynprog: 2.32% (1.0703 => 1.0951, std.dev.: 0.0003)
  SingleSource/Benchmarks/Misc/lowercase: 2.23% (0.7611 => 0.7781, std.dev.: 0.0059)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 1.53% (3.4043 => 3.4563, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/LoopRestructuring-dbl/LoopRestructuring-dbl: 1.42% (5.7760 => 5.8579, std.dev.: 0.0161)
  MultiSource/Benchmarks/TSVC/ControlFlow-flt/ControlFlow-flt: 1.17% (5.7891 => 5.8566, std.dev.: 0.0261)
  MultiSource/Benchmarks/NPB-serial/is/is: 1.14% (12.2130 => 12.3522, std.dev.: 0.0280)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 1.13% (4.9397 => 4.9953, std.dev.: 0.0150)

Performance Improvements - Compile Time
---------------------------------------
  SingleSource/Benchmarks/Misc-C++/bigfib: -1.75% (0.7390 => 0.7261, std.dev.: 0.0038)

Performance Improvements - Execution Time
-----------------------------------------
  MultiSource/Benchmarks/TSVC/Packing-flt/Packing-flt: -14.62% (5.4707 => 4.6707, std.dev.: 0.0372)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -12.09% (5.9809 => 5.2581, std.dev.: 0.0340)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-flt/IndirectAddressing-flt: -5.43% (5.1467 => 4.8673, std.dev.: 0.0244)
  MultiSource/Benchmarks/TSVC/LinearDependence-dbl/LinearDependence-dbl: -5.21% (5.2994 => 5.0234, std.dev.: 0.0482)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -1.19% (0.1345 => 0.1329, std.dev.: 0.0112)

================================
Run-Over-Baseline Changes Detail
================================

Performance Regressions - Compile Time
--------------------------------------
  MultiSource/Benchmarks/BitBench/five11/five11: 51.00% (0.0698 => 0.1054, std.dev.: 0.0029)
  MultiSource/Benchmarks/mediabench/adpcm/rawdaudio/rawdaudio: 49.56% (0.0573 => 0.0857, std.dev.: 0.0056)
  MultiSource/Benchmarks/mafft/pairlocalalign: 14.00% (10.8541 => 12.3738, std.dev.: 0.2140)
  MultiSource/Benchmarks/nbench/nbench: 12.80% (1.3677 => 1.5427, std.dev.: 0.0452)
  MultiSource/Benchmarks/mediabench/g721/g721encode/encode: 12.12% (0.2458 => 0.2756, std.dev.: 0.0093)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: 10.53% (1.3630 => 1.5065, std.dev.: 0.0280)
  MultiSource/Benchmarks/TSVC/ControlLoops-dbl/ControlLoops-dbl: 10.18% (1.4732 => 1.6232, std.dev.: 0.0436)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: 8.63% (1.3649 => 1.4827, std.dev.: 0.0446)
  MultiSource/Benchmarks/TSVC/Expansion-dbl/Expansion-dbl: 7.73% (1.5437 => 1.6630, std.dev.: 0.0360)

Performance Regressions - Execution Time
----------------------------------------
  SingleSource/Benchmarks/Shootout-C++/matrix: 48.60% (2.8867 => 4.2897, std.dev.: 0.0280)
  MultiSource/Benchmarks/FreeBench/neural/neural: 42.16% (0.3171 => 0.4508, std.dev.: 0.0042)
  MultiSource/Benchmarks/MiBench/telecomm-CRC32/telecomm-CRC32: 24.15% (1.5030 => 1.8659, std.dev.: 0.0284)
  MultiSource/Benchmarks/7zip/7zip-benchmark: 15.69% (9.1355 => 10.5685, std.dev.: 0.4363)
  MultiSource/Applications/siod/siod: 13.66% (3.3761 => 3.8374, std.dev.: 0.0756)
  MultiSource/Applications/lambda-0_1_3/lambda: 12.78% (7.0762 => 7.9806, std.dev.: 0.0290)
  MultiSource/Benchmarks/ASC_Sequoia/AMGmk/AMGmk: 11.33% (14.9584 => 16.6536, std.dev.: 0.1381)
  MultiSource/Benchmarks/FreeBench/pcompress2/pcompress2: 9.54% (0.1678 => 0.1838, std.dev.: 0.0020)
  MultiSource/Benchmarks/Ptrdist/ks/ks: 8.35% (1.2557 => 1.3605, std.dev.: 0.0056)
  SingleSource/Benchmarks/Linpack/linpack-pc: 7.96% (48.3256 => 52.1720, std.dev.: 0.5330)
  MultiSource/Benchmarks/TSVC/Expansion-flt/Expansion-flt: 7.28% (3.2027 => 3.4359, std.dev.: 0.0216)
  MultiSource/Benchmarks/TSVC/Equivalencing-dbl/Equivalencing-dbl: 6.66% (3.4085 => 3.6356, std.dev.: 0.0276)
  MultiSource/Benchmarks/Bullet/bullet: 6.41% (7.2995 => 7.7677, std.dev.: 0.0582)
  MultiSource/Benchmarks/TSVC/LoopRerolling-dbl/LoopRerolling-dbl: 6.38% (5.3042 => 5.6426, std.dev.: 0.0836)
  MultiSource/Benchmarks/FreeBench/mason/mason: 6.29% (0.2799 => 0.2975, std.dev.: 0.0002)
  MultiSource/Benchmarks/TSVC/IndirectAddressing-dbl/IndirectAddressing-dbl: 5.15% (5.1471 => 5.4122, std.dev.: 0.0225)
  MultiSource/Benchmarks/TSVC/Symbolics-flt/Symbolics-flt: 4.41% (4.3151 => 4.5056, std.dev.: 0.0143)
  MultiSource/Benchmarks/TSVC/StatementReordering-flt/StatementReordering-flt: 3.28% (3.3464 => 3.4563, std.dev.: 0.0113)
  MultiSource/Benchmarks/TSVC/Symbolics-dbl/Symbolics-dbl: 3.04% (4.8739 => 5.0222, std.dev.: 0.0234)
  MultiSource/Applications/spiff/spiff: 2.83% (2.7609 => 2.8391, std.dev.: 0.0162)
  MultiSource/Benchmarks/TSVC/GlobalDataFlow-dbl/GlobalDataFlow-dbl: 2.53% (12.8625 => 13.1882, std.dev.: 0.0094)
  SingleSource/Benchmarks/Polybench/stencils/seidel-2d/seidel-2d: 1.85% (1.5957 => 1.6253, std.dev.: 0.0068)
  MultiSource/Benchmarks/TSVC/Reductions-dbl/Reductions-dbl: 1.14% (9.7023 => 9.8130, std.dev.: 0.0072)

Performance Improvements - Compile Time
---------------------------------------
  MultiSource/Benchmarks/Ptrdist/yacr2/yacr2: -1.88% (0.7487 => 0.7346, std.dev.: 0.0047)

Performance Improvements - Execution Time
-----------------------------------------
  SingleSource/Benchmarks/BenchmarkGame/spectral-norm: -32.40% (2.1022 => 1.4211, std.dev.: 0.0039)
  MultiSource/Applications/viterbi/viterbi: -27.61% (3.4923 => 2.5280, std.dev.: 0.0083)
  MultiSource/Benchmarks/TSVC/Searching-flt/Searching-flt: -24.40% (6.9552 => 5.2581, std.dev.: 0.0340)
  SingleSource/Benchmarks/Misc/perlin: -21.35% (4.5989 => 3.6170, std.dev.: 0.0078)
  SingleSource/Benchmarks/Misc/mandel: -14.03% (1.1996 => 1.0313, std.dev.: 0.0228)
  MultiSource/Benchmarks/TSVC/Searching-dbl/Searching-dbl: -13.12% (6.2627 => 5.4413, std.dev.: 0.0427)
  MultiSource/Applications/sgefa/sgefa: -12.82% (1.4030 => 1.2232, std.dev.: 0.0011)
  MultiSource/Applications/SIBsim4/SIBsim4: -9.73% (3.5791 => 3.2307, std.dev.: 0.0883)
  MultiSource/Applications/lua/lua: -8.64% (31.0707 => 28.3874, std.dev.: 0.9611)
  MultiSource/Benchmarks/Trimaran/enc-pc1/enc-pc1: -5.21% (1.7207 => 1.6310, std.dev.: 0.0300)
  MultiSource/Benchmarks/mafft/pairlocalalign: -4.93% (47.2250 => 44.8948, std.dev.: 0.1059)
  SingleSource/Regression/C/uint64_to_float: -4.57% (1.5184 => 1.4490, std.dev.: 0.0134)
  SingleSource/Benchmarks/Misc/fbench: -4.49% (4.9602 => 4.7375, std.dev.: 0.0114)
  MultiSource/Benchmarks/TSVC/CrossingThresholds-flt/CrossingThresholds-flt: -4.00% (3.8119 => 3.6596, std.dev.: 0.0234)
  SingleSource/UnitTests/Vectorizer/gcc-loops: -3.51% (21.6864 => 20.9249, std.dev.: 0.2049)
  MultiSource/Benchmarks/BitBench/drop3/drop3: -2.66% (0.4783 => 0.4656, std.dev.: 0.0027)
  MultiSource/Benchmarks/TSVC/ControlFlow-dbl/ControlFlow-dbl: -2.45% (6.0444 => 5.8965, std.dev.: 0.0461)
  SingleSource/Benchmarks/Misc/ReedSolomon: -2.43% (8.6172 => 8.4075, std.dev.: 0.0192)
  MultiSource/Benchmarks/TSVC/Packing-dbl/Packing-dbl: -2.39% (6.1482 => 6.0014, std.dev.: 0.0179)
  SingleSource/Benchmarks/CoyoteBench/almabench: -1.92% (34.8438 => 34.1751, std.dev.: 0.1053)
  SingleSource/Benchmarks/Polybench/datamining/correlation/correlation: -1.45% (2.8052 => 2.7645, std.dev.: 0.0046)

Existing Failures - Execution Time
----------------------------------
  MultiSource/Applications/ClamAV/clamscan
  MultiSource/Applications/ClamAV/clamscan: -3.56% (0.1378 => 0.1329, std.dev.: 0.0112)

Report Time: 1.26s
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.llvm.org/pipermail/llvm-testresults/attachments/20130730/2ca86564/attachment.html>


More information about the llvm-testresults mailing list